2024-02-18T16:07:29.772 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-18T16:07:29.772 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_cbodley@teuthology --name cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} --archive /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752 --verbose -- /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/orig.config.yaml 2024-02-18T16:07:29.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T16:07:29.890 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752 branch: wip-64173 description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7562752' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-64173 ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 02db01d0a75058abf10a307d548d1e1e71b47eeb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 02db01d0a75058abf10a307d548d1e1e71b47eeb rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-64173 sha1: 02db01d0a75058abf10a307d548d1e1e71b47eeb owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 0 sha1: 02db01d0a75058abf10a307d548d1e1e71b47eeb sleep_before_teardown: 0 suite: rgw suite_branch: wip-64173 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_02db01d0a75058abf10a307d548d1e1e71b47eeb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 02db01d0a75058abf10a307d548d1e1e71b47eeb targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEKfYAOznc3GwJnU4o9Ae1ngD7K1yZIn11qCR78NNpvD3Cmo2ued9PUzr2WArEK1gseXqPIB+0Rkw+2wwO1vcw= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArFJcbYpAUM4WaXDGxHpbZSgmfY43t/QQEZrjLs80RLZPVb5XM/llYH5uonBXZPDZdxSENiFJHLu9v/4Fiq8ZQ= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-16_18:38:34 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-18T16:07:29.891 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_02db01d0a75058abf10a307d548d1e1e71b47eeb/qa; will attempt to use it 2024-02-18T16:07:29.892 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_02db01d0a75058abf10a307d548d1e1e71b47eeb/qa/tasks 2024-02-18T16:07:29.892 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-18T16:07:29.893 INFO:teuthology.task.internal:Checking packages... 2024-02-18T16:07:29.917 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '02db01d0a75058abf10a307d548d1e1e71b47eeb' 2024-02-18T16:07:29.917 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-18T16:07:29.917 INFO:teuthology.packaging:ref: None 2024-02-18T16:07:29.917 INFO:teuthology.packaging:tag: None 2024-02-18T16:07:29.917 INFO:teuthology.packaging:branch: wip-64173 2024-02-18T16:07:29.917 INFO:teuthology.packaging:sha1: 02db01d0a75058abf10a307d548d1e1e71b47eeb 2024-02-18T16:07:29.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-64173 2024-02-18T16:07:30.133 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:07:30.135 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-18T16:07:30.142 INFO:teuthology.task.internal:no buildpackages task found 2024-02-18T16:07:30.142 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-18T16:07:30.150 INFO:teuthology.task.internal:Saving configuration 2024-02-18T16:07:30.163 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-18T16:07:30.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T16:07:30.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 16:01:51.701550', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIyTyMx0DSAGN9ANZbLTqY7TGh90YHzwVxAWgBsU7G4V'} 2024-02-18T16:07:30.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 16:01:51.703422', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID2QSe/unllJTF6PucLqX8SZVyO5SbMaSIunv1ONh0/4'} 2024-02-18T16:07:30.220 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-18T16:07:30.226 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-02-18T16:07:30.226 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-18T16:07:30.226 INFO:teuthology.run_tasks:Running task console_log... 2024-02-18T16:07:30.290 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d836c8e50>, signals=[15]) 2024-02-18T16:07:30.291 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-18T16:07:30.298 INFO:teuthology.task.internal:Opening connections... 2024-02-18T16:07:30.299 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-02-18T16:07:30.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:07:30.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:07:30.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:07:30.463 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-18T16:07:30.469 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-02-18T16:07:30.474 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-02-18T16:07:30.474 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="22.04" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=jammy 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-18T16:07:30.521 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=jammy 2024-02-18T16:07:30.522 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-02-18T16:07:30.542 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-02-18T16:07:30.547 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-02-18T16:07:30.547 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-02-18T16:07:30.593 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-18T16:07:30.593 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Ubuntu" 2024-02-18T16:07:30.593 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="22.04" 2024-02-18T16:07:30.593 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_CODENAME=jammy 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:ID=ubuntu 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE=debian 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-18T16:07:30.594 INFO:teuthology.orchestra.run.smithi129.stdout:UBUNTU_CODENAME=jammy 2024-02-18T16:07:30.594 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-02-18T16:07:30.617 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-18T16:07:30.624 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-18T16:07:30.630 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-18T16:07:30.631 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-02-18T16:07:30.633 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-02-18T16:07:30.640 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-18T16:07:30.647 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-18T16:07:30.647 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-02-18T16:07:30.678 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-02-18T16:07:30.696 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-18T16:07:30.752 INFO:teuthology.run_tasks:Running task kernel... 2024-02-18T16:07:30.768 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-18T16:07:30.768 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-18T16:07:30.768 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-18T16:07:30.769 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-18T16:07:30.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:07:30.773 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-18T16:07:30.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:07:30.774 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-02-18T16:07:30.821 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-56-generic 2024-02-18T16:07:30.821 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.15.0-56-generic 2024-02-18T16:07:30.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-02-18T16:07:30.822 INFO:teuthology.orchestra.run.smithi129.stdout:5.15.0-56-generic 2024-02-18T16:07:30.823 INFO:teuthology.task.kernel:Running kernel on smithi129: 5.15.0-56-generic 2024-02-18T16:07:30.823 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get clean 2024-02-18T16:07:30.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-02-18T16:07:30.961 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get update 2024-02-18T16:07:31.095 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-18T16:07:31.133 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-18T16:07:31.202 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-18T16:07:31.202 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-18T16:07:31.235 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-18T16:07:31.235 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-18T16:07:31.290 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-18T16:07:31.312 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,377 kB] 2024-02-18T16:07:31.415 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [570 kB] 2024-02-18T16:07:31.420 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-18T16:07:31.423 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-18T16:07:31.424 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-18T16:07:31.424 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-18T16:07:31.443 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-18T16:07:31.446 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-18T16:07:31.446 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-18T16:07:31.452 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-18T16:07:31.462 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-18T16:07:31.464 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-18T16:07:31.464 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-02-18T16:07:31.464 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-18T16:07:31.489 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-18T16:07:31.490 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-18T16:07:31.490 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-18T16:07:31.490 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-18T16:07:31.490 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-18T16:07:31.491 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-18T16:07:31.512 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-18T16:07:31.512 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-18T16:07:31.533 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-18T16:07:31.533 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-18T16:07:31.638 INFO:teuthology.orchestra.run.smithi129.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-18T16:07:31.647 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-18T16:07:31.651 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-18T16:07:31.789 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,377 kB] 2024-02-18T16:07:31.912 INFO:teuthology.orchestra.run.smithi129.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-18T16:07:32.051 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-18T16:07:32.070 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-18T16:07:32.072 INFO:teuthology.orchestra.run.smithi129.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-18T16:07:32.081 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-18T16:07:32.081 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-18T16:07:32.082 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [570 kB] 2024-02-18T16:07:32.083 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-18T16:07:32.086 INFO:teuthology.orchestra.run.smithi129.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-18T16:07:32.086 INFO:teuthology.orchestra.run.smithi129.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-18T16:07:32.121 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-18T16:07:32.138 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-18T16:07:32.139 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-18T16:07:32.140 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-18T16:07:32.164 INFO:teuthology.orchestra.run.smithi129.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-18T16:07:32.165 INFO:teuthology.orchestra.run.smithi129.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-18T16:07:32.173 INFO:teuthology.orchestra.run.smithi129.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-18T16:07:32.173 INFO:teuthology.orchestra.run.smithi129.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-18T16:07:32.199 INFO:teuthology.orchestra.run.smithi129.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-18T16:07:32.203 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-18T16:07:32.203 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-18T16:07:32.206 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-18T16:07:32.206 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-18T16:07:32.207 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-18T16:07:32.217 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-18T16:07:32.372 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-18T16:07:32.377 INFO:teuthology.orchestra.run.smithi129.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-18T16:07:32.394 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-18T16:07:32.781 INFO:teuthology.orchestra.run.smithi129.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-18T16:07:32.787 INFO:teuthology.orchestra.run.smithi129.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-18T16:07:32.797 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-18T16:07:32.801 INFO:teuthology.orchestra.run.smithi129.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-18T16:07:32.801 INFO:teuthology.orchestra.run.smithi129.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-18T16:07:32.802 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-18T16:07:32.803 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-18T16:07:32.804 INFO:teuthology.orchestra.run.smithi129.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-18T16:07:32.816 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-18T16:07:32.819 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-18T16:07:32.997 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-18T16:07:33.035 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-18T16:07:33.048 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-18T16:07:33.049 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-18T16:07:33.052 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-02-18T16:07:33.052 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-18T16:07:33.053 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-18T16:07:33.053 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-18T16:07:33.055 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-18T16:07:33.080 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-18T16:07:33.245 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-18T16:07:33.327 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-18T16:07:33.409 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-18T16:07:33.458 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-18T16:07:33.516 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-18T16:07:37.108 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 11.6 MB in 2s (6,494 kB/s) 2024-02-18T16:07:37.765 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 11.6 MB in 2s (4,657 kB/s) 2024-02-18T16:07:38.491 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-02-18T16:07:38.508 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-18T16:07:38.571 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-02-18T16:07:38.765 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-02-18T16:07:38.765 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-02-18T16:07:38.932 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-02-18T16:07:38.933 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-18T16:07:38.933 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-18T16:07:38.933 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-18T16:07:38.933 INFO:teuthology.orchestra.run.smithi129.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-18T16:07:38.933 INFO:teuthology.orchestra.run.smithi129.stdout: python2.7-minimal 2024-02-18T16:07:38.933 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-18T16:07:38.934 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2024-02-18T16:07:38.934 INFO:teuthology.orchestra.run.smithi129.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-18T16:07:38.934 INFO:teuthology.orchestra.run.smithi129.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-18T16:07:38.935 INFO:teuthology.orchestra.run.smithi129.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-18T16:07:38.936 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2024-02-18T16:07:38.936 INFO:teuthology.orchestra.run.smithi129.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-18T16:07:38.936 INFO:teuthology.orchestra.run.smithi129.stdout:Recommended packages: 2024-02-18T16:07:38.936 INFO:teuthology.orchestra.run.smithi129.stdout: thermald 2024-02-18T16:07:38.982 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2024-02-18T16:07:38.983 INFO:teuthology.orchestra.run.smithi129.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-18T16:07:38.983 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-18T16:07:38.983 INFO:teuthology.orchestra.run.smithi129.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-18T16:07:38.984 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be upgraded: 2024-02-18T16:07:38.985 INFO:teuthology.orchestra.run.smithi129.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-18T16:07:39.098 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-18T16:07:39.115 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-18T16:07:39.164 INFO:teuthology.orchestra.run.smithi129.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-18T16:07:39.164 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 113 MB of archives. 2024-02-18T16:07:39.164 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-18T16:07:39.164 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-18T16:07:39.169 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-18T16:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-02-18T16:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-02-18T16:07:39.519 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-02-18T16:07:39.519 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-18T16:07:39.519 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-18T16:07:39.520 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-18T16:07:39.520 INFO:teuthology.orchestra.run.smithi080.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-18T16:07:39.520 INFO:teuthology.orchestra.run.smithi080.stdout: python2.7-minimal 2024-02-18T16:07:39.520 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-18T16:07:39.521 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-02-18T16:07:39.521 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-18T16:07:39.521 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-18T16:07:39.521 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-18T16:07:39.522 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-02-18T16:07:39.522 INFO:teuthology.orchestra.run.smithi080.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-18T16:07:39.522 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-02-18T16:07:39.522 INFO:teuthology.orchestra.run.smithi080.stdout: thermald 2024-02-18T16:07:39.570 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-02-18T16:07:39.570 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-18T16:07:39.570 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-18T16:07:39.571 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-18T16:07:39.572 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages will be upgraded: 2024-02-18T16:07:39.572 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-18T16:07:39.636 INFO:teuthology.orchestra.run.smithi080.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-18T16:07:39.636 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 113 MB of archives. 2024-02-18T16:07:39.636 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-18T16:07:39.636 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-18T16:07:40.217 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-18T16:07:40.424 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-18T16:07:40.553 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-18T16:07:40.907 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-18T16:07:41.803 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-18T16:07:41.803 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-18T16:07:41.803 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-18T16:07:42.112 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-18T16:07:42.209 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-18T16:07:42.597 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 113 MB in 3s (43.0 MB/s) 2024-02-18T16:07:42.780 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-18T16:07:43.166 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-18T16:07:43.166 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-18T16:07:43.167 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-18T16:07:43.519 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-18T16:07:43.602 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-18T16:07:43.995 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-02-18T16:07:44.152 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-18T16:07:44.861 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-18T16:07:44.865 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:07:44.968 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:07:46.125 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-18T16:07:46.130 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:07:46.220 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:07:47.211 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-18T16:07:47.232 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:07:47.354 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:07:47.864 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-18T16:07:47.885 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:07:48.762 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-18T16:07:48.784 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:07:48.880 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:07:49.415 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-18T16:07:49.436 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:07:49.540 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:07:55.230 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-18T16:07:55.357 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-18T16:07:55.681 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-18T16:07:55.811 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-18T16:07:55.995 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-18T16:07:56.130 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-18T16:07:56.139 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-18T16:07:56.153 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-18T16:07:56.197 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-18T16:07:56.438 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-18T16:07:56.560 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-18T16:07:56.879 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-18T16:07:56.902 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-18T16:07:56.946 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-18T16:08:01.798 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-18T16:08:01.820 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:08:01.864 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:02.878 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-18T16:08:02.916 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-18T16:08:02.961 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:05.161 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-18T16:08:05.283 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-18T16:08:05.650 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-18T16:08:05.661 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-18T16:08:05.771 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:05.789 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-18T16:08:05.897 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-18T16:08:06.050 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:06.164 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-18T16:08:06.285 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:06.411 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-18T16:08:07.118 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:07.478 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:08.751 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:08.832 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-18T16:08:08.833 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-18T16:08:08.833 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-18T16:08:08.833 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:08.971 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:10.093 INFO:teuthology.orchestra.run.smithi129.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-18T16:08:10.093 INFO:teuthology.orchestra.run.smithi129.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-18T16:08:10.093 INFO:teuthology.orchestra.run.smithi129.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-18T16:08:10.093 INFO:teuthology.orchestra.run.smithi129.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:10.227 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:10.339 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-18T16:08:10.465 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-18T16:08:10.616 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:10.683 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-18T16:08:10.683 INFO:teuthology.orchestra.run.smithi080.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:11.637 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-18T16:08:11.788 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-18T16:08:11.914 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-18T16:08:11.975 INFO:teuthology.orchestra.run.smithi129.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-18T16:08:11.975 INFO:teuthology.orchestra.run.smithi129.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:24.949 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-18T16:08:24.949 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub' 2024-02-18T16:08:24.981 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-18T16:08:25.005 INFO:teuthology.orchestra.run.smithi080.stdout:Generating grub configuration file ... 2024-02-18T16:08:25.294 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-18T16:08:25.316 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:25.650 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-18T16:08:25.655 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-18T16:08:25.732 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-18T16:08:25.738 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-18T16:08:25.884 INFO:teuthology.orchestra.run.smithi129.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-18T16:08:25.885 INFO:teuthology.orchestra.run.smithi129.stdout:Sourcing file `/etc/default/grub' 2024-02-18T16:08:25.889 INFO:teuthology.orchestra.run.smithi129.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-18T16:08:25.904 INFO:teuthology.orchestra.run.smithi080.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-18T16:08:25.904 INFO:teuthology.orchestra.run.smithi080.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-18T16:08:25.904 INFO:teuthology.orchestra.run.smithi080.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-18T16:08:25.917 INFO:teuthology.orchestra.run.smithi129.stdout:Generating grub configuration file ... 2024-02-18T16:08:25.944 INFO:teuthology.orchestra.run.smithi080.stdout:done 2024-02-18T16:08:26.220 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-18T16:08:26.237 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:26.429 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 21 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.94.91 2024-02-18T16:08:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-18T16:08:26.451 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-18T16:08:26.451 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-02-18T16:08:26.451 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-02-18T16:08:26.451 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-02-18T16:08:26.451 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-02-18T16:08:26.451 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-18T16:08:26.451 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-18T16:08:26.451 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-18T16:08:26.451 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-18T16:08:26.452 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-02-18T16:08:26.452 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-02-18T16:08:26.524 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-18T16:08:26.531 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-18T16:08:26.600 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-02-18T16:08:26.601 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-18T16:08:26.604 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-18T16:08:26.730 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-18T16:08:26.775 INFO:teuthology.orchestra.run.smithi129.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-18T16:08:26.775 INFO:teuthology.orchestra.run.smithi129.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-18T16:08:26.775 INFO:teuthology.orchestra.run.smithi129.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-18T16:08:26.823 INFO:teuthology.orchestra.run.smithi129.stdout:done 2024-02-18T16:08:26.844 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-18T16:08:26.941 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-18T16:08:27.007 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-18T16:08:27.281 DEBUG:teuthology.orchestra.run.smithi129:> dpkg -s linux-image-generic 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Package: linux-image-generic 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Status: install ok installed 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Priority: optional 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Section: kernel 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Installed-Size: 21 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Maintainer: Ubuntu Kernel Team 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: amd64 2024-02-18T16:08:27.302 INFO:teuthology.orchestra.run.smithi129.stdout:Source: linux-meta 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout:Version: 5.15.0.94.91 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout:Recommends: thermald 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout:Description: Generic Linux kernel image 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: This package will always depend on the latest generic kernel image 2024-02-18T16:08:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: available. 2024-02-18T16:08:27.303 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-18T16:08:27.303 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-18T16:08:27.303 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-18T16:08:27.303 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-02-18T16:08:27.303 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-02-18T16:08:27.303 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get clean 2024-02-18T16:08:27.502 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get update 2024-02-18T16:08:27.653 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-18T16:08:27.653 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-18T16:08:27.675 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-18T16:08:27.753 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-18T16:08:28.080 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-18T16:08:28.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-18T16:08:28.150 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-18T16:08:28.328 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-02-18T16:08:28.328 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-02-18T16:08:28.482 INFO:teuthology.orchestra.run.smithi080.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-18T16:08:28.482 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-02-18T16:08:28.482 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-18T16:08:28.482 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-18T16:08:28.482 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-18T16:08:28.483 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-18T16:08:28.483 INFO:teuthology.orchestra.run.smithi080.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-18T16:08:28.483 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-18T16:08:28.520 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-18T16:08:28.522 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 21 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.94.91 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-18T16:08:28.580 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-18T16:08:28.581 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-02-18T16:08:28.581 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-02-18T16:08:28.581 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-02-18T16:08:28.581 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-02-18T16:08:28.581 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-02-18T16:08:28.625 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.U5nGBTBNh4 2024-02-18T16:08:28.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub/grub.cfg /tmp/tmp.U5nGBTBNh4 2024-02-18T16:08:28.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.U5nGBTBNh4 2024-02-18T16:08:28.820 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.U5nGBTBNh4 is 10KB 2024-02-18T16:08:28.833 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.U5nGBTBNh4 2024-02-18T16:08:28.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-18T16:08:28.892 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:08:28.892 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-18T16:08:28.892 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-18T16:08:28.959 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-18T16:08:28.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo update-grub 2024-02-18T16:08:28.996 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-02-18T16:08:29.014 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-18T16:08:29.074 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-02-18T16:08:29.267 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-02-18T16:08:29.267 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-02-18T16:08:29.435 INFO:teuthology.orchestra.run.smithi129.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-18T16:08:29.435 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-02-18T16:08:29.435 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-18T16:08:29.435 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-18T16:08:29.435 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-18T16:08:29.436 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-18T16:08:29.436 INFO:teuthology.orchestra.run.smithi129.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-18T16:08:29.436 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-18T16:08:29.474 INFO:teuthology.orchestra.run.smithi129.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-18T16:08:29.476 DEBUG:teuthology.orchestra.run.smithi129:> dpkg -s linux-image-generic 2024-02-18T16:08:29.491 INFO:teuthology.orchestra.run.smithi129.stdout:Package: linux-image-generic 2024-02-18T16:08:29.491 INFO:teuthology.orchestra.run.smithi129.stdout:Status: install ok installed 2024-02-18T16:08:29.491 INFO:teuthology.orchestra.run.smithi129.stdout:Priority: optional 2024-02-18T16:08:29.491 INFO:teuthology.orchestra.run.smithi129.stdout:Section: kernel 2024-02-18T16:08:29.491 INFO:teuthology.orchestra.run.smithi129.stdout:Installed-Size: 21 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Maintainer: Ubuntu Kernel Team 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: amd64 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Source: linux-meta 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Version: 5.15.0.94.91 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Recommends: thermald 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout:Description: Generic Linux kernel image 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout: This package will always depend on the latest generic kernel image 2024-02-18T16:08:29.492 INFO:teuthology.orchestra.run.smithi129.stdout: available. 2024-02-18T16:08:29.492 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-02-18T16:08:29.541 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.J7VkYLEhRI 2024-02-18T16:08:29.542 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub/grub.cfg /tmp/tmp.J7VkYLEhRI 2024-02-18T16:08:29.607 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.J7VkYLEhRI 2024-02-18T16:08:29.721 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.J7VkYLEhRI is 10KB 2024-02-18T16:08:29.735 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.J7VkYLEhRI 2024-02-18T16:08:29.741 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-18T16:08:29.797 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:08:29.797 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-18T16:08:29.797 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-18T16:08:29.869 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-18T16:08:29.869 DEBUG:teuthology.orchestra.run.smithi129:> sudo update-grub 2024-02-18T16:08:30.226 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub' 2024-02-18T16:08:30.227 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-18T16:08:30.239 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-02-18T16:08:30.421 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-18T16:08:30.427 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:30.643 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-18T16:08:30.648 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-18T16:08:30.688 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-18T16:08:30.693 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-18T16:08:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-18T16:08:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-18T16:08:30.814 INFO:teuthology.orchestra.run.smithi080.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-18T16:08:30.826 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-02-18T16:08:30.838 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-02-18T16:08:31.126 INFO:teuthology.orchestra.run.smithi129.stderr:Sourcing file `/etc/default/grub' 2024-02-18T16:08:31.128 INFO:teuthology.orchestra.run.smithi129.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-18T16:08:31.130 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-02-18T16:08:31.337 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-18T16:08:31.342 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-18T16:08:31.589 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-18T16:08:31.594 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-18T16:08:31.637 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-18T16:08:31.643 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-18T16:08:31.810 INFO:teuthology.orchestra.run.smithi129.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-18T16:08:31.810 INFO:teuthology.orchestra.run.smithi129.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-18T16:08:31.810 INFO:teuthology.orchestra.run.smithi129.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-18T16:08:31.833 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-02-18T16:08:31.842 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-02-18T16:09:00.868 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-18T16:09:00.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-18T16:09:00.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:09:01.846 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-02-18T16:09:01.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-02-18T16:09:01.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:09:36.316 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-02-18T16:09:45.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-02-18T16:09:45.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:10:00.881 DEBUG:teuthology.orchestra.remote:timed out 2024-02-18T16:10:03.712 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-02-18T16:10:09.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-18T16:10:09.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:10:10.908 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-18T16:10:15.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-02-18T16:10:15.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:10:16.033 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-02-18T16:10:17.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-02-18T16:10:17.086 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-94-generic"... 2024-02-18T16:10:17.087 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-02-18T16:10:17.133 INFO:teuthology.orchestra.run.smithi129.stdout:5.15.0-94-generic 2024-02-18T16:10:17.133 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-18T16:10:17.133 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-18T16:10:17.133 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-18T16:10:18.134 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-02-18T16:10:18.135 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-18T16:10:18.312 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-02-18T16:10:18.351 DEBUG:teuthology.parallel:result is None 2024-02-18T16:10:22.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-18T16:10:22.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:10:23.133 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-18T16:10:23.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-18T16:10:23.725 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-94-generic"... 2024-02-18T16:10:23.725 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-18T16:10:23.772 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-94-generic 2024-02-18T16:10:23.773 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-18T16:10:23.773 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-18T16:10:23.773 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-18T16:10:24.774 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-18T16:10:24.774 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-18T16:10:25.137 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-02-18T16:10:25.154 DEBUG:teuthology.parallel:result is None 2024-02-18T16:10:25.154 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-18T16:10:25.163 INFO:teuthology.task.internal:Creating test directory... 2024-02-18T16:10:25.163 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-18T16:10:25.166 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-18T16:10:25.173 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-18T16:10:25.196 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-18T16:10:25.206 INFO:teuthology.task.internal:Creating archive directory... 2024-02-18T16:10:25.206 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-18T16:10:25.213 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-18T16:10:25.291 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-18T16:10:25.298 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-18T16:10:25.298 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-18T16:10:25.301 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-18T16:10:25.318 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T16:10:25.322 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T16:10:25.326 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T16:10:25.330 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T16:10:25.332 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-18T16:10:25.339 INFO:teuthology.task.internal:Configuring sudo... 2024-02-18T16:10:25.339 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-18T16:10:25.374 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-18T16:10:25.403 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-18T16:10:25.414 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-18T16:10:25.414 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-18T16:10:25.430 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-18T16:10:25.449 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T16:10:25.481 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T16:10:25.529 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:10:25.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-18T16:10:25.604 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T16:10:25.610 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T16:10:25.657 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:10:25.657 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-18T16:10:25.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-02-18T16:10:25.727 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-02-18T16:10:25.818 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-18T16:10:25.826 INFO:teuthology.task.internal:Starting timer... 2024-02-18T16:10:25.826 INFO:teuthology.run_tasks:Running task pcp... 2024-02-18T16:10:25.836 INFO:teuthology.run_tasks:Running task selinux... 2024-02-18T16:10:25.846 DEBUG:teuthology.task.selinux:Excluding smithi080: OS 'ubuntu' does not support SELinux 2024-02-18T16:10:25.847 DEBUG:teuthology.task.selinux:Excluding smithi129: OS 'ubuntu' does not support SELinux 2024-02-18T16:10:25.847 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-18T16:10:25.847 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-18T16:10:25.847 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-18T16:10:25.847 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-18T16:10:25.856 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-18T16:10:25.873 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-18T16:10:25.875 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-18T16:17:27.942 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2024-02-18T16:17:27.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-18T16:17:27.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:17:28.028 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-18T16:17:28.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-18T16:17:28.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-02-18T16:17:28.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T16:17:28.186 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-02-18T16:17:28.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-02-18T16:17:28.264 INFO:teuthology.run_tasks:Running task clock... 2024-02-18T16:17:28.277 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-18T16:17:28.277 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-18T16:17:28.277 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T16:17:28.280 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-18T16:17:28.280 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T16:17:28.309 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-18T16:17:28.309 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Command line: ntpd -gq 2024-02-18T16:17:28.310 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: ---------------------------------------------------- 2024-02-18T16:17:28.310 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: ntp-4 is maintained by Network Time Foundation, 2024-02-18T16:17:28.310 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-18T16:17:28.310 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: corporation. Support and training for ntp-4 are 2024-02-18T16:17:28.310 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: available at https://www.nwtime.org/support 2024-02-18T16:17:28.310 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: ---------------------------------------------------- 2024-02-18T16:17:28.311 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: proto: precision = 0.062 usec (-24) 2024-02-18T16:17:28.311 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: basedate set to 2022-02-04 2024-02-18T16:17:28.311 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: gps base set to 2022-02-06 (week 2196) 2024-02-18T16:17:28.311 INFO:teuthology.orchestra.run.smithi080.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-18T16:17:28.312 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-18T16:17:28.312 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: restrict ::: KOD does nothing without LIMITED. 2024-02-18T16:17:28.312 INFO:teuthology.orchestra.run.smithi080.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-18T16:17:28.313 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listen and drop on 0 v6wildcard [::]:123 2024-02-18T16:17:28.313 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-18T16:17:28.313 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listen normally on 2 lo 127.0.0.1:123 2024-02-18T16:17:28.313 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listen normally on 3 enp3s0f1 172.21.15.80:123 2024-02-18T16:17:28.313 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listen normally on 4 lo [::1]:123 2024-02-18T16:17:28.314 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba9%5]:123 2024-02-18T16:17:28.314 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:28 ntpd[17143]: Listening on routing socket on fd #22 for interface updates 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Command line: ntpd -gq 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: ---------------------------------------------------- 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: ntp-4 is maintained by Network Time Foundation, 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: corporation. Support and training for ntp-4 are 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: available at https://www.nwtime.org/support 2024-02-18T16:17:28.331 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: ---------------------------------------------------- 2024-02-18T16:17:28.332 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: proto: precision = 0.055 usec (-24) 2024-02-18T16:17:28.332 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: basedate set to 2022-02-04 2024-02-18T16:17:28.332 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: gps base set to 2022-02-06 (week 2196) 2024-02-18T16:17:28.333 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-18T16:17:28.337 INFO:teuthology.orchestra.run.smithi129.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-18T16:17:28.337 INFO:teuthology.orchestra.run.smithi129.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-18T16:17:28.338 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: restrict ::: KOD does nothing without LIMITED. 2024-02-18T16:17:28.338 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listen and drop on 0 v6wildcard [::]:123 2024-02-18T16:17:28.338 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-18T16:17:28.338 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listen normally on 2 lo 127.0.0.1:123 2024-02-18T16:17:28.339 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listen normally on 3 enp3s0f1 172.21.15.129:123 2024-02-18T16:17:28.339 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listen normally on 4 lo [::1]:123 2024-02-18T16:17:28.339 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7261%5]:123 2024-02-18T16:17:28.339 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:28 ntpd[17184]: Listening on routing socket on fd #22 for interface updates 2024-02-18T16:17:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:29 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:29.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:29.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:29.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:29.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:29 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:29.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:29 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:29.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:29 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:30.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:30 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:30.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:30 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:31 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:31 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:31.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:31 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:31.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:31.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:31.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:31.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:31.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:31.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:31.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:31.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:31.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:31 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:32.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:32.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:32 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:32.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:32.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:32 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:32.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:32.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:32 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:32.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:32 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:32.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:32 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:32.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:32 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:32.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:32 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:32.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:32 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:32.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:32 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:33.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:33 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:33.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:33.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:33 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:34 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:34 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:34.310 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:34 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:34.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:34 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:34.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:34 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:34.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:34 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:34.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:34 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:34.331 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:34 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:34.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:34 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.311 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:35.312 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:35.313 INFO:teuthology.orchestra.run.smithi080.stdout:18 Feb 16:17:35 ntpd[17143]: ntpd: time slew -0.001456 s 2024-02-18T16:17:35.313 INFO:teuthology.orchestra.run.smithi080.stdout:ntpd: time slew -0.001456s 2024-02-18T16:17:35.313 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-18T16:17:35.313 INFO:teuthology.orchestra.run.smithi080.stderr:18 Feb 16:17:35 ntpd[17143]: can't open /var/log/ntpstats/loopstats.20240218: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: can't open /var/log/ntpstats/rawstats.20240218: Permission denied 2024-02-18T16:17:35.332 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-18T16:17:35.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: can't open /var/log/ntpstats/peerstats.20240218: Permission denied 2024-02-18T16:17:35.333 INFO:teuthology.orchestra.run.smithi129.stdout:18 Feb 16:17:35 ntpd[17184]: ntpd: time slew -0.002388 s 2024-02-18T16:17:35.333 INFO:teuthology.orchestra.run.smithi129.stdout:ntpd: time slew -0.002388s 2024-02-18T16:17:35.333 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-18T16:17:35.334 INFO:teuthology.orchestra.run.smithi129.stderr:18 Feb 16:17:35 ntpd[17184]: can't open /var/log/ntpstats/loopstats.20240218: Permission denied 2024-02-18T16:17:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-02-18T16:17:35.365 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-02-18T16:17:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.365 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: remote refid st t when poll reach delay offset jitter 2024-02-18T16:17:35.383 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================== 2024-02-18T16:17:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:17:35.384 INFO:teuthology.run_tasks:Running task install... 2024-02-18T16:17:35.394 DEBUG:teuthology.task.install:project ceph 2024-02-18T16:17:35.394 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb'}} 2024-02-18T16:17:35.394 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb'} 2024-02-18T16:17:35.394 INFO:teuthology.task.install:Using flavor: default 2024-02-18T16:17:35.400 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-18T16:17:35.400 INFO:teuthology.task.install:extra packages: [] 2024-02-18T16:17:35.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-key list | grep Ceph 2024-02-18T16:17:35.401 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-key list | grep Ceph 2024-02-18T16:17:35.468 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-18T16:17:35.480 INFO:teuthology.orchestra.run.smithi129.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-18T16:17:35.498 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-18T16:17:35.498 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph.com (release key) 2024-02-18T16:17:35.499 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-18T16:17:35.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=02db01d0a75058abf10a307d548d1e1e71b47eeb 2024-02-18T16:17:35.507 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-18T16:17:35.507 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph.com (release key) 2024-02-18T16:17:35.507 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-18T16:17:35.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=02db01d0a75058abf10a307d548d1e1e71b47eeb 2024-02-18T16:17:35.649 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default/ 2024-02-18T16:17:35.649 INFO:teuthology.task.install.deb:Package version is 19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:17:35.723 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default/ 2024-02-18T16:17:35.723 INFO:teuthology.task.install.deb:Package version is 19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:17:35.831 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:17:35.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-18T16:17:35.833 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:17:35.833 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-18T16:17:35.855 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get update 2024-02-18T16:17:35.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-02-18T16:17:36.063 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-18T16:17:36.071 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy InRelease 2024-02-18T16:17:36.078 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy InRelease 2024-02-18T16:17:36.092 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-18T16:17:36.099 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-18T16:17:36.117 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-18T16:17:36.123 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-18T16:17:36.133 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-18T16:17:36.137 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,389 B] 2024-02-18T16:17:36.156 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-18T16:17:36.156 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-18T16:17:36.156 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,389 B] 2024-02-18T16:17:36.167 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-18T16:17:36.185 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-18T16:17:36.215 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-18T16:17:36.226 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-18T16:17:36.297 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-18T16:17:36.307 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-18T16:17:36.433 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 28.9 kB in 0s (70.4 kB/s) 2024-02-18T16:17:36.512 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 28.9 kB in 0s (60.3 kB/s) 2024-02-18T16:17:37.381 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-18T16:17:37.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1520-g02db01d0-1jammy cephadm=19.0.0-1520-g02db01d0-1jammy ceph-mds=19.0.0-1520-g02db01d0-1jammy ceph-mgr=19.0.0-1520-g02db01d0-1jammy ceph-common=19.0.0-1520-g02db01d0-1jammy ceph-fuse=19.0.0-1520-g02db01d0-1jammy ceph-test=19.0.0-1520-g02db01d0-1jammy ceph-volume=19.0.0-1520-g02db01d0-1jammy radosgw=19.0.0-1520-g02db01d0-1jammy python3-rados=19.0.0-1520-g02db01d0-1jammy python3-rgw=19.0.0-1520-g02db01d0-1jammy python3-cephfs=19.0.0-1520-g02db01d0-1jammy python3-rbd=19.0.0-1520-g02db01d0-1jammy libcephfs2=19.0.0-1520-g02db01d0-1jammy libcephfs-dev=19.0.0-1520-g02db01d0-1jammy librados2=19.0.0-1520-g02db01d0-1jammy librbd1=19.0.0-1520-g02db01d0-1jammy rbd-fuse=19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:17:37.403 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-02-18T16:17:37.419 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1520-g02db01d0-1jammy cephadm=19.0.0-1520-g02db01d0-1jammy ceph-mds=19.0.0-1520-g02db01d0-1jammy ceph-mgr=19.0.0-1520-g02db01d0-1jammy ceph-common=19.0.0-1520-g02db01d0-1jammy ceph-fuse=19.0.0-1520-g02db01d0-1jammy ceph-test=19.0.0-1520-g02db01d0-1jammy ceph-volume=19.0.0-1520-g02db01d0-1jammy radosgw=19.0.0-1520-g02db01d0-1jammy python3-rados=19.0.0-1520-g02db01d0-1jammy python3-rgw=19.0.0-1520-g02db01d0-1jammy python3-cephfs=19.0.0-1520-g02db01d0-1jammy python3-rbd=19.0.0-1520-g02db01d0-1jammy libcephfs2=19.0.0-1520-g02db01d0-1jammy libcephfs-dev=19.0.0-1520-g02db01d0-1jammy librados2=19.0.0-1520-g02db01d0-1jammy librbd1=19.0.0-1520-g02db01d0-1jammy rbd-fuse=19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:17:37.457 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-18T16:17:37.481 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-02-18T16:17:37.648 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-02-18T16:17:37.648 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-02-18T16:17:37.673 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-02-18T16:17:37.674 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-02-18T16:17:37.816 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-02-18T16:17:37.816 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-18T16:17:37.816 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-18T16:17:37.816 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-18T16:17:37.816 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-18T16:17:37.817 INFO:teuthology.orchestra.run.smithi080.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-18T16:17:37.817 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-18T16:17:37.817 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-02-18T16:17:37.817 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-18T16:17:37.817 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-18T16:17:37.818 INFO:teuthology.orchestra.run.smithi080.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-18T16:17:37.818 INFO:teuthology.orchestra.run.smithi080.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-18T16:17:37.819 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet zip 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-18T16:17:37.820 INFO:teuthology.orchestra.run.smithi080.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-02-18T16:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout: btrfs-tools 2024-02-18T16:17:37.850 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-02-18T16:17:37.851 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-18T16:17:37.851 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-18T16:17:37.851 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-18T16:17:37.851 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-18T16:17:37.851 INFO:teuthology.orchestra.run.smithi129.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-18T16:17:37.851 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-18T16:17:37.853 INFO:teuthology.orchestra.run.smithi129.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-18T16:17:37.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet zip 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-18T16:17:37.855 INFO:teuthology.orchestra.run.smithi129.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-18T16:17:37.856 INFO:teuthology.orchestra.run.smithi129.stdout:Recommended packages: 2024-02-18T16:17:37.856 INFO:teuthology.orchestra.run.smithi129.stdout: btrfs-tools 2024-02-18T16:17:37.918 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-02-18T16:17:37.919 INFO:teuthology.orchestra.run.smithi080.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-18T16:17:37.919 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-18T16:17:37.919 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-18T16:17:37.919 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-18T16:17:37.919 INFO:teuthology.orchestra.run.smithi080.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-18T16:17:37.919 INFO:teuthology.orchestra.run.smithi080.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-18T16:17:37.920 INFO:teuthology.orchestra.run.smithi080.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-18T16:17:37.920 INFO:teuthology.orchestra.run.smithi080.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-18T16:17:37.920 INFO:teuthology.orchestra.run.smithi080.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-18T16:17:37.920 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-18T16:17:37.920 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-18T16:17:37.920 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-18T16:17:37.921 INFO:teuthology.orchestra.run.smithi080.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-18T16:17:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-18T16:17:37.958 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-18T16:17:37.959 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-18T16:17:37.959 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-18T16:17:37.959 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-18T16:17:37.959 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-18T16:17:37.959 INFO:teuthology.orchestra.run.smithi129.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-18T16:17:38.049 INFO:teuthology.orchestra.run.smithi129.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-18T16:17:38.049 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 176 MB of archives. 2024-02-18T16:17:38.049 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 730 MB of additional disk space will be used. 2024-02-18T16:17:38.049 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-18T16:17:38.099 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1520-g02db01d0-1jammy [3,532 kB] 2024-02-18T16:17:38.106 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-18T16:17:38.106 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 176 MB of archives. 2024-02-18T16:17:38.106 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 730 MB of additional disk space will be used. 2024-02-18T16:17:38.106 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-18T16:17:38.196 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1520-g02db01d0-1jammy [3,532 kB] 2024-02-18T16:17:38.220 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-18T16:17:38.229 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-18T16:17:38.286 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-18T16:17:38.328 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1520-g02db01d0-1jammy [3,210 kB] 2024-02-18T16:17:38.435 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1520-g02db01d0-1jammy [709 kB] 2024-02-18T16:17:38.453 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-18T16:17:38.457 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1520-g02db01d0-1jammy [356 kB] 2024-02-18T16:17:38.460 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-18T16:17:38.469 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1520-g02db01d0-1jammy [32.8 kB] 2024-02-18T16:17:38.470 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1520-g02db01d0-1jammy [180 kB] 2024-02-18T16:17:38.475 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1520-g02db01d0-1jammy [64.9 kB] 2024-02-18T16:17:38.477 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1520-g02db01d0-1jammy [330 kB] 2024-02-18T16:17:38.478 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-18T16:17:38.488 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-18T16:17:38.488 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1520-g02db01d0-1jammy [6,566 kB] 2024-02-18T16:17:38.489 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-18T16:17:38.491 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-18T16:17:38.507 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-18T16:17:38.511 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-18T16:17:38.515 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-18T16:17:38.517 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-18T16:17:38.532 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-18T16:17:38.544 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-18T16:17:38.551 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-18T16:17:38.555 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-18T16:17:38.559 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-18T16:17:38.594 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-18T16:17:38.595 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-18T16:17:38.596 INFO:teuthology.orchestra.run.smithi129.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-18T16:17:38.598 INFO:teuthology.orchestra.run.smithi129.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-18T16:17:38.599 INFO:teuthology.orchestra.run.smithi129.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-18T16:17:38.599 INFO:teuthology.orchestra.run.smithi129.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-18T16:17:38.600 INFO:teuthology.orchestra.run.smithi129.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-18T16:17:38.625 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-18T16:17:38.643 INFO:teuthology.orchestra.run.smithi129.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-18T16:17:38.644 INFO:teuthology.orchestra.run.smithi129.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-18T16:17:38.645 INFO:teuthology.orchestra.run.smithi129.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-18T16:17:38.696 INFO:teuthology.orchestra.run.smithi129.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-18T16:17:38.698 INFO:teuthology.orchestra.run.smithi129.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-18T16:17:38.699 INFO:teuthology.orchestra.run.smithi129.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-18T16:17:38.699 INFO:teuthology.orchestra.run.smithi129.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-18T16:17:38.701 INFO:teuthology.orchestra.run.smithi129.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-18T16:17:38.702 INFO:teuthology.orchestra.run.smithi129.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-18T16:17:38.703 INFO:teuthology.orchestra.run.smithi129.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-18T16:17:38.724 INFO:teuthology.orchestra.run.smithi129.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1520-g02db01d0-1jammy [112 kB] 2024-02-18T16:17:38.728 INFO:teuthology.orchestra.run.smithi129.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1520-g02db01d0-1jammy [465 kB] 2024-02-18T16:17:38.733 INFO:teuthology.orchestra.run.smithi129.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-18T16:17:38.742 INFO:teuthology.orchestra.run.smithi129.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1520-g02db01d0-1jammy [24.1 MB] 2024-02-18T16:17:38.790 INFO:teuthology.orchestra.run.smithi129.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-18T16:17:38.791 INFO:teuthology.orchestra.run.smithi129.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-18T16:17:38.802 INFO:teuthology.orchestra.run.smithi129.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-18T16:17:38.802 INFO:teuthology.orchestra.run.smithi129.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-18T16:17:38.804 INFO:teuthology.orchestra.run.smithi129.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-18T16:17:38.804 INFO:teuthology.orchestra.run.smithi129.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-18T16:17:38.807 INFO:teuthology.orchestra.run.smithi129.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-18T16:17:38.811 INFO:teuthology.orchestra.run.smithi129.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-18T16:17:38.812 INFO:teuthology.orchestra.run.smithi129.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-18T16:17:38.840 INFO:teuthology.orchestra.run.smithi129.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-18T16:17:38.841 INFO:teuthology.orchestra.run.smithi129.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-18T16:17:38.854 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-18T16:17:38.866 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-18T16:17:38.868 INFO:teuthology.orchestra.run.smithi129.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-18T16:17:38.870 INFO:teuthology.orchestra.run.smithi129.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-18T16:17:38.872 INFO:teuthology.orchestra.run.smithi129.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-18T16:17:38.883 INFO:teuthology.orchestra.run.smithi129.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-18T16:17:38.896 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-18T16:17:38.905 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-18T16:17:38.906 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-18T16:17:38.907 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-18T16:17:38.925 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-18T16:17:39.068 INFO:teuthology.orchestra.run.smithi129.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-18T16:17:39.070 INFO:teuthology.orchestra.run.smithi129.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-18T16:17:39.072 INFO:teuthology.orchestra.run.smithi129.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-18T16:17:39.072 INFO:teuthology.orchestra.run.smithi129.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-18T16:17:39.074 INFO:teuthology.orchestra.run.smithi129.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-18T16:17:39.094 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-18T16:17:39.100 INFO:teuthology.orchestra.run.smithi129.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-18T16:17:39.103 INFO:teuthology.orchestra.run.smithi129.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-18T16:17:39.103 INFO:teuthology.orchestra.run.smithi129.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-18T16:17:39.158 INFO:teuthology.orchestra.run.smithi129.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-18T16:17:39.158 INFO:teuthology.orchestra.run.smithi129.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-18T16:17:39.165 INFO:teuthology.orchestra.run.smithi129.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-18T16:17:39.167 INFO:teuthology.orchestra.run.smithi129.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-18T16:17:39.168 INFO:teuthology.orchestra.run.smithi129.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-18T16:17:39.170 INFO:teuthology.orchestra.run.smithi129.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-18T16:17:39.171 INFO:teuthology.orchestra.run.smithi129.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-18T16:17:39.172 INFO:teuthology.orchestra.run.smithi129.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-18T16:17:39.181 INFO:teuthology.orchestra.run.smithi129.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-18T16:17:39.221 INFO:teuthology.orchestra.run.smithi129.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-18T16:17:39.224 INFO:teuthology.orchestra.run.smithi129.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-18T16:17:39.226 INFO:teuthology.orchestra.run.smithi129.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-18T16:17:39.272 INFO:teuthology.orchestra.run.smithi129.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-18T16:17:39.279 INFO:teuthology.orchestra.run.smithi129.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-18T16:17:39.282 INFO:teuthology.orchestra.run.smithi129.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-18T16:17:39.283 INFO:teuthology.orchestra.run.smithi129.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-18T16:17:39.296 INFO:teuthology.orchestra.run.smithi129.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-18T16:17:39.297 INFO:teuthology.orchestra.run.smithi129.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-18T16:17:39.305 INFO:teuthology.orchestra.run.smithi129.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-18T16:17:39.319 INFO:teuthology.orchestra.run.smithi129.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-18T16:17:39.321 INFO:teuthology.orchestra.run.smithi129.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-18T16:17:39.321 INFO:teuthology.orchestra.run.smithi129.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-18T16:17:39.344 INFO:teuthology.orchestra.run.smithi129.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-18T16:17:39.346 INFO:teuthology.orchestra.run.smithi129.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-18T16:17:39.364 INFO:teuthology.orchestra.run.smithi129.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-18T16:17:39.364 INFO:teuthology.orchestra.run.smithi129.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-18T16:17:39.365 INFO:teuthology.orchestra.run.smithi129.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-18T16:17:39.370 INFO:teuthology.orchestra.run.smithi129.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-18T16:17:39.371 INFO:teuthology.orchestra.run.smithi129.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-18T16:17:39.495 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-18T16:17:39.530 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-18T16:17:39.532 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-18T16:17:39.611 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-18T16:17:39.663 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-18T16:17:39.685 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-18T16:17:39.691 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-18T16:17:39.692 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-18T16:17:39.704 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-18T16:17:39.704 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-18T16:17:39.756 INFO:teuthology.orchestra.run.smithi129.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1520-g02db01d0-1jammy [5,073 kB] 2024-02-18T16:17:39.835 INFO:teuthology.orchestra.run.smithi129.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1520-g02db01d0-1jammy [243 kB] 2024-02-18T16:17:39.838 INFO:teuthology.orchestra.run.smithi129.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1520-g02db01d0-1jammy [124 kB] 2024-02-18T16:17:39.839 INFO:teuthology.orchestra.run.smithi129.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1520-g02db01d0-1jammy [1,519 kB] 2024-02-18T16:17:39.869 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-18T16:17:39.873 INFO:teuthology.orchestra.run.smithi129.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1520-g02db01d0-1jammy [6,240 kB] 2024-02-18T16:17:39.952 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-18T16:17:39.981 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-18T16:17:39.998 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-18T16:17:40.042 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-18T16:17:40.088 INFO:teuthology.orchestra.run.smithi129.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1520-g02db01d0-1jammy [22.7 MB] 2024-02-18T16:17:40.118 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1520-g02db01d0-1jammy [3,210 kB] 2024-02-18T16:17:40.252 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-18T16:17:40.267 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-18T16:17:40.274 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-18T16:17:40.279 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-18T16:17:40.300 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-18T16:17:40.304 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-18T16:17:40.470 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-18T16:17:40.802 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-18T16:17:40.834 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-18T16:17:40.844 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-18T16:17:40.966 INFO:teuthology.orchestra.run.smithi129.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1520-g02db01d0-1jammy [14.1 kB] 2024-02-18T16:17:40.966 INFO:teuthology.orchestra.run.smithi129.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1520-g02db01d0-1jammy [865 kB] 2024-02-18T16:17:40.984 INFO:teuthology.orchestra.run.smithi129.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1520-g02db01d0-1jammy [2,184 kB] 2024-02-18T16:17:41.022 INFO:teuthology.orchestra.run.smithi129.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1520-g02db01d0-1jammy [776 kB] 2024-02-18T16:17:41.032 INFO:teuthology.orchestra.run.smithi129.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1520-g02db01d0-1jammy [144 kB] 2024-02-18T16:17:41.033 INFO:teuthology.orchestra.run.smithi129.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1520-g02db01d0-1jammy [1,921 kB] 2024-02-18T16:17:41.046 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-18T16:17:41.047 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-18T16:17:41.053 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-18T16:17:41.059 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-18T16:17:41.074 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-18T16:17:41.095 INFO:teuthology.orchestra.run.smithi080.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-18T16:17:41.097 INFO:teuthology.orchestra.run.smithi129.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1520-g02db01d0-1jammy [8,625 kB] 2024-02-18T16:17:41.101 INFO:teuthology.orchestra.run.smithi080.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-18T16:17:41.277 INFO:teuthology.orchestra.run.smithi080.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-18T16:17:41.401 INFO:teuthology.orchestra.run.smithi129.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1520-g02db01d0-1jammy [14.2 kB] 2024-02-18T16:17:41.402 INFO:teuthology.orchestra.run.smithi129.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1520-g02db01d0-1jammy [49.9 MB] 2024-02-18T16:17:41.533 INFO:teuthology.orchestra.run.smithi080.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-18T16:17:41.621 INFO:teuthology.orchestra.run.smithi080.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1520-g02db01d0-1jammy [709 kB] 2024-02-18T16:17:41.709 INFO:teuthology.orchestra.run.smithi080.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-18T16:17:41.723 INFO:teuthology.orchestra.run.smithi080.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-18T16:17:41.742 INFO:teuthology.orchestra.run.smithi080.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-18T16:17:41.807 INFO:teuthology.orchestra.run.smithi080.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-18T16:17:41.944 INFO:teuthology.orchestra.run.smithi080.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1520-g02db01d0-1jammy [356 kB] 2024-02-18T16:17:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1520-g02db01d0-1jammy [32.8 kB] 2024-02-18T16:17:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-18T16:17:42.100 INFO:teuthology.orchestra.run.smithi080.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-18T16:17:42.103 INFO:teuthology.orchestra.run.smithi080.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-18T16:17:42.103 INFO:teuthology.orchestra.run.smithi080.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-18T16:17:42.106 INFO:teuthology.orchestra.run.smithi080.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-18T16:17:42.133 INFO:teuthology.orchestra.run.smithi080.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1520-g02db01d0-1jammy [180 kB] 2024-02-18T16:17:42.226 INFO:teuthology.orchestra.run.smithi080.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1520-g02db01d0-1jammy [64.9 kB] 2024-02-18T16:17:42.245 INFO:teuthology.orchestra.run.smithi080.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1520-g02db01d0-1jammy [330 kB] 2024-02-18T16:17:42.325 INFO:teuthology.orchestra.run.smithi080.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-18T16:17:42.412 INFO:teuthology.orchestra.run.smithi080.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1520-g02db01d0-1jammy [6,566 kB] 2024-02-18T16:17:42.762 INFO:teuthology.orchestra.run.smithi080.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-18T16:17:42.768 INFO:teuthology.orchestra.run.smithi080.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-18T16:17:43.057 INFO:teuthology.orchestra.run.smithi080.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-18T16:17:43.057 INFO:teuthology.orchestra.run.smithi080.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-18T16:17:43.059 INFO:teuthology.orchestra.run.smithi080.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-18T16:17:43.061 INFO:teuthology.orchestra.run.smithi080.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-18T16:17:43.063 INFO:teuthology.orchestra.run.smithi080.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-18T16:17:43.065 INFO:teuthology.orchestra.run.smithi080.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-18T16:17:43.066 INFO:teuthology.orchestra.run.smithi080.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-18T16:17:43.067 INFO:teuthology.orchestra.run.smithi080.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-18T16:17:43.249 INFO:teuthology.orchestra.run.smithi080.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-18T16:17:43.379 INFO:teuthology.orchestra.run.smithi129.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1520-g02db01d0-1jammy [121 kB] 2024-02-18T16:17:43.382 INFO:teuthology.orchestra.run.smithi129.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1520-g02db01d0-1jammy [38.4 kB] 2024-02-18T16:17:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1520-g02db01d0-1jammy [13.0 MB] 2024-02-18T16:17:43.665 INFO:teuthology.orchestra.run.smithi080.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-18T16:17:43.705 INFO:teuthology.orchestra.run.smithi129.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1520-g02db01d0-1jammy [91.5 kB] 2024-02-18T16:17:43.712 INFO:teuthology.orchestra.run.smithi080.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-18T16:17:43.746 INFO:teuthology.orchestra.run.smithi080.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-18T16:17:43.844 INFO:teuthology.orchestra.run.smithi080.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-18T16:17:43.887 INFO:teuthology.orchestra.run.smithi080.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-18T16:17:43.896 INFO:teuthology.orchestra.run.smithi080.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-18T16:17:43.901 INFO:teuthology.orchestra.run.smithi080.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-18T16:17:43.948 INFO:teuthology.orchestra.run.smithi080.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-18T16:17:43.951 INFO:teuthology.orchestra.run.smithi080.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-18T16:17:43.972 INFO:teuthology.orchestra.run.smithi080.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-18T16:17:44.136 INFO:teuthology.orchestra.run.smithi080.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-18T16:17:44.270 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 176 MB in 6s (30.6 MB/s) 2024-02-18T16:17:44.409 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-18T16:17:44.410 INFO:teuthology.orchestra.run.smithi080.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-18T16:17:44.428 INFO:teuthology.orchestra.run.smithi080.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-18T16:17:44.507 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-18T16:17:44.513 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-18T16:17:44.582 INFO:teuthology.orchestra.run.smithi080.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-18T16:17:44.582 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-18T16:17:44.611 INFO:teuthology.orchestra.run.smithi080.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-18T16:17:44.768 INFO:teuthology.orchestra.run.smithi080.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-18T16:17:44.771 INFO:teuthology.orchestra.run.smithi080.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-18T16:17:44.773 INFO:teuthology.orchestra.run.smithi080.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-18T16:17:44.795 INFO:teuthology.orchestra.run.smithi080.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-18T16:17:44.800 INFO:teuthology.orchestra.run.smithi080.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-18T16:17:44.902 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-18T16:17:44.929 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-18T16:17:44.969 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-18T16:17:45.331 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-18T16:17:45.357 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-18T16:17:45.397 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-18T16:17:45.463 INFO:teuthology.orchestra.run.smithi080.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1520-g02db01d0-1jammy [112 kB] 2024-02-18T16:17:45.495 INFO:teuthology.orchestra.run.smithi080.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1520-g02db01d0-1jammy [465 kB] 2024-02-18T16:17:45.665 INFO:teuthology.orchestra.run.smithi080.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1520-g02db01d0-1jammy [24.1 MB] 2024-02-18T16:17:45.859 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-18T16:17:45.886 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-18T16:17:45.934 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:17:46.354 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-18T16:17:46.381 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-18T16:17:46.413 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:17:46.757 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-18T16:17:46.784 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-18T16:17:46.824 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:17:47.177 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-18T16:17:47.203 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-18T16:17:47.243 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-18T16:17:47.539 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librados2. 2024-02-18T16:17:47.565 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../007-librados2_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:47.605 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librados2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:48.041 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librbd1. 2024-02-18T16:17:48.068 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../008-librbd1_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:48.108 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librbd1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:48.552 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libcephfs2. 2024-02-18T16:17:48.578 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:48.619 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:48.913 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rados. 2024-02-18T16:17:48.940 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:48.980 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rados (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:49.266 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-18T16:17:49.292 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:17:49.324 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-argparse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:49.577 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cephfs. 2024-02-18T16:17:49.592 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:49.660 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cephfs (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:49.988 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-18T16:17:50.014 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:17:50.055 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:50.383 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-18T16:17:50.409 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-18T16:17:50.449 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-18T16:17:50.769 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-prettytable. 2024-02-18T16:17:50.795 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-18T16:17:50.827 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-18T16:17:51.080 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rbd. 2024-02-18T16:17:51.106 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:51.146 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rbd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:51.574 INFO:teuthology.orchestra.run.smithi080.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1520-g02db01d0-1jammy [5,073 kB] 2024-02-18T16:17:51.775 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-18T16:17:51.801 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-18T16:17:51.842 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-18T16:17:52.127 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-18T16:17:52.153 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-18T16:17:52.194 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-18T16:17:52.472 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-18T16:17:52.487 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-18T16:17:52.522 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-18T16:17:52.550 INFO:teuthology.orchestra.run.smithi080.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1520-g02db01d0-1jammy [243 kB] 2024-02-18T16:17:52.599 INFO:teuthology.orchestra.run.smithi080.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1520-g02db01d0-1jammy [124 kB] 2024-02-18T16:17:52.623 INFO:teuthology.orchestra.run.smithi080.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1520-g02db01d0-1jammy [1,519 kB] 2024-02-18T16:17:52.858 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua5.1. 2024-02-18T16:17:52.885 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-18T16:17:52.925 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-18T16:17:52.969 INFO:teuthology.orchestra.run.smithi080.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1520-g02db01d0-1jammy [6,240 kB] 2024-02-18T16:17:53.261 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua-any. 2024-02-18T16:17:53.276 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-18T16:17:53.320 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-18T16:17:53.539 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package zip. 2024-02-18T16:17:53.554 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-18T16:17:53.589 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking zip (3.0-12build2) ... 2024-02-18T16:17:53.934 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package unzip. 2024-02-18T16:17:53.961 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-18T16:17:54.000 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-18T16:17:54.401 INFO:teuthology.orchestra.run.smithi080.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1520-g02db01d0-1jammy [22.7 MB] 2024-02-18T16:17:54.455 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package luarocks. 2024-02-18T16:17:54.481 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-18T16:17:54.530 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-18T16:17:54.938 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librgw2. 2024-02-18T16:17:54.964 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../025-librgw2_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:55.004 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librgw2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:55.515 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rgw. 2024-02-18T16:17:55.530 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:55.573 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:55.926 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-18T16:17:55.953 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-18T16:17:56.001 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-18T16:17:56.396 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libradosstriper1. 2024-02-18T16:17:56.423 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:56.462 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libradosstriper1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:57.066 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-common. 2024-02-18T16:17:57.093 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:57.133 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:58.094 INFO:teuthology.orchestra.run.smithi080.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1520-g02db01d0-1jammy [14.1 kB] 2024-02-18T16:17:58.094 INFO:teuthology.orchestra.run.smithi080.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1520-g02db01d0-1jammy [865 kB] 2024-02-18T16:17:58.111 INFO:teuthology.orchestra.run.smithi080.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1520-g02db01d0-1jammy [2,184 kB] 2024-02-18T16:17:58.354 INFO:teuthology.orchestra.run.smithi080.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1520-g02db01d0-1jammy [776 kB] 2024-02-18T16:17:58.490 INFO:teuthology.orchestra.run.smithi080.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1520-g02db01d0-1jammy [144 kB] 2024-02-18T16:17:58.494 INFO:teuthology.orchestra.run.smithi080.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1520-g02db01d0-1jammy [1,921 kB] 2024-02-18T16:17:58.530 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-base. 2024-02-18T16:17:58.557 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:17:58.608 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-base (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:17:58.756 INFO:teuthology.orchestra.run.smithi080.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1520-g02db01d0-1jammy [8,625 kB] 2024-02-18T16:17:59.209 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-18T16:17:59.236 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-18T16:17:59.276 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-18T16:17:59.579 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cheroot. 2024-02-18T16:17:59.605 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-18T16:17:59.671 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-18T16:17:59.837 INFO:teuthology.orchestra.run.smithi080.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1520-g02db01d0-1jammy [14.2 kB] 2024-02-18T16:17:59.838 INFO:teuthology.orchestra.run.smithi080.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1520-g02db01d0-1jammy [49.9 MB] 2024-02-18T16:18:00.007 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-18T16:18:00.036 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-18T16:18:00.082 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-18T16:18:00.360 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-18T16:18:00.387 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-18T16:18:00.427 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-18T16:18:00.738 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-18T16:18:00.765 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-18T16:18:00.805 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-18T16:18:01.108 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tempora. 2024-02-18T16:18:01.134 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-18T16:18:01.183 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-18T16:18:01.552 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-portend. 2024-02-18T16:18:01.579 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-18T16:18:01.627 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-18T16:18:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-18T16:18:01.949 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-18T16:18:01.989 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-18T16:18:02.292 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-18T16:18:02.318 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-18T16:18:02.358 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-18T16:18:02.729 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-natsort. 2024-02-18T16:18:02.755 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-18T16:18:02.795 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-18T16:18:03.132 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-logutils. 2024-02-18T16:18:03.158 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-18T16:18:03.215 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-18T16:18:03.476 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-18T16:18:03.491 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-18T16:18:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-18T16:18:03.821 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-mako. 2024-02-18T16:18:03.847 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-18T16:18:03.887 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-18T16:18:04.224 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-18T16:18:04.251 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-18T16:18:04.291 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-18T16:18:04.594 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-18T16:18:04.620 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-18T16:18:04.660 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-18T16:18:04.921 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webob. 2024-02-18T16:18:04.948 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-18T16:18:04.988 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-18T16:18:05.316 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-waitress. 2024-02-18T16:18:05.342 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-18T16:18:05.386 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-18T16:18:05.702 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tempita. 2024-02-18T16:18:05.729 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-18T16:18:05.769 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-18T16:18:06.072 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-paste. 2024-02-18T16:18:06.099 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-18T16:18:06.138 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-18T16:18:06.450 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-18T16:18:06.466 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-18T16:18:06.508 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-18T16:18:06.811 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-18T16:18:06.838 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-18T16:18:06.878 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-18T16:18:07.158 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webtest. 2024-02-18T16:18:07.185 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-18T16:18:07.224 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-18T16:18:07.669 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pecan. 2024-02-18T16:18:07.695 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-18T16:18:07.727 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-18T16:18:08.031 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-certifi. 2024-02-18T16:18:08.047 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-18T16:18:08.081 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-18T16:18:08.410 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-idna. 2024-02-18T16:18:08.436 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-18T16:18:08.476 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-18T16:18:08.547 INFO:teuthology.orchestra.run.smithi080.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1520-g02db01d0-1jammy [121 kB] 2024-02-18T16:18:08.549 INFO:teuthology.orchestra.run.smithi080.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1520-g02db01d0-1jammy [38.4 kB] 2024-02-18T16:18:08.551 INFO:teuthology.orchestra.run.smithi080.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1520-g02db01d0-1jammy [13.0 MB] 2024-02-18T16:18:08.787 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-urllib3. 2024-02-18T16:18:08.814 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-18T16:18:08.854 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-18T16:18:09.157 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-requests. 2024-02-18T16:18:09.183 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-18T16:18:09.223 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-18T16:18:09.576 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-18T16:18:09.591 INFO:teuthology.orchestra.run.smithi080.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-64173/02db01d0a75058abf10a307d548d1e1e71b47eeb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1520-g02db01d0-1jammy [91.5 kB] 2024-02-18T16:18:09.603 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-18T16:18:09.651 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-18T16:18:09.938 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-18T16:18:09.964 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:10.004 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:10.146 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 176 MB in 32s (5,552 kB/s) 2024-02-18T16:18:10.260 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-18T16:18:10.356 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-18T16:18:10.361 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-18T16:18:10.376 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-18T16:18:10.402 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:10.433 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-18T16:18:10.442 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:10.739 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-18T16:18:10.762 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-18T16:18:10.766 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-18T16:18:10.788 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-18T16:18:10.806 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-18T16:18:10.828 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-18T16:18:11.142 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-18T16:18:11.169 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-18T16:18:11.209 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-18T16:18:11.390 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-openssl. 2024-02-18T16:18:11.416 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-18T16:18:11.865 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-18T16:18:12.343 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr. 2024-02-18T16:18:12.346 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-18T16:18:12.370 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:12.374 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-18T16:18:12.418 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:12.421 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:18:12.808 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-18T16:18:12.834 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-18T16:18:12.837 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mon. 2024-02-18T16:18:12.864 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:12.874 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:18:12.904 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mon (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:13.194 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-18T16:18:13.209 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-18T16:18:13.244 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:18:13.508 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-osd. 2024-02-18T16:18:13.535 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:13.572 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-18T16:18:13.574 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-osd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:13.599 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-18T16:18:13.639 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-18T16:18:13.958 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librados2. 2024-02-18T16:18:13.985 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../007-librados2_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:14.025 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librados2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:14.453 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librbd1. 2024-02-18T16:18:14.479 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../008-librbd1_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:14.519 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librbd1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:14.685 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph. 2024-02-18T16:18:14.712 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../066-ceph_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:14.760 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:15.112 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs2. 2024-02-18T16:18:15.113 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-fuse. 2024-02-18T16:18:15.138 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:15.140 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:15.180 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:15.180 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:15.458 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rados. 2024-02-18T16:18:15.484 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:15.525 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rados (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:15.566 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mds. 2024-02-18T16:18:15.593 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:15.633 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mds (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:15.869 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-18T16:18:15.896 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:15.936 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-argparse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:16.019 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package cephadm. 2024-02-18T16:18:16.046 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../069-cephadm_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:16.094 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:16.164 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cephfs. 2024-02-18T16:18:16.190 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:16.230 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cephfs (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:16.497 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-18T16:18:16.523 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-18T16:18:16.541 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-18T16:18:16.557 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:16.571 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-18T16:18:16.600 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:16.882 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-18T16:18:16.897 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-18T16:18:16.919 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-18T16:18:16.945 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-18T16:18:16.949 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-18T16:18:16.986 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-18T16:18:17.306 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-prettytable. 2024-02-18T16:18:17.332 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-18T16:18:17.364 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-18T16:18:17.592 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rbd. 2024-02-18T16:18:17.618 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:17.658 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rbd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:17.995 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-18T16:18:18.021 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-18T16:18:18.061 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-18T16:18:18.179 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-babel. 2024-02-18T16:18:18.206 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-18T16:18:18.245 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-18T16:18:18.347 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-18T16:18:18.362 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-18T16:18:18.405 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-18T16:18:18.573 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jinja2. 2024-02-18T16:18:18.600 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-18T16:18:18.640 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-18T16:18:18.683 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-18T16:18:18.698 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-18T16:18:18.733 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-18T16:18:18.993 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-18T16:18:19.020 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:19.053 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua5.1. 2024-02-18T16:18:19.059 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:19.080 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-18T16:18:19.120 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-18T16:18:19.396 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-18T16:18:19.423 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-18T16:18:19.457 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-any. 2024-02-18T16:18:19.462 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-18T16:18:19.483 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-18T16:18:19.523 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-18T16:18:19.757 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-routes. 2024-02-18T16:18:19.767 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package zip. 2024-02-18T16:18:19.783 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-18T16:18:19.784 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-18T16:18:19.817 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking zip (3.0-12build2) ... 2024-02-18T16:18:19.823 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-18T16:18:20.104 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package unzip. 2024-02-18T16:18:20.131 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-18T16:18:20.160 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-18T16:18:20.170 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-18T16:18:20.187 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:20.226 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:20.680 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-18T16:18:20.707 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-18T16:18:20.708 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package luarocks. 2024-02-18T16:18:20.734 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-18T16:18:20.746 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-18T16:18:20.775 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-18T16:18:21.183 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librgw2. 2024-02-18T16:18:21.209 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../025-librgw2_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:21.249 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librgw2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:21.300 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-joblib. 2024-02-18T16:18:21.327 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-18T16:18:21.366 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-18T16:18:21.711 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-18T16:18:21.738 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-18T16:18:21.768 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rgw. 2024-02-18T16:18:21.777 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-18T16:18:21.783 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:21.818 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:22.030 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sklearn. 2024-02-18T16:18:22.057 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-18T16:18:22.088 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-18T16:18:22.146 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-18T16:18:22.173 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-18T16:18:22.213 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-18T16:18:22.533 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libradosstriper1. 2024-02-18T16:18:22.559 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:22.599 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libradosstriper1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:22.755 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-18T16:18:22.783 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:22.899 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:22.994 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-common. 2024-02-18T16:18:23.021 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:23.052 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:23.886 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cachetools. 2024-02-18T16:18:23.913 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-18T16:18:23.952 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-18T16:18:24.255 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-18T16:18:24.282 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-18T16:18:24.322 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-18T16:18:24.391 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-base. 2024-02-18T16:18:24.418 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:24.467 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-base (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:24.659 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-18T16:18:24.686 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-18T16:18:24.725 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-18T16:18:25.045 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rsa. 2024-02-18T16:18:25.062 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-18T16:18:25.072 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-18T16:18:25.089 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-18T16:18:25.111 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-18T16:18:25.129 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-18T16:18:25.381 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-google-auth. 2024-02-18T16:18:25.397 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-18T16:18:25.431 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-18T16:18:25.432 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cheroot. 2024-02-18T16:18:25.458 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-18T16:18:25.498 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-18T16:18:25.743 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-18T16:18:25.771 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-18T16:18:25.809 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-18T16:18:25.968 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-18T16:18:25.994 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-18T16:18:26.026 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-18T16:18:26.121 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-websocket. 2024-02-18T16:18:26.148 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-18T16:18:26.187 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-18T16:18:26.296 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-18T16:18:26.322 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-18T16:18:26.362 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-18T16:18:26.499 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-18T16:18:26.526 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-18T16:18:26.557 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-18T16:18:26.699 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-18T16:18:26.725 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-18T16:18:26.765 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-18T16:18:27.068 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempora. 2024-02-18T16:18:27.095 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-18T16:18:27.135 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-18T16:18:27.204 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-18T16:18:27.220 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:27.254 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:27.396 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-portend. 2024-02-18T16:18:27.423 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-18T16:18:27.462 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-18T16:18:27.540 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-18T16:18:27.569 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-18T16:18:27.607 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-18T16:18:27.766 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-18T16:18:27.792 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-18T16:18:27.832 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-18T16:18:27.943 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-18T16:18:27.971 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-18T16:18:28.009 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-18T16:18:28.135 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-18T16:18:28.162 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-18T16:18:28.202 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-18T16:18:28.414 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package jq. 2024-02-18T16:18:28.442 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-18T16:18:28.545 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-18T16:18:28.556 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-natsort. 2024-02-18T16:18:28.582 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-18T16:18:28.631 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-18T16:18:28.756 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package socat. 2024-02-18T16:18:28.772 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-18T16:18:28.806 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-18T16:18:28.917 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-logutils. 2024-02-18T16:18:28.943 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-18T16:18:28.975 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-18T16:18:29.093 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package xmlstarlet. 2024-02-18T16:18:29.109 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-18T16:18:29.151 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-18T16:18:29.261 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-18T16:18:29.288 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-18T16:18:29.328 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-18T16:18:29.497 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-test. 2024-02-18T16:18:29.525 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:29.555 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-test (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:29.640 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-mako. 2024-02-18T16:18:29.666 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-18T16:18:29.723 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-18T16:18:30.068 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-18T16:18:30.094 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-18T16:18:30.134 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-18T16:18:30.412 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-18T16:18:30.439 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-18T16:18:30.479 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-18T16:18:30.757 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webob. 2024-02-18T16:18:30.784 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-18T16:18:30.815 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-18T16:18:31.126 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-waitress. 2024-02-18T16:18:31.154 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-18T16:18:31.196 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-18T16:18:31.504 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempita. 2024-02-18T16:18:31.531 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-18T16:18:31.571 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-18T16:18:31.801 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-volume. 2024-02-18T16:18:31.828 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:31.867 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-volume (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:31.882 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-paste. 2024-02-18T16:18:31.909 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-18T16:18:31.949 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-18T16:18:32.154 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-18T16:18:32.170 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:32.212 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs-dev (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:32.235 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-18T16:18:32.251 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-18T16:18:32.294 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-18T16:18:32.532 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-18T16:18:32.559 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-18T16:18:32.598 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-18T16:18:32.651 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-18T16:18:32.764 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-18T16:18:32.772 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-18T16:18:33.075 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webtest. 2024-02-18T16:18:33.086 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-18T16:18:33.101 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-18T16:18:33.114 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-18T16:18:33.141 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-18T16:18:33.144 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-18T16:18:33.436 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pecan. 2024-02-18T16:18:33.462 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-18T16:18:33.502 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-18T16:18:33.523 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package nvme-cli. 2024-02-18T16:18:33.551 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-18T16:18:33.590 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-18T16:18:33.874 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-certifi. 2024-02-18T16:18:33.901 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-18T16:18:33.941 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-18T16:18:34.012 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package pkg-config. 2024-02-18T16:18:34.039 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-18T16:18:34.078 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-18T16:18:34.269 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-idna. 2024-02-18T16:18:34.295 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-18T16:18:34.335 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-18T16:18:34.339 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-18T16:18:34.367 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-18T16:18:34.406 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-18T16:18:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-urllib3. 2024-02-18T16:18:34.673 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-18T16:18:34.713 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-18T16:18:34.850 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-18T16:18:34.878 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-18T16:18:34.917 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-18T16:18:35.042 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests. 2024-02-18T16:18:35.069 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-18T16:18:35.108 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-18T16:18:35.203 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pastescript. 2024-02-18T16:18:35.231 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-18T16:18:35.269 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-18T16:18:35.411 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-18T16:18:35.427 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-18T16:18:35.469 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-18T16:18:35.606 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pluggy. 2024-02-18T16:18:35.634 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-18T16:18:35.689 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-18T16:18:35.748 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-18T16:18:35.774 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:35.806 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:35.968 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-psutil. 2024-02-18T16:18:35.995 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-18T16:18:36.025 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-18T16:18:36.219 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-18T16:18:36.246 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:36.362 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-py. 2024-02-18T16:18:36.385 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:36.389 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-18T16:18:36.428 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-18T16:18:36.672 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-18T16:18:36.698 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-18T16:18:36.723 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pygments. 2024-02-18T16:18:36.738 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-18T16:18:36.739 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-18T16:18:36.781 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-18T16:18:37.017 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-openssl. 2024-02-18T16:18:37.043 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-18T16:18:37.084 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-18T16:18:37.194 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-18T16:18:37.222 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-18T16:18:37.252 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-18T16:18:37.453 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr. 2024-02-18T16:18:37.479 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:37.519 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:37.563 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-toml. 2024-02-18T16:18:37.591 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-18T16:18:37.629 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-18T16:18:37.932 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pytest. 2024-02-18T16:18:37.939 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mon. 2024-02-18T16:18:37.959 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-18T16:18:37.966 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:37.998 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-18T16:18:38.006 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mon (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:38.369 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-simplejson. 2024-02-18T16:18:38.397 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-18T16:18:38.435 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-18T16:18:38.543 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-osd. 2024-02-18T16:18:38.570 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:38.609 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-osd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:38.704 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-18T16:18:38.720 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-18T16:18:38.763 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-18T16:18:39.458 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package radosgw. 2024-02-18T16:18:39.486 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../116-radosgw_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:39.524 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking radosgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:39.654 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph. 2024-02-18T16:18:39.681 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../066-ceph_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:40.049 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-fuse. 2024-02-18T16:18:40.076 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:40.115 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:40.319 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package rbd-fuse. 2024-02-18T16:18:40.335 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:40.378 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking rbd-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:40.444 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mds. 2024-02-18T16:18:40.470 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:40.501 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mds (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:40.699 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-18T16:18:40.913 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package cephadm. 2024-02-18T16:18:40.940 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../069-cephadm_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:40.940 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-18T16:18:40.979 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:41.050 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-18T16:18:41.299 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-18T16:18:41.326 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-18T16:18:41.327 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-18T16:18:41.365 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-18T16:18:41.660 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-18T16:18:41.661 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-18T16:18:41.676 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-18T16:18:41.718 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-18T16:18:42.075 INFO:teuthology.orchestra.run.smithi129.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-18T16:18:42.143 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:42.662 INFO:teuthology.orchestra.run.smithi129.stdout:Adding system user cephadm....done 2024-02-18T16:18:42.724 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-babel. 2024-02-18T16:18:42.751 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-18T16:18:42.782 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-18T16:18:42.825 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-18T16:18:43.085 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jinja2. 2024-02-18T16:18:43.100 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-18T16:18:43.118 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-18T16:18:43.134 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-18T16:18:43.361 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-18T16:18:43.439 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-18T16:18:43.465 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:43.470 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-18T16:18:43.496 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:43.713 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-18T16:18:43.774 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-18T16:18:43.790 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-18T16:18:43.833 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-18T16:18:44.006 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-18T16:18:44.131 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-18T16:18:44.135 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-routes. 2024-02-18T16:18:44.162 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-18T16:18:44.202 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-18T16:18:44.424 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-18T16:18:44.564 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-18T16:18:44.591 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:44.630 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:44.777 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-18T16:18:45.020 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-18T16:18:45.059 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-18T16:18:45.074 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-18T16:18:45.117 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-18T16:18:45.287 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-18T16:18:45.547 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-18T16:18:45.562 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-joblib. 2024-02-18T16:18:45.578 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-18T16:18:45.612 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-18T16:18:45.823 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-18T16:18:45.974 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-18T16:18:46.001 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-18T16:18:46.040 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-18T16:18:46.083 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-18T16:18:46.327 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn. 2024-02-18T16:18:46.333 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-argparse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:46.353 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-18T16:18:46.393 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-18T16:18:46.610 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-18T16:18:46.736 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-18T16:18:46.862 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-18T16:18:46.988 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-18T16:18:47.227 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-18T16:18:47.239 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-18T16:18:47.243 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:47.371 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:47.600 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-18T16:18:47.636 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-18T16:18:47.700 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-18T16:18:47.826 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-18T16:18:48.169 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-18T16:18:48.312 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-18T16:18:48.349 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cachetools. 2024-02-18T16:18:48.365 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-18T16:18:48.407 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-18T16:18:48.571 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-18T16:18:48.710 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-18T16:18:48.738 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-18T16:18:48.777 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-18T16:18:48.830 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-18T16:18:49.083 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-18T16:18:49.110 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-18T16:18:49.149 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-18T16:18:49.415 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up zip (3.0-12build2) ... 2024-02-18T16:18:49.435 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rsa. 2024-02-18T16:18:49.462 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-18T16:18:49.502 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-18T16:18:49.544 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-18T16:18:49.806 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-google-auth. 2024-02-18T16:18:49.833 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-18T16:18:49.872 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-18T16:18:50.201 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-18T16:18:50.228 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-18T16:18:50.236 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-18T16:18:50.267 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-18T16:18:50.488 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-18T16:18:50.520 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-websocket. 2024-02-18T16:18:50.536 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-18T16:18:50.570 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-18T16:18:50.614 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-18T16:18:50.739 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-18T16:18:50.840 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-18T16:18:50.856 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-18T16:18:50.898 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-18T16:18:51.024 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-18T16:18:51.391 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-18T16:18:51.479 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-18T16:18:51.494 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:51.555 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:51.642 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-18T16:18:51.882 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-18T16:18:51.909 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-18T16:18:51.948 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-18T16:18:52.002 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-18T16:18:52.285 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-18T16:18:52.295 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-18T16:18:52.312 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-18T16:18:52.351 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-18T16:18:52.587 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package jq. 2024-02-18T16:18:52.603 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-18T16:18:52.637 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-18T16:18:52.638 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-18T16:18:52.865 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package socat. 2024-02-18T16:18:52.892 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-18T16:18:52.906 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-18T16:18:52.931 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-18T16:18:53.032 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:53.235 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package xmlstarlet. 2024-02-18T16:18:53.262 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-18T16:18:53.301 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-18T16:18:53.333 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-idna (3.3-1) ... 2024-02-18T16:18:53.622 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-test. 2024-02-18T16:18:53.638 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:53.659 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-18T16:18:53.672 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-test (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:54.789 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-18T16:18:55.008 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:18:55.133 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-18T16:18:55.393 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-18T16:18:55.519 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-18T16:18:55.653 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-18T16:18:55.860 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-volume. 2024-02-18T16:18:55.887 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1520-g02db01d0-1jammy_all.deb ... 2024-02-18T16:18:55.926 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-volume (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:55.955 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-18T16:18:56.222 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-18T16:18:56.238 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:18:56.239 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-18T16:18:56.280 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs-dev (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:18:56.482 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:18:56.599 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-18T16:18:56.608 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-18T16:18:56.636 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-18T16:18:56.675 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-18T16:18:56.884 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-18T16:18:56.988 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-18T16:18:57.016 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-18T16:18:57.054 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-18T16:18:57.118 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-18T16:18:57.378 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-18T16:18:57.620 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-18T16:18:57.633 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package nvme-cli. 2024-02-18T16:18:57.661 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-18T16:18:57.700 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-18T16:18:57.880 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-18T16:18:58.080 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package pkg-config. 2024-02-18T16:18:58.107 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-18T16:18:58.138 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-18T16:18:58.147 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-18T16:18:58.290 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-18T16:18:58.391 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-18T16:18:58.407 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-18T16:18:58.449 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-18T16:18:58.557 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-18T16:18:58.683 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-18T16:18:58.861 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-18T16:18:58.876 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-18T16:18:58.919 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-18T16:18:58.968 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-18T16:18:59.222 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastescript. 2024-02-18T16:18:59.249 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-18T16:18:59.252 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-18T16:18:59.288 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-18T16:18:59.495 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-18T16:18:59.617 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pluggy. 2024-02-18T16:18:59.644 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-18T16:18:59.654 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-18T16:18:59.683 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-18T16:18:59.780 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-18T16:18:59.869 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-18T16:18:59.995 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-psutil. 2024-02-18T16:19:00.022 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-18T16:19:00.061 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-18T16:19:00.115 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-18T16:19:00.241 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-18T16:19:00.398 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-py. 2024-02-18T16:19:00.425 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-18T16:19:00.472 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-18T16:19:00.626 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-18T16:19:00.801 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pygments. 2024-02-18T16:19:00.829 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-18T16:19:00.867 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-18T16:19:00.868 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-18T16:19:00.995 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-18T16:19:01.254 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:19:01.313 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-18T16:19:01.329 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-18T16:19:01.363 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-18T16:19:01.380 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-18T16:19:01.650 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-toml. 2024-02-18T16:19:01.677 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-18T16:19:01.714 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-18T16:19:01.716 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-18T16:19:02.015 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-18T16:19:02.019 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pytest. 2024-02-18T16:19:02.047 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-18T16:19:02.085 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-18T16:19:02.275 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-18T16:19:02.397 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplejson. 2024-02-18T16:19:02.400 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-18T16:19:02.425 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-18T16:19:02.464 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-18T16:19:02.660 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-18T16:19:02.725 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-18T16:19:02.745 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-18T16:19:02.783 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-18T16:19:02.928 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-18T16:19:03.256 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-18T16:19:03.488 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package radosgw. 2024-02-18T16:19:03.515 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../116-radosgw_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:19:03.546 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking radosgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:03.641 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-18T16:19:03.917 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-18T16:19:04.261 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-18T16:19:04.315 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package rbd-fuse. 2024-02-18T16:19:04.331 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1520-g02db01d0-1jammy_amd64.deb ... 2024-02-18T16:19:04.373 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking rbd-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:04.387 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librados2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:04.513 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:04.639 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-18T16:19:04.661 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-18T16:19:04.912 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-18T16:19:05.000 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:05.038 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-18T16:19:05.120 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libradosstriper1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:05.219 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-18T16:19:05.295 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-18T16:19:05.495 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librbd1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:05.622 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-modules-core (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:05.643 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-18T16:19:05.748 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:05.961 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-18T16:19:05.961 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-18T16:19:06.082 INFO:teuthology.orchestra.run.smithi080.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-18T16:19:06.157 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:06.457 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs-dev (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:06.558 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rados (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:06.666 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user cephadm....done 2024-02-18T16:19:06.675 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librgw2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:06.801 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-18T16:19:06.804 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-18T16:19:07.081 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-18T16:19:07.374 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-18T16:19:07.500 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-18T16:19:07.742 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-18T16:19:07.947 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rbd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:07.977 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-18T16:19:08.073 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up rbd-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:08.095 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-18T16:19:08.199 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:08.324 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cephfs (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:08.405 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-18T16:19:08.450 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:08.766 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-18T16:19:08.943 INFO:teuthology.orchestra.run.smithi129.stdout:Adding group ceph....done 2024-02-18T16:19:09.025 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-18T16:19:09.285 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-18T16:19:09.319 INFO:teuthology.orchestra.run.smithi129.stdout:Adding system user ceph....done 2024-02-18T16:19:09.515 INFO:teuthology.orchestra.run.smithi129.stdout:Setting system user ceph properties....done 2024-02-18T16:19:09.530 INFO:teuthology.orchestra.run.smithi129.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-18T16:19:09.561 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-18T16:19:09.664 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-18T16:19:09.812 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-18T16:19:09.962 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-18T16:19:10.071 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-18T16:19:10.306 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-argparse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:10.443 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-test (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:10.552 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up radosgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:10.591 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-18T16:19:10.717 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-18T16:19:10.843 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-18T16:19:10.969 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-18T16:19:11.044 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-18T16:19:11.044 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-18T16:19:11.228 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-18T16:19:11.496 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-base (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:11.650 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-18T16:19:11.675 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-18T16:19:11.731 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-18T16:19:11.845 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-18T16:19:11.857 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-18T16:19:12.209 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-18T16:19:12.310 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-18T16:19:12.330 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mds (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:12.564 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-18T16:19:12.565 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-18T16:19:12.569 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-18T16:19:12.837 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-18T16:19:13.049 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:13.146 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up zip (3.0-12build2) ... 2024-02-18T16:19:13.262 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-18T16:19:13.263 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-18T16:19:13.272 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-18T16:19:13.734 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-osd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:13.925 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-18T16:19:13.999 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-18T16:19:13.999 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-18T16:19:14.159 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-18T16:19:14.260 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-18T16:19:14.378 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-18T16:19:14.502 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:14.636 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:14.670 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-18T16:19:14.787 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mon (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:15.000 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-18T16:19:15.000 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-18T16:19:15.055 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-18T16:19:15.315 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-18T16:19:15.472 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:15.614 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:15.658 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-18T16:19:15.724 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-dashboard (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:15.866 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-volume (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:15.926 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-18T16:19:16.219 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-18T16:19:16.269 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-18T16:19:16.328 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-18T16:19:16.489 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-18T16:19:16.520 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-18T16:19:16.663 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:16.956 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-idna (3.3-1) ... 2024-02-18T16:19:17.266 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-18T16:19:17.581 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-18T16:19:18.224 INFO:teuthology.orchestra.run.smithi129.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-18T16:19:18.228 DEBUG:teuthology.parallel:result is None 2024-02-18T16:19:18.446 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-18T16:19:18.707 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:19:18.816 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-18T16:19:19.059 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-18T16:19:19.160 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-18T16:19:19.286 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-18T16:19:19.587 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-18T16:19:19.847 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-18T16:19:20.098 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:19:20.199 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-18T16:19:20.518 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-18T16:19:20.769 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-18T16:19:21.028 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-18T16:19:21.288 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-18T16:19:21.538 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-18T16:19:21.790 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-18T16:19:21.916 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-18T16:19:22.175 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-18T16:19:22.302 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-18T16:19:22.578 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-18T16:19:22.879 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-18T16:19:23.138 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-18T16:19:23.273 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-18T16:19:23.399 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-18T16:19:23.480 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-18T16:19:23.717 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-18T16:19:23.877 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-18T16:19:24.262 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-18T16:19:24.521 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-18T16:19:24.647 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-18T16:19:24.907 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-18T16:19:25.016 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-18T16:19:25.326 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-18T16:19:25.627 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-18T16:19:25.903 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-18T16:19:26.029 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-18T16:19:26.297 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-18T16:19:26.557 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-18T16:19:26.877 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-18T16:19:27.262 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-18T16:19:27.588 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-18T16:19:27.958 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-18T16:19:28.059 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librados2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:28.160 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:28.286 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-18T16:19:28.631 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:28.757 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libradosstriper1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:28.875 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-18T16:19:29.143 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librbd1 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:29.269 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-modules-core (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:29.395 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:29.607 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-18T16:19:29.607 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-18T16:19:30.113 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs-dev (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:30.248 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rados (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:30.357 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librgw2 (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:30.458 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-18T16:19:31.603 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rbd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:31.729 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up rbd-fuse (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:31.839 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:31.940 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cephfs (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:32.041 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-common (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:32.584 INFO:teuthology.orchestra.run.smithi080.stdout:Adding group ceph....done 2024-02-18T16:19:32.969 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user ceph....done 2024-02-18T16:19:33.112 INFO:teuthology.orchestra.run.smithi080.stdout:Setting system user ceph properties....done 2024-02-18T16:19:33.127 INFO:teuthology.orchestra.run.smithi080.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-18T16:19:33.261 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-18T16:19:33.549 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-18T16:19:34.296 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-test (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:34.422 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up radosgw (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:34.882 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-18T16:19:34.882 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-18T16:19:35.349 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-base (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:35.704 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-18T16:19:36.210 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mds (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:36.436 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-18T16:19:36.436 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-18T16:19:36.944 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:37.163 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-18T16:19:37.164 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-18T16:19:37.671 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-osd (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:37.934 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-18T16:19:37.934 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-18T16:19:38.425 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:38.550 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:38.702 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mon (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:38.922 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-18T16:19:38.922 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-18T16:19:39.578 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-cephadm (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:39.936 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:40.061 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-dashboard (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:40.213 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-volume (19.0.0-1520-g02db01d0-1jammy) ... 2024-02-18T16:19:40.558 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-18T16:19:40.667 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-18T16:19:40.811 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-18T16:19:41.921 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-18T16:19:42.588 INFO:teuthology.orchestra.run.smithi080.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-18T16:19:42.592 DEBUG:teuthology.parallel:result is None 2024-02-18T16:19:42.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=02db01d0a75058abf10a307d548d1e1e71b47eeb 2024-02-18T16:20:15.107 DEBUG:teuthology.orchestra.run.smithi080:> dpkg-query -W -f '${Version}' ceph 2024-02-18T16:20:15.127 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:20:15.128 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:20:15.128 INFO:teuthology.task.install:The correct ceph version 19.0.0-1520-g02db01d0-1jammy is installed. 2024-02-18T16:20:15.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=02db01d0a75058abf10a307d548d1e1e71b47eeb 2024-02-18T16:20:15.346 DEBUG:teuthology.orchestra.run.smithi129:> dpkg-query -W -f '${Version}' ceph 2024-02-18T16:20:15.427 INFO:teuthology.orchestra.run.smithi129.stdout:19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:20:15.427 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1520-g02db01d0-1jammy 2024-02-18T16:20:15.427 INFO:teuthology.task.install:The correct ceph version 19.0.0-1520-g02db01d0-1jammy is installed. 2024-02-18T16:20:15.429 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-18T16:20:15.429 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:15.430 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-18T16:20:15.444 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:15.445 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-18T16:20:15.483 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-18T16:20:15.483 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:15.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-02-18T16:20:15.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-18T16:20:15.556 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:15.556 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-02-18T16:20:15.569 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-18T16:20:15.622 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-18T16:20:15.622 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:15.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-18T16:20:15.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-18T16:20:15.693 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:15.693 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-18T16:20:15.706 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-18T16:20:15.761 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-18T16:20:15.761 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:15.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-02-18T16:20:15.774 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-18T16:20:15.829 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:15.829 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-02-18T16:20:15.841 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-18T16:20:15.894 INFO:teuthology.run_tasks:Running task ceph... 2024-02-18T16:20:15.979 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-18T16:20:15.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-02-18T16:20:15.982 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-02-18T16:20:15.994 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-18T16:20:15.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-18T16:20:16.039 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-18T16:20:16.051 INFO:tasks.ceph:Creating extra log directories... 2024-02-18T16:20:16.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-18T16:20:16.094 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-18T16:20:16.115 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-18T16:20:16.115 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-18T16:20:16.115 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752', 'branch': 'wip-64173', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7562752', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-64173'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-64173', 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 0, 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-64173', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_02db01d0a75058abf10a307d548d1e1e71b47eeb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb', 'targets': {'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEKfYAOznc3GwJnU4o9Ae1ngD7K1yZIn11qCR78NNpvD3Cmo2ued9PUzr2WArEK1gseXqPIB+0Rkw+2wwO1vcw=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArFJcbYpAUM4WaXDGxHpbZSgmfY43t/QQEZrjLs80RLZPVb5XM/llYH5uonBXZPDZdxSENiFJHLu9v/4Fiq8ZQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '02db01d0a75058abf10a307d548d1e1e71b47eeb', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-16_18:38:34', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-18T16:20:16.116 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-18T16:20:16.151 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-18T16:20:16.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-02-18T16:20:16.199 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-02-18T16:20:16.212 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:16.212 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-02-18T16:20:16.257 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-18T16:20:16.257 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-02-18T16:20:16.305 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-18T16:20:16.305 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:16.305 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-02-18T16:20:16.305 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:16.305 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-18 16:14:09.785723700 +0000 2024-02-18T16:20:16.306 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-18 16:14:09.533725948 +0000 2024-02-18T16:20:16.306 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-18 16:14:09.533725948 +0000 2024-02-18T16:20:16.306 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-18T16:20:16.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-18T16:20:16.359 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-18T16:20:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-18T16:20:16.360 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000321196 s, 1.6 MB/s 2024-02-18T16:20:16.361 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-18T16:20:16.411 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-02-18T16:20:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-18T16:20:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:16.457 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-02-18T16:20:16.457 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:16.457 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-18 16:14:10.293719168 +0000 2024-02-18T16:20:16.457 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-18 16:14:10.021721594 +0000 2024-02-18T16:20:16.458 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-18 16:14:10.021721594 +0000 2024-02-18T16:20:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-18T16:20:16.458 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-18T16:20:16.511 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-18T16:20:16.511 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-18T16:20:16.511 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000434413 s, 1.2 MB/s 2024-02-18T16:20:16.513 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-18T16:20:16.562 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-02-18T16:20:16.609 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-18 16:14:10.769714922 +0000 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-18 16:14:10.525717099 +0000 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-18 16:14:10.525717099 +0000 2024-02-18T16:20:16.610 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-18T16:20:16.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-18T16:20:16.664 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-18T16:20:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-18T16:20:16.665 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000416683 s, 1.2 MB/s 2024-02-18T16:20:16.666 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-18T16:20:16.715 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-02-18T16:20:16.762 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-18T16:20:16.762 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:16.762 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-02-18T16:20:16.762 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:16.763 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-18 16:14:11.241710711 +0000 2024-02-18T16:20:16.763 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-18 16:14:10.989712960 +0000 2024-02-18T16:20:16.763 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-18 16:14:10.989712960 +0000 2024-02-18T16:20:16.763 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-18T16:20:16.763 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-18T16:20:16.816 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-18T16:20:16.816 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-18T16:20:16.816 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000401647 s, 1.3 MB/s 2024-02-18T16:20:16.817 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-18T16:20:16.866 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-18T16:20:16.867 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:16.867 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-02-18T16:20:16.873 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-18T16:20:16.873 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-02-18T16:20:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-18T16:20:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:16.920 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-02-18T16:20:16.920 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:16.920 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-02-18 16:14:09.272707640 +0000 2024-02-18T16:20:16.921 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-02-18 16:14:08.988710175 +0000 2024-02-18T16:20:16.921 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-02-18 16:14:08.988710175 +0000 2024-02-18T16:20:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-02-18T16:20:16.921 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-18T16:20:16.973 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-02-18T16:20:16.973 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-02-18T16:20:16.973 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000376159 s, 1.4 MB/s 2024-02-18T16:20:16.974 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-18T16:20:17.024 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-02-18T16:20:17.070 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-18T16:20:17.070 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:17.071 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-02-18T16:20:17.071 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:17.071 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-02-18 16:14:09.736703502 +0000 2024-02-18T16:20:17.071 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-02-18 16:14:09.512705500 +0000 2024-02-18T16:20:17.071 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-02-18 16:14:09.512705500 +0000 2024-02-18T16:20:17.071 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-02-18T16:20:17.071 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-18T16:20:17.124 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-02-18T16:20:17.125 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-02-18T16:20:17.125 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.00044466 s, 1.2 MB/s 2024-02-18T16:20:17.126 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-18T16:20:17.176 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-02-18 16:14:10.240699006 +0000 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-02-18 16:14:09.980701325 +0000 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-02-18 16:14:09.980701325 +0000 2024-02-18T16:20:17.223 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-02-18T16:20:17.223 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-18T16:20:17.277 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-02-18T16:20:17.277 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-02-18T16:20:17.277 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000429823 s, 1.2 MB/s 2024-02-18T16:20:17.278 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-18T16:20:17.328 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-02-18T16:20:17.374 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-18T16:20:17.374 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T16:20:17.374 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-02-18T16:20:17.375 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T16:20:17.375 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-02-18 16:14:10.704694866 +0000 2024-02-18T16:20:17.375 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-02-18 16:14:10.476696900 +0000 2024-02-18T16:20:17.375 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-02-18 16:14:10.476696900 +0000 2024-02-18T16:20:17.375 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-02-18T16:20:17.375 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-18T16:20:17.428 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-02-18T16:20:17.429 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-02-18T16:20:17.429 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000381931 s, 1.3 MB/s 2024-02-18T16:20:17.432 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-18T16:20:17.479 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-18T16:20:17.480 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-18T16:20:17.480 INFO:tasks.ceph:Generating config... 2024-02-18T16:20:17.481 INFO:tasks.ceph:[client] debug ms = 1 2024-02-18T16:20:17.481 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-02-18T16:20:17.481 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-18T16:20:17.481 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-18T16:20:17.481 INFO:tasks.ceph:[client] setuser = ceph 2024-02-18T16:20:17.481 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-18T16:20:17.481 INFO:tasks.ceph:[osd] debug objclass = 20 2024-02-18T16:20:17.481 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-18T16:20:17.481 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-18T16:20:17.481 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-18T16:20:17.482 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-18T16:20:17.482 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-18T16:20:17.482 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-18T16:20:17.482 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-18T16:20:17.482 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-18T16:20:17.482 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-18T16:20:17.483 INFO:tasks.ceph:Setting up mon.a... 2024-02-18T16:20:17.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-18T16:20:17.517 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2024-02-18T16:20:17.530 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-18T16:20:17.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T16:20:17.665 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80')] 2024-02-18T16:20:17.665 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.80'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-02-18T16:20:17.666 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:17.666 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-18T16:20:17.713 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.80 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:17.792 INFO:teuthology.orchestra.run.smithi080.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:20:17.792 INFO:teuthology.orchestra.run.smithi080.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid ac02793c-3733-4042-8a10-93627d56bc80 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = quincy 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:fsid ac02793c-3733-4042-8a10-93627d56bc80 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2024-02-18T16:20:17.790744+0000 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-02-18T16:20:17.790744+0000 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 17 (quincy) 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:election_strategy: 1 2024-02-18T16:20:17.793 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-02-18T16:20:17.794 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-02-18T16:20:17.795 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-18T16:20:17.843 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ac02793c-3733-4042-8a10-93627d56bc80... 2024-02-18T16:20:17.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-18T16:20:17.887 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-18T16:20:17.916 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-02-18T16:20:17.916 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-02-18T16:20:17.916 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-18T16:20:17.916 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-02-18T16:20:17.916 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.916 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-18T16:20:17.917 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.918 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = 172.21.15.80 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = ac02793c-3733-4042-8a10-93627d56bc80 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-02-18T16:20:17.919 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.920 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.921 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug objclass = 20 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: bdev async discard = True 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: bdev enable discard = True 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore allocator = bitmap 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 1/20 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 1/20 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 4/10 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-02-18T16:20:17.922 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-02-18T16:20:17.923 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-18T16:20:17.924 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-02-18T16:20:17.925 INFO:teuthology.orchestra.run.smithi080.stdout: rgw gc obj min wait = 15 2024-02-18T16:20:17.926 INFO:teuthology.orchestra.run.smithi080.stdout: debug rgw = 20 2024-02-18T16:20:17.926 INFO:teuthology.orchestra.run.smithi080.stdout: setgroup = ceph 2024-02-18T16:20:17.926 INFO:teuthology.orchestra.run.smithi080.stdout: setuser = ceph 2024-02-18T16:20:17.926 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-02-18T16:20:17.927 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-02-18T16:20:17.927 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-02-18T16:20:17.927 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-02-18T16:20:17.928 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-02-18T16:20:17.929 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-02-18T16:20:17.930 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = 172.21.15.80 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = ac02793c-3733-4042-8a10-93627d56bc80 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-02-18T16:20:17.931 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug trim objects = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.932 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: debug objclass = 20 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore allocator = bitmap 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-02-18T16:20:17.933 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-02-18T16:20:17.934 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-02-18T16:20:17.935 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: rgw gc obj min wait = 15 2024-02-18T16:20:17.936 INFO:teuthology.orchestra.run.smithi129.stdout: debug rgw = 20 2024-02-18T16:20:17.937 INFO:teuthology.orchestra.run.smithi129.stdout: setgroup = ceph 2024-02-18T16:20:17.937 INFO:teuthology.orchestra.run.smithi129.stdout: setuser = ceph 2024-02-18T16:20:17.937 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-02-18T16:20:17.937 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-18T16:20:17.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-18T16:20:18.018 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-18T16:20:18.018 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:18.018 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-18T16:20:18.023 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:18.024 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-18T16:20:18.069 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-02-18T16:20:18.069 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:18.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-18T16:20:18.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T16:20:18.132 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:18.133 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:18.181 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:20:18.181 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:18.181 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-18T16:20:18.181 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T16:20:18.205 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:18.205 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:18.251 INFO:tasks.ceph:Setting up mon nodes... 2024-02-18T16:20:18.251 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-18T16:20:18.251 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-18T16:20:18.335 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-18T16:20:18.346 INFO:tasks.ceph:Setting up mds nodes... 2024-02-18T16:20:18.346 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-18T16:20:18.346 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-18T16:20:18.421 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-18T16:20:18.432 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-18T16:20:18.432 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-18T16:20:18.432 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-18T16:20:18.446 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-18T16:20:18.446 INFO:tasks.ceph:role: osd.0 2024-02-18T16:20:18.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-02-18T16:20:18.446 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-18T16:20:18.508 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T16:20:18.509 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T16:20:18.964 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-02-18T16:20:18.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-02-18T16:20:18.966 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-18T16:20:19.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-18T16:20:19.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:20:19.071 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-02-18T16:20:19.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:19.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:19.169+0000 7f7d5988e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-18T16:20:19.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:19.169+0000 7f7d5988e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-18T16:20:19.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:19.169+0000 7f7d5988e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-18T16:20:19.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:19.169+0000 7f7d5988e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-18T16:20:19.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:19.169+0000 7f7d5988e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-18T16:20:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:19.173+0000 7f7d5988e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-18T16:20:22.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-18T16:20:22.166 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-18T16:20:22.180 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-18T16:20:22.180 INFO:tasks.ceph:role: osd.1 2024-02-18T16:20:22.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:20:22.180 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-18T16:20:22.241 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T16:20:22.242 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T16:20:22.690 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-02-18T16:20:22.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-02-18T16:20:22.692 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-18T16:20:22.781 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-18T16:20:22.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:20:22.792 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2024-02-18T16:20:22.792 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-18T16:20:22.844 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-18T16:20:22.844 INFO:tasks.ceph:role: osd.2 2024-02-18T16:20:22.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:20:22.844 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T16:20:22.907 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-18T16:20:22.908 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T16:20:22.908 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T16:20:23.372 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-02-18T16:20:23.374 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-02-18T16:20:23.374 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-02-18T16:20:23.537 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-18T16:20:23.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:20:23.549 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2024-02-18T16:20:23.549 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-18T16:20:23.602 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-18T16:20:23.602 INFO:tasks.ceph:role: osd.3 2024-02-18T16:20:23.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:20:23.602 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-18T16:20:23.666 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T16:20:23.667 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T16:20:24.148 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-02-18T16:20:24.150 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-02-18T16:20:24.150 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-02-18T16:20:24.304 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-18T16:20:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2024-02-18T16:20:24.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:20:24.315 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:24.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:24.523+0000 7f08762227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-18T16:20:24.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:24.523+0000 7f08762227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-18T16:20:24.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:24.523+0000 7f08762227c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-18T16:20:24.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:24.523+0000 7f08762227c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-18T16:20:24.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:24.523+0000 7f08762227c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-18T16:20:24.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:24.523+0000 7f08762227c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-18T16:20:27.547 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-18T16:20:27.561 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:27.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:27.631+0000 7faca09137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-18T16:20:27.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:27.631+0000 7faca09137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-18T16:20:27.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:27.631+0000 7faca09137c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-18T16:20:27.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:27.631+0000 7faca09137c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-18T16:20:27.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:27.631+0000 7faca09137c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-18T16:20:27.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:27.631+0000 7faca09137c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-18T16:20:30.635 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-18T16:20:30.696 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:30.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:30.766+0000 7fae5d6c87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-18T16:20:30.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:30.766+0000 7fae5d6c87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-18T16:20:30.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:30.766+0000 7fae5d6c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-18T16:20:30.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:30.766+0000 7fae5d6c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-18T16:20:30.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:30.766+0000 7fae5d6c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-18T16:20:30.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:30.770+0000 7fae5d6c87c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-18T16:20:33.762 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-18T16:20:33.824 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-18T16:20:33.825 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:33.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-18T16:20:33.839 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:33.839 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-18T16:20:33.877 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:33.877 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-18T16:20:33.934 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:33.934 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-18T16:20:33.990 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:33.991 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-18T16:20:34.046 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:34.046 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-18T16:20:34.094 INFO:tasks.ceph:Adding keys to all mons... 2024-02-18T16:20:34.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBDLtJlG88zChAArLjjdHDob+jpK1ynIDWKEw== 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBCLtJlR5LBExAApDDknrtc5qsqMwx1xvnkdQ== 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBILtJlj/RvHxAAGHJN5HJIxBqiSymLi64fvw== 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-02-18T16:20:34.106 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBLLtJlJUDtJRAAbdoU6qNd65JxcxvQuwDwAQ== 2024-02-18T16:20:34.107 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-02-18T16:20:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBOLtJlggQSLhAAnA8DrcJZECwuAB9/vh43kg== 2024-02-18T16:20:34.107 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-02-18T16:20:34.107 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQBCLtJlFnTlGBAA81Rof2dESzzs8i0/2NVCZw== 2024-02-18T16:20:34.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T16:20:34.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-18T16:20:34.234 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T16:20:34.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T16:20:34.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T16:20:34.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-18T16:20:34.571 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-18T16:20:34.572 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-18T16:20:34.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-18T16:20:34.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-18T16:20:34.723 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-18T16:20:34.768 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-18T16:20:34.769 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-18T16:20:34.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-18T16:20:34.814 INFO:tasks.ceph.mon.a:Started 2024-02-18T16:20:34.814 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-18T16:20:34.814 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-18T16:20:34.814 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-18T16:20:34.817 INFO:tasks.ceph.mgr.x:Started 2024-02-18T16:20:34.817 INFO:tasks.ceph:Setting crush tunables to default 2024-02-18T16:20:34.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.928+0000 7ff084387640 1 Processor -- start 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.928+0000 7ff084387640 1 -- start start 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff084387640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 0x7ff07c133580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff084387640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c073250 con 0x7ff07c098910 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff084387640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c096da0 con 0x7ff07c099400 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff081922640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 0x7ff07c133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff082123640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff07c098910 0x7ff07c098cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59870/0 (socket says 172.21.15.80:59870) 2024-02-18T16:20:34.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff082123640 1 -- 172.21.15.80:0/765269139 learned_addr learned my addr 172.21.15.80:0/765269139 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff081922640 1 -- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 msgr2=0x7ff07c133580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-18T16:20:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff081922640 1 -- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 msgr2=0x7ff07c133580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-18T16:20:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff081922640 1 --2- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 0x7ff07c133580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-18T16:20:34.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.932+0000 7ff081922640 1 --2- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 0x7ff07c133580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667352958 0 0) 0x7ff07c073250 con 0x7ff07c098910 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff068003530 con 0x7ff07c098910 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316773554 0 0) 0x7ff068003530 con 0x7ff07c098910 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 msgr2=0x7ff07c133580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 --2- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 0x7ff07c133580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c099ee0 con 0x7ff07c098910 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4147525989 0 0) 0x7ff0780015b0 con 0x7ff07c098910 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 >> v1:172.21.15.80:6789/0 conn(0x7ff07c098910 legacy=0x7ff07c098cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 --2- 172.21.15.80:0/765269139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff068003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c096da0 con 0x7ff0680039b0 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff082123640 1 --2- 172.21.15.80:0/765269139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff068003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:34.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.940+0000 7ff082123640 1 -- 172.21.15.80:0/765269139 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068003530 con 0x7ff0680039b0 2024-02-18T16:20:34.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.952+0000 7ff082123640 1 --2- 172.21.15.80:0/765269139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff068003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff078007fb0 tx=0x7ff07801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7e3fb5a31bab29 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:34.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.952+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0780a5a80 con 0x7ff0680039b0 2024-02-18T16:20:34.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.952+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0780a5be0 con 0x7ff0680039b0 2024-02-18T16:20:34.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.952+0000 7ff081121640 1 -- 172.21.15.80:0/765269139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0780058e0 con 0x7ff0680039b0 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.952+0000 7ff084387640 1 -- 172.21.15.80:0/765269139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 msgr2=0x7ff068003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.952+0000 7ff084387640 1 --2- 172.21.15.80:0/765269139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff068003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff078007fb0 tx=0x7ff07801cbd0 comp rx=0 tx=0).stop 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/765269139 shutdown_connections 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 --2- 172.21.15.80:0/765269139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff068003db0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 --2- 172.21.15.80:0/765269139 >> v2:172.21.15.80:3300/0 conn(0x7ff07c099400 0x7ff07c133580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/765269139 >> 172.21.15.80:0/765269139 conn(0x7ff07c09e900 msgr2=0x7ff07c09ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/765269139 shutdown_connections 2024-02-18T16:20:34.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/765269139 wait complete. 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 Processor -- start 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- start start 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff07c093230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c095ef0 con 0x7ff0680039b0 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff082123640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff07c093230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff082123640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff07c093230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55292/0 (socket says 172.21.15.80:55292) 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff082123640 1 -- 172.21.15.80:0/150991226 learned_addr learned my addr 172.21.15.80:0/150991226 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff082123640 1 -- 172.21.15.80:0/150991226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c094a40 con 0x7ff0680039b0 2024-02-18T16:20:34.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff082123640 1 --2- 172.21.15.80:0/150991226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff07c093230 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff078007fb0 tx=0x7ff068005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0780a5a80 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078001440 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c095120 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0780070c0 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c093770 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff0780a5d50 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff0780b8740 con 0x7ff0680039b0 2024-02-18T16:20:34.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.956+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c095d40 con 0x7ff0680039b0 2024-02-18T16:20:34.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:34.960+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff078007c50 con 0x7ff0680039b0 2024-02-18T16:20:35.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff07c062860 con 0x7ff0680039b0 2024-02-18T16:20:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff072ffd640 1 -- 172.21.15.80:0/150991226 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff0780076c0 con 0x7ff0680039b0 2024-02-18T16:20:35.031 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-02-18T16:20:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 msgr2=0x7ff07c093230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 --2- 172.21.15.80:0/150991226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff07c093230 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff078007fb0 tx=0x7ff068005800 comp rx=0 tx=0).stop 2024-02-18T16:20:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 shutdown_connections 2024-02-18T16:20:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 --2- 172.21.15.80:0/150991226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0680039b0 0x7ff07c093230 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 >> 172.21.15.80:0/150991226 conn(0x7ff07c09e900 msgr2=0x7ff07c06f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 shutdown_connections 2024-02-18T16:20:35.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:35.024+0000 7ff084387640 1 -- 172.21.15.80:0/150991226 wait complete. 2024-02-18T16:20:35.049 INFO:tasks.ceph:check_enable_crimson: False 2024-02-18T16:20:35.049 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-18T16:20:35.049 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-18T16:20:35.049 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-18T16:20:35.058 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:35.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-18T16:20:35.071 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:35.071 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-18T16:20:35.126 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-02-18T16:20:35.126 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-18T16:20:35.185 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 77a1e3d7-2624-4145-98ac-6a2032a27533 0 2024-02-18T16:20:35.260 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:35.250+0000 7f5d051e4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7fade04e9640 1 Processor -- start 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7fade04e9640 1 -- start start 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7fade04e9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadd81167c0 0x7fadd8118bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7fade04e9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd81190f0 con 0x7fadd8112990 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7fade04e9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd811a2b0 con 0x7fadd81167c0 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7faddda84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadd81167c0 0x7fadd8118bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:35.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7faddda84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fadd81167c0 0x7fadd8118bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:33972/0 (socket says 172.21.15.129:33972) 2024-02-18T16:20:35.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7faddda84640 1 -- 172.21.15.129:0/2176057780 learned_addr learned my addr 172.21.15.129:0/2176057780 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:35.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7faddda84640 1 -- 172.21.15.129:0/2176057780 >> v1:172.21.15.80:6789/0 conn(0x7fadd8112990 legacy=0x7fadd8112d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.342+0000 7faddda84640 1 -- 172.21.15.129:0/2176057780 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd811a420 con 0x7fadd81167c0 2024-02-18T16:20:35.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7faddda84640 1 --2- 172.21.15.129:0/2176057780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd81167c0 0x7fadd8118bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006fd0 tx=0x7fadc801e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdefa29ea77f810b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:35.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7faddd283640 1 -- 172.21.15.129:0/2176057780 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc8004160 con 0x7fadd81167c0 2024-02-18T16:20:35.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7faddd283640 1 -- 172.21.15.129:0/2176057780 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80ab070 con 0x7fadd81167c0 2024-02-18T16:20:35.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7faddd283640 1 -- 172.21.15.129:0/2176057780 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc8004470 con 0x7fadd81167c0 2024-02-18T16:20:35.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 -- 172.21.15.129:0/2176057780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd81167c0 msgr2=0x7fadd8118bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 --2- 172.21.15.129:0/2176057780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd81167c0 0x7fadd8118bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fadc8006fd0 tx=0x7fadc801e970 comp rx=0 tx=0).stop 2024-02-18T16:20:35.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 -- 172.21.15.129:0/2176057780 shutdown_connections 2024-02-18T16:20:35.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 --2- 172.21.15.129:0/2176057780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd81167c0 0x7fadd8118bb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 -- 172.21.15.129:0/2176057780 >> 172.21.15.129:0/2176057780 conn(0x7fadd806ee90 msgr2=0x7fadd80712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 -- 172.21.15.129:0/2176057780 shutdown_connections 2024-02-18T16:20:35.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.346+0000 7fade04e9640 1 -- 172.21.15.129:0/2176057780 wait complete. 2024-02-18T16:20:35.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 Processor -- start 2024-02-18T16:20:35.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 -- start start 2024-02-18T16:20:35.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 0x7fadd81a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:35.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81a50b0 con 0x7fadd8112990 2024-02-18T16:20:35.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadde285640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 0x7fadd81a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:35.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadde285640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 0x7fadd81a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:33974/0 (socket says 172.21.15.129:33974) 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadde285640 1 -- 172.21.15.129:0/3517210791 learned_addr learned my addr 172.21.15.129:0/3517210791 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadde285640 1 -- 172.21.15.129:0/3517210791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc800b780 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadde285640 1 --2- 172.21.15.129:0/3517210791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 0x7fadd81a4b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadd400c3a0 tx=0x7fadd400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadd4005150 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd81a5310 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd40052b0 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadd40067e0 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd81a9400 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fadd4007030 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadd4003d60 con 0x7fadd8112990 2024-02-18T16:20:35.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.350+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8062860 con 0x7fadd8112990 2024-02-18T16:20:35.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.366+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fadd4006de0 con 0x7fadd8112990 2024-02-18T16:20:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.434+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "77a1e3d7-2624-4145-98ac-6a2032a27533", "id": 0} v 0) v1 -- 0x7fadd8067620 con 0x7fadd8112990 2024-02-18T16:20:35.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.434+0000 7fadceffd640 1 -- 172.21.15.129:0/3517210791 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77a1e3d7-2624-4145-98ac-6a2032a27533", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fadd40074c0 con 0x7fadd8112990 2024-02-18T16:20:35.446 INFO:teuthology.orchestra.run.smithi129.stdout:0 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 msgr2=0x7fadd81a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 --2- 172.21.15.129:0/3517210791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 0x7fadd81a4b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadd400c3a0 tx=0x7fadd400c860 comp rx=0 tx=0).stop 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 shutdown_connections 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 --2- 172.21.15.129:0/3517210791 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fadd8112990 0x7fadd81a4b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 >> 172.21.15.129:0/3517210791 conn(0x7fadd806ee90 msgr2=0x7fadd8114a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 shutdown_connections 2024-02-18T16:20:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.438+0000 7fade04e9640 1 -- 172.21.15.129:0/3517210791 wait complete. 2024-02-18T16:20:35.465 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new a80c19e3-9d70-47cd-9538-04c67607ba11 1 2024-02-18T16:20:35.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f3285a25640 1 Processor -- start 2024-02-18T16:20:35.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f3285a25640 1 -- start start 2024-02-18T16:20:35.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f3285a25640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f328006c760 0x7f328006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:35.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f3285a25640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328006d4e0 con 0x7f328006d080 2024-02-18T16:20:35.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f3285a25640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3280122370 con 0x7f328006c760 2024-02-18T16:20:35.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f327effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f328006c760 0x7f328006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:35.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f327e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f328006d080 0x7f328011fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:60814/0 (socket says 172.21.15.129:60814) 2024-02-18T16:20:35.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f327e7fc640 1 -- 172.21.15.129:0/3586409534 learned_addr learned my addr 172.21.15.129:0/3586409534 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:20:35.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f327effd640 1 -- 172.21.15.129:0/3586409534 >> v1:172.21.15.80:6789/0 conn(0x7f328006d080 legacy=0x7f328011fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.614+0000 7f327effd640 1 -- 172.21.15.129:0/3586409534 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32801224b0 con 0x7f328006c760 2024-02-18T16:20:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f327effd640 1 --2- 172.21.15.129:0/3586409534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f328006cb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3270009740 tx=0x7f327001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7c3e1043ae7e52 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f327dffb640 1 -- 172.21.15.129:0/3586409534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32700a8050 con 0x7f328006c760 2024-02-18T16:20:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f327dffb640 1 -- 172.21.15.129:0/3586409534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32700ac520 con 0x7f328006c760 2024-02-18T16:20:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f327dffb640 1 -- 172.21.15.129:0/3586409534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32700ac7e0 con 0x7f328006c760 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 -- 172.21.15.129:0/3586409534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 msgr2=0x7f328006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 --2- 172.21.15.129:0/3586409534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f328006cb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3270009740 tx=0x7f327001c370 comp rx=0 tx=0).stop 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 -- 172.21.15.129:0/3586409534 shutdown_connections 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 --2- 172.21.15.129:0/3586409534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f328006cb40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 -- 172.21.15.129:0/3586409534 >> 172.21.15.129:0/3586409534 conn(0x7f32800702e0 msgr2=0x7f3280072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 -- 172.21.15.129:0/3586409534 shutdown_connections 2024-02-18T16:20:35.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 -- 172.21.15.129:0/3586409534 wait complete. 2024-02-18T16:20:35.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 Processor -- start 2024-02-18T16:20:35.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.618+0000 7f3285a25640 1 -- start start 2024-02-18T16:20:35.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3285a25640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f32801acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:35.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3285a25640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801ad140 con 0x7f328006c760 2024-02-18T16:20:35.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f327effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f32801acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:35.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f327effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f32801acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:33998/0 (socket says 172.21.15.129:33998) 2024-02-18T16:20:35.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f327effd640 1 -- 172.21.15.129:0/369735959 learned_addr learned my addr 172.21.15.129:0/369735959 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f327effd640 1 -- 172.21.15.129:0/369735959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009420 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f327effd640 1 --2- 172.21.15.129:0/369735959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f32801acb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f32700af040 tx=0x7f327001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32700ab8d0 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32801ad340 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32700aba30 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32700abcd0 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32801b1460 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f32700b87e0 con 0x7f328006c760 2024-02-18T16:20:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f32700b6400 con 0x7f328006c760 2024-02-18T16:20:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.622+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280062860 con 0x7f328006c760 2024-02-18T16:20:35.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.630+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f32700dfdd0 con 0x7f328006c760 2024-02-18T16:20:35.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.698+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a80c19e3-9d70-47cd-9538-04c67607ba11", "id": 1} v 0) v1 -- 0x7f328006d080 con 0x7f328006c760 2024-02-18T16:20:35.709 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.698+0000 7f3277fff640 1 -- 172.21.15.129:0/369735959 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a80c19e3-9d70-47cd-9538-04c67607ba11", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f32700ce030 con 0x7f328006c760 2024-02-18T16:20:35.710 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 msgr2=0x7f32801acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 --2- 172.21.15.129:0/369735959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f32801acb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f32700af040 tx=0x7f327001abb0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 shutdown_connections 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 --2- 172.21.15.129:0/369735959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f328006c760 0x7f32801acb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 >> 172.21.15.129:0/369735959 conn(0x7f32800702e0 msgr2=0x7f328010f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 shutdown_connections 2024-02-18T16:20:35.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.702+0000 7f3285a25640 1 -- 172.21.15.129:0/369735959 wait complete. 2024-02-18T16:20:35.728 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 53707962-fe35-44e8-a5ea-08f8c69343ef 2 2024-02-18T16:20:35.788 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:35.778+0000 7f5d051e4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-18T16:20:35.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc222879640 1 Processor -- start 2024-02-18T16:20:35.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc222879640 1 -- start start 2024-02-18T16:20:35.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc222879640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc21c1180f0 0x7fc21c11a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:35.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc222879640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c11aab0 con 0x7fc21c115460 2024-02-18T16:20:35.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc222879640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c11bc50 con 0x7fc21c1180f0 2024-02-18T16:20:35.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc21b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc21c1180f0 0x7fc21c11a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:35.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc21bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc21c115460 0x7fc21c115840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:60816/0 (socket says 172.21.15.129:60816) 2024-02-18T16:20:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc21bfff640 1 -- 172.21.15.129:0/2384144895 learned_addr learned my addr 172.21.15.129:0/2384144895 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:20:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc21b7fe640 1 -- 172.21.15.129:0/2384144895 >> v1:172.21.15.80:6789/0 conn(0x7fc21c115460 legacy=0x7fc21c115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc21b7fe640 1 -- 172.21.15.129:0/2384144895 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c11bdc0 con 0x7fc21c1180f0 2024-02-18T16:20:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.834+0000 7fc21b7fe640 1 --2- 172.21.15.129:0/2384144895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c1180f0 0x7fc21c11a4e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc210009740 tx=0x7fc21001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d2165c902e10b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:35.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21affd640 1 -- 172.21.15.129:0/2384144895 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2100a8050 con 0x7fc21c1180f0 2024-02-18T16:20:35.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21affd640 1 -- 172.21.15.129:0/2384144895 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2100ac520 con 0x7fc21c1180f0 2024-02-18T16:20:35.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21affd640 1 -- 172.21.15.129:0/2384144895 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2100ac7e0 con 0x7fc21c1180f0 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2384144895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c1180f0 msgr2=0x7fc21c11a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 --2- 172.21.15.129:0/2384144895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c1180f0 0x7fc21c11a4e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc210009740 tx=0x7fc21001c370 comp rx=0 tx=0).stop 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2384144895 shutdown_connections 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 --2- 172.21.15.129:0/2384144895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c1180f0 0x7fc21c11a4e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2384144895 >> 172.21.15.129:0/2384144895 conn(0x7fc21c06f4d0 msgr2=0x7fc21c0718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2384144895 shutdown_connections 2024-02-18T16:20:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2384144895 wait complete. 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 Processor -- start 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- start start 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 0x7fc21c1ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1ac960 con 0x7fc21c115460 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 0x7fc21c1ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 0x7fc21c1ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34012/0 (socket says 172.21.15.129:34012) 2024-02-18T16:20:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21bfff640 1 -- 172.21.15.129:0/2077999996 learned_addr learned my addr 172.21.15.129:0/2077999996 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:35.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21bfff640 1 -- 172.21.15.129:0/2077999996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009420 con 0x7fc21c115460 2024-02-18T16:20:35.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc21bfff640 1 --2- 172.21.15.129:0/2077999996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 0x7fc21c1ac390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c3a0 tx=0x7fc20c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc20c005c20 con 0x7fc21c115460 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c1acb60 con 0x7fc21c115460 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c005d80 con 0x7fc21c115460 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc20c007200 con 0x7fc21c115460 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.838+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c1a6220 con 0x7fc21c115460 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.842+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc20c007360 con 0x7fc21c115460 2024-02-18T16:20:35.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.842+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc20c007610 con 0x7fc21c115460 2024-02-18T16:20:35.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.842+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c062860 con 0x7fc21c115460 2024-02-18T16:20:35.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.846+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc20c021060 con 0x7fc21c115460 2024-02-18T16:20:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.910+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "53707962-fe35-44e8-a5ea-08f8c69343ef", "id": 2} v 0) v1 -- 0x7fc21c067620 con 0x7fc21c115460 2024-02-18T16:20:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc218ff9640 1 -- 172.21.15.129:0/2077999996 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53707962-fe35-44e8-a5ea-08f8c69343ef", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc20c017070 con 0x7fc21c115460 2024-02-18T16:20:35.924 INFO:teuthology.orchestra.run.smithi129.stdout:2 2024-02-18T16:20:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 msgr2=0x7fc21c1ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 --2- 172.21.15.129:0/2077999996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 0x7fc21c1ac390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c3a0 tx=0x7fc20c00c860 comp rx=0 tx=0).stop 2024-02-18T16:20:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 shutdown_connections 2024-02-18T16:20:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 --2- 172.21.15.129:0/2077999996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc21c115460 0x7fc21c1ac390 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 >> 172.21.15.129:0/2077999996 conn(0x7fc21c06f4d0 msgr2=0x7fc21c1188d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 shutdown_connections 2024-02-18T16:20:35.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:35.914+0000 7fc222879640 1 -- 172.21.15.129:0/2077999996 wait complete. 2024-02-18T16:20:35.939 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new e7de7c5f-16d2-4989-9f9a-1f55679624a8 3 2024-02-18T16:20:36.004 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:35.994+0000 7f5d051e4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-18T16:20:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12f57eb640 1 Processor -- start 2024-02-18T16:20:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12f57eb640 1 -- start start 2024-02-18T16:20:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12f57eb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f011a350 0x7f12f011c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12f57eb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f011cc80 con 0x7f12f0116500 2024-02-18T16:20:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12f57eb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f011de20 con 0x7f12f011a350 2024-02-18T16:20:36.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12e7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f12f011a350 0x7f12f011c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:36.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12eeffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f12f0116500 0x7f12f01168e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:60824/0 (socket says 172.21.15.129:60824) 2024-02-18T16:20:36.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12eeffd640 1 -- 172.21.15.129:0/2649004233 learned_addr learned my addr 172.21.15.129:0/2649004233 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:20:36.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12e7fff640 1 -- 172.21.15.129:0/2649004233 >> v1:172.21.15.80:6789/0 conn(0x7f12f0116500 legacy=0x7f12f01168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.042+0000 7f12e7fff640 1 -- 172.21.15.129:0/2649004233 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f011df60 con 0x7f12f011a350 2024-02-18T16:20:36.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12e7fff640 1 --2- 172.21.15.129:0/2649004233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f011a350 0x7f12f011c740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009740 tx=0x7f12d801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8143b9390587d25 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:36.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12ee7fc640 1 -- 172.21.15.129:0/2649004233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12d80a8050 con 0x7f12f011a350 2024-02-18T16:20:36.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12ee7fc640 1 -- 172.21.15.129:0/2649004233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d80ac520 con 0x7f12f011a350 2024-02-18T16:20:36.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12ee7fc640 1 -- 172.21.15.129:0/2649004233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12d80ac7e0 con 0x7f12f011a350 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 -- 172.21.15.129:0/2649004233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f011a350 msgr2=0x7f12f011c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 --2- 172.21.15.129:0/2649004233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f011a350 0x7f12f011c740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009740 tx=0x7f12d801c370 comp rx=0 tx=0).stop 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 -- 172.21.15.129:0/2649004233 shutdown_connections 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 --2- 172.21.15.129:0/2649004233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f011a350 0x7f12f011c740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 -- 172.21.15.129:0/2649004233 >> 172.21.15.129:0/2649004233 conn(0x7f12f006dba0 msgr2=0x7f12f006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 -- 172.21.15.129:0/2649004233 shutdown_connections 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.046+0000 7f12f57eb640 1 -- 172.21.15.129:0/2649004233 wait complete. 2024-02-18T16:20:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 Processor -- start 2024-02-18T16:20:36.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 -- start start 2024-02-18T16:20:36.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 0x7f12f01ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:36.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f01aea70 con 0x7f12f0116500 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12eeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 0x7f12f01ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12eeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 0x7f12f01ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34030/0 (socket says 172.21.15.129:34030) 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12eeffd640 1 -- 172.21.15.129:0/3613645079 learned_addr learned my addr 172.21.15.129:0/3613645079 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12eeffd640 1 -- 172.21.15.129:0/3613645079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d8009420 con 0x7f12f0116500 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12eeffd640 1 --2- 172.21.15.129:0/3613645079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 0x7f12f01ae4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c3a0 tx=0x7f12e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12e0005c20 con 0x7f12f0116500 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f01aecd0 con 0x7f12f0116500 2024-02-18T16:20:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f01a8390 con 0x7f12f0116500 2024-02-18T16:20:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0005d80 con 0x7f12f0116500 2024-02-18T16:20:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12e0007200 con 0x7f12f0116500 2024-02-18T16:20:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f12e0007360 con 0x7f12f0116500 2024-02-18T16:20:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f12e0007610 con 0x7f12f0116500 2024-02-18T16:20:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.050+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0062860 con 0x7f12f0116500 2024-02-18T16:20:36.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.058+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f12e0021060 con 0x7f12f0116500 2024-02-18T16:20:36.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.126+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7de7c5f-16d2-4989-9f9a-1f55679624a8", "id": 3} v 0) v1 -- 0x7f12f0067620 con 0x7f12f0116500 2024-02-18T16:20:36.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.126+0000 7f12e77fe640 1 -- 172.21.15.129:0/3613645079 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7de7c5f-16d2-4989-9f9a-1f55679624a8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f12e0017070 con 0x7f12f0116500 2024-02-18T16:20:36.137 INFO:teuthology.orchestra.run.smithi129.stdout:3 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 msgr2=0x7f12f01ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 --2- 172.21.15.129:0/3613645079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 0x7f12f01ae4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c3a0 tx=0x7f12e000c860 comp rx=0 tx=0).stop 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 shutdown_connections 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 --2- 172.21.15.129:0/3613645079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f12f0116500 0x7f12f01ae4a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 >> 172.21.15.129:0/3613645079 conn(0x7f12f006dba0 msgr2=0x7f12f0118ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 shutdown_connections 2024-02-18T16:20:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:36.130+0000 7f12f57eb640 1 -- 172.21.15.129:0/3613645079 wait complete. 2024-02-18T16:20:36.155 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-18T16:20:36.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-18T16:20:36.158 INFO:tasks.ceph.osd.0:Started 2024-02-18T16:20:36.158 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-18T16:20:36.158 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-18T16:20:36.161 INFO:tasks.ceph.osd.1:Started 2024-02-18T16:20:36.161 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-18T16:20:36.161 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-18T16:20:36.163 INFO:tasks.ceph.osd.2:Started 2024-02-18T16:20:36.163 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-18T16:20:36.163 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-18T16:20:36.165 INFO:tasks.ceph.osd.3:Started 2024-02-18T16:20:36.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.276+0000 7ffa23cae640 1 Processor -- start 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.276+0000 7ffa23cae640 1 -- start start 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.276+0000 7ffa23cae640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa1c09d7e0 0x7ffa1c1332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.276+0000 7ffa23cae640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c099d80 con 0x7ffa1c098910 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.276+0000 7ffa23cae640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c09a340 con 0x7ffa1c09d7e0 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa21249640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffa1c09d7e0 0x7ffa1c1332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa21a4a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffa1c098910 0x7ffa1c098cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59880/0 (socket says 172.21.15.80:59880) 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa21a4a640 1 -- 172.21.15.80:0/2280923739 learned_addr learned my addr 172.21.15.80:0/2280923739 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa21249640 1 -- 172.21.15.80:0/2280923739 >> v1:172.21.15.80:6789/0 conn(0x7ffa1c098910 legacy=0x7ffa1c098cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa20a48640 1 -- 172.21.15.80:0/2280923739 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189038752 0 0) 0x7ffa1c099d80 con 0x7ffa1c098910 2024-02-18T16:20:36.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa21249640 1 -- 172.21.15.80:0/2280923739 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c09a5e0 con 0x7ffa1c09d7e0 2024-02-18T16:20:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa21249640 1 --2- 172.21.15.80:0/2280923739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c09d7e0 0x7ffa1c1332f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009740 tx=0x7ffa0c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d515c6bfbd257b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa20a48640 1 -- 172.21.15.80:0/2280923739 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa0c0ab530 con 0x7ffa1c09d7e0 2024-02-18T16:20:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa20a48640 1 -- 172.21.15.80:0/2280923739 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0a7050 con 0x7ffa1c09d7e0 2024-02-18T16:20:36.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa20a48640 1 -- 172.21.15.80:0/2280923739 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa0c0ab7e0 con 0x7ffa1c09d7e0 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 -- 172.21.15.80:0/2280923739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c09d7e0 msgr2=0x7ffa1c1332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 --2- 172.21.15.80:0/2280923739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c09d7e0 0x7ffa1c1332f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009740 tx=0x7ffa0c01c370 comp rx=0 tx=0).stop 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 -- 172.21.15.80:0/2280923739 shutdown_connections 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 --2- 172.21.15.80:0/2280923739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c09d7e0 0x7ffa1c1332f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 -- 172.21.15.80:0/2280923739 >> 172.21.15.80:0/2280923739 conn(0x7ffa1c0a0a00 msgr2=0x7ffa1c09cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 -- 172.21.15.80:0/2280923739 shutdown_connections 2024-02-18T16:20:36.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.280+0000 7ffa23cae640 1 -- 172.21.15.80:0/2280923739 wait complete. 2024-02-18T16:20:36.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 Processor -- start 2024-02-18T16:20:36.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 -- start start 2024-02-18T16:20:36.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 0x7ffa1c1c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:36.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c132910 con 0x7ffa1c098910 2024-02-18T16:20:36.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa21a4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 0x7ffa1c1c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:36.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa21a4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 0x7ffa1c1c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55330/0 (socket says 172.21.15.80:55330) 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa21a4a640 1 -- 172.21.15.80:0/3097914620 learned_addr learned my addr 172.21.15.80:0/3097914620 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa21a4a640 1 -- 172.21.15.80:0/3097914620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009420 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa21a4a640 1 --2- 172.21.15.80:0/3097914620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 0x7ffa1c1c5940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c420 tx=0x7ffa1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa180074d0 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18007630 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c132e40 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa18004960 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c1323c0 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ffa18004ac0 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ffa1801c8c0 con 0x7ffa1c098910 2024-02-18T16:20:36.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.284+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c062860 con 0x7ffa1c098910 2024-02-18T16:20:36.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.288+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ffa18018070 con 0x7ffa1c098910 2024-02-18T16:20:36.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa1c131750 con 0x7ffa1c098910 2024-02-18T16:20:36.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa127fc640 1 -- 172.21.15.80:0/3097914620 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7ffa1801c3b0 con 0x7ffa1c098910 2024-02-18T16:20:36.351 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:36.351 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:20:36.134256+0000","last_up_change":"0.000000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:20:36.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 msgr2=0x7ffa1c1c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 --2- 172.21.15.80:0/3097914620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 0x7ffa1c1c5940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c420 tx=0x7ffa1800c8e0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 shutdown_connections 2024-02-18T16:20:36.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 --2- 172.21.15.80:0/3097914620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffa1c098910 0x7ffa1c1c5940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 >> 172.21.15.80:0/3097914620 conn(0x7ffa1c0a0a00 msgr2=0x7ffa1c12bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:36.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 shutdown_connections 2024-02-18T16:20:36.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:36.344+0000 7ffa23cae640 1 -- 172.21.15.80:0/3097914620 wait complete. 2024-02-18T16:20:36.369 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-18T16:20:36.369 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-18T16:20:36.591 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.582+0000 7f5d051e4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-18T16:20:36.645 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.634+0000 7f5d051e4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-18T16:20:36.697 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.686+0000 7f5d051e4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-18T16:20:36.762 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-02-18T16:20:36.756+0000 7f97862997c0 -1 Falling back to public interface 2024-02-18T16:20:36.767 INFO:tasks.ceph.osd.3.smithi129.stderr:2024-02-18T16:20:36.758+0000 7f1c331d47c0 -1 Falling back to public interface 2024-02-18T16:20:36.768 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-02-18T16:20:36.758+0000 7fb6b50b07c0 -1 Falling back to public interface 2024-02-18T16:20:36.772 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-18T16:20:36.774 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.766+0000 7f5d051e4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-18T16:20:36.779 INFO:tasks.ceph.osd.1.smithi129.stderr:2024-02-18T16:20:36.770+0000 7f90472f07c0 -1 Falling back to public interface 2024-02-18T16:20:36.830 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.818+0000 7f5d051e4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.880+0000 7f3e63b2a640 1 Processor -- start 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.880+0000 7f3e63b2a640 1 -- start start 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e5c129060 0x7f3e5c130c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0961b0 con 0x7f3e5c128430 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c094b00 con 0x7f3e5c129060 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e610c5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e5c129060 0x7f3e5c130c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e618c6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3e5c128430 0x7f3e5c128950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59894/0 (socket says 172.21.15.80:59894) 2024-02-18T16:20:36.889 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e618c6640 1 -- 172.21.15.80:0/3756576683 learned_addr learned my addr 172.21.15.80:0/3756576683 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:36.890 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e610c5640 1 -- 172.21.15.80:0/3756576683 >> v1:172.21.15.80:6789/0 conn(0x7f3e5c128430 legacy=0x7f3e5c128950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.890 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e610c5640 1 -- 172.21.15.80:0/3756576683 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0724c0 con 0x7f3e5c129060 2024-02-18T16:20:36.890 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e608c4640 1 -- 172.21.15.80:0/3756576683 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122948600 0 0) 0x7f3e5c0961b0 con 0x7f3e5c128430 2024-02-18T16:20:36.891 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e610c5640 1 --2- 172.21.15.80:0/3756576683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c129060 0x7f3e5c130c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009740 tx=0x7f3e5801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bec01e4d74e971 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:36.892 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e608c4640 1 -- 172.21.15.80:0/3756576683 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e580ab530 con 0x7f3e5c129060 2024-02-18T16:20:36.892 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e608c4640 1 -- 172.21.15.80:0/3756576683 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e580a7050 con 0x7f3e5c129060 2024-02-18T16:20:36.892 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e608c4640 1 -- 172.21.15.80:0/3756576683 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e580ab7e0 con 0x7f3e5c129060 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- 172.21.15.80:0/3756576683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c129060 msgr2=0x7f3e5c130c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 --2- 172.21.15.80:0/3756576683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c129060 0x7f3e5c130c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009740 tx=0x7f3e5801c400 comp rx=0 tx=0).stop 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- 172.21.15.80:0/3756576683 shutdown_connections 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 --2- 172.21.15.80:0/3756576683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c129060 0x7f3e5c130c90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- 172.21.15.80:0/3756576683 >> 172.21.15.80:0/3756576683 conn(0x7f3e5c09a000 msgr2=0x7f3e5c09a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- 172.21.15.80:0/3756576683 shutdown_connections 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.884+0000 7f3e63b2a640 1 -- 172.21.15.80:0/3756576683 wait complete. 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 Processor -- start 2024-02-18T16:20:36.893 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 -- start start 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 0x7f3e5c1c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c06dce0 con 0x7f3e5c128430 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e618c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 0x7f3e5c1c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e618c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 0x7f3e5c1c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55334/0 (socket says 172.21.15.80:55334) 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e618c6640 1 -- 172.21.15.80:0/1758529371 learned_addr learned my addr 172.21.15.80:0/1758529371 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e618c6640 1 -- 172.21.15.80:0/1758529371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58009420 con 0x7f3e5c128430 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e618c6640 1 --2- 172.21.15.80:0/1758529371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 0x7f3e5c1c5170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c420 tx=0x7f3e4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:36.895 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e4c0074d0 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c007630 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c095550 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e4c004960 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c12dd00 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3e4c004ac0 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3e4c01c8c0 con 0x7f3e5c128430 2024-02-18T16:20:36.896 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.888+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c067fa0 con 0x7f3e5c128430 2024-02-18T16:20:36.897 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.892+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3e4c018070 con 0x7f3e5c128430 2024-02-18T16:20:36.906 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.898+0000 7f5d051e4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-18T16:20:36.954 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e5c062860 con 0x7f3e5c128430 2024-02-18T16:20:36.955 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e527fc640 1 -- 172.21.15.80:0/1758529371 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f3e4c01cb10 con 0x7f3e5c128430 2024-02-18T16:20:36.955 INFO:teuthology.misc.health.smithi080.stdout: 2024-02-18T16:20:36.955 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":6,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:20:36.134256+0000","last_up_change":"0.000000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:20:36.956 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 msgr2=0x7f3e5c1c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:36.956 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 --2- 172.21.15.80:0/1758529371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 0x7f3e5c1c5170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c420 tx=0x7f3e4c00c8e0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.956 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 shutdown_connections 2024-02-18T16:20:36.957 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 --2- 172.21.15.80:0/1758529371 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e5c128430 0x7f3e5c1c5170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:36.957 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 >> 172.21.15.80:0/1758529371 conn(0x7f3e5c09a000 msgr2=0x7f3e5c126f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:36.957 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 shutdown_connections 2024-02-18T16:20:36.957 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:36.948+0000 7f3e63b2a640 1 -- 172.21.15.80:0/1758529371 wait complete. 2024-02-18T16:20:36.958 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:36.950+0000 7f5d051e4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-18T16:20:36.972 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-18T16:20:37.107 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:37.098+0000 7f5d051e4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-18T16:20:37.168 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:37.158+0000 7f5d051e4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-18T16:20:37.795 INFO:tasks.ceph.mgr.x.smithi129.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-18T16:20:37.795 INFO:tasks.ceph.mgr.x.smithi129.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-18T16:20:37.795 INFO:tasks.ceph.mgr.x.smithi129.stderr: from numpy import show_config as show_numpy_config 2024-02-18T16:20:37.869 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:37.858+0000 7f5d051e4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-18T16:20:38.044 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:38.034+0000 7f5d051e4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-18T16:20:38.201 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:38.190+0000 7f5d051e4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-18T16:20:38.263 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:38.254+0000 7f5d051e4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-18T16:20:38.397 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:38.386+0000 7f5d051e4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-18T16:20:39.036 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:39.026+0000 7f5d051e4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-18T16:20:39.111 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:39.102+0000 7f5d051e4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-18T16:20:39.290 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:39.282+0000 7f5d051e4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-18T16:20:39.363 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:39.354+0000 7f5d051e4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-18T16:20:39.665 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:39.654+0000 7f5d051e4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-18T16:20:39.726 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:39.718+0000 7f5d051e4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-18T16:20:40.439 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-02-18T16:20:40.432+0000 7f97862997c0 -1 osd.0 0 log_to_monitors true 2024-02-18T16:20:40.576 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-02-18T16:20:40.566+0000 7fb6b50b07c0 -1 osd.2 0 log_to_monitors true 2024-02-18T16:20:40.676 INFO:tasks.ceph.osd.3.smithi129.stderr:2024-02-18T16:20:40.666+0000 7f1c331d47c0 -1 osd.3 0 log_to_monitors true 2024-02-18T16:20:40.695 INFO:tasks.ceph.osd.1.smithi129.stderr:2024-02-18T16:20:40.686+0000 7f90472f07c0 -1 osd.1 0 log_to_monitors true 2024-02-18T16:20:40.764 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-02-18T16:20:40.754+0000 7f5cac631640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-18T16:20:42.736 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-02-18T16:20:42.728+0000 7f9781a1f640 -1 osd.0 0 waiting for initial osdmap 2024-02-18T16:20:42.754 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-02-18T16:20:42.748+0000 7f977a066640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T16:20:43.376 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-18T16:20:43.496 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.488+0000 7f14db570640 1 Processor -- start 2024-02-18T16:20:43.496 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.488+0000 7f14db570640 1 -- start start 2024-02-18T16:20:43.497 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14db570640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14d4129060 0x7f14d4130c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14db570640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40961b0 con 0x7f14d4128430 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14db570640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d4094b00 con 0x7f14d4129060 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d930c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f14d4128430 0x7f14d4128950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59300/0 (socket says 172.21.15.80:59300) 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d8b0b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14d4129060 0x7f14d4130c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d930c640 1 -- 172.21.15.80:0/1323165535 learned_addr learned my addr 172.21.15.80:0/1323165535 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d3fff640 1 -- 172.21.15.80:0/1323165535 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748491569 0 0) 0x7f14d40961b0 con 0x7f14d4128430 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d3fff640 1 -- 172.21.15.80:0/1323165535 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14bc003530 con 0x7f14d4128430 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d8b0b640 1 -- 172.21.15.80:0/1323165535 >> v1:172.21.15.80:6789/0 conn(0x7f14d4128430 legacy=0x7f14d4128950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:43.498 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.492+0000 7f14d8b0b640 1 -- 172.21.15.80:0/1323165535 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40724c0 con 0x7f14d4129060 2024-02-18T16:20:43.500 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d8b0b640 1 --2- 172.21.15.80:0/1323165535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4129060 0x7f14d4130c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009d90 tx=0x7f14cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32230aee6cba2ce server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:43.500 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d3fff640 1 -- 172.21.15.80:0/1323165535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14cc0a56c0 con 0x7f14d4129060 2024-02-18T16:20:43.500 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d3fff640 1 -- 172.21.15.80:0/1323165535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc0a5820 con 0x7f14d4129060 2024-02-18T16:20:43.501 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d3fff640 1 -- 172.21.15.80:0/1323165535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14cc0a5ae0 con 0x7f14d4129060 2024-02-18T16:20:43.501 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/1323165535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4129060 msgr2=0x7f14d4130c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:43.501 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 --2- 172.21.15.80:0/1323165535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4129060 0x7f14d4130c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009d90 tx=0x7f14cc01c950 comp rx=0 tx=0).stop 2024-02-18T16:20:43.501 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/1323165535 shutdown_connections 2024-02-18T16:20:43.501 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 --2- 172.21.15.80:0/1323165535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4129060 0x7f14d4130c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:43.502 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/1323165535 >> 172.21.15.80:0/1323165535 conn(0x7f14d409a000 msgr2=0x7f14d409a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:43.502 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/1323165535 shutdown_connections 2024-02-18T16:20:43.502 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/1323165535 wait complete. 2024-02-18T16:20:43.503 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 Processor -- start 2024-02-18T16:20:43.503 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- start start 2024-02-18T16:20:43.503 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 0x7f14d41c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:43.503 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d406d360 con 0x7f14d4128430 2024-02-18T16:20:43.503 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d930c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 0x7f14d41c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:43.503 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d930c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 0x7f14d41c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37418/0 (socket says 172.21.15.80:37418) 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d930c640 1 -- 172.21.15.80:0/4036899624 learned_addr learned my addr 172.21.15.80:0/4036899624 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d930c640 1 -- 172.21.15.80:0/4036899624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009a70 con 0x7f14d4128430 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d930c640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 0x7f14d41c5170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c450 tx=0x7f14c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14c8005c20 con 0x7f14d4128430 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8005d80 con 0x7f14d4128430 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d4095550 con 0x7f14d4128430 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14c80071a0 con 0x7f14d4128430 2024-02-18T16:20:43.504 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d412dc50 con 0x7f14d4128430 2024-02-18T16:20:43.505 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 43479+0+0 (secure 0 0 0) 0x7f14c8007300 con 0x7f14d4128430 2024-02-18T16:20:43.505 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.496+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d4067fa0 con 0x7f14d4128430 2024-02-18T16:20:43.505 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.500+0000 7f14d1ffb640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14c0035980 0x7f14c0037e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:43.505 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.500+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7f14c8046a10 con 0x7f14d4128430 2024-02-18T16:20:43.505 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.500+0000 7f14d8b0b640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14c0035980 0x7f14c0037e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:43.505 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.500+0000 7f14d8b0b640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14c0035980 0x7f14c0037e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009d90 tx=0x7f14cc0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:43.509 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.504+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f14c8012400 con 0x7f14d4128430 2024-02-18T16:20:43.561 INFO:tasks.ceph.osd.3.smithi129.stderr:2024-02-18T16:20:43.550+0000 7f1c2e95a640 -1 osd.3 0 waiting for initial osdmap 2024-02-18T16:20:43.587 INFO:tasks.ceph.osd.3.smithi129.stderr:2024-02-18T16:20:43.578+0000 7f1c26fa1640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T16:20:43.596 INFO:tasks.ceph.osd.1.smithi129.stderr:2024-02-18T16:20:43.586+0000 7f90442ac640 -1 osd.1 0 waiting for initial osdmap 2024-02-18T16:20:43.616 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-02-18T16:20:43.606+0000 7fb6b206c640 -1 osd.2 0 waiting for initial osdmap 2024-02-18T16:20:43.634 INFO:tasks.ceph.osd.1.smithi129.stderr:2024-02-18T16:20:43.626+0000 7f903b0bd640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T16:20:43.642 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-02-18T16:20:43.634+0000 7fb6a8e7d640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T16:20:43.671 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.664+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14d4062860 con 0x7f14d4128430 2024-02-18T16:20:43.671 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.664+0000 7f14d1ffb640 1 -- 172.21.15.80:0/4036899624 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f14c8017020 con 0x7f14d4128430 2024-02-18T16:20:43.672 INFO:teuthology.misc.health.smithi080.stdout: 2024-02-18T16:20:43.672 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":8,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:20:41.817958+0000","last_up_change":"0.000000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:20:43.673 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14c0035980 msgr2=0x7f14c0037e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14c0035980 0x7f14c0037e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009d90 tx=0x7f14cc0a7070 comp rx=0 tx=0).stop 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 msgr2=0x7f14d41c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 0x7f14d41c5170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c450 tx=0x7f14c800c910 comp rx=0 tx=0).stop 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 shutdown_connections 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14c0035980 0x7f14c0037e40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 --2- 172.21.15.80:0/4036899624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14d4128430 0x7f14d41c5170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 >> 172.21.15.80:0/4036899624 conn(0x7f14d409a000 msgr2=0x7f14d4126ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 shutdown_connections 2024-02-18T16:20:43.674 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:43.668+0000 7f14db570640 1 -- 172.21.15.80:0/4036899624 wait complete. 2024-02-18T16:20:43.689 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-18T16:20:50.094 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-18T16:20:50.212 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.204+0000 7f2e0a0a5640 1 Processor -- start 2024-02-18T16:20:50.212 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.204+0000 7f2e0a0a5640 1 -- start start 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e0a0a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e04092240 0x7f2e04092620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e0a0a5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e04095530 con 0x7f2e0409a490 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e0a0a5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e04074c70 con 0x7f2e04092240 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e037fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e04092240 0x7f2e04092620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e02ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2e0409a490 0x7f2e0412c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59310/0 (socket says 172.21.15.80:59310) 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e02ffd640 1 -- 172.21.15.80:0/1888769710 learned_addr learned my addr 172.21.15.80:0/1888769710 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e037fe640 1 -- 172.21.15.80:0/1888769710 >> v1:172.21.15.80:6789/0 conn(0x7f2e0409a490 legacy=0x7f2e0412c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e027fc640 1 -- 172.21.15.80:0/1888769710 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787542995 0 0) 0x7f2e04095530 con 0x7f2e0409a490 2024-02-18T16:20:50.214 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.208+0000 7f2e037fe640 1 -- 172.21.15.80:0/1888769710 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04093e10 con 0x7f2e04092240 2024-02-18T16:20:50.217 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e037fe640 1 --2- 172.21.15.80:0/1888769710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e04092620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009740 tx=0x7f2df401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953a551bfc6c52b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.217 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e027fc640 1 -- 172.21.15.80:0/1888769710 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df40ab530 con 0x7f2e04092240 2024-02-18T16:20:50.217 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e027fc640 1 -- 172.21.15.80:0/1888769710 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df40a7050 con 0x7f2e04092240 2024-02-18T16:20:50.217 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e027fc640 1 -- 172.21.15.80:0/1888769710 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df40ab7e0 con 0x7f2e04092240 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/1888769710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 msgr2=0x7f2e04092620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 --2- 172.21.15.80:0/1888769710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e04092620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009740 tx=0x7f2df401c310 comp rx=0 tx=0).stop 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/1888769710 shutdown_connections 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 --2- 172.21.15.80:0/1888769710 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e04092620 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/1888769710 >> 172.21.15.80:0/1888769710 conn(0x7f2e0409d620 msgr2=0x7f2e04099b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/1888769710 shutdown_connections 2024-02-18T16:20:50.218 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/1888769710 wait complete. 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 Processor -- start 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- start start 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e0408cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0408de50 con 0x7f2e04092240 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e0408cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e037fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e0408cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37426/0 (socket says 172.21.15.80:37426) 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e037fe640 1 -- 172.21.15.80:0/942636960 learned_addr learned my addr 172.21.15.80:0/942636960 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e037fe640 1 -- 172.21.15.80:0/942636960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009420 con 0x7f2e04092240 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e037fe640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e0408cce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2df40ae040 tx=0x7f2df4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df40b4410 con 0x7f2e04092240 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0408f1f0 con 0x7f2e04092240 2024-02-18T16:20:50.220 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df40b4570 con 0x7f2e04092240 2024-02-18T16:20:50.221 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df40b4850 con 0x7f2e04092240 2024-02-18T16:20:50.221 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.212+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0408fe00 con 0x7f2e04092240 2024-02-18T16:20:50.221 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.216+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0408e560 con 0x7f2e04092240 2024-02-18T16:20:50.221 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.216+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2df40b2040 con 0x7f2e04092240 2024-02-18T16:20:50.221 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.216+0000 7f2debfff640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2df00359c0 0x7f2df0037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.222 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.216+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f2df40e1db0 con 0x7f2e04092240 2024-02-18T16:20:50.222 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.216+0000 7f2e02ffd640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2df00359c0 0x7f2df0037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.222 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.216+0000 7f2e02ffd640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2df00359c0 0x7f2df0037e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007fd0 tx=0x7f2df8007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.230 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.224+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2df40b49b0 con 0x7f2e04092240 2024-02-18T16:20:50.383 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.376+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e04062860 con 0x7f2e04092240 2024-02-18T16:20:50.383 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.376+0000 7f2debfff640 1 -- 172.21.15.80:0/942636960 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7963 (secure 0 0 0) 0x7f2df40b0020 con 0x7f2e04092240 2024-02-18T16:20:50.384 INFO:teuthology.misc.health.smithi080.stdout: 2024-02-18T16:20:50.384 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":12,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:20:46.743269+0000","last_up_change":"2024-02-18T16:20:43.736890+0000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T16:20:43.836552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6801","nonce":4245413050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6803","nonce":4245413050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6807","nonce":4245413050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6805","nonce":4245413050}]},"public_addr":"172.21.15.80:6801/4245413050","cluster_addr":"172.21.15.80:6803/4245413050","heartbeat_back_addr":"172.21.15.80:6807/4245413050","heartbeat_front_addr":"172.21.15.80:6805/4245413050","state":["exists","up"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6817","nonce":834716550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6819","nonce":834716550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6823","nonce":834716550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6821","nonce":834716550}]},"public_addr":"172.21.15.129:6817/834716550","cluster_addr":"172.21.15.129:6819/834716550","heartbeat_back_addr":"172.21.15.129:6823/834716550","heartbeat_front_addr":"172.21.15.129:6821/834716550","state":["exists","up"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6809","nonce":222672308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6811","nonce":222672308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6815","nonce":222672308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6813","nonce":222672308}]},"public_addr":"172.21.15.129:6809/222672308","cluster_addr":"172.21.15.129:6811/222672308","heartbeat_back_addr":"172.21.15.129:6815/222672308","heartbeat_front_addr":"172.21.15.129:6813/222672308","state":["exists","up"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6801","nonce":2085458436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6803","nonce":2085458436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6807","nonce":2085458436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6805","nonce":2085458436}]},"public_addr":"172.21.15.129:6801/2085458436","cluster_addr":"172.21.15.129:6803/2085458436","heartbeat_back_addr":"172.21.15.129:6807/2085458436","heartbeat_front_addr":"172.21.15.129:6805/2085458436","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.403254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.666337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.547176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.636781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:20:50.386 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2df00359c0 msgr2=0x7f2df0037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2df00359c0 0x7f2df0037e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007fd0 tx=0x7f2df8007920 comp rx=0 tx=0).stop 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 msgr2=0x7f2e0408cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e0408cce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2df40ae040 tx=0x7f2df4019110 comp rx=0 tx=0).stop 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 shutdown_connections 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2df00359c0 0x7f2df0037e80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 --2- 172.21.15.80:0/942636960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e04092240 0x7f2e0408cce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 >> 172.21.15.80:0/942636960 conn(0x7f2e0409d620 msgr2=0x7f2e04098620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 shutdown_connections 2024-02-18T16:20:50.387 INFO:teuthology.misc.health.smithi080.stderr:2024-02-18T16:20:50.380+0000 7f2e0a0a5640 1 -- 172.21.15.80:0/942636960 wait complete. 2024-02-18T16:20:50.401 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-18T16:20:50.401 INFO:tasks.ceph:Creating RBD pool 2024-02-18T16:20:50.401 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-18T16:20:50.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.504+0000 7f45c0bb8640 1 Processor -- start 2024-02-18T16:20:50.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.504+0000 7f45c0bb8640 1 -- start start 2024-02-18T16:20:50.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.504+0000 7f45c0bb8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45bc095620 0x7f45bc130e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.504+0000 7f45c0bb8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc094fb0 con 0x7f45bc12c080 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.504+0000 7f45c0bb8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc0949e0 con 0x7f45bc095620 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.504+0000 7f45b9d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45bc095620 0x7f45bc130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b9d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45bc095620 0x7f45bc130e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37428/0 (socket says 172.21.15.80:37428) 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b9d9b640 1 -- 172.21.15.80:0/4226353888 learned_addr learned my addr 172.21.15.80:0/4226353888 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b9d9b640 1 -- 172.21.15.80:0/4226353888 >> v1:172.21.15.80:6789/0 conn(0x7f45bc12c080 legacy=0x7f45bc12c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b9d9b640 1 -- 172.21.15.80:0/4226353888 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0951e0 con 0x7f45bc095620 2024-02-18T16:20:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b9d9b640 1 --2- 172.21.15.80:0/4226353888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc130e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45a40097f0 tx=0x7f45a401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cec91f16b1a5f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b959a640 1 -- 172.21.15.80:0/4226353888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45bc095fa0 con 0x7f45bc095620 2024-02-18T16:20:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b959a640 1 -- 172.21.15.80:0/4226353888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a40ab400 con 0x7f45bc095620 2024-02-18T16:20:50.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45b959a640 1 -- 172.21.15.80:0/4226353888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45a40ab6c0 con 0x7f45bc095620 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 -- 172.21.15.80:0/4226353888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 msgr2=0x7f45bc130e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 --2- 172.21.15.80:0/4226353888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc130e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45a40097f0 tx=0x7f45a401c4c0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 -- 172.21.15.80:0/4226353888 shutdown_connections 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 --2- 172.21.15.80:0/4226353888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc130e40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 -- 172.21.15.80:0/4226353888 >> 172.21.15.80:0/4226353888 conn(0x7f45bc09a050 msgr2=0x7f45bc09a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 -- 172.21.15.80:0/4226353888 shutdown_connections 2024-02-18T16:20:50.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.508+0000 7f45c0bb8640 1 -- 172.21.15.80:0/4226353888 wait complete. 2024-02-18T16:20:50.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 Processor -- start 2024-02-18T16:20:50.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 -- start start 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc1c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc123660 con 0x7f45bc095620 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45ba59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc1c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45ba59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc1c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37442/0 (socket says 172.21.15.80:37442) 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45ba59c640 1 -- 172.21.15.80:0/2953865547 learned_addr learned my addr 172.21.15.80:0/2953865547 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45ba59c640 1 -- 172.21.15.80:0/2953865547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40094d0 con 0x7f45bc095620 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45ba59c640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc1c34f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c7f0 tx=0x7f45b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45b4003ab0 con 0x7f45bc095620 2024-02-18T16:20:50.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4003c30 con 0x7f45bc095620 2024-02-18T16:20:50.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45b400a820 con 0x7f45bc095620 2024-02-18T16:20:50.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc072140 con 0x7f45bc095620 2024-02-18T16:20:50.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc123e50 con 0x7f45bc095620 2024-02-18T16:20:50.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc124100 con 0x7f45bc095620 2024-02-18T16:20:50.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f45b400a980 con 0x7f45bc095620 2024-02-18T16:20:50.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b2ffd640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f459c035a10 0x7f459c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f45b4047b60 con 0x7f45bc095620 2024-02-18T16:20:50.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.512+0000 7f45b9d9b640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f459c035a10 0x7f459c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.516+0000 7f45b9d9b640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f459c035a10 0x7f459c037ed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f45a40af000 tx=0x7f45a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.516+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45b400ac30 con 0x7f45bc095620 2024-02-18T16:20:50.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.664+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f45bc062860 con 0x7f45bc095620 2024-02-18T16:20:50.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.756+0000 7f45b2ffd640 1 -- 172.21.15.80:0/2953865547 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f45b401a360 con 0x7f45bc095620 2024-02-18T16:20:50.762 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'rbd' created 2024-02-18T16:20:50.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f459c035a10 msgr2=0x7f459c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f459c035a10 0x7f459c037ed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f45a40af000 tx=0x7f45a4008040 comp rx=0 tx=0).stop 2024-02-18T16:20:50.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 msgr2=0x7f45bc1c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc1c34f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45b400c7f0 tx=0x7f45b400ccb0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 shutdown_connections 2024-02-18T16:20:50.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f459c035a10 0x7f459c037ed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 --2- 172.21.15.80:0/2953865547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45bc095620 0x7f45bc1c34f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 >> 172.21.15.80:0/2953865547 conn(0x7f45bc09a050 msgr2=0x7f45bc097380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:50.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 shutdown_connections 2024-02-18T16:20:50.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.760+0000 7f45c0bb8640 1 -- 172.21.15.80:0/2953865547 wait complete. 2024-02-18T16:20:50.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-18T16:20:50.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f02c63640 1 Processor -- start 2024-02-18T16:20:50.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f02c63640 1 -- start start 2024-02-18T16:20:50.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f02c63640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6efc128560 0x7f6efc128af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f02c63640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc0964c0 con 0x7f6efc129030 2024-02-18T16:20:50.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f02c63640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc129490 con 0x7f6efc128560 2024-02-18T16:20:50.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f009ff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6efc128560 0x7f6efc128af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6efbfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6efc129030 0x7f6efc12baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59318/0 (socket says 172.21.15.80:59318) 2024-02-18T16:20:50.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f009ff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6efc128560 0x7f6efc128af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37454/0 (socket says 172.21.15.80:37454) 2024-02-18T16:20:50.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6efbfff640 1 -- 172.21.15.80:0/1385046908 learned_addr learned my addr 172.21.15.80:0/1385046908 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:50.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f009ff640 1 -- 172.21.15.80:0/1385046908 >> v1:172.21.15.80:6789/0 conn(0x7f6efc129030 legacy=0x7f6efc12baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6f009ff640 1 -- 172.21.15.80:0/1385046908 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc095740 con 0x7f6efc128560 2024-02-18T16:20:50.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.892+0000 7f6efb7fe640 1 -- 172.21.15.80:0/1385046908 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120077844 0 0) 0x7f6efc0964c0 con 0x7f6efc129030 2024-02-18T16:20:50.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f009ff640 1 --2- 172.21.15.80:0/1385046908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc128af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009740 tx=0x7f6eec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c84510073b41124 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6efb7fe640 1 -- 172.21.15.80:0/1385046908 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6eec0ab530 con 0x7f6efc128560 2024-02-18T16:20:50.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6efb7fe640 1 -- 172.21.15.80:0/1385046908 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec0a7050 con 0x7f6efc128560 2024-02-18T16:20:50.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6efb7fe640 1 -- 172.21.15.80:0/1385046908 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6eec0ab7e0 con 0x7f6efc128560 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/1385046908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 msgr2=0x7f6efc128af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 --2- 172.21.15.80:0/1385046908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc128af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009740 tx=0x7f6eec01c370 comp rx=0 tx=0).stop 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/1385046908 shutdown_connections 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 --2- 172.21.15.80:0/1385046908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc128af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/1385046908 >> 172.21.15.80:0/1385046908 conn(0x7f6efc09a050 msgr2=0x7f6efc09a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/1385046908 shutdown_connections 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/1385046908 wait complete. 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 Processor -- start 2024-02-18T16:20:50.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- start start 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc1c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1309a0 con 0x7f6efc128560 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f009ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc1c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f009ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc1c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37462/0 (socket says 172.21.15.80:37462) 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f009ff640 1 -- 172.21.15.80:0/864760696 learned_addr learned my addr 172.21.15.80:0/864760696 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f009ff640 1 -- 172.21.15.80:0/864760696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec009420 con 0x7f6efc128560 2024-02-18T16:20:50.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f009ff640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc1c3cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ae040 tx=0x7f6eec019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6eec0b4540 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec0b46a0 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc1306f0 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6eec0b4980 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.896+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc125fb0 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.900+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc062860 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.900+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6eec0b2040 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.900+0000 7f6ef97fa640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ee80359c0 0x7f6ee8037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.900+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f6eec0e2150 con 0x7f6efc128560 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.900+0000 7f6efbfff640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ee80359c0 0x7f6ee8037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:50.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.900+0000 7f6efbfff640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ee80359c0 0x7f6ee8037e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0007fd0 tx=0x7f6ef0007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:50.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:50.904+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6eec0b4e60 con 0x7f6efc128560 2024-02-18T16:20:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.052+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6efc072bb0 con 0x7f6efc128560 2024-02-18T16:20:51.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.764+0000 7f6ef97fa640 1 -- 172.21.15.80:0/864760696 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6eec0b0030 con 0x7f6efc128560 2024-02-18T16:20:51.769 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-18T16:20:51.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ee80359c0 msgr2=0x7f6ee8037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:51.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ee80359c0 0x7f6ee8037e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0007fd0 tx=0x7f6ef0007940 comp rx=0 tx=0).stop 2024-02-18T16:20:51.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 msgr2=0x7f6efc1c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:51.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc1c3cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ae040 tx=0x7f6eec019110 comp rx=0 tx=0).stop 2024-02-18T16:20:51.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 shutdown_connections 2024-02-18T16:20:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ee80359c0 0x7f6ee8037e80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 --2- 172.21.15.80:0/864760696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6efc128560 0x7f6efc1c3cf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 >> 172.21.15.80:0/864760696 conn(0x7f6efc09a050 msgr2=0x7f6efc127110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 shutdown_connections 2024-02-18T16:20:51.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.768+0000 7f6f02c63640 1 -- 172.21.15.80:0/864760696 wait complete. 2024-02-18T16:20:51.796 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-18T16:20:51.797 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-18T16:20:51.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-18T16:20:51.797 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-18T16:20:51.797 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-18T16:20:51.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.904+0000 7fb0093db640 1 Processor -- start 2024-02-18T16:20:51.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.904+0000 7fb0093db640 1 -- start start 2024-02-18T16:20:51.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.904+0000 7fb0093db640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb004130f30 0x7fb004133320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.904+0000 7fb0093db640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00412a990 con 0x7fb00412ab90 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.904+0000 7fb0093db640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb004098bf0 con 0x7fb004130f30 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0027fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb004130f30 0x7fb004133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb002ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb00412ab90 0x7fb00412af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59320/0 (socket says 172.21.15.80:59320) 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb002ffd640 1 -- 172.21.15.80:0/4098431740 learned_addr learned my addr 172.21.15.80:0/4098431740 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0027fc640 1 -- 172.21.15.80:0/4098431740 >> v1:172.21.15.80:6789/0 conn(0x7fb00412ab90 legacy=0x7fb00412af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:51.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0027fc640 1 -- 172.21.15.80:0/4098431740 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00406ead0 con 0x7fb004130f30 2024-02-18T16:20:51.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0027fc640 1 --2- 172.21.15.80:0/4098431740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb004130f30 0x7fb004133320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faff8009740 tx=0x7faff801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e3e09cb9d5c52 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:51.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb001ffb640 1 -- 172.21.15.80:0/4098431740 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff80ab530 con 0x7fb004130f30 2024-02-18T16:20:51.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb001ffb640 1 -- 172.21.15.80:0/4098431740 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80a7050 con 0x7fb004130f30 2024-02-18T16:20:51.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb001ffb640 1 -- 172.21.15.80:0/4098431740 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff80ab7e0 con 0x7fb004130f30 2024-02-18T16:20:51.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 -- 172.21.15.80:0/4098431740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb004130f30 msgr2=0x7fb004133320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:51.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 --2- 172.21.15.80:0/4098431740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb004130f30 0x7fb004133320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faff8009740 tx=0x7faff801c370 comp rx=0 tx=0).stop 2024-02-18T16:20:51.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 -- 172.21.15.80:0/4098431740 shutdown_connections 2024-02-18T16:20:51.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 --2- 172.21.15.80:0/4098431740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb004130f30 0x7fb004133320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:51.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 -- 172.21.15.80:0/4098431740 >> 172.21.15.80:0/4098431740 conn(0x7fb00409c220 msgr2=0x7fb004071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:51.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 -- 172.21.15.80:0/4098431740 shutdown_connections 2024-02-18T16:20:51.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.908+0000 7fb0093db640 1 -- 172.21.15.80:0/4098431740 wait complete. 2024-02-18T16:20:51.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 Processor -- start 2024-02-18T16:20:51.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 -- start start 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 0x7fb0041c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0041333e0 con 0x7fb00412ab90 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb002ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 0x7fb0041c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb002ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 0x7fb0041c5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37476/0 (socket says 172.21.15.80:37476) 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb002ffd640 1 -- 172.21.15.80:0/660062384 learned_addr learned my addr 172.21.15.80:0/660062384 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb002ffd640 1 -- 172.21.15.80:0/660062384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8009420 con 0x7fb00412ab90 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb002ffd640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 0x7fb0041c5320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faff400c3a0 tx=0x7faff400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4005c20 con 0x7fb00412ab90 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4005d80 con 0x7fb00412ab90 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00409a5d0 con 0x7fb00412ab90 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4007200 con 0x7fb00412ab90 2024-02-18T16:20:51.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb004098ec0 con 0x7fb00412ab90 2024-02-18T16:20:51.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faff4007360 con 0x7fb00412ab90 2024-02-18T16:20:51.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0040998e0 con 0x7fb00412ab90 2024-02-18T16:20:51.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fafeb7fe640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faff0035a10 0x7faff0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:51.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7faff4047210 con 0x7fb00412ab90 2024-02-18T16:20:51.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0027fc640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faff0035a10 0x7faff0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:51.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.912+0000 7fb0027fc640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faff0035a10 0x7faff0037ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faff80ad000 tx=0x7faff80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:51.916+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faff4012400 con 0x7fb00412ab90 2024-02-18T16:20:52.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.112+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb004062860 con 0x7fb00412ab90 2024-02-18T16:20:52.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fafeb7fe640 1 -- 172.21.15.80:0/660062384 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83334 (secure 0 0 0) 0x7faff4017030 con 0x7fb00412ab90 2024-02-18T16:20:52.122 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:52.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faff0035a10 msgr2=0x7faff0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faff0035a10 0x7faff0037ed0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faff80ad000 tx=0x7faff80a6000 comp rx=0 tx=0).stop 2024-02-18T16:20:52.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 msgr2=0x7fb0041c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 0x7fb0041c5320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faff400c3a0 tx=0x7faff400c860 comp rx=0 tx=0).stop 2024-02-18T16:20:52.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 shutdown_connections 2024-02-18T16:20:52.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faff0035a10 0x7faff0037ed0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 --2- 172.21.15.80:0/660062384 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb00412ab90 0x7fb0041c5320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 >> 172.21.15.80:0/660062384 conn(0x7fb00409c220 msgr2=0x7fb004128370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 shutdown_connections 2024-02-18T16:20:52.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.116+0000 7fb0093db640 1 -- 172.21.15.80:0/660062384 wait complete. 2024-02-18T16:20:52.138 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":4092544777},{"type":"v1","addr":"172.21.15.129:6825","nonce":4092544777}]},"active_addr":"172.21.15.129:6825/4092544777","active_change":"2024-02-18T16:20:39.746472+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":3215496680}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":3954613982}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":2123294055}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":653514490}]}]} 2024-02-18T16:20:52.140 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-18T16:20:52.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-18T16:20:52.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f9560061640 1 Processor -- start 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f9560061640 1 -- start start 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f9560061640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9558128d10 0x7f95581290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f9560061640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9558095ee0 con 0x7f955812bb20 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f9560061640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9558095b30 con 0x7f9558128d10 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f955ddfd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9558128d10 0x7f95581290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f955d5fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f955812bb20 0x7f955812bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59322/0 (socket says 172.21.15.80:59322) 2024-02-18T16:20:52.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f955d5fc640 1 -- 172.21.15.80:0/1315201706 learned_addr learned my addr 172.21.15.80:0/1315201706 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f955ddfd640 1 -- 172.21.15.80:0/1315201706 >> v1:172.21.15.80:6789/0 conn(0x7f955812bb20 legacy=0x7f955812bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.240+0000 7f955ddfd640 1 -- 172.21.15.80:0/1315201706 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558096320 con 0x7f9558128d10 2024-02-18T16:20:52.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955ddfd640 1 --2- 172.21.15.80:0/1315201706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581290f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f954c009740 tx=0x7f954c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0f586596b1910 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955cdfb640 1 -- 172.21.15.80:0/1315201706 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c0ab530 con 0x7f9558128d10 2024-02-18T16:20:52.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955cdfb640 1 -- 172.21.15.80:0/1315201706 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c0a7050 con 0x7f9558128d10 2024-02-18T16:20:52.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955cdfb640 1 -- 172.21.15.80:0/1315201706 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c0ab7e0 con 0x7f9558128d10 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- 172.21.15.80:0/1315201706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 msgr2=0x7f95581290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 --2- 172.21.15.80:0/1315201706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581290f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f954c009740 tx=0x7f954c01c400 comp rx=0 tx=0).stop 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- 172.21.15.80:0/1315201706 shutdown_connections 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 --2- 172.21.15.80:0/1315201706 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581290f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- 172.21.15.80:0/1315201706 >> 172.21.15.80:0/1315201706 conn(0x7f955809a2f0 msgr2=0x7f955809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- 172.21.15.80:0/1315201706 shutdown_connections 2024-02-18T16:20:52.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- 172.21.15.80:0/1315201706 wait complete. 2024-02-18T16:20:52.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 Processor -- start 2024-02-18T16:20:52.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- start start 2024-02-18T16:20:52.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f9560061640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558071970 con 0x7f9558128d10 2024-02-18T16:20:52.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955ddfd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955ddfd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37490/0 (socket says 172.21.15.80:37490) 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.244+0000 7f955ddfd640 1 -- 172.21.15.80:0/1029734599 learned_addr learned my addr 172.21.15.80:0/1029734599 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f955ddfd640 1 -- 172.21.15.80:0/1029734599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009420 con 0x7f9558128d10 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f955ddfd640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581c3ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f954c01a030 tx=0x7f954c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c0b4750 con 0x7f9558128d10 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c0a4e90 con 0x7f9558128d10 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955812cc70 con 0x7f9558128d10 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c0b49e0 con 0x7f9558128d10 2024-02-18T16:20:52.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9558071650 con 0x7f9558128d10 2024-02-18T16:20:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9558067e00 con 0x7f9558128d10 2024-02-18T16:20:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f954c0b2040 con 0x7f9558128d10 2024-02-18T16:20:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f954a7fc640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f953c035a10 0x7f953c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f954c0e21d0 con 0x7f9558128d10 2024-02-18T16:20:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f955d5fc640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f953c035a10 0x7f953c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.248+0000 7f955d5fc640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f953c035a10 0x7f953c037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9554001610 tx=0x7f9554007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.252+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f954c0bc9a0 con 0x7f9558128d10 2024-02-18T16:20:52.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.408+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955812cff0 con 0x7f9558128d10 2024-02-18T16:20:52.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.408+0000 7f954a7fc640 1 -- 172.21.15.80:0/1029734599 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9744 (secure 0 0 0) 0x7f954c0b0070 con 0x7f9558128d10 2024-02-18T16:20:52.416 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:52.416 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:20:51.760759+0000","last_up_change":"2024-02-18T16:20:43.736890+0000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T16:20:43.836552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-18T16:20:50.707832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6801","nonce":4245413050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6803","nonce":4245413050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6807","nonce":4245413050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6805","nonce":4245413050}]},"public_addr":"172.21.15.80:6801/4245413050","cluster_addr":"172.21.15.80:6803/4245413050","heartbeat_back_addr":"172.21.15.80:6807/4245413050","heartbeat_front_addr":"172.21.15.80:6805/4245413050","state":["exists","up"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6817","nonce":834716550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6819","nonce":834716550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6823","nonce":834716550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6821","nonce":834716550}]},"public_addr":"172.21.15.129:6817/834716550","cluster_addr":"172.21.15.129:6819/834716550","heartbeat_back_addr":"172.21.15.129:6823/834716550","heartbeat_front_addr":"172.21.15.129:6821/834716550","state":["exists","up"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6809","nonce":222672308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6811","nonce":222672308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6815","nonce":222672308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6813","nonce":222672308}]},"public_addr":"172.21.15.129:6809/222672308","cluster_addr":"172.21.15.129:6811/222672308","heartbeat_back_addr":"172.21.15.129:6815/222672308","heartbeat_front_addr":"172.21.15.129:6813/222672308","state":["exists","up"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6801","nonce":2085458436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6803","nonce":2085458436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6807","nonce":2085458436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6805","nonce":2085458436}]},"public_addr":"172.21.15.129:6801/2085458436","cluster_addr":"172.21.15.129:6803/2085458436","heartbeat_back_addr":"172.21.15.129:6807/2085458436","heartbeat_front_addr":"172.21.15.129:6805/2085458436","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.403254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.666337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.547176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.636781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:20:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f953c035a10 msgr2=0x7f953c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f953c035a10 0x7f953c037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9554001610 tx=0x7f9554007ad0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 msgr2=0x7f95581c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581c3ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f954c01a030 tx=0x7f954c0191a0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 shutdown_connections 2024-02-18T16:20:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f953c035a10 0x7f953c037ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 --2- 172.21.15.80:0/1029734599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9558128d10 0x7f95581c3ac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 >> 172.21.15.80:0/1029734599 conn(0x7f955809a2f0 msgr2=0x7f9558097170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 shutdown_connections 2024-02-18T16:20:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.412+0000 7f9560061640 1 -- 172.21.15.80:0/1029734599 wait complete. 2024-02-18T16:20:52.433 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-18T16:20:52.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T16:20:52.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870cbf4640 1 Processor -- start 2024-02-18T16:20:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870cbf4640 1 -- start start 2024-02-18T16:20:52.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870cbf4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f870809d7e0 0x7f87081332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870cbf4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8708099d80 con 0x7f8708098910 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870cbf4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870809a340 con 0x7f870809d7e0 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f8705d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f870809d7e0 0x7f87081332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8708098910 0x7f8708098cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59328/0 (socket says 172.21.15.80:59328) 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f870659c640 1 -- 172.21.15.80:0/1767559390 learned_addr learned my addr 172.21.15.80:0/1767559390 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f8705d9b640 1 -- 172.21.15.80:0/1767559390 >> v1:172.21.15.80:6789/0 conn(0x7f8708098910 legacy=0x7f8708098cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.540+0000 7f8705d9b640 1 -- 172.21.15.80:0/1767559390 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870809a5e0 con 0x7f870809d7e0 2024-02-18T16:20:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f8705d9b640 1 --2- 172.21.15.80:0/1767559390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f870809d7e0 0x7f87081332f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009740 tx=0x7f86fc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984708675dd7cc29 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870559a640 1 -- 172.21.15.80:0/1767559390 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86fc0ab530 con 0x7f870809d7e0 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870559a640 1 -- 172.21.15.80:0/1767559390 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc0a7050 con 0x7f870809d7e0 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870559a640 1 -- 172.21.15.80:0/1767559390 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86fc0ab7e0 con 0x7f870809d7e0 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- 172.21.15.80:0/1767559390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f870809d7e0 msgr2=0x7f87081332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 --2- 172.21.15.80:0/1767559390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f870809d7e0 0x7f87081332f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009740 tx=0x7f86fc01c370 comp rx=0 tx=0).stop 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- 172.21.15.80:0/1767559390 shutdown_connections 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 --2- 172.21.15.80:0/1767559390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f870809d7e0 0x7f87081332f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- 172.21.15.80:0/1767559390 >> 172.21.15.80:0/1767559390 conn(0x7f87080a0a00 msgr2=0x7f870809cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- 172.21.15.80:0/1767559390 shutdown_connections 2024-02-18T16:20:52.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- 172.21.15.80:0/1767559390 wait complete. 2024-02-18T16:20:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 Processor -- start 2024-02-18T16:20:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- start start 2024-02-18T16:20:52.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 0x7f87081c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870cbf4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87081324f0 con 0x7f8708098910 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 0x7f87081c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 0x7f87081c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37514/0 (socket says 172.21.15.80:37514) 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870659c640 1 -- 172.21.15.80:0/4242645111 learned_addr learned my addr 172.21.15.80:0/4242645111 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870659c640 1 -- 172.21.15.80:0/4242645111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc009420 con 0x7f8708098910 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.544+0000 7f870659c640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 0x7f87081c5940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f86f800cb20 tx=0x7f86f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86f800abf0 con 0x7f8708098910 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800ad50 con 0x7f8708098910 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8708131100 con 0x7f8708098910 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86f8012400 con 0x7f8708098910 2024-02-18T16:20:52.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87081321e0 con 0x7f8708098910 2024-02-18T16:20:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8708062860 con 0x7f8708098910 2024-02-18T16:20:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f86f8012560 con 0x7f8708098910 2024-02-18T16:20:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f86f6ffd640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e8035a10 0x7f86e8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f86f8047cd0 con 0x7f8708098910 2024-02-18T16:20:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f8705d9b640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e8035a10 0x7f86e8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.548+0000 7f8705d9b640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e8035a10 0x7f86e8037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0ad000 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.552+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f86f8007070 con 0x7f8708098910 2024-02-18T16:20:52.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.700+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8708073100 con 0x7f8708098910 2024-02-18T16:20:52.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.700+0000 7f86f6ffd640 1 -- 172.21.15.80:0/4242645111 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9744 (secure 0 0 0) 0x7f86f8017030 con 0x7f8708098910 2024-02-18T16:20:52.706 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:52.707 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:20:51.760759+0000","last_up_change":"2024-02-18T16:20:43.736890+0000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T16:20:43.836552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-18T16:20:50.707832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6801","nonce":4245413050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6803","nonce":4245413050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6807","nonce":4245413050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6805","nonce":4245413050}]},"public_addr":"172.21.15.80:6801/4245413050","cluster_addr":"172.21.15.80:6803/4245413050","heartbeat_back_addr":"172.21.15.80:6807/4245413050","heartbeat_front_addr":"172.21.15.80:6805/4245413050","state":["exists","up"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6817","nonce":834716550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6819","nonce":834716550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6823","nonce":834716550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6821","nonce":834716550}]},"public_addr":"172.21.15.129:6817/834716550","cluster_addr":"172.21.15.129:6819/834716550","heartbeat_back_addr":"172.21.15.129:6823/834716550","heartbeat_front_addr":"172.21.15.129:6821/834716550","state":["exists","up"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6809","nonce":222672308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6811","nonce":222672308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6815","nonce":222672308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6813","nonce":222672308}]},"public_addr":"172.21.15.129:6809/222672308","cluster_addr":"172.21.15.129:6811/222672308","heartbeat_back_addr":"172.21.15.129:6815/222672308","heartbeat_front_addr":"172.21.15.129:6813/222672308","state":["exists","up"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6801","nonce":2085458436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6803","nonce":2085458436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6807","nonce":2085458436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6805","nonce":2085458436}]},"public_addr":"172.21.15.129:6801/2085458436","cluster_addr":"172.21.15.129:6803/2085458436","heartbeat_back_addr":"172.21.15.129:6807/2085458436","heartbeat_front_addr":"172.21.15.129:6805/2085458436","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.403254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.666337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.547176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.636781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:20:52.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.700+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e8035a10 msgr2=0x7f86e8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.700+0000 7f870cbf4640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e8035a10 0x7f86e8037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0ad000 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.700+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 msgr2=0x7f87081c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.700+0000 7f870cbf4640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 0x7f87081c5940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f86f800cb20 tx=0x7f86f800a060 comp rx=0 tx=0).stop 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.704+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 shutdown_connections 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.704+0000 7f870cbf4640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e8035a10 0x7f86e8037ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.704+0000 7f870cbf4640 1 --2- 172.21.15.80:0/4242645111 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8708098910 0x7f87081c5940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.704+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 >> 172.21.15.80:0/4242645111 conn(0x7f87080a0a00 msgr2=0x7f8708095690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.704+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 shutdown_connections 2024-02-18T16:20:52.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.704+0000 7f870cbf4640 1 -- 172.21.15.80:0/4242645111 wait complete. 2024-02-18T16:20:52.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-18T16:20:52.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-18T16:20:52.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-18T16:20:52.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-18T16:20:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eb5f35640 1 Processor -- start 2024-02-18T16:20:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eb5f35640 1 -- start start 2024-02-18T16:20:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eb5f35640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1eb0130fa0 0x7f1eb0133390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eb5f35640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb0072150 con 0x7f1eb012dfc0 2024-02-18T16:20:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eb5f35640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00726c0 con 0x7f1eb0130fa0 2024-02-18T16:20:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eaeffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1eb0130fa0 0x7f1eb0133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eaeffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1eb0130fa0 0x7f1eb0133390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37522/0 (socket says 172.21.15.80:37522) 2024-02-18T16:20:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eaeffd640 1 -- 172.21.15.80:0/791203030 learned_addr learned my addr 172.21.15.80:0/791203030 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eaeffd640 1 -- 172.21.15.80:0/791203030 >> v1:172.21.15.80:6789/0 conn(0x7f1eb012dfc0 legacy=0x7f1eb012e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T16:20:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.824+0000 7f1eaeffd640 1 -- 172.21.15.80:0/791203030 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0071f30 con 0x7f1eb0130fa0 2024-02-18T16:20:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcee4f4640 1 Processor -- start 2024-02-18T16:20:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcee4f4640 1 -- start start 2024-02-18T16:20:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0378f86640 1 Processor -- start 2024-02-18T16:20:52.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0378f86640 1 -- start start 2024-02-18T16:20:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcee4f4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdce812e880 0x7fdce8132ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcee4f4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce8115770 con 0x7fdce812db70 2024-02-18T16:20:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcee4f4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce812df50 con 0x7fdce812e880 2024-02-18T16:20:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdce7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdce812db70 0x7fdce812e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59346/0 (socket says 172.21.15.80:59346) 2024-02-18T16:20:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdce7fff640 1 -- 172.21.15.80:0/3202165978 learned_addr learned my addr 172.21.15.80:0/3202165978 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcdffff640 1 --2- 172.21.15.80:0/3202165978 >> v2:172.21.15.80:3300/0 conn(0x7fdce812e880 0x7fdce8132ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0378f86640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f037412e890 0x7f0374132f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0378f86640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037406ec70 con 0x7f037412dbf0 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0378f86640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037406ef90 con 0x7f037412e890 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0371d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f037412e890 0x7f0374132f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f037259c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f037412dbf0 0x7f037412e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59358/0 (socket says 172.21.15.80:59358) 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f037259c640 1 -- 172.21.15.80:0/797099723 learned_addr learned my addr 172.21.15.80:0/797099723 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdce77fe640 1 -- 172.21.15.80:0/3202165978 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137909028 0 0) 0x7fdce8115770 con 0x7fdce812db70 2024-02-18T16:20:52.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdce77fe640 1 -- 172.21.15.80:0/3202165978 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd4003530 con 0x7fdce812db70 2024-02-18T16:20:52.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0371d9b640 1 -- 172.21.15.80:0/797099723 >> v1:172.21.15.80:6789/0 conn(0x7f037412dbf0 legacy=0x7f037412e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T16:20:52.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcdffff640 1 -- 172.21.15.80:0/3202165978 >> v1:172.21.15.80:6789/0 conn(0x7fdce812db70 legacy=0x7fdce812e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7fdcdffff640 1 -- 172.21.15.80:0/3202165978 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8114c50 con 0x7fdce812e880 2024-02-18T16:20:52.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f0371d9b640 1 -- 172.21.15.80:0/797099723 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374114cb0 con 0x7f037412e890 2024-02-18T16:20:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eaeffd640 1 --2- 172.21.15.80:0/791203030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb0130fa0 0x7f1eb0133390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40097f0 tx=0x7f1ea401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48040967e1fc4088 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eae7fc640 1 -- 172.21.15.80:0/791203030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ea40ab540 con 0x7f1eb0130fa0 2024-02-18T16:20:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eae7fc640 1 -- 172.21.15.80:0/791203030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea40ab6a0 con 0x7f1eb0130fa0 2024-02-18T16:20:52.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eae7fc640 1 -- 172.21.15.80:0/791203030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ea40ab960 con 0x7f1eb0130fa0 2024-02-18T16:20:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f512ca0d640 1 Processor -- start 2024-02-18T16:20:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f512ca0d640 1 -- start start 2024-02-18T16:20:52.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eb5f35640 1 -- 172.21.15.80:0/791203030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb0130fa0 msgr2=0x7f1eb0133390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/791203030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb0130fa0 0x7f1eb0133390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40097f0 tx=0x7f1ea401c3f0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eb5f35640 1 -- 172.21.15.80:0/791203030 shutdown_connections 2024-02-18T16:20:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/791203030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb0130fa0 0x7f1eb0133390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f1eb5f35640 1 -- 172.21.15.80:0/791203030 >> 172.21.15.80:0/791203030 conn(0x7f1eb009d4e0 msgr2=0x7f1eb009d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f512ca0d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5128066b60 0x7f512806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f512ca0d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512806e8f0 con 0x7f5128071a60 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f512ca0d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512806dc70 con 0x7f5128066b60 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f511dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5128066b60 0x7f512806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f511dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5128066b60 0x7f512806d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37544/0 (socket says 172.21.15.80:37544) 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f511dd9b640 1 -- 172.21.15.80:0/2857911348 learned_addr learned my addr 172.21.15.80:0/2857911348 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f511dd9b640 1 -- 172.21.15.80:0/2857911348 >> v1:172.21.15.80:6789/0 conn(0x7f5128071a60 legacy=0x7f512806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.828+0000 7f511dd9b640 1 -- 172.21.15.80:0/2857911348 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512806ec00 con 0x7f5128066b60 2024-02-18T16:20:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcdffff640 1 --2- 172.21.15.80:0/3202165978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812e880 0x7fdce8132ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009740 tx=0x7fdcd001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b04bc513bd72ce server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce77fe640 1 -- 172.21.15.80:0/3202165978 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd00ac530 con 0x7fdce812e880 2024-02-18T16:20:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce77fe640 1 -- 172.21.15.80:0/3202165978 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd00a8050 con 0x7fdce812e880 2024-02-18T16:20:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 -- 172.21.15.80:0/791203030 shutdown_connections 2024-02-18T16:20:52.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce77fe640 1 -- 172.21.15.80:0/3202165978 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd00ac7e0 con 0x7fdce812e880 2024-02-18T16:20:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0371d9b640 1 --2- 172.21.15.80:0/797099723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412e890 0x7f0374132f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0368009740 tx=0x7f036801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f6a108e3b5a2f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f037159a640 1 -- 172.21.15.80:0/797099723 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03680ab530 con 0x7f037412e890 2024-02-18T16:20:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f037159a640 1 -- 172.21.15.80:0/797099723 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03680a7050 con 0x7f037412e890 2024-02-18T16:20:52.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f037159a640 1 -- 172.21.15.80:0/797099723 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03680ab7e0 con 0x7f037412e890 2024-02-18T16:20:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- 172.21.15.80:0/3202165978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812e880 msgr2=0x7fdce8132ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/3202165978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812e880 0x7fdce8132ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009740 tx=0x7fdcd001c450 comp rx=0 tx=0).stop 2024-02-18T16:20:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- 172.21.15.80:0/3202165978 shutdown_connections 2024-02-18T16:20:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/3202165978 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812e880 0x7fdce8132ef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- 172.21.15.80:0/3202165978 >> 172.21.15.80:0/3202165978 conn(0x7fdce806f5c0 msgr2=0x7fdce80719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- 172.21.15.80:0/3202165978 shutdown_connections 2024-02-18T16:20:52.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- 172.21.15.80:0/3202165978 wait complete. 2024-02-18T16:20:52.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 -- 172.21.15.80:0/791203030 wait complete. 2024-02-18T16:20:52.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 Processor -- start 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- 172.21.15.80:0/797099723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412e890 msgr2=0x7f0374132f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 --2- 172.21.15.80:0/797099723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412e890 0x7f0374132f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0368009740 tx=0x7f036801c330 comp rx=0 tx=0).stop 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- 172.21.15.80:0/797099723 shutdown_connections 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 --2- 172.21.15.80:0/797099723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412e890 0x7f0374132f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- 172.21.15.80:0/797099723 >> 172.21.15.80:0/797099723 conn(0x7f037406f3f0 msgr2=0x7f0374071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- 172.21.15.80:0/797099723 shutdown_connections 2024-02-18T16:20:52.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- 172.21.15.80:0/797099723 wait complete. 2024-02-18T16:20:52.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 -- start start 2024-02-18T16:20:52.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 0x7f1eb01c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb012b4b0 con 0x7f1eb012dfc0 2024-02-18T16:20:52.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f511dd9b640 1 --2- 172.21.15.80:0/2857911348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512806d2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51100097f0 tx=0x7f511001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d8d64ae856a7aa server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 0x7f1eb01c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 0x7f1eb01c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37552/0 (socket says 172.21.15.80:37552) 2024-02-18T16:20:52.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eaf7fe640 1 -- 172.21.15.80:0/987205057 learned_addr learned my addr 172.21.15.80:0/987205057 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f5125d9b640 1 -- 172.21.15.80:0/2857911348 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51100ab530 con 0x7f5128066b60 2024-02-18T16:20:52.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f5125d9b640 1 -- 172.21.15.80:0/2857911348 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51100a7050 con 0x7f5128066b60 2024-02-18T16:20:52.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f5125d9b640 1 -- 172.21.15.80:0/2857911348 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51100ab7e0 con 0x7f5128066b60 2024-02-18T16:20:52.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 Processor -- start 2024-02-18T16:20:52.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eaf7fe640 1 -- 172.21.15.80:0/987205057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40094d0 con 0x7f1eb012dfc0 2024-02-18T16:20:52.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- start start 2024-02-18T16:20:52.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eaf7fe640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 0x7f1eb01c3330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c3d0 tx=0x7f1ea000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 Processor -- start 2024-02-18T16:20:52.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- start start 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ea00116c0 con 0x7f1eb012dfc0 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0011820 con 0x7f1eb012dfc0 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb009a710 con 0x7f1eb012dfc0 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0011b00 con 0x7f1eb012dfc0 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb01333a0 con 0x7f1eb012dfc0 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 0x7fdce81c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdcee4f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce809cf10 con 0x7fdce812db70 2024-02-18T16:20:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f512ca0d640 1 -- 172.21.15.80:0/2857911348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 msgr2=0x7f512806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f512ca0d640 1 --2- 172.21.15.80:0/2857911348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512806d2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51100097f0 tx=0x7f511001c430 comp rx=0 tx=0).stop 2024-02-18T16:20:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f512ca0d640 1 -- 172.21.15.80:0/2857911348 shutdown_connections 2024-02-18T16:20:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f512ca0d640 1 --2- 172.21.15.80:0/2857911348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512806d2c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f512ca0d640 1 -- 172.21.15.80:0/2857911348 >> 172.21.15.80:0/2857911348 conn(0x7f512809c8e0 msgr2=0x7f512809ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 0x7f0374130c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f0378f86640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0374131e00 con 0x7f037412dbf0 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f037259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 0x7f0374130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f037259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 0x7f0374130c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37564/0 (socket says 172.21.15.80:37564) 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f037259c640 1 -- 172.21.15.80:0/2508501214 learned_addr learned my addr 172.21.15.80:0/2508501214 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7f512ca0d640 1 -- 172.21.15.80:0/2857911348 shutdown_connections 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 -- 172.21.15.80:0/2857911348 wait complete. 2024-02-18T16:20:52.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1eb01360f0 con 0x7f1eb012dfc0 2024-02-18T16:20:52.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 0x7fdce81c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 0x7fdce81c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37562/0 (socket says 172.21.15.80:37562) 2024-02-18T16:20:52.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce7fff640 1 -- 172.21.15.80:0/4187999359 learned_addr learned my addr 172.21.15.80:0/4187999359 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.832+0000 7fdce7fff640 1 -- 172.21.15.80:0/4187999359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009420 con 0x7fdce812db70 2024-02-18T16:20:52.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f037259c640 1 -- 172.21.15.80:0/2508501214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368009420 con 0x7f037412dbf0 2024-02-18T16:20:52.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f037259c640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 0x7f0374130c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f036400b3b0 tx=0x7f036400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1ea0011c60 con 0x7f1eb012dfc0 2024-02-18T16:20:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0364011760 con 0x7f037412dbf0 2024-02-18T16:20:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03640118e0 con 0x7f037412dbf0 2024-02-18T16:20:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0374132510 con 0x7f037412dbf0 2024-02-18T16:20:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0364011bc0 con 0x7f037412dbf0 2024-02-18T16:20:52.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0374116fd0 con 0x7f037412dbf0 2024-02-18T16:20:52.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1e97fff640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1e9c035a10 0x7f1e9c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f1ea0047650 con 0x7f1eb012dfc0 2024-02-18T16:20:52.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1e97fff640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f1e9c03b190 0x7f1e9c03d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e9c03dca0 con 0x7f1e9c03b190 2024-02-18T16:20:52.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ea0049cc0 con 0x7f1eb012dfc0 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce7fff640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 0x7fdce81c8be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c3f0 tx=0x7fdcd800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8007410 con 0x7fdce812db70 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8007570 con 0x7fdce812db70 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce809c510 con 0x7fdce812db70 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8004920 con 0x7fdce812db70 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce812efb0 con 0x7fdce812db70 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 Processor -- start 2024-02-18T16:20:52.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1eaffff640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f1e9c03b190 0x7f1e9c03d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdcd8004a80 con 0x7fdce812db70 2024-02-18T16:20:52.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0358000f90 con 0x7f037412dbf0 2024-02-18T16:20:52.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdce8132c70 con 0x7fdce812db70 2024-02-18T16:20:52.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcc8035a60 0x7fdcc8037f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fdcd8047b40 con 0x7fdce812db70 2024-02-18T16:20:52.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0364011d20 con 0x7f037412dbf0 2024-02-18T16:20:52.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc803b1e0 0x7fdcc803d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcc803dcf0 con 0x7fdcc803b1e0 2024-02-18T16:20:52.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd80133c0 con 0x7fdce812db70 2024-02-18T16:20:52.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 -- start start 2024-02-18T16:20:52.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512808a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128070810 con 0x7f5128066b60 2024-02-18T16:20:52.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1eaeffd640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1e9c035a10 0x7f1e9c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdcdffff640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcc8035a60 0x7fdcc8037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0354035a60 0x7f0354037f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512808a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512808a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37572/0 (socket says 172.21.15.80:37572) 2024-02-18T16:20:52.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512659c640 1 -- 172.21.15.80:0/3385082549 learned_addr learned my addr 172.21.15.80:0/3385082549 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0364047e20 con 0x7f037412dbf0 2024-02-18T16:20:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1eaffff640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f1e9c03b190 0x7f1e9c03d5d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f035403b1e0 0x7f035403d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f035403dcf0 con 0x7f035403b1e0 2024-02-18T16:20:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f036404a410 con 0x7f037412dbf0 2024-02-18T16:20:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdceca91640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc803b1e0 0x7fdcc803d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0372d9d640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f035403b1e0 0x7f035403d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0371d9b640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0354035a60 0x7f0354037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512659c640 1 -- 172.21.15.80:0/3385082549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100094d0 con 0x7f5128066b60 2024-02-18T16:20:52.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f1eaeffd640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1e9c035a10 0x7f1e9c037ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40af000 tx=0x7f1ea4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512659c640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512808a080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f511800c480 tx=0x7f511800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0372d9d640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f035403b1e0 0x7f035403d620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5118005150 con 0x7f5128066b60 2024-02-18T16:20:52.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdcdffff640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcc8035a60 0x7fdcc8037f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009740 tx=0x7fdcd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512808db50 con 0x7f5128066b60 2024-02-18T16:20:52.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51180052b0 con 0x7f5128066b60 2024-02-18T16:20:52.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5118007030 con 0x7f5128066b60 2024-02-18T16:20:52.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512808cc90 con 0x7f5128066b60 2024-02-18T16:20:52.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7fdceca91640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc803b1e0 0x7fdcc803d620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0371d9b640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0354035a60 0x7f0354037f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03680ad000 tx=0x7f0368008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f512808cfe0 con 0x7f5128066b60 2024-02-18T16:20:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.836+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f035403dcf0 con 0x7f035403b1e0 2024-02-18T16:20:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f51180072a0 con 0x7f5128066b60 2024-02-18T16:20:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51080359c0 0x7f5108037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f51180471c0 con 0x7f5128066b60 2024-02-18T16:20:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f510803b140 0x7f510803d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f510803dc50 con 0x7f510803b140 2024-02-18T16:20:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51180498b0 con 0x7f5128066b60 2024-02-18T16:20:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1e9c03dca0 con 0x7f1e9c03b190 2024-02-18T16:20:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511dd9b640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51080359c0 0x7f5108037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f5126d9d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f510803b140 0x7f510803d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511dd9b640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51080359c0 0x7f5108037e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f51100ad000 tx=0x7f5110008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f5126d9d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f510803b140 0x7f510803d580 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.840+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f510803dc50 con 0x7f510803b140 2024-02-18T16:20:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.844+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdcc803dcf0 con 0x7fdcc803b1e0 2024-02-18T16:20:52.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0358002be0 con 0x7f035403b1e0 2024-02-18T16:20:52.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0362ffd640 1 -- 172.21.15.80:0/2508501214 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0358002be0 con 0x7f035403b1e0 2024-02-18T16:20:52.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1eb0062860 con 0x7f1e9c03b190 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f035403b1e0 msgr2=0x7f035403d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f035403b1e0 0x7f035403d620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0354035a60 msgr2=0x7f0354037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0354035a60 0x7f0354037f20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03680ad000 tx=0x7f0368008040 comp rx=0 tx=0).stop 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 msgr2=0x7f0374130c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 0x7f0374130c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f036400b3b0 tx=0x7f036400b870 comp rx=0 tx=0).stop 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 shutdown_connections 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f035403b1e0 0x7f035403d620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0354035a60 0x7f0354037f20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 --2- 172.21.15.80:0/2508501214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f037412dbf0 0x7f0374130c00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 >> 172.21.15.80:0/2508501214 conn(0x7f037406f3f0 msgr2=0x7f0374127100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 shutdown_connections 2024-02-18T16:20:52.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f0378f86640 1 -- 172.21.15.80:0/2508501214 wait complete. 2024-02-18T16:20:52.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1e97fff640 1 -- 172.21.15.80:0/987205057 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1eb0062860 con 0x7f1e9c03b190 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f1e9c03b190 msgr2=0x7f1e9c03d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f1e9c03b190 0x7f1e9c03d5d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1e9c035a10 msgr2=0x7f1e9c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1e9c035a10 0x7f1e9c037ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40af000 tx=0x7f1ea4008040 comp rx=0 tx=0).stop 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 msgr2=0x7f1eb01c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 0x7f1eb01c3330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c3d0 tx=0x7f1ea000c890 comp rx=0 tx=0).stop 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 shutdown_connections 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f1e9c03b190 0x7f1e9c03d5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1e9c035a10 0x7f1e9c037ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 --2- 172.21.15.80:0/987205057 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1eb012dfc0 0x7f1eb01c3330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 >> 172.21.15.80:0/987205057 conn(0x7f1eb009d4e0 msgr2=0x7f1eb0096300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 shutdown_connections 2024-02-18T16:20:52.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.852+0000 7f1eb5f35640 1 -- 172.21.15.80:0/987205057 wait complete. 2024-02-18T16:20:52.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f512808d7a0 con 0x7f510803b140 2024-02-18T16:20:52.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdce809d5a0 con 0x7fdcc803b1e0 2024-02-18T16:20:52.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f511f7fe640 1 -- 172.21.15.80:0/3385082549 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5120011040 con 0x7f510803b140 2024-02-18T16:20:52.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdce57fa640 1 -- 172.21.15.80:0/4187999359 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdce0011040 con 0x7fdcc803b1e0 2024-02-18T16:20:52.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f510803b140 msgr2=0x7f510803d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f510803b140 0x7f510803d580 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51080359c0 msgr2=0x7f5108037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51080359c0 0x7f5108037e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f51100ad000 tx=0x7f5110008040 comp rx=0 tx=0).stop 2024-02-18T16:20:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 msgr2=0x7f512808a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512808a080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f511800c480 tx=0x7f511800c940 comp rx=0 tx=0).stop 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 shutdown_connections 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f510803b140 0x7f510803d580 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51080359c0 0x7f5108037e80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 --2- 172.21.15.80:0/3385082549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5128066b60 0x7f512808a080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 >> 172.21.15.80:0/3385082549 conn(0x7f512809c8e0 msgr2=0x7f51280972e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 shutdown_connections 2024-02-18T16:20:52.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7f512ca0d640 1 -- 172.21.15.80:0/3385082549 wait complete. 2024-02-18T16:20:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc803b1e0 msgr2=0x7fdcc803d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc803b1e0 0x7fdcc803d620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcc8035a60 msgr2=0x7fdcc8037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcc8035a60 0x7fdcc8037f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009740 tx=0x7fdcd0008040 comp rx=0 tx=0).stop 2024-02-18T16:20:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 msgr2=0x7fdce81c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 0x7fdce81c8be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c3f0 tx=0x7fdcd800c8b0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 shutdown_connections 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcc8035a60 0x7fdcc8037f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc803b1e0 0x7fdcc803d620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 --2- 172.21.15.80:0/4187999359 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdce812db70 0x7fdce81c8be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 >> 172.21.15.80:0/4187999359 conn(0x7fdce806f5c0 msgr2=0x7fdce812c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 shutdown_connections 2024-02-18T16:20:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.856+0000 7fdcee4f4640 1 -- 172.21.15.80:0/4187999359 wait complete. 2024-02-18T16:20:52.884 INFO:teuthology.orchestra.run.smithi080.stdout:38654705669 2024-02-18T16:20:52.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-18T16:20:52.885 INFO:teuthology.orchestra.run.smithi080.stdout:38654705669 2024-02-18T16:20:52.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-18T16:20:52.889 INFO:teuthology.orchestra.run.smithi080.stdout:38654705668 2024-02-18T16:20:52.889 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-18T16:20:52.890 INFO:teuthology.orchestra.run.smithi080.stdout:38654705668 2024-02-18T16:20:52.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-18T16:20:52.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd551795640 1 Processor -- start 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd551795640 1 -- start start 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd551795640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c06c0d0 0x7fd54c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd551795640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c096290 con 0x7fd54c095640 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd551795640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c09df10 con 0x7fd54c06c0d0 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd54a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd54c095640 0x7fd54c06c9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59372/0 (socket says 172.21.15.80:59372) 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd54affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd54c06c0d0 0x7fd54c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd54a7fc640 1 -- 172.21.15.80:0/3696712091 learned_addr learned my addr 172.21.15.80:0/3696712091 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:52.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd54affd640 1 -- 172.21.15.80:0/3696712091 >> v1:172.21.15.80:6789/0 conn(0x7fd54c095640 legacy=0x7fd54c06c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd54affd640 1 -- 172.21.15.80:0/3696712091 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c09a470 con 0x7fd54c06c0d0 2024-02-18T16:20:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd54affd640 1 --2- 172.21.15.80:0/3696712091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c06c4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009740 tx=0x7fd53c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20732a15cfd3cf4c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd549ffb640 1 -- 172.21.15.80:0/3696712091 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c0ab530 con 0x7fd54c06c0d0 2024-02-18T16:20:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd549ffb640 1 -- 172.21.15.80:0/3696712091 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0a7050 con 0x7fd54c06c0d0 2024-02-18T16:20:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.984+0000 7fd549ffb640 1 -- 172.21.15.80:0/3696712091 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c0ab7e0 con 0x7fd54c06c0d0 2024-02-18T16:20:52.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- 172.21.15.80:0/3696712091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 msgr2=0x7fd54c06c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 --2- 172.21.15.80:0/3696712091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c06c4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009740 tx=0x7fd53c01c370 comp rx=0 tx=0).stop 2024-02-18T16:20:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- 172.21.15.80:0/3696712091 shutdown_connections 2024-02-18T16:20:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 --2- 172.21.15.80:0/3696712091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c06c4b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- 172.21.15.80:0/3696712091 >> 172.21.15.80:0/3696712091 conn(0x7fd54c09d600 msgr2=0x7fd54c099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- 172.21.15.80:0/3696712091 shutdown_connections 2024-02-18T16:20:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- 172.21.15.80:0/3696712091 wait complete. 2024-02-18T16:20:52.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 Processor -- start 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- start start 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c122290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd551795640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c124b90 con 0x7fd54c06c0d0 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd54affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c122290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd54affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c122290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37592/0 (socket says 172.21.15.80:37592) 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd54affd640 1 -- 172.21.15.80:0/677561222 learned_addr learned my addr 172.21.15.80:0/677561222 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd54affd640 1 -- 172.21.15.80:0/677561222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c009420 con 0x7fd54c06c0d0 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd54affd640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c122290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd53c019fa0 tx=0x7fd53c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c0b7790 con 0x7fd54c06c0d0 2024-02-18T16:20:52.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0b78f0 con 0x7fd54c06c0d0 2024-02-18T16:20:52.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.988+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd53c0b7b90 con 0x7fd54c06c0d0 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd551795640 1 -- 172.21.15.80:0/677561222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c125640 con 0x7fd54c06c0d0 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd551795640 1 -- 172.21.15.80:0/677561222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c124d70 con 0x7fd54c06c0d0 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524005090 con 0x7fd54c06c0d0 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd53c0b7cf0 con 0x7fd54c06c0d0 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd5337fe640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd538035a40 0x7fd538037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fd53c0e29f0 con 0x7fd54c06c0d0 2024-02-18T16:20:52.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd54a7fc640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd538035a40 0x7fd538037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:52.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:52.992+0000 7fd54a7fc640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd538035a40 0x7fd538037f00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd540005890 tx=0x7fd540007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.000+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd53c0b3300 con 0x7fd54c06c0d0 2024-02-18T16:20:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515b673640 1 Processor -- start 2024-02-18T16:20:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515b673640 1 -- start start 2024-02-18T16:20:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515b673640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5154099560 0x7f5154130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515b673640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5154072150 con 0x7f5154098a70 2024-02-18T16:20:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515b673640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515409b060 con 0x7f5154099560 2024-02-18T16:20:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f5158c0e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5154099560 0x7f5154130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515940f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5154098a70 0x7f5154098e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59374/0 (socket says 172.21.15.80:59374) 2024-02-18T16:20:53.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f5158c0e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5154099560 0x7f5154130fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37600/0 (socket says 172.21.15.80:37600) 2024-02-18T16:20:53.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f515940f640 1 -- 172.21.15.80:0/4243652844 learned_addr learned my addr 172.21.15.80:0/4243652844 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:53.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f5158c0e640 1 -- 172.21.15.80:0/4243652844 >> v1:172.21.15.80:6789/0 conn(0x7f5154098a70 legacy=0x7f5154098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f5158c0e640 1 -- 172.21.15.80:0/4243652844 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515409a910 con 0x7f5154099560 2024-02-18T16:20:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f43394ee640 1 Processor -- start 2024-02-18T16:20:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f43394ee640 1 -- start start 2024-02-18T16:20:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f43394ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f433412df20 0x7f4334130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f43394ee640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433406f950 con 0x7f4334096410 2024-02-18T16:20:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.036+0000 7f43394ee640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433406f390 con 0x7f433412df20 2024-02-18T16:20:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f4332ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4334096410 0x7f43340967f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59382/0 (socket says 172.21.15.80:59382) 2024-02-18T16:20:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f4332ffd640 1 -- 172.21.15.80:0/134003997 learned_addr learned my addr 172.21.15.80:0/134003997 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f43327fc640 1 --2- 172.21.15.80:0/134003997 >> v2:172.21.15.80:3300/0 conn(0x7f433412df20 0x7f4334130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f43327fc640 1 -- 172.21.15.80:0/134003997 >> v1:172.21.15.80:6789/0 conn(0x7f4334096410 legacy=0x7f43340967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f43327fc640 1 -- 172.21.15.80:0/134003997 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334096f00 con 0x7f433412df20 2024-02-18T16:20:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f4331ffb640 1 -- 172.21.15.80:0/134003997 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430385124 0 0) 0x7f433406f950 con 0x7f4334096410 2024-02-18T16:20:53.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f5158c0e640 1 --2- 172.21.15.80:0/4243652844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154099560 0x7f5154130fd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5144009740 tx=0x7f514401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82ce1201430338a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f514bfff640 1 -- 172.21.15.80:0/4243652844 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51440ab530 con 0x7f5154099560 2024-02-18T16:20:53.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f514bfff640 1 -- 172.21.15.80:0/4243652844 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51440a7050 con 0x7f5154099560 2024-02-18T16:20:53.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f514bfff640 1 -- 172.21.15.80:0/4243652844 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51440ab7e0 con 0x7f5154099560 2024-02-18T16:20:53.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- 172.21.15.80:0/4243652844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154099560 msgr2=0x7f5154130fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 --2- 172.21.15.80:0/4243652844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154099560 0x7f5154130fd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5144009740 tx=0x7f514401c370 comp rx=0 tx=0).stop 2024-02-18T16:20:53.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- 172.21.15.80:0/4243652844 shutdown_connections 2024-02-18T16:20:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 --2- 172.21.15.80:0/4243652844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154099560 0x7f5154130fd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- 172.21.15.80:0/4243652844 >> 172.21.15.80:0/4243652844 conn(0x7f515409c330 msgr2=0x7f5154071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- 172.21.15.80:0/4243652844 shutdown_connections 2024-02-18T16:20:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- 172.21.15.80:0/4243652844 wait complete. 2024-02-18T16:20:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 Processor -- start 2024-02-18T16:20:53.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- start start 2024-02-18T16:20:53.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 0x7f5154125850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515b673640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154116ae0 con 0x7f5154098a70 2024-02-18T16:20:53.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.040+0000 7f515940f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 0x7f5154125850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515940f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 0x7f5154125850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37614/0 (socket says 172.21.15.80:37614) 2024-02-18T16:20:53.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515940f640 1 -- 172.21.15.80:0/970808185 learned_addr learned my addr 172.21.15.80:0/970808185 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:53.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515940f640 1 -- 172.21.15.80:0/970808185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009420 con 0x7f5154098a70 2024-02-18T16:20:53.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515940f640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 0x7f5154125850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f515000c480 tx=0x7f515000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43327fc640 1 --2- 172.21.15.80:0/134003997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f433412df20 0x7f4334130310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4328009740 tx=0x7f432801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8416a359c4245767 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5150005c20 con 0x7f5154098a70 2024-02-18T16:20:53.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150005d80 con 0x7f5154098a70 2024-02-18T16:20:53.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51500071a0 con 0x7f5154098a70 2024-02-18T16:20:53.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51541170a0 con 0x7f5154098a70 2024-02-18T16:20:53.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51541306e0 con 0x7f5154098a70 2024-02-18T16:20:53.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f4331ffb640 1 -- 172.21.15.80:0/134003997 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43280ab530 con 0x7f433412df20 2024-02-18T16:20:53.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f4331ffb640 1 -- 172.21.15.80:0/134003997 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280a7050 con 0x7f433412df20 2024-02-18T16:20:53.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f4331ffb640 1 -- 172.21.15.80:0/134003997 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43280ab7e0 con 0x7f433412df20 2024-02-18T16:20:53.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5154131000 con 0x7f5154098a70 2024-02-18T16:20:53.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5150007300 con 0x7f5154098a70 2024-02-18T16:20:53.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 -- 172.21.15.80:0/134003997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f433412df20 msgr2=0x7f4334130310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 --2- 172.21.15.80:0/134003997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f433412df20 0x7f4334130310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4328009740 tx=0x7f432801c370 comp rx=0 tx=0).stop 2024-02-18T16:20:53.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 -- 172.21.15.80:0/134003997 shutdown_connections 2024-02-18T16:20:53.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 --2- 172.21.15.80:0/134003997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f433412df20 0x7f4334130310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 -- 172.21.15.80:0/134003997 >> 172.21.15.80:0/134003997 conn(0x7f433409c8e0 msgr2=0x7f433409ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5149ffb640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51380359c0 0x7f5138037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f5150047300 con 0x7f5154098a70 2024-02-18T16:20:53.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 -- 172.21.15.80:0/134003997 shutdown_connections 2024-02-18T16:20:53.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 -- 172.21.15.80:0/134003997 wait complete. 2024-02-18T16:20:53.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5158c0e640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51380359c0 0x7f5138037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f5158c0e640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51380359c0 0x7f5138037e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5144009740 tx=0x7f5144008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.044+0000 7f43394ee640 1 Processor -- start 2024-02-18T16:20:53.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f43394ee640 1 -- start start 2024-02-18T16:20:53.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f43394ee640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 0x7f4334094f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f43394ee640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340928e0 con 0x7f4334096410 2024-02-18T16:20:53.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 0x7f4334094f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 0x7f4334094f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37626/0 (socket says 172.21.15.80:37626) 2024-02-18T16:20:53.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f4332ffd640 1 -- 172.21.15.80:0/1230512318 learned_addr learned my addr 172.21.15.80:0/1230512318 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:53.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f4332ffd640 1 -- 172.21.15.80:0/1230512318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4328009420 con 0x7f4334096410 2024-02-18T16:20:53.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f4332ffd640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 0x7f4334094f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f432400c390 tx=0x7f432400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f174d61f640 1 Processor -- start 2024-02-18T16:20:53.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f174d61f640 1 -- start start 2024-02-18T16:20:53.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f174d61f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1748092390 0x7f1748092770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f174d61f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480747d0 con 0x7f1748092cb0 2024-02-18T16:20:53.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f174d61f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748095130 con 0x7f1748092390 2024-02-18T16:20:53.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f1746ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1748092390 0x7f1748092770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f17467fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1748092cb0 0x7f17481322f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59394/0 (socket says 172.21.15.80:59394) 2024-02-18T16:20:53.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f17467fc640 1 -- 172.21.15.80:0/1296402061 learned_addr learned my addr 172.21.15.80:0/1296402061 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:53.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f1746ffd640 1 -- 172.21.15.80:0/1296402061 >> v1:172.21.15.80:6789/0 conn(0x7f1748092cb0 legacy=0x7f17481322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f1746ffd640 1 -- 172.21.15.80:0/1296402061 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174809a320 con 0x7f1748092390 2024-02-18T16:20:53.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f515001b3b0 con 0x7f5154098a70 2024-02-18T16:20:53.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4324007410 con 0x7f4334096410 2024-02-18T16:20:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324007590 con 0x7f4334096410 2024-02-18T16:20:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4334093510 con 0x7f4334096410 2024-02-18T16:20:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43240047f0 con 0x7f4334096410 2024-02-18T16:20:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.048+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334094580 con 0x7f4334096410 2024-02-18T16:20:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4324004950 con 0x7f4334096410 2024-02-18T16:20:53.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334093cb0 con 0x7f4334096410 2024-02-18T16:20:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f431b7fe640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4320035a70 0x7f4320037f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4324013980 con 0x7f4334096410 2024-02-18T16:20:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f43327fc640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4320035a70 0x7f4320037f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f1746ffd640 1 --2- 172.21.15.80:0/1296402061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f1748092770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1738009740 tx=0x7f173801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f1010413635fa server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.052+0000 7f43327fc640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4320035a70 0x7f4320037f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43280ad000 tx=0x7f43280a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f1745ffb640 1 -- 172.21.15.80:0/1296402061 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17380ab530 con 0x7f1748092390 2024-02-18T16:20:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f1745ffb640 1 -- 172.21.15.80:0/1296402061 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380a7050 con 0x7f1748092390 2024-02-18T16:20:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f1745ffb640 1 -- 172.21.15.80:0/1296402061 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17380ab7e0 con 0x7f1748092390 2024-02-18T16:20:53.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4324013cc0 con 0x7f4334096410 2024-02-18T16:20:53.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 -- 172.21.15.80:0/1296402061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 msgr2=0x7f1748092770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 --2- 172.21.15.80:0/1296402061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f1748092770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1738009740 tx=0x7f173801c3e0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 -- 172.21.15.80:0/1296402061 shutdown_connections 2024-02-18T16:20:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 --2- 172.21.15.80:0/1296402061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f1748092770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 -- 172.21.15.80:0/1296402061 >> 172.21.15.80:0/1296402061 conn(0x7f174809ae30 msgr2=0x7f174809b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 -- 172.21.15.80:0/1296402061 shutdown_connections 2024-02-18T16:20:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.056+0000 7f174d61f640 1 -- 172.21.15.80:0/1296402061 wait complete. 2024-02-18T16:20:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f174d61f640 1 Processor -- start 2024-02-18T16:20:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f174d61f640 1 -- start start 2024-02-18T16:20:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f174d61f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f174812fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f174d61f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480710f0 con 0x7f1748092390 2024-02-18T16:20:53.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f1746ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f174812fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f1746ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f174812fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37646/0 (socket says 172.21.15.80:37646) 2024-02-18T16:20:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f1746ffd640 1 -- 172.21.15.80:0/945229754 learned_addr learned my addr 172.21.15.80:0/945229754 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f1746ffd640 1 -- 172.21.15.80:0/945229754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738009420 con 0x7f1748092390 2024-02-18T16:20:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f1746ffd640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f174812fa80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f173801a010 tx=0x7f173801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17380b7450 con 0x7f1748092390 2024-02-18T16:20:53.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380b75b0 con 0x7f1748092390 2024-02-18T16:20:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f174d61f640 1 -- 172.21.15.80:0/945229754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17481308c0 con 0x7f1748092390 2024-02-18T16:20:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17380b7850 con 0x7f1748092390 2024-02-18T16:20:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f174d61f640 1 -- 172.21.15.80:0/945229754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1748071b20 con 0x7f1748092390 2024-02-18T16:20:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f17380b79b0 con 0x7f1748092390 2024-02-18T16:20:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720005090 con 0x7f1748092390 2024-02-18T16:20:53.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172f7fe640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1734035a10 0x7f1734037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f17380e2d10 con 0x7f1748092390 2024-02-18T16:20:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.060+0000 7f17467fc640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1734035a10 0x7f1734037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.064+0000 7f17467fc640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1734035a10 0x7f1734037ed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f173c005890 tx=0x7f173c007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:53.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.068+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17380c79f0 con 0x7f1748092390 2024-02-18T16:20:53.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.176+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd524005340 con 0x7fd54c06c0d0 2024-02-18T16:20:53.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.176+0000 7fd5337fe640 1 -- 172.21.15.80:0/677561222 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd53c0b0030 con 0x7fd54c06c0d0 2024-02-18T16:20:53.183 INFO:teuthology.orchestra.run.smithi080.stdout:38654705668 2024-02-18T16:20:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd538035a40 msgr2=0x7fd538037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd538035a40 0x7fd538037f00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd540005890 tx=0x7fd540007a90 comp rx=0 tx=0).stop 2024-02-18T16:20:53.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 msgr2=0x7fd54c122290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c122290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd53c019fa0 tx=0x7fd53c01abb0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 shutdown_connections 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd538035a40 0x7fd538037f00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 --2- 172.21.15.80:0/677561222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd54c06c0d0 0x7fd54c122290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 >> 172.21.15.80:0/677561222 conn(0x7fd54c09d600 msgr2=0x7fd54c090610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 shutdown_connections 2024-02-18T16:20:53.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.180+0000 7fd5317fa640 1 -- 172.21.15.80:0/677561222 wait complete. 2024-02-18T16:20:53.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-02-18T16:20:53.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5154062860 con 0x7f5154098a70 2024-02-18T16:20:53.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f5149ffb640 1 -- 172.21.15.80:0/970808185 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5150017020 con 0x7f5154098a70 2024-02-18T16:20:53.217 INFO:teuthology.orchestra.run.smithi080.stdout:38654705667 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51380359c0 msgr2=0x7f5138037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51380359c0 0x7f5138037e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5144009740 tx=0x7f5144008040 comp rx=0 tx=0).stop 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 msgr2=0x7f5154125850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 0x7f5154125850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f515000c480 tx=0x7f515000c940 comp rx=0 tx=0).stop 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 shutdown_connections 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f51380359c0 0x7f5138037e80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 --2- 172.21.15.80:0/970808185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5154098a70 0x7f5154125850 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 >> 172.21.15.80:0/970808185 conn(0x7f515409c330 msgr2=0x7f5154128d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 shutdown_connections 2024-02-18T16:20:53.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f515b673640 1 -- 172.21.15.80:0/970808185 wait complete. 2024-02-18T16:20:53.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4334095f10 con 0x7f4334096410 2024-02-18T16:20:53.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.212+0000 7f431b7fe640 1 -- 172.21.15.80:0/1230512318 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4324034020 con 0x7f4334096410 2024-02-18T16:20:53.221 INFO:teuthology.orchestra.run.smithi080.stdout:38654705667 2024-02-18T16:20:53.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4320035a70 msgr2=0x7f4320037f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4320035a70 0x7f4320037f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43280ad000 tx=0x7f43280a6000 comp rx=0 tx=0).stop 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 msgr2=0x7f4334094f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 0x7f4334094f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f432400c390 tx=0x7f432400c850 comp rx=0 tx=0).stop 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 shutdown_connections 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4320035a70 0x7f4320037f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 --2- 172.21.15.80:0/1230512318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4334096410 0x7f4334094f40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 >> 172.21.15.80:0/1230512318 conn(0x7f433409c8e0 msgr2=0x7f433408a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 shutdown_connections 2024-02-18T16:20:53.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.216+0000 7f43394ee640 1 -- 172.21.15.80:0/1230512318 wait complete. 2024-02-18T16:20:53.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-02-18T16:20:53.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1720005340 con 0x7f1748092390 2024-02-18T16:20:53.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172f7fe640 1 -- 172.21.15.80:0/945229754 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17380b0070 con 0x7f1748092390 2024-02-18T16:20:53.237 INFO:teuthology.orchestra.run.smithi080.stdout:38654705668 2024-02-18T16:20:53.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-02-18T16:20:53.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1734035a10 msgr2=0x7f1734037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1734035a10 0x7f1734037ed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f173c005890 tx=0x7f173c007a90 comp rx=0 tx=0).stop 2024-02-18T16:20:53.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 msgr2=0x7f174812fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:53.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f174812fa80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f173801a010 tx=0x7f173801ac20 comp rx=0 tx=0).stop 2024-02-18T16:20:53.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 shutdown_connections 2024-02-18T16:20:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1734035a10 0x7f1734037ed0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 --2- 172.21.15.80:0/945229754 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1748092390 0x7f174812fa80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 >> 172.21.15.80:0/945229754 conn(0x7f174809ae30 msgr2=0x7f174809ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 shutdown_connections 2024-02-18T16:20:53.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:53.232+0000 7f172d7fa640 1 -- 172.21.15.80:0/945229754 wait complete. 2024-02-18T16:20:53.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-02-18T16:20:54.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-18T16:20:54.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-18T16:20:54.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-18T16:20:54.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-18T16:20:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f8661640 1 Processor -- start 2024-02-18T16:20:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f8661640 1 -- start start 2024-02-18T16:20:54.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f8661640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f06f006d4d0 0x7f06f0130e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f8661640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f0096e60 con 0x7f06f0096a80 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f8661640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f006c290 con 0x7f06f006d4d0 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f5bfc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f06f006d4d0 0x7f06f0130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f63fd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f06f0096a80 0x7f06f006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53640/0 (socket says 172.21.15.80:53640) 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f63fd640 1 -- 172.21.15.80:0/720472584 learned_addr learned my addr 172.21.15.80:0/720472584 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f5bfc640 1 -- 172.21.15.80:0/720472584 >> v1:172.21.15.80:6789/0 conn(0x7f06f0096a80 legacy=0x7f06f006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.328+0000 7f06f5bfc640 1 -- 172.21.15.80:0/720472584 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f006dc40 con 0x7f06f006d4d0 2024-02-18T16:20:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f5bfc640 1 --2- 172.21.15.80:0/720472584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f0130e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009740 tx=0x7f06e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f1579c7f9ad230 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f53fb640 1 -- 172.21.15.80:0/720472584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06e00ab530 con 0x7f06f006d4d0 2024-02-18T16:20:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f53fb640 1 -- 172.21.15.80:0/720472584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e00a7050 con 0x7f06f006d4d0 2024-02-18T16:20:54.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f53fb640 1 -- 172.21.15.80:0/720472584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06e00ab7e0 con 0x7f06f006d4d0 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 -- 172.21.15.80:0/720472584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 msgr2=0x7f06f0130e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 --2- 172.21.15.80:0/720472584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f0130e40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009740 tx=0x7f06e001c370 comp rx=0 tx=0).stop 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 -- 172.21.15.80:0/720472584 shutdown_connections 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 --2- 172.21.15.80:0/720472584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f0130e40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 -- 172.21.15.80:0/720472584 >> 172.21.15.80:0/720472584 conn(0x7f06f009d400 msgr2=0x7f06f009d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 -- 172.21.15.80:0/720472584 shutdown_connections 2024-02-18T16:20:54.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.332+0000 7f06f8661640 1 -- 172.21.15.80:0/720472584 wait complete. 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f8661640 1 Processor -- start 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f8661640 1 -- start start 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f8661640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f012d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f8661640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f012ffe0 con 0x7f06f006d4d0 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f63fd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f012d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f63fd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f012d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43380/0 (socket says 172.21.15.80:43380) 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f63fd640 1 -- 172.21.15.80:0/2455330932 learned_addr learned my addr 172.21.15.80:0/2455330932 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:54.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f63fd640 1 -- 172.21.15.80:0/2455330932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0009420 con 0x7f06f006d4d0 2024-02-18T16:20:54.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f63fd640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f012d8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c480 tx=0x7f06ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06ec005c20 con 0x7f06f006d4d0 2024-02-18T16:20:54.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec005d80 con 0x7f06f006d4d0 2024-02-18T16:20:54.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f006e820 con 0x7f06f006d4d0 2024-02-18T16:20:54.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06ec0071a0 con 0x7f06f006d4d0 2024-02-18T16:20:54.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f01307f0 con 0x7f06f006d4d0 2024-02-18T16:20:54.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f06ec0073c0 con 0x7f06f006d4d0 2024-02-18T16:20:54.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06e6ffd640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06d40359a0 0x7f06d4037e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.336+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f06ec04ce20 con 0x7f06f006d4d0 2024-02-18T16:20:54.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.340+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f0062860 con 0x7f06f006d4d0 2024-02-18T16:20:54.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.340+0000 7f06f5bfc640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06d40359a0 0x7f06d4037e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.340+0000 7f06f5bfc640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06d40359a0 0x7f06d4037e60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06e00ad000 tx=0x7f06e00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.348+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f06ec017030 con 0x7f06f006d4d0 2024-02-18T16:20:54.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.360+0000 7fdce0a84640 1 Processor -- start 2024-02-18T16:20:54.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.360+0000 7fdce0a84640 1 -- start start 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.360+0000 7fdce0a84640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdcdc098a70 0x7fdcdc098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.360+0000 7fdce0a84640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc072150 con 0x7fdcdc099390 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.360+0000 7fdce0a84640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc09b060 con 0x7fdcdc098a70 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd9d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdcdc099390 0x7fdcdc12bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53648/0 (socket says 172.21.15.80:53648) 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd9d9b640 1 -- 172.21.15.80:0/4076400336 learned_addr learned my addr 172.21.15.80:0/4076400336 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcda59c640 1 --2- 172.21.15.80:0/4076400336 >> v2:172.21.15.80:3300/0 conn(0x7fdcdc098a70 0x7fdcdc098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06dbc6d640 1 Processor -- start 2024-02-18T16:20:54.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06dbc6d640 1 -- start start 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277143647 0 0) 0x7fdcdc072150 con 0x7fdcdc099390 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc4003530 con 0x7fdcdc099390 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354103307 0 0) 0x7fdcc4003530 con 0x7fdcdc099390 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 >> v2:172.21.15.80:3300/0 conn(0x7fdcdc098a70 msgr2=0x7fdcdc098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 --2- 172.21.15.80:0/4076400336 >> v2:172.21.15.80:3300/0 conn(0x7fdcdc098a70 0x7fdcdc098e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc09a910 con 0x7fdcdc099390 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4147525989 0 0) 0x7fdcd00015b0 con 0x7fdcdc099390 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 >> v1:172.21.15.80:6789/0 conn(0x7fdcdc099390 legacy=0x7fdcdc12bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 --2- 172.21.15.80:0/4076400336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4004570 con 0x7fdcc4003a00 2024-02-18T16:20:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06dbc6d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f06d412c020 0x7f06d412c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06dbc6d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d412c940 con 0x7f06d4099a80 2024-02-18T16:20:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06dbc6d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d409bc60 con 0x7f06d412c020 2024-02-18T16:20:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d9208640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f06d4099a80 0x7f06d4099e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53656/0 (socket says 172.21.15.80:53656) 2024-02-18T16:20:54.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d9208640 1 -- 172.21.15.80:0/2394245229 learned_addr learned my addr 172.21.15.80:0/2394245229 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:54.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcda59c640 1 --2- 172.21.15.80:0/4076400336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d9a09640 1 --2- 172.21.15.80:0/2394245229 >> v2:172.21.15.80:3300/0 conn(0x7f06d412c020 0x7f06d412c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d8a07640 1 -- 172.21.15.80:0/2394245229 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641950584 0 0) 0x7f06d412c940 con 0x7f06d4099a80 2024-02-18T16:20:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d8a07640 1 -- 172.21.15.80:0/2394245229 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c0003530 con 0x7f06d4099a80 2024-02-18T16:20:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d9a09640 1 -- 172.21.15.80:0/2394245229 >> v1:172.21.15.80:6789/0 conn(0x7f06d4099a80 legacy=0x7f06d4099e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d9a09640 1 -- 172.21.15.80:0/2394245229 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d409cb70 con 0x7f06d412c020 2024-02-18T16:20:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcda59c640 1 -- 172.21.15.80:0/4076400336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4003530 con 0x7fdcc4003a00 2024-02-18T16:20:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d9a09640 1 --2- 172.21.15.80:0/2394245229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d412c020 0x7f06d412c400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009d90 tx=0x7f06d001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99611ca487bcddec server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcda59c640 1 --2- 172.21.15.80:0/4076400336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00b990 tx=0x7fdccc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554994504e2b6eda server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d8a07640 1 -- 172.21.15.80:0/2394245229 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06d00a6640 con 0x7f06d412c020 2024-02-18T16:20:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d8a07640 1 -- 172.21.15.80:0/2394245229 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d00a67a0 con 0x7f06d412c020 2024-02-18T16:20:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7f06d8a07640 1 -- 172.21.15.80:0/2394245229 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06d00a6a60 con 0x7f06d412c020 2024-02-18T16:20:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdccc0a9590 con 0x7fdcc4003a00 2024-02-18T16:20:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc0a96f0 con 0x7fdcc4003a00 2024-02-18T16:20:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.364+0000 7fdcd959a640 1 -- 172.21.15.80:0/4076400336 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdccc0a9990 con 0x7fdcc4003a00 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2394245229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d412c020 msgr2=0x7f06d412c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 --2- 172.21.15.80:0/2394245229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d412c020 0x7f06d412c400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009d90 tx=0x7f06d001c8c0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2394245229 shutdown_connections 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 --2- 172.21.15.80:0/2394245229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d412c020 0x7f06d412c400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2394245229 >> 172.21.15.80:0/2394245229 conn(0x7f06d406f5c0 msgr2=0x7f06d40719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 -- 172.21.15.80:0/4076400336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 msgr2=0x7fdcc4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 --2- 172.21.15.80:0/4076400336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00b990 tx=0x7fdccc01c760 comp rx=0 tx=0).stop 2024-02-18T16:20:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2394245229 shutdown_connections 2024-02-18T16:20:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2394245229 wait complete. 2024-02-18T16:20:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 -- 172.21.15.80:0/4076400336 shutdown_connections 2024-02-18T16:20:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 --2- 172.21.15.80:0/4076400336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 --2- 172.21.15.80:0/4076400336 >> v2:172.21.15.80:3300/0 conn(0x7fdcdc098a70 0x7fdcdc098e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 -- 172.21.15.80:0/4076400336 >> 172.21.15.80:0/4076400336 conn(0x7fdcdc09c330 msgr2=0x7fdcdc071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 Processor -- start 2024-02-18T16:20:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 -- 172.21.15.80:0/4076400336 shutdown_connections 2024-02-18T16:20:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- start start 2024-02-18T16:20:54.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 0x7f06d412a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d411cda0 con 0x7f06d4099a80 2024-02-18T16:20:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 -- 172.21.15.80:0/4076400336 wait complete. 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06d9a09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 0x7f06d412a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06d9a09640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 0x7f06d412a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43414/0 (socket says 172.21.15.80:43414) 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06d9a09640 1 -- 172.21.15.80:0/2397478431 learned_addr learned my addr 172.21.15.80:0/2397478431 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06d9a09640 1 -- 172.21.15.80:0/2397478431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009a70 con 0x7f06d4099a80 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06d9a09640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 0x7f06d412a440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f90 tx=0x7f06d0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06d00b8770 con 0x7f06d4099a80 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d00b88d0 con 0x7f06d4099a80 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d411de10 con 0x7f06d4099a80 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06d00b8bf0 con 0x7f06d4099a80 2024-02-18T16:20:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d411c640 con 0x7f06d4099a80 2024-02-18T16:20:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 Processor -- start 2024-02-18T16:20:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.368+0000 7fdce0a84640 1 -- start start 2024-02-18T16:20:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f06d00b8d50 con 0x7f06d4099a80 2024-02-18T16:20:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdce0a84640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcdc11aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdce0a84640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc11c9b0 con 0x7fdcc4003a00 2024-02-18T16:20:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4062860 con 0x7f06d4099a80 2024-02-18T16:20:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdcda59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcdc11aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdcda59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcdc11aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43418/0 (socket says 172.21.15.80:43418) 2024-02-18T16:20:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdcda59c640 1 -- 172.21.15.80:0/26641129 learned_addr learned my addr 172.21.15.80:0/26641129 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7f06ca7fc640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06b8035a10 0x7f06b8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f06d00aa070 con 0x7f06d4099a80 2024-02-18T16:20:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdcda59c640 1 -- 172.21.15.80:0/26641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc11c770 con 0x7fdcc4003a00 2024-02-18T16:20:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7f06d9208640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06b8035a10 0x7f06b8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7fdcda59c640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcdc11aa00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00b990 tx=0x7fdcc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.372+0000 7f06d9208640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06b8035a10 0x7f06b8037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007fd0 tx=0x7f06c4007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f06d00c1dd0 con 0x7f06d4099a80 2024-02-18T16:20:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdccc0b3660 con 0x7fdcc4003a00 2024-02-18T16:20:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc11c2d0 con 0x7fdcc4003a00 2024-02-18T16:20:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc11af40 con 0x7fdcc4003a00 2024-02-18T16:20:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc0b37c0 con 0x7fdcc4003a00 2024-02-18T16:20:54.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdccc0b3a60 con 0x7fdcc4003a00 2024-02-18T16:20:54.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc0005090 con 0x7fdcc4003a00 2024-02-18T16:20:54.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdccc0b3bc0 con 0x7fdcc4003a00 2024-02-18T16:20:54.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdccaffd640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcbc0359c0 0x7fdcbc037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.376+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fdccc0e2e80 con 0x7fdcc4003a00 2024-02-18T16:20:54.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.380+0000 7fdcd9d9b640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcbc0359c0 0x7fdcbc037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.380+0000 7fdcd9d9b640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcbc0359c0 0x7fdcbc037e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0001eb0 tx=0x7fdcd0001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.384+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdccc0a6df0 con 0x7fdcc4003a00 2024-02-18T16:20:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.404+0000 7faa5ee2c640 1 Processor -- start 2024-02-18T16:20:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.404+0000 7faa5ee2c640 1 -- start start 2024-02-18T16:20:54.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.404+0000 7faa5ee2c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa58099560 0x7faa58130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.404+0000 7faa5ee2c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa58072150 con 0x7faa58098a70 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.404+0000 7faa5ee2c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5809b060 con 0x7faa58099560 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa57fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa58099560 0x7faa58130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5cbc8640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faa58098a70 0x7faa58098e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53662/0 (socket says 172.21.15.80:53662) 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5cbc8640 1 -- 172.21.15.80:0/2214473326 learned_addr learned my addr 172.21.15.80:0/2214473326 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa57fff640 1 -- 172.21.15.80:0/2214473326 >> v1:172.21.15.80:6789/0 conn(0x7faa58098a70 legacy=0x7faa58098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa57fff640 1 -- 172.21.15.80:0/2214473326 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5809a910 con 0x7faa58099560 2024-02-18T16:20:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa57fff640 1 --2- 172.21.15.80:0/2214473326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58099560 0x7faa58130fd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa44009740 tx=0x7faa4401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9677b06abde2ead server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa577fe640 1 -- 172.21.15.80:0/2214473326 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440ab530 con 0x7faa58099560 2024-02-18T16:20:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa577fe640 1 -- 172.21.15.80:0/2214473326 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440a7050 con 0x7faa58099560 2024-02-18T16:20:54.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa577fe640 1 -- 172.21.15.80:0/2214473326 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa440ab7e0 con 0x7faa58099560 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 -- 172.21.15.80:0/2214473326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58099560 msgr2=0x7faa58130fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 --2- 172.21.15.80:0/2214473326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58099560 0x7faa58130fd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa44009740 tx=0x7faa4401c370 comp rx=0 tx=0).stop 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 -- 172.21.15.80:0/2214473326 shutdown_connections 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 --2- 172.21.15.80:0/2214473326 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58099560 0x7faa58130fd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 -- 172.21.15.80:0/2214473326 >> 172.21.15.80:0/2214473326 conn(0x7faa5809c330 msgr2=0x7faa58071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 -- 172.21.15.80:0/2214473326 shutdown_connections 2024-02-18T16:20:54.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.408+0000 7faa5ee2c640 1 -- 172.21.15.80:0/2214473326 wait complete. 2024-02-18T16:20:54.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5ee2c640 1 Processor -- start 2024-02-18T16:20:54.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5ee2c640 1 -- start start 2024-02-18T16:20:54.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5ee2c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 0x7faa5806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5ee2c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5812ed70 con 0x7faa58098a70 2024-02-18T16:20:54.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5cbc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 0x7faa5806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5cbc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 0x7faa5806d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43440/0 (socket says 172.21.15.80:43440) 2024-02-18T16:20:54.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5cbc8640 1 -- 172.21.15.80:0/3544329468 learned_addr learned my addr 172.21.15.80:0/3544329468 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5cbc8640 1 -- 172.21.15.80:0/3544329468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009420 con 0x7faa58098a70 2024-02-18T16:20:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5cbc8640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 0x7faa5806d3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c480 tx=0x7faa4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa4c005c20 con 0x7faa58098a70 2024-02-18T16:20:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c005d80 con 0x7faa58098a70 2024-02-18T16:20:54.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5806ecf0 con 0x7faa58098a70 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa4c0071a0 con 0x7faa58098a70 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5811f900 con 0x7faa58098a70 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa4c0073c0 con 0x7faa58098a70 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa557fa640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faa3c0359a0 0x7faa3c037e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.412+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7faa4c04ce20 con 0x7faa58098a70 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.416+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5811ef90 con 0x7faa58098a70 2024-02-18T16:20:54.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.416+0000 7faa57fff640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faa3c0359a0 0x7faa3c037e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.416+0000 7faa57fff640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faa3c0359a0 0x7faa3c037e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa44009740 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.424+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa4c017030 con 0x7faa58098a70 2024-02-18T16:20:54.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06f0073100 con 0x7f06f006d4d0 2024-02-18T16:20:54.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06e6ffd640 1 -- 172.21.15.80:0/2455330932 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06ec017020 con 0x7f06f006d4d0 2024-02-18T16:20:54.520 INFO:teuthology.orchestra.run.smithi080.stdout:38654705669 2024-02-18T16:20:54.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06d40359a0 msgr2=0x7f06d4037e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06d40359a0 0x7f06d4037e60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06e00ad000 tx=0x7f06e00a6000 comp rx=0 tx=0).stop 2024-02-18T16:20:54.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 msgr2=0x7f06f012d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f012d8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c480 tx=0x7f06ec00c940 comp rx=0 tx=0).stop 2024-02-18T16:20:54.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 shutdown_connections 2024-02-18T16:20:54.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06d40359a0 0x7f06d4037e60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 --2- 172.21.15.80:0/2455330932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06f006d4d0 0x7f06f012d8c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 >> 172.21.15.80:0/2455330932 conn(0x7f06f009d400 msgr2=0x7f06f0129920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 shutdown_connections 2024-02-18T16:20:54.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.512+0000 7f06f8661640 1 -- 172.21.15.80:0/2455330932 wait complete. 2024-02-18T16:20:54.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-02-18T16:20:54.536 DEBUG:teuthology.parallel:result is None 2024-02-18T16:20:54.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06d4073100 con 0x7f06d4099a80 2024-02-18T16:20:54.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06ca7fc640 1 -- 172.21.15.80:0/2397478431 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06d00c1bf0 con 0x7f06d4099a80 2024-02-18T16:20:54.546 INFO:teuthology.orchestra.run.smithi080.stdout:38654705668 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06b8035a10 msgr2=0x7f06b8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06b8035a10 0x7f06b8037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007fd0 tx=0x7f06c4007980 comp rx=0 tx=0).stop 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 msgr2=0x7f06d412a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 0x7f06d412a440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f90 tx=0x7f06d0019660 comp rx=0 tx=0).stop 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 shutdown_connections 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f06b8035a10 0x7f06b8037ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 --2- 172.21.15.80:0/2397478431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06d4099a80 0x7f06d412a440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 >> 172.21.15.80:0/2397478431 conn(0x7f06d406f5c0 msgr2=0x7f06d412fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 shutdown_connections 2024-02-18T16:20:54.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.540+0000 7f06dbc6d640 1 -- 172.21.15.80:0/2397478431 wait complete. 2024-02-18T16:20:54.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcc0005340 con 0x7fdcc4003a00 2024-02-18T16:20:54.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdccaffd640 1 -- 172.21.15.80:0/26641129 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdccc0ae020 con 0x7fdcc4003a00 2024-02-18T16:20:54.550 INFO:teuthology.orchestra.run.smithi080.stdout:38654705668 2024-02-18T16:20:54.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcbc0359c0 msgr2=0x7fdcbc037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcbc0359c0 0x7fdcbc037e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0001eb0 tx=0x7fdcd0001440 comp rx=0 tx=0).stop 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 msgr2=0x7fdcdc11aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcdc11aa00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00b990 tx=0x7fdcc4005800 comp rx=0 tx=0).stop 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 shutdown_connections 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdcbc0359c0 0x7fdcbc037e80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 --2- 172.21.15.80:0/26641129 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdcc4003a00 0x7fdcdc11aa00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 >> 172.21.15.80:0/26641129 conn(0x7fdcdc09c330 msgr2=0x7fdcdc1302f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 shutdown_connections 2024-02-18T16:20:54.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.544+0000 7fdce0a84640 1 -- 172.21.15.80:0/26641129 wait complete. 2024-02-18T16:20:54.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-02-18T16:20:54.565 DEBUG:teuthology.parallel:result is None 2024-02-18T16:20:54.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2024-02-18T16:20:54.569 DEBUG:teuthology.parallel:result is None 2024-02-18T16:20:54.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.580+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa58062860 con 0x7faa58098a70 2024-02-18T16:20:54.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.580+0000 7faa557fa640 1 -- 172.21.15.80:0/3544329468 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa4c017020 con 0x7faa58098a70 2024-02-18T16:20:54.587 INFO:teuthology.orchestra.run.smithi080.stdout:38654705669 2024-02-18T16:20:54.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faa3c0359a0 msgr2=0x7faa3c037e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faa3c0359a0 0x7faa3c037e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa44009740 tx=0x7faa44008040 comp rx=0 tx=0).stop 2024-02-18T16:20:54.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 msgr2=0x7faa5806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 0x7faa5806d3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c480 tx=0x7faa4c00c940 comp rx=0 tx=0).stop 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 shutdown_connections 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7faa3c0359a0 0x7faa3c037e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 --2- 172.21.15.80:0/3544329468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa58098a70 0x7faa5806d3e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 >> 172.21.15.80:0/3544329468 conn(0x7faa5809c330 msgr2=0x7faa58114c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 shutdown_connections 2024-02-18T16:20:54.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.584+0000 7faa5ee2c640 1 -- 172.21.15.80:0/3544329468 wait complete. 2024-02-18T16:20:54.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-02-18T16:20:54.604 DEBUG:teuthology.parallel:result is None 2024-02-18T16:20:54.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-18T16:20:54.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:20:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b7dc3640 1 Processor -- start 2024-02-18T16:20:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b7dc3640 1 -- start start 2024-02-18T16:20:54.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b7dc3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84b01290f0 0x7f84b012c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b7dc3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b0095ee0 con 0x7f84b0128d10 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b7dc3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b0096320 con 0x7f84b01290f0 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b535e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84b01290f0 0x7f84b012c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b5b5f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f84b0128d10 0x7f84b012bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53676/0 (socket says 172.21.15.80:53676) 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b5b5f640 1 -- 172.21.15.80:0/1342254653 learned_addr learned my addr 172.21.15.80:0/1342254653 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b535e640 1 -- 172.21.15.80:0/1342254653 >> v1:172.21.15.80:6789/0 conn(0x7f84b0128d10 legacy=0x7f84b012bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.740+0000 7f84b535e640 1 -- 172.21.15.80:0/1342254653 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0128620 con 0x7f84b01290f0 2024-02-18T16:20:54.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b535e640 1 --2- 172.21.15.80:0/1342254653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b01290f0 0x7f84b012c230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009740 tx=0x7f84a001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3516e94a120397b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b4b5d640 1 -- 172.21.15.80:0/1342254653 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a00ac530 con 0x7f84b01290f0 2024-02-18T16:20:54.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b4b5d640 1 -- 172.21.15.80:0/1342254653 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00a8050 con 0x7f84b01290f0 2024-02-18T16:20:54.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b4b5d640 1 -- 172.21.15.80:0/1342254653 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a00ac7e0 con 0x7f84b01290f0 2024-02-18T16:20:54.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 -- 172.21.15.80:0/1342254653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b01290f0 msgr2=0x7f84b012c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 --2- 172.21.15.80:0/1342254653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b01290f0 0x7f84b012c230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009740 tx=0x7f84a001c490 comp rx=0 tx=0).stop 2024-02-18T16:20:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 -- 172.21.15.80:0/1342254653 shutdown_connections 2024-02-18T16:20:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 --2- 172.21.15.80:0/1342254653 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b01290f0 0x7f84b012c230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 -- 172.21.15.80:0/1342254653 >> 172.21.15.80:0/1342254653 conn(0x7f84b009a2f0 msgr2=0x7f84b009a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 -- 172.21.15.80:0/1342254653 shutdown_connections 2024-02-18T16:20:54.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 -- 172.21.15.80:0/1342254653 wait complete. 2024-02-18T16:20:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 Processor -- start 2024-02-18T16:20:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.744+0000 7f84b7dc3640 1 -- start start 2024-02-18T16:20:54.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b7dc3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 0x7f84b01c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b7dc3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0130d70 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b5b5f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 0x7f84b01c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b5b5f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 0x7f84b01c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43458/0 (socket says 172.21.15.80:43458) 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b5b5f640 1 -- 172.21.15.80:0/78677099 learned_addr learned my addr 172.21.15.80:0/78677099 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b5b5f640 1 -- 172.21.15.80:0/78677099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009420 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b5b5f640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 0x7f84b01c2db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f84a800c480 tx=0x7f84a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a8005c20 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a8005d80 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b0131090 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80071a0 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0098220 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b01304f0 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f84a8007300 con 0x7f84b0128d10 2024-02-18T16:20:54.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84a67fc640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8494035a10 0x7f8494037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:54.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f84a8047280 con 0x7f84b0128d10 2024-02-18T16:20:54.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b535e640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8494035a10 0x7f8494037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:54.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.748+0000 7f84b535e640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8494035a10 0x7f8494037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f84a00ae000 tx=0x7f84a00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:54.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.752+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84b01304f0 con 0x7f84b0128d10 2024-02-18T16:20:54.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.896+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84b0095170 con 0x7f8494035a10 2024-02-18T16:20:54.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.896+0000 7f84a67fc640 1 -- 172.21.15.80:0/78677099 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34670 (secure 0 0 0) 0x7f84a00ac7a0 con 0x7f8494035a10 2024-02-18T16:20:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:54.905 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8494035a10 msgr2=0x7f8494037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8494035a10 0x7f8494037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f84a00ae000 tx=0x7f84a00a7000 comp rx=0 tx=0).stop 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 msgr2=0x7f84b01c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 0x7f84b01c2db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f84a800c480 tx=0x7f84a800c940 comp rx=0 tx=0).stop 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 shutdown_connections 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8494035a10 0x7f8494037ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 --2- 172.21.15.80:0/78677099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84b0128d10 0x7f84b01c2db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 >> 172.21.15.80:0/78677099 conn(0x7f84b009a2f0 msgr2=0x7f84b0097010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 shutdown_connections 2024-02-18T16:20:54.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:54.900+0000 7f84b7dc3640 1 -- 172.21.15.80:0/78677099 wait complete. 2024-02-18T16:20:54.922 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-02-18T16:20:53.754782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109724,"kb_used_data":1640,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377636,"statfs":{"total":386547056640,"available":386434699264,"internally_reserved":0,"allocated":1679360,"data_stored":1328808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001368"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778566+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:20:52.778566+0000","last_peered":"2024-02-18T16:20:52.778566+0000","last_clean":"2024-02-18T16:20:52.778566+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:20:52.778566+0000","last_undegraded":"2024-02-18T16:20:52.778566+0000","last_fullsized":"2024-02-18T16:20:52.778566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:28:14.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.779167+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:20:52.779167+0000","last_peered":"2024-02-18T16:20:52.779167+0000","last_clean":"2024-02-18T16:20:52.779167+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:20:52.779167+0000","last_undegraded":"2024-02-18T16:20:52.779167+0000","last_fullsized":"2024-02-18T16:20:52.779167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:07.695714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778621+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:20:52.778621+0000","last_peered":"2024-02-18T16:20:52.778621+0000","last_clean":"2024-02-18T16:20:52.778621+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:20:52.778621+0000","last_undegraded":"2024-02-18T16:20:52.778621+0000","last_fullsized":"2024-02-18T16:20:52.778621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:55:06.221596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.779136+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:20:52.779136+0000","last_peered":"2024-02-18T16:20:52.779136+0000","last_clean":"2024-02-18T16:20:52.779136+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:20:52.779136+0000","last_undegraded":"2024-02-18T16:20:52.779136+0000","last_fullsized":"2024-02-18T16:20:52.779136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:59:56.616913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778509+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:20:52.778509+0000","last_peered":"2024-02-18T16:20:52.778509+0000","last_clean":"2024-02-18T16:20:52.778509+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:20:52.778509+0000","last_undegraded":"2024-02-18T16:20:52.778509+0000","last_fullsized":"2024-02-18T16:20:52.778509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:28:03.856941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.768404+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:20:52.768404+0000","last_peered":"2024-02-18T16:20:52.768404+0000","last_clean":"2024-02-18T16:20:52.768404+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:20:52.768404+0000","last_undegraded":"2024-02-18T16:20:52.768404+0000","last_fullsized":"2024-02-18T16:20:52.768404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:43.102493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778418+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:20:52.778418+0000","last_peered":"2024-02-18T16:20:52.778418+0000","last_clean":"2024-02-18T16:20:52.778418+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:20:52.778418+0000","last_undegraded":"2024-02-18T16:20:52.778418+0000","last_fullsized":"2024-02-18T16:20:52.778418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:05:58.537300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778458+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:20:52.778458+0000","last_peered":"2024-02-18T16:20:52.778458+0000","last_clean":"2024-02-18T16:20:52.778458+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:20:52.778458+0000","last_undegraded":"2024-02-18T16:20:52.778458+0000","last_fullsized":"2024-02-18T16:20:52.778458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:58:17.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":168,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.777887+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:20:52.777887+0000","last_peered":"2024-02-18T16:20:52.777887+0000","last_clean":"2024-02-18T16:20:52.777887+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:20:52.777887+0000","last_undegraded":"2024-02-18T16:20:52.777887+0000","last_fullsized":"2024-02-18T16:20:52.777887+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:37.088141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:20:54.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.020+0000 7f14f9e77640 1 Processor -- start 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.020+0000 7f14f9e77640 1 -- start start 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14f412af90 0x7f14f412b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f409b140 con 0x7f14f409a280 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f40720b0 con 0x7f14f412af90 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14f412af90 0x7f14f412b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f2ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f14f409a280 0x7f14f412bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53692/0 (socket says 172.21.15.80:53692) 2024-02-18T16:20:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f2ffd640 1 -- 172.21.15.80:0/517271444 learned_addr learned my addr 172.21.15.80:0/517271444 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f37fe640 1 -- 172.21.15.80:0/517271444 >> v1:172.21.15.80:6789/0 conn(0x7f14f409a280 legacy=0x7f14f412bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f37fe640 1 -- 172.21.15.80:0/517271444 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f409ae30 con 0x7f14f412af90 2024-02-18T16:20:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f27fc640 1 -- 172.21.15.80:0/517271444 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535425121 0 0) 0x7f14f409b140 con 0x7f14f409a280 2024-02-18T16:20:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f37fe640 1 --2- 172.21.15.80:0/517271444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f412af90 0x7f14f412b370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009740 tx=0x7f14e401c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f830ec9e473d5209 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f27fc640 1 -- 172.21.15.80:0/517271444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e40ab530 con 0x7f14f412af90 2024-02-18T16:20:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f27fc640 1 -- 172.21.15.80:0/517271444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40a7050 con 0x7f14f412af90 2024-02-18T16:20:55.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f27fc640 1 -- 172.21.15.80:0/517271444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e40ab7e0 con 0x7f14f412af90 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- 172.21.15.80:0/517271444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f412af90 msgr2=0x7f14f412b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 --2- 172.21.15.80:0/517271444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f412af90 0x7f14f412b370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009740 tx=0x7f14e401c2e0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- 172.21.15.80:0/517271444 shutdown_connections 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 --2- 172.21.15.80:0/517271444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f412af90 0x7f14f412b370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- 172.21.15.80:0/517271444 >> 172.21.15.80:0/517271444 conn(0x7f14f409c220 msgr2=0x7f14f4071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- 172.21.15.80:0/517271444 shutdown_connections 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.024+0000 7f14f9e77640 1 -- 172.21.15.80:0/517271444 wait complete. 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 Processor -- start 2024-02-18T16:20:55.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 -- start start 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 0x7f14f41c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f411bd70 con 0x7f14f409a280 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 0x7f14f41c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 0x7f14f41c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43486/0 (socket says 172.21.15.80:43486) 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f37fe640 1 -- 172.21.15.80:0/752273759 learned_addr learned my addr 172.21.15.80:0/752273759 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f37fe640 1 -- 172.21.15.80:0/752273759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4009420 con 0x7f14f409a280 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f37fe640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 0x7f14f41c3750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f14e4018ef0 tx=0x7f14e401ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e40abe70 con 0x7f14f409a280 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40b7450 con 0x7f14f409a280 2024-02-18T16:20:55.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f411a530 con 0x7f14f409a280 2024-02-18T16:20:55.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e40b7730 con 0x7f14f409a280 2024-02-18T16:20:55.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f411ad00 con 0x7f14f409a280 2024-02-18T16:20:55.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f411beb0 con 0x7f14f409a280 2024-02-18T16:20:55.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f14e40b7890 con 0x7f14f409a280 2024-02-18T16:20:55.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14dbfff640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14e0035a10 0x7f14e0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f14e40e2ad0 con 0x7f14f409a280 2024-02-18T16:20:55.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.028+0000 7f14f2ffd640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14e0035a10 0x7f14e0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.032+0000 7f14f2ffd640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14e0035a10 0x7f14e0037ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14e8007fd0 tx=0x7f14e8007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.032+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f14e40bf770 con 0x7f14f409a280 2024-02-18T16:20:55.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.176+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14f4062860 con 0x7f14e0035a10 2024-02-18T16:20:55.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14dbfff640 1 -- 172.21.15.80:0/752273759 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34670 (secure 0 0 0) 0x7f14f4062860 con 0x7f14e0035a10 2024-02-18T16:20:55.186 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:55.187 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14e0035a10 msgr2=0x7f14e0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14e0035a10 0x7f14e0037ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14e8007fd0 tx=0x7f14e8007920 comp rx=0 tx=0).stop 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 msgr2=0x7f14f41c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 0x7f14f41c3750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f14e4018ef0 tx=0x7f14e401ab20 comp rx=0 tx=0).stop 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 shutdown_connections 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f14e0035a10 0x7f14e0037ed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 --2- 172.21.15.80:0/752273759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14f409a280 0x7f14f41c3750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 >> 172.21.15.80:0/752273759 conn(0x7f14f409c220 msgr2=0x7f14f412ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 shutdown_connections 2024-02-18T16:20:55.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.180+0000 7f14f9e77640 1 -- 172.21.15.80:0/752273759 wait complete. 2024-02-18T16:20:55.203 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-02-18T16:20:53.754782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109724,"kb_used_data":1640,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377636,"statfs":{"total":386547056640,"available":386434699264,"internally_reserved":0,"allocated":1679360,"data_stored":1328808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001368"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778566+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:20:52.778566+0000","last_peered":"2024-02-18T16:20:52.778566+0000","last_clean":"2024-02-18T16:20:52.778566+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:20:52.778566+0000","last_undegraded":"2024-02-18T16:20:52.778566+0000","last_fullsized":"2024-02-18T16:20:52.778566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:28:14.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.779167+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:20:52.779167+0000","last_peered":"2024-02-18T16:20:52.779167+0000","last_clean":"2024-02-18T16:20:52.779167+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:20:52.779167+0000","last_undegraded":"2024-02-18T16:20:52.779167+0000","last_fullsized":"2024-02-18T16:20:52.779167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:07.695714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778621+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:20:52.778621+0000","last_peered":"2024-02-18T16:20:52.778621+0000","last_clean":"2024-02-18T16:20:52.778621+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:20:52.778621+0000","last_undegraded":"2024-02-18T16:20:52.778621+0000","last_fullsized":"2024-02-18T16:20:52.778621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:55:06.221596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.779136+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:20:52.779136+0000","last_peered":"2024-02-18T16:20:52.779136+0000","last_clean":"2024-02-18T16:20:52.779136+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:20:52.779136+0000","last_undegraded":"2024-02-18T16:20:52.779136+0000","last_fullsized":"2024-02-18T16:20:52.779136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:59:56.616913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778509+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:20:52.778509+0000","last_peered":"2024-02-18T16:20:52.778509+0000","last_clean":"2024-02-18T16:20:52.778509+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:20:52.778509+0000","last_undegraded":"2024-02-18T16:20:52.778509+0000","last_fullsized":"2024-02-18T16:20:52.778509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:28:03.856941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.768404+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:20:52.768404+0000","last_peered":"2024-02-18T16:20:52.768404+0000","last_clean":"2024-02-18T16:20:52.768404+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:20:52.768404+0000","last_undegraded":"2024-02-18T16:20:52.768404+0000","last_fullsized":"2024-02-18T16:20:52.768404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:43.102493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778418+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:20:52.778418+0000","last_peered":"2024-02-18T16:20:52.778418+0000","last_clean":"2024-02-18T16:20:52.778418+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:20:52.778418+0000","last_undegraded":"2024-02-18T16:20:52.778418+0000","last_fullsized":"2024-02-18T16:20:52.778418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:05:58.537300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.778458+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:20:52.778458+0000","last_peered":"2024-02-18T16:20:52.778458+0000","last_clean":"2024-02-18T16:20:52.778458+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:20:52.778458+0000","last_undegraded":"2024-02-18T16:20:52.778458+0000","last_fullsized":"2024-02-18T16:20:52.778458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:58:17.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":168,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-02-18T16:20:52.777887+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:20:52.777887+0000","last_peered":"2024-02-18T16:20:52.777887+0000","last_clean":"2024-02-18T16:20:52.777887+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:20:52.777887+0000","last_undegraded":"2024-02-18T16:20:52.777887+0000","last_fullsized":"2024-02-18T16:20:52.777887+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:37.088141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:20:55.204 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-18T16:20:55.204 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-18T16:20:55.204 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-18T16:20:55.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-18T16:20:55.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3ef65a4640 1 Processor -- start 2024-02-18T16:20:55.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3ef65a4640 1 -- start start 2024-02-18T16:20:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3ef65a4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef0099020 0x7f3ef0099400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3ef65a4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef0099940 con 0x7f3ef0097160 2024-02-18T16:20:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3ef65a4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef009a1c0 con 0x7f3ef0099020 2024-02-18T16:20:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3eef7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ef0099020 0x7f3ef0099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3eeffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3ef0097160 0x7f3ef0098910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53698/0 (socket says 172.21.15.80:53698) 2024-02-18T16:20:55.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3eeffff640 1 -- 172.21.15.80:0/2528785043 learned_addr learned my addr 172.21.15.80:0/2528785043 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:20:55.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3eef7fe640 1 -- 172.21.15.80:0/2528785043 >> v1:172.21.15.80:6789/0 conn(0x7f3ef0097160 legacy=0x7f3ef0098910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.304+0000 7f3eef7fe640 1 -- 172.21.15.80:0/2528785043 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef009a4d0 con 0x7f3ef0099020 2024-02-18T16:20:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eef7fe640 1 --2- 172.21.15.80:0/2528785043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0099020 0x7f3ef0099400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009740 tx=0x7f3ee401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b45c7c0d76440e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeeffd640 1 -- 172.21.15.80:0/2528785043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ee40ab550 con 0x7f3ef0099020 2024-02-18T16:20:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeeffd640 1 -- 172.21.15.80:0/2528785043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee40ab6b0 con 0x7f3ef0099020 2024-02-18T16:20:55.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeeffd640 1 -- 172.21.15.80:0/2528785043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ee40ab970 con 0x7f3ef0099020 2024-02-18T16:20:55.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/2528785043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0099020 msgr2=0x7f3ef0099400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 --2- 172.21.15.80:0/2528785043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0099020 0x7f3ef0099400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009740 tx=0x7f3ee401c400 comp rx=0 tx=0).stop 2024-02-18T16:20:55.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/2528785043 shutdown_connections 2024-02-18T16:20:55.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 --2- 172.21.15.80:0/2528785043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0099020 0x7f3ef0099400 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/2528785043 >> 172.21.15.80:0/2528785043 conn(0x7f3ef00a0a00 msgr2=0x7f3ef009cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/2528785043 shutdown_connections 2024-02-18T16:20:55.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/2528785043 wait complete. 2024-02-18T16:20:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 Processor -- start 2024-02-18T16:20:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- start start 2024-02-18T16:20:55.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 0x7f3ef0131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0132a00 con 0x7f3ef0097160 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 0x7f3ef0131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 0x7f3ef0131bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43500/0 (socket says 172.21.15.80:43500) 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeffff640 1 -- 172.21.15.80:0/1335611857 learned_addr learned my addr 172.21.15.80:0/1335611857 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeffff640 1 -- 172.21.15.80:0/1335611857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4009420 con 0x7f3ef0097160 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eeffff640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 0x7f3ef0131bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c380 tx=0x7f3ee000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ee0005c20 con 0x7f3ef0097160 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0005d80 con 0x7f3ef0097160 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef0094e90 con 0x7f3ef0097160 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ee0007200 con 0x7f3ef0097160 2024-02-18T16:20:55.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.308+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef0094980 con 0x7f3ef0097160 2024-02-18T16:20:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.312+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef00950c0 con 0x7f3ef0097160 2024-02-18T16:20:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.312+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ee0007360 con 0x7f3ef0097160 2024-02-18T16:20:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.312+0000 7f3eecff9640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc035a10 0x7f3edc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.312+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f3ee0047090 con 0x7f3ef0097160 2024-02-18T16:20:55.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.312+0000 7f3eef7fe640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc035a10 0x7f3edc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.312+0000 7f3eef7fe640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc035a10 0x7f3edc037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40af000 tx=0x7f3ee40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.316+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ee0007610 con 0x7f3ef0097160 2024-02-18T16:20:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.492+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3ef0062860 con 0x7f3ef0097160 2024-02-18T16:20:55.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3eecff9640 1 -- 172.21.15.80:0/1335611857 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3ee0017070 con 0x7f3ef0097160 2024-02-18T16:20:55.501 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:20:55.501 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc035a10 msgr2=0x7f3edc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc035a10 0x7f3edc037ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40af000 tx=0x7f3ee40a7000 comp rx=0 tx=0).stop 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 msgr2=0x7f3ef0131bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 0x7f3ef0131bc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c380 tx=0x7f3ee000c840 comp rx=0 tx=0).stop 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 shutdown_connections 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc035a10 0x7f3edc037ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 --2- 172.21.15.80:0/1335611857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ef0097160 0x7f3ef0131bc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 >> 172.21.15.80:0/1335611857 conn(0x7f3ef00a0a00 msgr2=0x7f3ef006f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 shutdown_connections 2024-02-18T16:20:55.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:20:55.496+0000 7f3ef65a4640 1 -- 172.21.15.80:0/1335611857 wait complete. 2024-02-18T16:20:55.518 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-18T16:20:55.518 INFO:teuthology.run_tasks:Running task rgw... 2024-02-18T16:20:55.536 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-18T16:20:55.536 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-18T16:20:55.536 INFO:tasks.rgw:Creating data pools 2024-02-18T16:20:55.536 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-18T16:20:55.536 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-02-18T16:20:55.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd2268e2640 1 Processor -- start 2024-02-18T16:20:55.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd2268e2640 1 -- start start 2024-02-18T16:20:55.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd2268e2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2201167d0 0x7fd220118bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd2268e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd220119100 con 0x7fd2201129c0 2024-02-18T16:20:55.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd2268e2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22011a2a0 con 0x7fd2201167d0 2024-02-18T16:20:55.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd21f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd2201167d0 0x7fd220118bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd21ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd2201129c0 0x7fd220112da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:37414/0 (socket says 172.21.15.129:37414) 2024-02-18T16:20:55.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd21ffff640 1 -- 172.21.15.129:0/2032987968 learned_addr learned my addr 172.21.15.129:0/2032987968 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:20:55.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd21f7fe640 1 -- 172.21.15.129:0/2032987968 >> v1:172.21.15.80:6789/0 conn(0x7fd2201129c0 legacy=0x7fd220112da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd21effd640 1 -- 172.21.15.129:0/2032987968 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264815011 0 0) 0x7fd220119100 con 0x7fd2201129c0 2024-02-18T16:20:55.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.662+0000 7fd21f7fe640 1 -- 172.21.15.129:0/2032987968 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22011a3e0 con 0x7fd2201167d0 2024-02-18T16:20:55.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21f7fe640 1 --2- 172.21.15.129:0/2032987968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201167d0 0x7fd220118bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd214009740 tx=0x7fd21401d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8e7a8d73e94927 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21effd640 1 -- 172.21.15.129:0/2032987968 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2140a8070 con 0x7fd2201167d0 2024-02-18T16:20:55.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21effd640 1 -- 172.21.15.129:0/2032987968 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2140ac560 con 0x7fd2201167d0 2024-02-18T16:20:55.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21effd640 1 -- 172.21.15.129:0/2032987968 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2140ac820 con 0x7fd2201167d0 2024-02-18T16:20:55.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- 172.21.15.129:0/2032987968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201167d0 msgr2=0x7fd220118bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:55.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 --2- 172.21.15.129:0/2032987968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201167d0 0x7fd220118bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd214009740 tx=0x7fd21401d480 comp rx=0 tx=0).stop 2024-02-18T16:20:55.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- 172.21.15.129:0/2032987968 shutdown_connections 2024-02-18T16:20:55.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 --2- 172.21.15.129:0/2032987968 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201167d0 0x7fd220118bc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:55.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- 172.21.15.129:0/2032987968 >> 172.21.15.129:0/2032987968 conn(0x7fd22006e8d0 msgr2=0x7fd220070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:55.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- 172.21.15.129:0/2032987968 shutdown_connections 2024-02-18T16:20:55.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- 172.21.15.129:0/2032987968 wait complete. 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 Processor -- start 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- start start 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 0x7fd2201a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2201a71d0 con 0x7fd2201129c0 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 0x7fd2201a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 0x7fd2201a6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:53946/0 (socket says 172.21.15.129:53946) 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21ffff640 1 -- 172.21.15.129:0/49848861 learned_addr learned my addr 172.21.15.129:0/49848861 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:55.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21ffff640 1 -- 172.21.15.129:0/49848861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009420 con 0x7fd2201129c0 2024-02-18T16:20:55.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21ffff640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 0x7fd2201a6c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c400 tx=0x7fd21000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2100074d0 con 0x7fd2201129c0 2024-02-18T16:20:55.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2201a7430 con 0x7fd2201129c0 2024-02-18T16:20:55.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.666+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210007630 con 0x7fd2201129c0 2024-02-18T16:20:55.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd210004960 con 0x7fd2201129c0 2024-02-18T16:20:55.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2201ab520 con 0x7fd2201129c0 2024-02-18T16:20:55.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220062860 con 0x7fd2201129c0 2024-02-18T16:20:55.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd210004bd0 con 0x7fd2201129c0 2024-02-18T16:20:55.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd21cff9640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd20c0359c0 0x7fd20c037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:55.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fd210047e10 con 0x7fd2201129c0 2024-02-18T16:20:55.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd21f7fe640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd20c0359c0 0x7fd20c037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:55.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.670+0000 7fd21f7fe640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd20c0359c0 0x7fd20c037e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd214009740 tx=0x7fd2140a8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:55.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.682+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2100123b0 con 0x7fd2201129c0 2024-02-18T16:20:55.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:55.850+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) v1 -- 0x7fd220067620 con 0x7fd2201129c0 2024-02-18T16:20:56.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.778+0000 7fd21cff9640 1 -- 172.21.15.129:0/49848861 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v16) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd21002e030 con 0x7fd2201129c0 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd20c0359c0 msgr2=0x7fd20c037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd20c0359c0 0x7fd20c037e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd214009740 tx=0x7fd2140a8000 comp rx=0 tx=0).stop 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 msgr2=0x7fd2201a6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 0x7fd2201a6c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c400 tx=0x7fd21000c8c0 comp rx=0 tx=0).stop 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 shutdown_connections 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd20c0359c0 0x7fd20c037e80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:56.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 --2- 172.21.15.129:0/49848861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd2201129c0 0x7fd2201a6c90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:56.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 >> 172.21.15.129:0/49848861 conn(0x7fd22006e8d0 msgr2=0x7fd220111560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:56.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 shutdown_connections 2024-02-18T16:20:56.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.782+0000 7fd2268e2640 1 -- 172.21.15.129:0/49848861 wait complete. 2024-02-18T16:20:56.812 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-02-18T16:20:56.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29f5791640 1 Processor -- start 2024-02-18T16:20:56.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29f5791640 1 -- start start 2024-02-18T16:20:56.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29f5791640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29f01181b0 0x7f29f011a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:56.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29f5791640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f011aae0 con 0x7f29f010e020 2024-02-18T16:20:56.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29f5791640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f011bc80 con 0x7f29f01181b0 2024-02-18T16:20:56.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29ee7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29f01181b0 0x7f29f011a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:56.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29eeffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f29f010e020 0x7f29f010e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:37422/0 (socket says 172.21.15.129:37422) 2024-02-18T16:20:56.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29ee7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29f01181b0 0x7f29f011a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:53960/0 (socket says 172.21.15.129:53960) 2024-02-18T16:20:56.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29eeffd640 1 -- 172.21.15.129:0/666059802 learned_addr learned my addr 172.21.15.129:0/666059802 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:20:56.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29ee7fc640 1 -- 172.21.15.129:0/666059802 >> v1:172.21.15.80:6789/0 conn(0x7f29f010e020 legacy=0x7f29f010e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:56.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29ee7fc640 1 -- 172.21.15.129:0/666059802 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f011bdc0 con 0x7f29f01181b0 2024-02-18T16:20:56.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.934+0000 7f29ee7fc640 1 --2- 172.21.15.129:0/666059802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f01181b0 0x7f29f011a5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009740 tx=0x7f29e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea2de5b92de7035 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:56.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29edffb640 1 -- 172.21.15.129:0/666059802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29e00a8050 con 0x7f29f01181b0 2024-02-18T16:20:56.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29edffb640 1 -- 172.21.15.129:0/666059802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e00ac520 con 0x7f29f01181b0 2024-02-18T16:20:56.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29edffb640 1 -- 172.21.15.129:0/666059802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29e00ac7e0 con 0x7f29f01181b0 2024-02-18T16:20:56.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/666059802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f01181b0 msgr2=0x7f29f011a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:56.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 --2- 172.21.15.129:0/666059802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f01181b0 0x7f29f011a5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009740 tx=0x7f29e001c370 comp rx=0 tx=0).stop 2024-02-18T16:20:56.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/666059802 shutdown_connections 2024-02-18T16:20:56.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 --2- 172.21.15.129:0/666059802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f01181b0 0x7f29f011a5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:56.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/666059802 >> 172.21.15.129:0/666059802 conn(0x7f29f006e8d0 msgr2=0x7f29f0070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:56.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/666059802 shutdown_connections 2024-02-18T16:20:56.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/666059802 wait complete. 2024-02-18T16:20:56.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 Processor -- start 2024-02-18T16:20:56.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- start start 2024-02-18T16:20:56.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 0x7f29f01ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:56.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01ac960 con 0x7f29f010e020 2024-02-18T16:20:56.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29eeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 0x7f29f01ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:56.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29eeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 0x7f29f01ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:53976/0 (socket says 172.21.15.129:53976) 2024-02-18T16:20:56.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29eeffd640 1 -- 172.21.15.129:0/3249880262 learned_addr learned my addr 172.21.15.129:0/3249880262 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:56.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29eeffd640 1 -- 172.21.15.129:0/3249880262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0009420 con 0x7f29f010e020 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29eeffd640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 0x7f29f01ac390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c3b0 tx=0x7f29d800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29d8005c20 con 0x7f29f010e020 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8005d80 con 0x7f29f010e020 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f01acb00 con 0x7f29f010e020 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29d8004940 con 0x7f29f010e020 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.938+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f01a6220 con 0x7f29f010e020 2024-02-18T16:20:56.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.942+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0062860 con 0x7f29f010e020 2024-02-18T16:20:56.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.942+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f29d802abd0 con 0x7f29f010e020 2024-02-18T16:20:56.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.942+0000 7f29e77fe640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f29d0035a10 0x7f29d0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:56.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.942+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3797+0+0 (secure 0 0 0) 0x7f29d8047a00 con 0x7f29f010e020 2024-02-18T16:20:56.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.942+0000 7f29ee7fc640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f29d0035a10 0x7f29d0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:56.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.942+0000 7f29ee7fc640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f29d0035a10 0x7f29d0037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29e00ae000 tx=0x7f29e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:56.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:56.954+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f29d80118b0 con 0x7f29f010e020 2024-02-18T16:20:57.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:57.114+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f29f0067620 con 0x7f29f010e020 2024-02-18T16:20:58.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29e77fe640 1 -- 172.21.15.129:0/3249880262 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v18) v1 ==== 227+0+0 (secure 0 0 0) 0x7f29d802e070 con 0x7f29f010e020 2024-02-18T16:20:58.798 INFO:teuthology.orchestra.run.smithi129.stderr:pool 'default.rgw.buckets.data' created 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f29d0035a10 msgr2=0x7f29d0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29f5791640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f29d0035a10 0x7f29d0037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29e00ae000 tx=0x7f29e0008040 comp rx=0 tx=0).stop 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 msgr2=0x7f29f01ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29f5791640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 0x7f29f01ac390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c3b0 tx=0x7f29d800c870 comp rx=0 tx=0).stop 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 shutdown_connections 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.790+0000 7f29f5791640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f29d0035a10 0x7f29d0037ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.794+0000 7f29f5791640 1 --2- 172.21.15.129:0/3249880262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29f010e020 0x7f29f01ac390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.794+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 >> 172.21.15.129:0/3249880262 conn(0x7f29f006e8d0 msgr2=0x7f29f006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:58.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.794+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 shutdown_connections 2024-02-18T16:20:58.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.794+0000 7f29f5791640 1 -- 172.21.15.129:0/3249880262 wait complete. 2024-02-18T16:20:58.829 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09fccf7640 1 Processor -- start 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09fccf7640 1 -- start start 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09fccf7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09f81181b0 0x7f09f811a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09fccf7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f811aae0 con 0x7f09f810e020 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09fccf7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f811bc80 con 0x7f09f81181b0 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f5d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09f81181b0 0x7f09f811a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:58.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f5d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09f81181b0 0x7f09f811a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34442/0 (socket says 172.21.15.129:34442) 2024-02-18T16:20:58.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f5d9b640 1 -- 172.21.15.129:0/634189635 learned_addr learned my addr 172.21.15.129:0/634189635 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:58.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f659c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f09f810e020 0x7f09f810e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:48548/0 (socket says 172.21.15.129:48548) 2024-02-18T16:20:58.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f5d9b640 1 -- 172.21.15.129:0/634189635 >> v1:172.21.15.80:6789/0 conn(0x7f09f810e020 legacy=0x7f09f810e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:58.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f5d9b640 1 -- 172.21.15.129:0/634189635 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f811bdc0 con 0x7f09f81181b0 2024-02-18T16:20:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.946+0000 7f09f559a640 1 -- 172.21.15.129:0/634189635 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370038288 0 0) 0x7f09f811aae0 con 0x7f09f810e020 2024-02-18T16:20:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f5d9b640 1 --2- 172.21.15.129:0/634189635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f81181b0 0x7f09f811a5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0097f0 tx=0x7f09ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28404f638b3789d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f559a640 1 -- 172.21.15.129:0/634189635 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09ec0ab580 con 0x7f09f81181b0 2024-02-18T16:20:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f559a640 1 -- 172.21.15.129:0/634189635 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec0ab6e0 con 0x7f09f81181b0 2024-02-18T16:20:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f559a640 1 -- 172.21.15.129:0/634189635 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09ec0ab9a0 con 0x7f09f81181b0 2024-02-18T16:20:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- 172.21.15.129:0/634189635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f81181b0 msgr2=0x7f09f811a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 --2- 172.21.15.129:0/634189635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f81181b0 0x7f09f811a5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0097f0 tx=0x7f09ec01c430 comp rx=0 tx=0).stop 2024-02-18T16:20:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- 172.21.15.129:0/634189635 shutdown_connections 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 --2- 172.21.15.129:0/634189635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f81181b0 0x7f09f811a5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- 172.21.15.129:0/634189635 >> 172.21.15.129:0/634189635 conn(0x7f09f806e870 msgr2=0x7f09f8070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- 172.21.15.129:0/634189635 shutdown_connections 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- 172.21.15.129:0/634189635 wait complete. 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 Processor -- start 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- start start 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 0x7f09f81ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:58.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09fccf7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f81ac780 con 0x7f09f810e020 2024-02-18T16:20:58.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 0x7f09f81ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 0x7f09f81ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34454/0 (socket says 172.21.15.129:34454) 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f659c640 1 -- 172.21.15.129:0/2654462096 learned_addr learned my addr 172.21.15.129:0/2654462096 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.950+0000 7f09f659c640 1 -- 172.21.15.129:0/2654462096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0094d0 con 0x7f09f810e020 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09f659c640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 0x7f09f81ac1b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c400 tx=0x7f09e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09e80074d0 con 0x7f09f810e020 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8007630 con 0x7f09f810e020 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f81ac980 con 0x7f09f810e020 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09e8004960 con 0x7f09f810e020 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f81a6040 con 0x7f09f810e020 2024-02-18T16:20:58.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8062860 con 0x7f09f810e020 2024-02-18T16:20:58.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f09e8004bd0 con 0x7f09f810e020 2024-02-18T16:20:58.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09e6ffd640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09d80359c0 0x7f09d8037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:58.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4272+0+0 (secure 0 0 0) 0x7f09e8048510 con 0x7f09f810e020 2024-02-18T16:20:58.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09f5d9b640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09d80359c0 0x7f09d8037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:58.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.954+0000 7f09f5d9b640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09d80359c0 0x7f09d8037e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0af000 tx=0x7f09ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:58.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:58.966+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09e801a6c0 con 0x7f09f810e020 2024-02-18T16:20:59.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.126+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f09f81181b0 con 0x7f09f810e020 2024-02-18T16:20:59.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.794+0000 7f09e6ffd640 1 -- 172.21.15.129:0/2654462096 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) v1 ==== 185+0+0 (secure 0 0 0) 0x7f09e801a2b0 con 0x7f09f810e020 2024-02-18T16:20:59.804 INFO:teuthology.orchestra.run.smithi129.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09d80359c0 msgr2=0x7f09d8037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09d80359c0 0x7f09d8037e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0af000 tx=0x7f09ec008040 comp rx=0 tx=0).stop 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 msgr2=0x7f09f81ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 0x7f09f81ac1b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c400 tx=0x7f09e800c8c0 comp rx=0 tx=0).stop 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 shutdown_connections 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09d80359c0 0x7f09d8037e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 --2- 172.21.15.129:0/2654462096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09f810e020 0x7f09f81ac1b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 >> 172.21.15.129:0/2654462096 conn(0x7f09f806e870 msgr2=0x7f09f806f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:59.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 shutdown_connections 2024-02-18T16:20:59.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.798+0000 7f09fccf7640 1 -- 172.21.15.129:0/2654462096 wait complete. 2024-02-18T16:20:59.840 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-18T16:20:59.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.962+0000 7f95c7c24640 1 Processor -- start 2024-02-18T16:20:59.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.962+0000 7f95c7c24640 1 -- start start 2024-02-18T16:20:59.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c7c24640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95c011a310 0x7f95c011c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:59.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c7c24640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c011cc70 con 0x7f95c0116550 2024-02-18T16:20:59.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c7c24640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c011de30 con 0x7f95c011a310 2024-02-18T16:20:59.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c51bf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95c011a310 0x7f95c011c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:59.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c51bf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f95c011a310 0x7f95c011c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34470/0 (socket says 172.21.15.129:34470) 2024-02-18T16:20:59.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c51bf640 1 -- 172.21.15.129:0/2077670157 learned_addr learned my addr 172.21.15.129:0/2077670157 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:59.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c51bf640 1 -- 172.21.15.129:0/2077670157 >> v1:172.21.15.80:6789/0 conn(0x7f95c0116550 legacy=0x7f95c0116930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:59.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c51bf640 1 -- 172.21.15.129:0/2077670157 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c011dfa0 con 0x7f95c011a310 2024-02-18T16:20:59.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c51bf640 1 --2- 172.21.15.129:0/2077670157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c011a310 0x7f95c011c700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009e50 tx=0x7f95bc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ed1eddbb59ab52 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:59.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c49be640 1 -- 172.21.15.129:0/2077670157 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc009200 con 0x7f95c011a310 2024-02-18T16:20:59.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c49be640 1 -- 172.21.15.129:0/2077670157 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc0a57e0 con 0x7f95c011a310 2024-02-18T16:20:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.966+0000 7f95c49be640 1 -- 172.21.15.129:0/2077670157 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc0a5aa0 con 0x7f95c011a310 2024-02-18T16:20:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/2077670157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c011a310 msgr2=0x7f95c011c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:20:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 --2- 172.21.15.129:0/2077670157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c011a310 0x7f95c011c700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009e50 tx=0x7f95bc01c980 comp rx=0 tx=0).stop 2024-02-18T16:20:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/2077670157 shutdown_connections 2024-02-18T16:20:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 --2- 172.21.15.129:0/2077670157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c011a310 0x7f95c011c700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:20:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/2077670157 >> 172.21.15.129:0/2077670157 conn(0x7f95c006dbe0 msgr2=0x7f95c006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:20:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/2077670157 shutdown_connections 2024-02-18T16:20:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/2077670157 wait complete. 2024-02-18T16:20:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 Processor -- start 2024-02-18T16:20:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- start start 2024-02-18T16:20:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 0x7f95c01a8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01a8cc0 con 0x7f95c0116550 2024-02-18T16:20:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c59c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 0x7f95c01a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c59c0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 0x7f95c01a8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34478/0 (socket says 172.21.15.129:34478) 2024-02-18T16:20:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c59c0640 1 -- 172.21.15.129:0/3997236592 learned_addr learned my addr 172.21.15.129:0/3997236592 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c59c0640 1 -- 172.21.15.129:0/3997236592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009b30 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c59c0640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 0x7f95c01a8780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c3b0 tx=0x7f95b000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95b0005200 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c01a8ec0 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b0005380 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95b0007020 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.970+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c01ad0a0 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.974+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0062860 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.974+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f95b0007180 con 0x7f95c0116550 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.974+0000 7f95b67fc640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f95a40359c0 0x7f95a4037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:20:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.974+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4283+0+0 (secure 0 0 0) 0x7f95b00478e0 con 0x7f95c0116550 2024-02-18T16:20:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.974+0000 7f95c51bf640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f95a40359c0 0x7f95a4037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:20:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.974+0000 7f95c51bf640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f95a40359c0 0x7f95a4037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ae000 tx=0x7f95bc0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:20:59.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:20:59.986+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95b0019c30 con 0x7f95c0116550 2024-02-18T16:21:00.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.146+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f95c0067620 con 0x7f95c0116550 2024-02-18T16:21:00.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.802+0000 7f95b67fc640 1 -- 172.21.15.129:0/3997236592 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7f95b0019e60 con 0x7f95c0116550 2024-02-18T16:21:00.813 INFO:teuthology.orchestra.run.smithi129.stderr:pool 'default.rgw.buckets.index' created 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.806+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f95a40359c0 msgr2=0x7f95a4037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.806+0000 7f95c7c24640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f95a40359c0 0x7f95a4037e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ae000 tx=0x7f95bc0a7070 comp rx=0 tx=0).stop 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.806+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 msgr2=0x7f95c01a8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.806+0000 7f95c7c24640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 0x7f95c01a8780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c3b0 tx=0x7f95b000c870 comp rx=0 tx=0).stop 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.810+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 shutdown_connections 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.810+0000 7f95c7c24640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f95a40359c0 0x7f95a4037e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.810+0000 7f95c7c24640 1 --2- 172.21.15.129:0/3997236592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95c0116550 0x7f95c01a8780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:00.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.810+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 >> 172.21.15.129:0/3997236592 conn(0x7f95c006dbe0 msgr2=0x7f95c01182e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:00.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.810+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 shutdown_connections 2024-02-18T16:21:00.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.810+0000 7f95c7c24640 1 -- 172.21.15.129:0/3997236592 wait complete. 2024-02-18T16:21:00.851 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-18T16:21:00.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89cf1af640 1 Processor -- start 2024-02-18T16:21:00.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89cf1af640 1 -- start start 2024-02-18T16:21:00.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89cf1af640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89c8116550 0x7f89c8116930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:00.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89cf1af640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c8116f00 con 0x7f89c81150c0 2024-02-18T16:21:00.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89cf1af640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c8115c50 con 0x7f89c8116550 2024-02-18T16:21:00.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89ccf4b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89c8116550 0x7f89c8116930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:00.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89c7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f89c81150c0 0x7f89c8115540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:48562/0 (socket says 172.21.15.129:48562) 2024-02-18T16:21:00.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89ccf4b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89c8116550 0x7f89c8116930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34490/0 (socket says 172.21.15.129:34490) 2024-02-18T16:21:00.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89c7fff640 1 -- 172.21.15.129:0/36548099 learned_addr learned my addr 172.21.15.129:0/36548099 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:00.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89ccf4b640 1 -- 172.21.15.129:0/36548099 >> v1:172.21.15.80:6789/0 conn(0x7f89c81150c0 legacy=0x7f89c8115540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:00.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.966+0000 7f89ccf4b640 1 -- 172.21.15.129:0/36548099 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8115dc0 con 0x7f89c8116550 2024-02-18T16:21:00.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89ccf4b640 1 --2- 172.21.15.129:0/36548099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c8116550 0x7f89c8116930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009740 tx=0x7f89b801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac375072162a54cb server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:00.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89c77fe640 1 -- 172.21.15.129:0/36548099 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b80a8050 con 0x7f89c8116550 2024-02-18T16:21:00.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89c77fe640 1 -- 172.21.15.129:0/36548099 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b80ac520 con 0x7f89c8116550 2024-02-18T16:21:00.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89c77fe640 1 -- 172.21.15.129:0/36548099 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b80ac7e0 con 0x7f89c8116550 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- 172.21.15.129:0/36548099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c8116550 msgr2=0x7f89c8116930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 --2- 172.21.15.129:0/36548099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c8116550 0x7f89c8116930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009740 tx=0x7f89b801c370 comp rx=0 tx=0).stop 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- 172.21.15.129:0/36548099 shutdown_connections 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 --2- 172.21.15.129:0/36548099 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c8116550 0x7f89c8116930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- 172.21.15.129:0/36548099 >> 172.21.15.129:0/36548099 conn(0x7f89c806dbe0 msgr2=0x7f89c806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- 172.21.15.129:0/36548099 shutdown_connections 2024-02-18T16:21:00.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- 172.21.15.129:0/36548099 wait complete. 2024-02-18T16:21:00.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 Processor -- start 2024-02-18T16:21:00.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- start start 2024-02-18T16:21:00.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 0x7f89c81a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:00.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89cf1af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c81a8d60 con 0x7f89c81150c0 2024-02-18T16:21:00.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89ccf4b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 0x7f89c81a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89ccf4b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 0x7f89c81a8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:34500/0 (socket says 172.21.15.129:34500) 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.970+0000 7f89ccf4b640 1 -- 172.21.15.129:0/3455946150 learned_addr learned my addr 172.21.15.129:0/3455946150 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89ccf4b640 1 -- 172.21.15.129:0/3455946150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b8009420 con 0x7f89c81150c0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89ccf4b640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 0x7f89c81a8820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89b80af040 tx=0x7f89b801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b80ab8d0 con 0x7f89c81150c0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c81a8f60 con 0x7f89c81150c0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c81ad140 con 0x7f89c81150c0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b80aba30 con 0x7f89c81150c0 2024-02-18T16:21:00.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b80abcd0 con 0x7f89c81150c0 2024-02-18T16:21:00.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c81a9380 con 0x7f89c81150c0 2024-02-18T16:21:00.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f89b80b8450 con 0x7f89c81150c0 2024-02-18T16:21:00.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c57fa640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f89b40359c0 0x7f89b4037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:00.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4647+0+0 (secure 0 0 0) 0x7f89b80e31d0 con 0x7f89c81150c0 2024-02-18T16:21:00.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c7fff640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f89b40359c0 0x7f89b4037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:00.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.974+0000 7f89c7fff640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f89b40359c0 0x7f89b4037e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89bc001610 tx=0x7f89bc007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:00.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:00.986+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89b80c72b0 con 0x7f89c81150c0 2024-02-18T16:21:01.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.146+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f89c80628d0 con 0x7f89c81150c0 2024-02-18T16:21:01.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.810+0000 7f89c57fa640 1 -- 172.21.15.129:0/3455946150 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) v1 ==== 187+0+0 (secure 0 0 0) 0x7f89c80628d0 con 0x7f89c81150c0 2024-02-18T16:21:01.819 INFO:teuthology.orchestra.run.smithi129.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-18T16:21:01.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f89b40359c0 msgr2=0x7f89b4037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:01.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f89b40359c0 0x7f89b4037e80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89bc001610 tx=0x7f89bc007ad0 comp rx=0 tx=0).stop 2024-02-18T16:21:01.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 msgr2=0x7f89c81a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:01.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 0x7f89c81a8820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89b80af040 tx=0x7f89b801abb0 comp rx=0 tx=0).stop 2024-02-18T16:21:01.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 shutdown_connections 2024-02-18T16:21:01.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f89b40359c0 0x7f89b4037e80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:01.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 --2- 172.21.15.129:0/3455946150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c81150c0 0x7f89c81a8820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:01.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 >> 172.21.15.129:0/3455946150 conn(0x7f89c806dbe0 msgr2=0x7f89c81136a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:01.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 shutdown_connections 2024-02-18T16:21:01.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:01.814+0000 7f89cf1af640 1 -- 172.21.15.129:0/3455946150 wait complete. 2024-02-18T16:21:01.864 DEBUG:tasks.rgw:Pools created 2024-02-18T16:21:01.864 INFO:tasks.rgw:Starting rgw... 2024-02-18T16:21:01.864 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-18T16:21:01.864 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-18T16:21:01.864 DEBUG:teuthology.orchestra.run.smithi129:> sudo echo -n http://smithi129.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-02-18T16:21:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:http://smithi129.front.sepia.ceph.com:80 2024-02-18T16:21:01.876 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-02-18T16:21:01.927 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-18T16:21:01.927 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-18T16:21:01.971 INFO:tasks.rgw.client.0:Started 2024-02-18T16:21:01.971 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi129.front.sepia.ceph.com:80/ 2024-02-18T16:21:01.971 DEBUG:teuthology.orchestra.run.smithi129:> curl http://smithi129.front.sepia.ceph.com:80/ 2024-02-18T16:21:02.005 INFO:teuthology.orchestra.run.smithi129.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-18T16:21:02.005 INFO:teuthology.orchestra.run.smithi129.stderr: Dload Upload Total Spent Left Speed 2024-02-18T16:21:02.007 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-18T16:21:02.007 INFO:teuthology.orchestra.run.smithi129.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-18T16:21:02.008 INFO:teuthology.orchestra.run.smithi129.stderr:curl: (7) Failed to connect to smithi129.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-18T16:21:03.009 DEBUG:teuthology.orchestra.run.smithi129:> curl http://smithi129.front.sepia.ceph.com:80/ 2024-02-18T16:21:03.021 INFO:teuthology.orchestra.run.smithi129.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-18T16:21:03.021 INFO:teuthology.orchestra.run.smithi129.stderr: Dload Upload Total Spent Left Speed 2024-02-18T16:21:03.021 INFO:teuthology.orchestra.run.smithi129.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-18T16:21:03.021 INFO:teuthology.orchestra.run.smithi129.stderr:curl: (7) Failed to connect to smithi129.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-18T16:21:03.021 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-18T16:21:05.022 DEBUG:teuthology.orchestra.run.smithi129:> curl http://smithi129.front.sepia.ceph.com:80/ 2024-02-18T16:21:05.034 INFO:teuthology.orchestra.run.smithi129.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-18T16:21:05.035 INFO:teuthology.orchestra.run.smithi129.stderr: Dload Upload Total Spent Left Speed 2024-02-18T16:21:05.035 INFO:teuthology.orchestra.run.smithi129.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-18T16:21:05.035 INFO:teuthology.orchestra.run.smithi129.stderr:curl: (7) Failed to connect to smithi129.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-18T16:21:05.035 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-18T16:21:09.037 DEBUG:teuthology.orchestra.run.smithi129:> curl http://smithi129.front.sepia.ceph.com:80/ 2024-02-18T16:21:09.049 INFO:teuthology.orchestra.run.smithi129.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-18T16:21:09.049 INFO:teuthology.orchestra.run.smithi129.stderr: Dload Upload Total Spent Left Speed 2024-02-18T16:21:09.050 INFO:teuthology.orchestra.run.smithi129.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-18T16:21:09.050 INFO:teuthology.orchestra.run.smithi129.stderr:curl: (7) Failed to connect to smithi129.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-18T16:21:09.050 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-18T16:21:17.051 DEBUG:teuthology.orchestra.run.smithi129:> curl http://smithi129.front.sepia.ceph.com:80/ 2024-02-18T16:21:17.063 INFO:teuthology.orchestra.run.smithi129.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-18T16:21:17.063 INFO:teuthology.orchestra.run.smithi129.stderr: Dload Upload Total Spent Left Speed 2024-02-18T16:21:17.067 INFO:teuthology.orchestra.run.smithi129.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 57066 0 --:--:-- --:--:-- --:--:-- 71333 2024-02-18T16:21:17.068 INFO:teuthology.orchestra.run.smithi129.stdout:anonymous 2024-02-18T16:21:17.068 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-02-18T16:21:18.743 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-02-18T16:21:18.743 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-18T16:21:18.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-18T16:21:18.744 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-18T16:21:18.780 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:18.781 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:18.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.770+0000 7f0abaab6980 1 Processor -- start 2024-02-18T16:21:18.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.770+0000 7f0abaab6980 1 -- start start 2024-02-18T16:21:18.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0abaab6980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x558a627e2340 0x558a627e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0abaab6980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558a6272c4b0 con 0x558a627e2c60 2024-02-18T16:21:18.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0abaab6980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x558a626f3180 con 0x558a627e2340 2024-02-18T16:21:18.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0ab85d1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x558a627e2340 0x558a627e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0ab7dd0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x558a627e2c60 0x558a627e3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42576/0 (socket says 172.21.15.129:42576) 2024-02-18T16:21:18.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/15774361 learned_addr learned my addr 172.21.15.129:0/15774361 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:18.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0ab85d1640 1 -- 172.21.15.129:0/15774361 >> v1:172.21.15.80:6789/0 conn(0x558a627e2c60 legacy=0x558a627e3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.774+0000 7f0ab85d1640 1 -- 172.21.15.129:0/15774361 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a627e3e40 con 0x558a627e2340 2024-02-18T16:21:18.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/15774361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a627e2720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800a420 tx=0x7f0aa801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6963e1c09390029 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0ab75cf640 1 -- 172.21.15.129:0/15774361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aa80aa530 con 0x558a627e2340 2024-02-18T16:21:18.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0ab75cf640 1 -- 172.21.15.129:0/15774361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa80a6050 con 0x558a627e2340 2024-02-18T16:21:18.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0ab75cf640 1 -- 172.21.15.129:0/15774361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aa80aa800 con 0x558a627e2340 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 -- 172.21.15.129:0/15774361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 msgr2=0x558a627e2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 --2- 172.21.15.129:0/15774361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a627e2720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800a420 tx=0x7f0aa801afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 -- 172.21.15.129:0/15774361 shutdown_connections 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 --2- 172.21.15.129:0/15774361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a627e2720 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 -- 172.21.15.129:0/15774361 >> 172.21.15.129:0/15774361 conn(0x558a62755a30 msgr2=0x558a62755e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 -- 172.21.15.129:0/15774361 shutdown_connections 2024-02-18T16:21:18.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.778+0000 7f0abaab6980 1 -- 172.21.15.129:0/15774361 wait complete. 2024-02-18T16:21:18.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0abaab6980 1 Processor -- start 2024-02-18T16:21:18.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0abaab6980 1 -- start start 2024-02-18T16:21:18.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0abaab6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0abaab6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a626f06b0 con 0x558a627e2340 2024-02-18T16:21:18.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0ab85d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0ab85d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:46934/0 (socket says 172.21.15.129:46934) 2024-02-18T16:21:18.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0ab85d1640 1 -- 172.21.15.129:0/3878222705 learned_addr learned my addr 172.21.15.129:0/3878222705 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:18.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0ab85d1640 1 -- 172.21.15.129:0/3878222705 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa800a100 con 0x558a627e2340 2024-02-18T16:21:18.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/3878222705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628cc7e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80ad040 tx=0x7f0aa80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f7cb45dca7f895 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f09a660c640 1 -- 172.21.15.129:0/3878222705 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aa80aa6c0 con 0x558a627e2340 2024-02-18T16:21:18.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f09a660c640 1 -- 172.21.15.129:0/3878222705 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa80aa820 con 0x558a627e2340 2024-02-18T16:21:18.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.794+0000 7f09a660c640 1 -- 172.21.15.129:0/3878222705 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aa80aaac0 con 0x558a627e2340 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/3878222705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 msgr2=0x558a628cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 --2- 172.21.15.129:0/3878222705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628cc7e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80ad040 tx=0x7f0aa80033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/3878222705 shutdown_connections 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 --2- 172.21.15.129:0/3878222705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628cc7e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/3878222705 >> 172.21.15.129:0/3878222705 conn(0x558a62755a30 msgr2=0x558a628c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/3878222705 shutdown_connections 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/3878222705 wait complete. 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 Processor -- start 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- start start 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628d3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a626ebe90 con 0x558a627e2340 2024-02-18T16:21:18.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0ab85d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0ab85d1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628d3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:46950/0 (socket says 172.21.15.129:46950) 2024-02-18T16:21:18.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2767681950 learned_addr learned my addr 172.21.15.129:0/2767681950 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a627e3e40 con 0x558a627e2340 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628d3530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8003430 tx=0x7f0aa8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f09a4e09640 1 -- 172.21.15.129:0/2767681950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aa80b6920 con 0x558a627e2340 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f09a4e09640 1 -- 172.21.15.129:0/2767681950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa80b6a80 con 0x558a627e2340 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a628d3a70 con 0x558a627e2340 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f09a4e09640 1 -- 172.21.15.129:0/2767681950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aa80b6d20 con 0x558a627e2340 2024-02-18T16:21:18.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a628d3ea0 con 0x558a627e2340 2024-02-18T16:21:18.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f09a4e09640 1 -- 172.21.15.129:0/2767681950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0aa80c0450 con 0x558a627e2340 2024-02-18T16:21:18.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.798+0000 7f09a4e09640 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09a00342b0 0x7f09a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f09a4e09640 1 -- 172.21.15.129:0/2767681950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0aa80e3fa0 con 0x558a627e2340 2024-02-18T16:21:18.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09a00342b0 0x7f09a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a627e2c60 0x558a628da160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a628da6a0 con 0x558a627e2c60 2024-02-18T16:21:18.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a627e2c60 0x558a628da160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09a00342b0 0x7f09a0036770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0aac001da0 tx=0x7f0aac001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a627e2c60 0x558a628da160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2767681950 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ab00083f0 con 0x558a627e2c60 2024-02-18T16:21:18.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a628daa20 con 0x558a627e2c60 2024-02-18T16:21:18.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2767681950 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0ab00083f0 con 0x558a627e2c60 2024-02-18T16:21:18.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a628dc2d0 con 0x558a627e2c60 2024-02-18T16:21:18.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2767681950 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0ab00083f0 con 0x558a627e2c60 2024-02-18T16:21:18.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a628db4d0 con 0x558a627e2c60 2024-02-18T16:21:18.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2767681950 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0ab00083f0 con 0x558a627e2c60 2024-02-18T16:21:18.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a628db8e0 con 0x558a627e2c60 2024-02-18T16:21:18.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2767681950 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0ab0012040 con 0x558a627e2c60 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 Processor -- start 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- start start 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 0x558a628eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0abaab6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a62684f20 con 0x558a628ea9e0 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab7dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 0x558a628eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab7dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 0x558a628eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:46954/0 (socket says 172.21.15.129:46954) 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.802+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2639360509 learned_addr learned my addr 172.21.15.129:0/2639360509 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2639360509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a628eb340 con 0x558a628ea9e0 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 0x558a628eae00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d660 tx=0x7f0aac00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f099dffb640 1 -- 172.21.15.129:0/2639360509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aac020070 con 0x558a628ea9e0 2024-02-18T16:21:18.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f099dffb640 1 -- 172.21.15.129:0/2639360509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac00c770 con 0x558a628ea9e0 2024-02-18T16:21:18.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a628eb590 con 0x558a628ea9e0 2024-02-18T16:21:18.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f099dffb640 1 -- 172.21.15.129:0/2639360509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aac013040 con 0x558a628ea9e0 2024-02-18T16:21:18.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a628ec0e0 con 0x558a628ea9e0 2024-02-18T16:21:18.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f099dffb640 1 -- 172.21.15.129:0/2639360509 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0aac00a040 con 0x558a628ea9e0 2024-02-18T16:21:18.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f099dffb640 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0990034300 0x7f09900367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f099dffb640 1 -- 172.21.15.129:0/2639360509 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0aac04b640 con 0x558a628ea9e0 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0990034300 0x7f09900367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0abaab6980 1 Processor -- start 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0abaab6980 1 -- start start 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0990034300 0x7f09900367c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x558a628daf10 tx=0x7f0ab0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0abaab6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0abaab6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a62678790 con 0x558a628f7a00 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab7dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab7dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628f7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:46968/0 (socket says 172.21.15.129:46968) 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.806+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/1079227874 learned_addr learned my addr 172.21.15.129:0/1079227874 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/1079227874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a628f83b0 con 0x558a628f7a00 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/1079227874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628f7de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0aac019ef0 tx=0x7f0aac0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a013ebe4777a8d4b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f09977fe640 1 -- 172.21.15.129:0/1079227874 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aac03a1a0 con 0x558a628f7a00 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f09977fe640 1 -- 172.21.15.129:0/1079227874 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac03a300 con 0x558a628f7a00 2024-02-18T16:21:18.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f09977fe640 1 -- 172.21.15.129:0/1079227874 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aac01b7a0 con 0x558a628f7a00 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/1079227874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 msgr2=0x558a628f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 --2- 172.21.15.129:0/1079227874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628f7de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0aac019ef0 tx=0x7f0aac0196f0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/1079227874 shutdown_connections 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 --2- 172.21.15.129:0/1079227874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628f7de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/1079227874 >> 172.21.15.129:0/1079227874 conn(0x558a628f3d40 msgr2=0x558a628f1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/1079227874 shutdown_connections 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/1079227874 wait complete. 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 Processor -- start 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- start start 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a628fee80 con 0x558a628f7a00 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:46982/0 (socket says 172.21.15.129:46982) 2024-02-18T16:21:18.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 learned_addr learned my addr 172.21.15.129:0/2028126682 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a628ec0e0 con 0x558a628f7a00 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628fe940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0aac01ac50 tx=0x7f0aac049900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0995ffb640 1 -- 172.21.15.129:0/2028126682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aac03a140 con 0x558a628f7a00 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a628ff080 con 0x558a628f7a00 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0995ffb640 1 -- 172.21.15.129:0/2028126682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac034070 con 0x558a628f7a00 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a628ff510 con 0x558a628f7a00 2024-02-18T16:21:18.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.810+0000 7f0995ffb640 1 -- 172.21.15.129:0/2028126682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0aac048380 con 0x558a628f7a00 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0995ffb640 1 -- 172.21.15.129:0/2028126682 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0aac00ca30 con 0x558a628f7a00 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0995ffb640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09880342b0 0x7f0988036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0995ffb640 1 -- 172.21.15.129:0/2028126682 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0aac040020 con 0x558a628f7a00 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09880342b0 0x7f0988036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a62909e30 0x558a6290c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290ca10 con 0x558a62909e30 2024-02-18T16:21:18.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a62909e30 0x558a6290c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a62909e30 0x558a6290c2c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09880342b0 0x7f0988036770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0008fd0 tx=0x7f0ab001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 realm 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290cde0 con 0x558a62909e30 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290d630 con 0x558a62909e30 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290d990 con 0x558a62909e30 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290d2d0 con 0x558a62909e30 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 20 searching for the correct realm 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558a6290fbe0 0x558a62911ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.814+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558a6290fbe0 0x558a62911ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558a6290fbe0 0x558a62911ff0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac022070 con 0x558a6290fbe0 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab7dd0640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0aac03b8a0 0x7f0aac011870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0aac03b8a0 0x7f0aac011870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0aac03b8a0 0x7f0aac011870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab002c040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab8dd2640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0ab0027940 0x7f0ab00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0ab0027940 0x7f0ab00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab85d1640 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0ab0027940 0x7f0ab00333c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.818+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab002c040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac022070 con 0x558a6290fbe0 2024-02-18T16:21:18.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.822+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0ab002c040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.826+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab002c040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x558a62909e30 2024-02-18T16:21:18.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80c6070 con 0x7f0ab0027940 2024-02-18T16:21:18.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab002c040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.830+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab002c040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:18.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290e830 con 0x558a62909e30 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290e4b0 con 0x558a62909e30 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290f180 con 0x558a62909e30 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 zone default found 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 4 Realm: () 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 zonegroup default 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62912fa0 con 0x7f0ab0027940 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62914980 con 0x558a6290fbe0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62914ce0 con 0x558a6290fbe0 2024-02-18T16:21:18.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 started sync module instance, tier type = 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.834+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62913f50 con 0x7f0aac03b8a0 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94052847534848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62913f50 con 0x7f0aac03b8a0 2024-02-18T16:21:18.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62915770 con 0x558a62909e30 2024-02-18T16:21:18.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94052847534848] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94052847538768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62913f50 con 0x558a62909e30 2024-02-18T16:21:18.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.838+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62916130 con 0x558a6290fbe0 2024-02-18T16:21:18.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94052847538768] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94052847541392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62916490 con 0x558a6290fbe0 2024-02-18T16:21:18.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62916e00 con 0x7f0aac03b8a0 2024-02-18T16:21:18.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94052847544944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62917550 con 0x7f0aac03b8a0 2024-02-18T16:21:18.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62918020 con 0x558a62909e30 2024-02-18T16:21:18.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.842+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94052847541392] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.846+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.846+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94052847544944] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.846+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94052847549184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62917fe0 con 0x558a62909e30 2024-02-18T16:21:18.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.846+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62917120 con 0x7f0ab0027940 2024-02-18T16:21:18.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.846+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94052847549184] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94052847550432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629188a0 con 0x7f0ab0027940 2024-02-18T16:21:18.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629190e0 con 0x7f0ab0027940 2024-02-18T16:21:18.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94052847550432] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94052847551488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62918cc0 con 0x7f0ab0027940 2024-02-18T16:21:18.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.850+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62919ae0 con 0x7f0ab0027940 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94052847556096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62919a60 con 0x7f0ab0027940 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=0 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=1 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=2 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=3 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=4 2024-02-18T16:21:18.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=5 2024-02-18T16:21:18.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94052847551488] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=6 2024-02-18T16:21:18.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94052847556096] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 20 add_watcher() i=7 2024-02-18T16:21:18.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:18.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62918820 con 0x558a62909e30 2024-02-18T16:21:18.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.854+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94052847558208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62918820 con 0x558a62909e30 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94052847558208] v30'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f096e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0abaab6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0abaab6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0abaab6980 5 note: GC not initialized 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f096d7e2640 20 reqs_thread_entry: start 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0abaab6980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0abaab6980 20 Filter name: none 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f08e6ffd640 20 reqs_thread_entry: start 2024-02-18T16:21:18.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6293e680 con 0x558a6290fbe0 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6293e680 con 0x558a6290fbe0 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6293e680 con 0x558a62909e30 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290e4b0 con 0x558a62909e30 2024-02-18T16:21:18.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.858+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290e4b0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.862+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.866+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0ab0027940 2024-02-18T16:21:18.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.870+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a62909e30 2024-02-18T16:21:18.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x558a6290fbe0 2024-02-18T16:21:18.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a629126c0 con 0x7f0aac03b8a0 2024-02-18T16:21:18.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f096e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:18.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94052847558208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6290e4b0 con 0x558a62909e30 2024-02-18T16:21:18.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94052847558208] v30'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.874+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94052847534848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6293e680 con 0x7f0aac03b8a0 2024-02-18T16:21:18.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94052847534848] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0abaab6980 20 remove_watcher() i=0 2024-02-18T16:21:18.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0abaab6980 2 removed watcher, disabling cache 2024-02-18T16:21:18.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94052847538768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6293e680 con 0x558a62909e30 2024-02-18T16:21:18.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94052847538768] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0abaab6980 20 remove_watcher() i=1 2024-02-18T16:21:18.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.878+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94052847541392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a6293e680 con 0x558a6290fbe0 2024-02-18T16:21:18.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.882+0000 7f0ab7dd0640 1 -- 172.21.15.129:0/2028126682 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94052847541392] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aac060040 con 0x558a6290fbe0 2024-02-18T16:21:18.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.882+0000 7f0abaab6980 20 remove_watcher() i=2 2024-02-18T16:21:18.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.882+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94052847544944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62915c90 con 0x7f0aac03b8a0 2024-02-18T16:21:18.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.882+0000 7f0ab8dd2640 1 -- 172.21.15.129:0/2028126682 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94052847544944] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ab003f040 con 0x7f0aac03b8a0 2024-02-18T16:21:18.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.882+0000 7f0abaab6980 20 remove_watcher() i=3 2024-02-18T16:21:18.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.882+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94052847549184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62916a70 con 0x558a62909e30 2024-02-18T16:21:18.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.886+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94052847549184] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x558a62909e30 2024-02-18T16:21:18.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.886+0000 7f0abaab6980 20 remove_watcher() i=4 2024-02-18T16:21:18.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.886+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94052847550432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62915c90 con 0x7f0ab0027940 2024-02-18T16:21:18.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.886+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94052847550432] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.886+0000 7f0abaab6980 20 remove_watcher() i=5 2024-02-18T16:21:18.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.886+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94052847551488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62916a70 con 0x7f0ab0027940 2024-02-18T16:21:18.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94052847551488] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 20 remove_watcher() i=6 2024-02-18T16:21:18.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94052847556096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a62916a70 con 0x7f0ab0027940 2024-02-18T16:21:18.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94052847556096] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0aa80f6040 con 0x7f0ab0027940 2024-02-18T16:21:18.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 20 remove_watcher() i=7 2024-02-18T16:21:18.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0ab0027940 msgr2=0x7f0ab00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0ab0027940 0x7f0ab00333c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a62909e30 msgr2=0x558a6290c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a62909e30 0x558a6290c2c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0aac03b8a0 msgr2=0x7f0aac011870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0aac03b8a0 0x7f0aac011870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558a6290fbe0 msgr2=0x558a62911ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558a6290fbe0 0x558a62911ff0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09880342b0 msgr2=0x7f0988036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09880342b0 0x7f0988036770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0008fd0 tx=0x7f0ab001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 msgr2=0x558a628fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2028126682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628f7a00 0x558a628fe940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0aac01ac50 tx=0x7f0aac049900 comp rx=0 tx=0).stop 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.890+0000 7f0ab85d1640 1 -- 172.21.15.129:0/2028126682 reap_dead start 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 shutdown_connections 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 >> 172.21.15.129:0/2028126682 conn(0x558a628f3d40 msgr2=0x558a628f13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:18.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 shutdown_connections 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2028126682 wait complete. 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0990034300 msgr2=0x7f09900367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0990034300 0x7f09900367c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x558a628daf10 tx=0x7f0ab0003070 comp rx=0 tx=0).stop 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 msgr2=0x558a628eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 0x558a628eae00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d660 tx=0x7f0aac00da60 comp rx=0 tx=0).stop 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 shutdown_connections 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0990034300 0x7f09900367c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2639360509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a628ea9e0 0x558a628eae00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 >> 172.21.15.129:0/2639360509 conn(0x558a628df7f0 msgr2=0x558a628e0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 shutdown_connections 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2639360509 wait complete. 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a627e2c60 msgr2=0x558a628da160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a627e2c60 0x558a628da160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09a00342b0 msgr2=0x7f09a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09a00342b0 0x7f09a0036770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0aac001da0 tx=0x7f0aac001300 comp rx=0 tx=0).stop 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 msgr2=0x558a628d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628d3530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8003430 tx=0x7f0aa8019810 comp rx=0 tx=0).stop 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 shutdown_connections 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558a627e2c60 0x558a628da160 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09a00342b0 0x7f09a0036770 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 --2- 172.21.15.129:0/2767681950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558a627e2340 0x558a628d3530 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 >> 172.21.15.129:0/2767681950 conn(0x558a62755a30 msgr2=0x558a628c6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 shutdown_connections 2024-02-18T16:21:18.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.894+0000 7f0abaab6980 1 -- 172.21.15.129:0/2767681950 wait complete. 2024-02-18T16:21:18.913 INFO:teuthology.orchestra.run.smithi129.stdout:[] 2024-02-18T16:21:18.914 DEBUG:tasks.util.rgw: json result: [] 2024-02-18T16:21:18.914 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-02-18T16:21:18.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-02-18T16:21:18.914 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-02-18T16:21:18.994 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:18.994 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:18.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2546345980 1 Processor -- start 2024-02-18T16:21:18.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2546345980 1 -- start start 2024-02-18T16:21:18.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2546345980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5590d28c5010 0x5590d28c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:18.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2546345980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5590d28124c0 con 0x5590d28c5930 2024-02-18T16:21:18.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2546345980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5590d27d9180 con 0x5590d28c5010 2024-02-18T16:21:18.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f254365f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5590d28c5930 0x5590d28c6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42580/0 (socket says 172.21.15.129:42580) 2024-02-18T16:21:18.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2543e60640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5590d28c5010 0x5590d28c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:18.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f254365f640 1 -- 172.21.15.129:0/3663467770 learned_addr learned my addr 172.21.15.129:0/3663467770 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:18.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2543e60640 1 -- 172.21.15.129:0/3663467770 >> v1:172.21.15.80:6789/0 conn(0x5590d28c5930 legacy=0x5590d28c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:18.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.986+0000 7f2543e60640 1 -- 172.21.15.129:0/3663467770 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d28c6b70 con 0x5590d28c5010 2024-02-18T16:21:18.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2543e60640 1 --2- 172.21.15.129:0/3663467770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d28c53f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f253400a480 tx=0x7f253401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8450173d3b0d41e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:18.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2542e5e640 1 -- 172.21.15.129:0/3663467770 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340ab540 con 0x5590d28c5010 2024-02-18T16:21:18.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2542e5e640 1 -- 172.21.15.129:0/3663467770 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340ab6a0 con 0x5590d28c5010 2024-02-18T16:21:18.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2542e5e640 1 -- 172.21.15.129:0/3663467770 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340ab960 con 0x5590d28c5010 2024-02-18T16:21:19.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 -- 172.21.15.129:0/3663467770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 msgr2=0x5590d28c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 --2- 172.21.15.129:0/3663467770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d28c53f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f253400a480 tx=0x7f253401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:19.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 -- 172.21.15.129:0/3663467770 shutdown_connections 2024-02-18T16:21:19.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 --2- 172.21.15.129:0/3663467770 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d28c53f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 -- 172.21.15.129:0/3663467770 >> 172.21.15.129:0/3663467770 conn(0x5590d28c08e0 msgr2=0x5590d28c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 -- 172.21.15.129:0/3663467770 shutdown_connections 2024-02-18T16:21:19.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:18.990+0000 7f2546345980 1 -- 172.21.15.129:0/3663467770 wait complete. 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2546345980 1 Processor -- start 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2546345980 1 -- start start 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2546345980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d2839790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2546345980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d27d66b0 con 0x5590d28c5010 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2543e60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d2839790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2543e60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d2839790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47002/0 (socket says 172.21.15.129:47002) 2024-02-18T16:21:19.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2543e60640 1 -- 172.21.15.129:0/838187226 learned_addr learned my addr 172.21.15.129:0/838187226 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2543e60640 1 -- 172.21.15.129:0/838187226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534005d30 con 0x5590d28c5010 2024-02-18T16:21:19.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2543e60640 1 --2- 172.21.15.129:0/838187226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d2839790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2534018eb0 tx=0x7f2534003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cd67b9b1759ce4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2431e0b640 1 -- 172.21.15.129:0/838187226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340ab810 con 0x5590d28c5010 2024-02-18T16:21:19.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2431e0b640 1 -- 172.21.15.129:0/838187226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340ab970 con 0x5590d28c5010 2024-02-18T16:21:19.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.006+0000 7f2431e0b640 1 -- 172.21.15.129:0/838187226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340abc30 con 0x5590d28c5010 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/838187226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 msgr2=0x5590d2839790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 --2- 172.21.15.129:0/838187226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d2839790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2534018eb0 tx=0x7f2534003030 comp rx=0 tx=0).stop 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/838187226 shutdown_connections 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 --2- 172.21.15.129:0/838187226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d2839790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/838187226 >> 172.21.15.129:0/838187226 conn(0x5590d28c08e0 msgr2=0x5590d29ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/838187226 shutdown_connections 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/838187226 wait complete. 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 Processor -- start 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- start start 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d29b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d27d1e90 con 0x5590d28c5010 2024-02-18T16:21:19.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2543e60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d29b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2543e60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d29b95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47004/0 (socket says 172.21.15.129:47004) 2024-02-18T16:21:19.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2543e60640 1 -- 172.21.15.129:0/1395504862 learned_addr learned my addr 172.21.15.129:0/1395504862 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2543e60640 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d28c6b70 con 0x5590d28c5010 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2543e60640 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d29b95d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f253401b2c0 tx=0x7f2534018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f242bfff640 1 -- 172.21.15.129:0/1395504862 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340c3070 con 0x5590d28c5010 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f242bfff640 1 -- 172.21.15.129:0/1395504862 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340bea90 con 0x5590d28c5010 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590d29b9b10 con 0x5590d28c5010 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f242bfff640 1 -- 172.21.15.129:0/1395504862 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340bed70 con 0x5590d28c5010 2024-02-18T16:21:19.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590d29b9f60 con 0x5590d28c5010 2024-02-18T16:21:19.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f242bfff640 1 -- 172.21.15.129:0/1395504862 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f25340b2070 con 0x5590d28c5010 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f242bfff640 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f242c0342b0 0x7f242c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.010+0000 7f242bfff640 1 -- 172.21.15.129:0/1395504862 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f25340e37e0 con 0x5590d28c5010 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f254365f640 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f242c0342b0 0x7f242c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d28c5930 0x5590d29c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29c0770 con 0x5590d28c5930 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d28c5930 0x5590d29c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f254365f640 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f242c0342b0 0x7f242c036770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2538000f70 tx=0x7f25380012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d28c5930 0x5590d29c0230 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 -- 172.21.15.129:0/1395504862 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f253c00a4d0 con 0x5590d28c5930 2024-02-18T16:21:19.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd910 con 0x5590d28c5930 2024-02-18T16:21:19.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 -- 172.21.15.129:0/1395504862 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f253c00a4d0 con 0x5590d28c5930 2024-02-18T16:21:19.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29c2150 con 0x5590d28c5930 2024-02-18T16:21:19.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 -- 172.21.15.129:0/1395504862 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f253c00a4d0 con 0x5590d28c5930 2024-02-18T16:21:19.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29c0fb0 con 0x5590d28c5930 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 -- 172.21.15.129:0/1395504862 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f253c00a4d0 con 0x5590d28c5930 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29c13c0 con 0x5590d28c5930 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2544661640 1 -- 172.21.15.129:0/1395504862 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f253c00a4d0 con 0x5590d28c5930 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 Processor -- start 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- start start 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 0x5590d29d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f2546345980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d276af20 con 0x5590d29d0a90 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f254365f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 0x5590d29d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f254365f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 0x5590d29d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47012/0 (socket says 172.21.15.129:47012) 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.014+0000 7f254365f640 1 -- 172.21.15.129:0/3408074004 learned_addr learned my addr 172.21.15.129:0/3408074004 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f254365f640 1 -- 172.21.15.129:0/3408074004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d29d13f0 con 0x5590d29d0a90 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f254365f640 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 0x5590d29d0eb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2538001ee0 tx=0x7f253800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f24297fa640 1 -- 172.21.15.129:0/3408074004 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2538020070 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f24297fa640 1 -- 172.21.15.129:0/3408074004 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800c770 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590d29d1640 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f24297fa640 1 -- 172.21.15.129:0/3408074004 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2538013040 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590d29d2190 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f24297fa640 1 -- 172.21.15.129:0/3408074004 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f253800a040 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f24297fa640 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f241c034300 0x7f241c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f24297fa640 1 -- 172.21.15.129:0/3408074004 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f253804b770 con 0x5590d29d0a90 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2544661640 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f241c034300 0x7f241c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2546345980 1 Processor -- start 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2546345980 1 -- start start 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2546345980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2546345980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d275e790 con 0x5590d29ddac0 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f2544661640 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f241c034300 0x7f241c0367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5590d29c1b60 tx=0x7f253c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f254365f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f254365f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29ddea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47018/0 (socket says 172.21.15.129:47018) 2024-02-18T16:21:19.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.018+0000 7f254365f640 1 -- 172.21.15.129:0/1219125840 learned_addr learned my addr 172.21.15.129:0/1219125840 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 -- 172.21.15.129:0/1219125840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d29de470 con 0x5590d29ddac0 2024-02-18T16:21:19.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 --2- 172.21.15.129:0/1219125840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29ddea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2538049ad0 tx=0x7f2538019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1bd1be6862ded7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2422ffd640 1 -- 172.21.15.129:0/1219125840 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2538048070 con 0x5590d29ddac0 2024-02-18T16:21:19.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2422ffd640 1 -- 172.21.15.129:0/1219125840 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253803a2e0 con 0x5590d29ddac0 2024-02-18T16:21:19.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2422ffd640 1 -- 172.21.15.129:0/1219125840 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f253801b7a0 con 0x5590d29ddac0 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/1219125840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 msgr2=0x5590d29ddea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 --2- 172.21.15.129:0/1219125840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29ddea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2538049ad0 tx=0x7f2538019a70 comp rx=0 tx=0).stop 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/1219125840 shutdown_connections 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 --2- 172.21.15.129:0/1219125840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29ddea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/1219125840 >> 172.21.15.129:0/1219125840 conn(0x5590d29d9e00 msgr2=0x5590d29d7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/1219125840 shutdown_connections 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/1219125840 wait complete. 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 Processor -- start 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- start start 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29e4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d29e4eb0 con 0x5590d29ddac0 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29e4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47024/0 (socket says 172.21.15.129:47024) 2024-02-18T16:21:19.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 learned_addr learned my addr 172.21.15.129:0/2854097316 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d29d2190 con 0x5590d29ddac0 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f254365f640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29e4970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2538049e40 tx=0x7f2538049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f24217fa640 1 -- 172.21.15.129:0/2854097316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2538024e80 con 0x5590d29ddac0 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f24217fa640 1 -- 172.21.15.129:0/2854097316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800ca50 con 0x5590d29ddac0 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590d29e50b0 con 0x5590d29ddac0 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f24217fa640 1 -- 172.21.15.129:0/2854097316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f253800ccf0 con 0x5590d29ddac0 2024-02-18T16:21:19.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.022+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590d29e54e0 con 0x5590d29ddac0 2024-02-18T16:21:19.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f24217fa640 1 -- 172.21.15.129:0/2854097316 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2538042050 con 0x5590d29ddac0 2024-02-18T16:21:19.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f24217fa640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f240c0342b0 0x7f240c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f24217fa640 1 -- 172.21.15.129:0/2854097316 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2538038c60 con 0x5590d29ddac0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2544661640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f240c0342b0 0x7f240c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d29eff80 0x5590d29f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f2b90 con 0x5590d29eff80 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d29eff80 0x5590d29f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2544661640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f240c0342b0 0x7f240c036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f253c011010 tx=0x7f253c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d29eff80 0x5590d29f2440 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 realm 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f2f60 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f37b0 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f3b10 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f4310 con 0x5590d29eff80 2024-02-18T16:21:19.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 20 searching for the correct realm 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5590d29f6260 0x5590d29f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.026+0000 7f254365f640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5590d29f6260 0x5590d29f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f254365f640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5590d29f6260 0x5590d29f8690 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f254365f640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f253803fc20 0x7f253801a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253803fc20 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2544661640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f253803fc20 0x7f253801a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2544661640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f253803fc20 0x7f253801a5e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f253c00a4d0 con 0x7f253803fc20 2024-02-18T16:21:19.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2544661640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f253c0141d0 0x7f253c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2543e60640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f253c0141d0 0x7f253c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2543e60640 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f253c0141d0 0x7f253c015940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x7f253c0141d0 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.030+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x7f253c0141d0 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x7f253c0141d0 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253803fc20 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f253c00a4d0 con 0x7f253803fc20 2024-02-18T16:21:19.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x7f253c0141d0 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253803fc20 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.034+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x7f253c0141d0 2024-02-18T16:21:19.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f25340d7040 con 0x5590d29eff80 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253803fc20 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.038+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253803fc20 2024-02-18T16:21:19.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29f6260 2024-02-18T16:21:19.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253c0141d0 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x5590d29eff80 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.042+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f8d10 con 0x7f253803fc20 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f4d00 con 0x5590d29eff80 2024-02-18T16:21:19.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f5550 con 0x5590d29eff80 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f9150 con 0x5590d29eff80 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 zone default found 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 4 Realm: () 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:19.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 zonegroup default 2024-02-18T16:21:19.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29f95f0 con 0x7f253c0141d0 2024-02-18T16:21:19.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fafd0 con 0x5590d29f6260 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fb330 con 0x5590d29f6260 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 started sync module instance, tier type = 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.046+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fa5a0 con 0x7f253803fc20 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94080497330560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fa5a0 con 0x7f253803fc20 2024-02-18T16:21:19.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fbdb0 con 0x5590d29eff80 2024-02-18T16:21:19.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94080497334432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fbdb0 con 0x5590d29eff80 2024-02-18T16:21:19.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94080497330560] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.050+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fa100 con 0x5590d29f6260 2024-02-18T16:21:19.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94080497338272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fd150 con 0x5590d29f6260 2024-02-18T16:21:19.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fd990 con 0x7f253803fc20 2024-02-18T16:21:19.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94080497334432] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94080497336672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fdd40 con 0x7f253803fc20 2024-02-18T16:21:19.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fe6b0 con 0x5590d29eff80 2024-02-18T16:21:19.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.054+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94080497338272] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94080497339568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fe6b0 con 0x5590d29eff80 2024-02-18T16:21:19.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29ff070 con 0x7f253c0141d0 2024-02-18T16:21:19.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94080497336672] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94080497339568] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94080497345040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29fe630 con 0x7f253c0141d0 2024-02-18T16:21:19.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.058+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29ff510 con 0x7f253c0141d0 2024-02-18T16:21:19.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.062+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.062+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94080497348720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29ff930 con 0x7f253c0141d0 2024-02-18T16:21:19.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.062+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a002a0 con 0x7f253c0141d0 2024-02-18T16:21:19.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.062+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94080497345040] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94080497348720] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94080497347536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a002a0 con 0x7f253c0141d0 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=0 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=1 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=2 2024-02-18T16:21:19.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=3 2024-02-18T16:21:19.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=4 2024-02-18T16:21:19.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=5 2024-02-18T16:21:19.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.066+0000 7f2546345980 20 add_watcher() i=6 2024-02-18T16:21:19.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94080497347536] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 20 add_watcher() i=7 2024-02-18T16:21:19.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:19.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a032d0 con 0x5590d29eff80 2024-02-18T16:21:19.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94080497352192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a006c0 con 0x5590d29eff80 2024-02-18T16:21:19.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94080497352192] v30'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f23f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:19.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:19.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.070+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0b6e0 con 0x5590d29eff80 2024-02-18T16:21:19.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.074+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.074+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0b750 con 0x7f253c0141d0 2024-02-18T16:21:19.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.074+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.074+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0be10 con 0x5590d29f6260 2024-02-18T16:21:19.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.078+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.078+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0c7e0 con 0x5590d29eff80 2024-02-18T16:21:19.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.078+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.078+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0cd10 con 0x7f253803fc20 2024-02-18T16:21:19.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.082+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.082+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0d240 con 0x5590d29f6260 2024-02-18T16:21:19.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.082+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.082+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0dc10 con 0x5590d29eff80 2024-02-18T16:21:19.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.086+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.086+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0dc10 con 0x7f253c0141d0 2024-02-18T16:21:19.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.086+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.086+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0dc10 con 0x7f253803fc20 2024-02-18T16:21:19.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.090+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.090+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a09760 con 0x5590d29f6260 2024-02-18T16:21:19.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.090+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.090+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a09d70 con 0x7f253803fc20 2024-02-18T16:21:19.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.094+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.094+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0e950 con 0x7f253c0141d0 2024-02-18T16:21:19.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.094+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.094+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0e950 con 0x7f253803fc20 2024-02-18T16:21:19.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.098+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.098+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253c0141d0 2024-02-18T16:21:19.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.098+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.098+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29eff80 2024-02-18T16:21:19.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.102+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.102+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.102+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.102+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253803fc20 2024-02-18T16:21:19.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.106+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.106+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.106+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.106+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29eff80 2024-02-18T16:21:19.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.110+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.110+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29eff80 2024-02-18T16:21:19.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.114+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.114+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.114+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.114+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253803fc20 2024-02-18T16:21:19.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.118+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.118+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.118+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.118+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.122+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.122+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.122+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.126+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.126+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.126+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253c0141d0 2024-02-18T16:21:19.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.130+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.130+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.130+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.130+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253c0141d0 2024-02-18T16:21:19.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.134+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.134+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x5590d29f6260 2024-02-18T16:21:19.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.138+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.138+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253c0141d0 2024-02-18T16:21:19.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.138+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.138+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d2a0edf0 con 0x7f253803fc20 2024-02-18T16:21:19.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f23f8fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:19.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:19.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 20 Filter name: none 2024-02-18T16:21:19.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f23727fc640 20 reqs_thread_entry: start 2024-02-18T16:21:19.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-18T16:21:19.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x7f253803fc20 2024-02-18T16:21:19.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-02-18T16:21:19.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.142+0000 7f2546345980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:21:19.153 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, user does not exist 2024-02-18T16:21:19.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.146+0000 7f23f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.146+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94080497352192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x5590d29eff80 2024-02-18T16:21:19.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.150+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94080497352192] v30'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.150+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94080497330560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x7f253803fc20 2024-02-18T16:21:19.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.150+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94080497330560] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.150+0000 7f2546345980 20 remove_watcher() i=0 2024-02-18T16:21:19.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.150+0000 7f2546345980 2 removed watcher, disabling cache 2024-02-18T16:21:19.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.150+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94080497334432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x5590d29eff80 2024-02-18T16:21:19.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94080497334432] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2546345980 20 remove_watcher() i=1 2024-02-18T16:21:19.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94080497338272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x5590d29f6260 2024-02-18T16:21:19.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f254365f640 1 -- 172.21.15.129:0/2854097316 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94080497338272] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2538034070 con 0x5590d29f6260 2024-02-18T16:21:19.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2546345980 20 remove_watcher() i=2 2024-02-18T16:21:19.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94080497336672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x7f253803fc20 2024-02-18T16:21:19.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2544661640 1 -- 172.21.15.129:0/2854097316 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94080497336672] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f253c03a040 con 0x7f253803fc20 2024-02-18T16:21:19.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2546345980 20 remove_watcher() i=3 2024-02-18T16:21:19.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.154+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94080497339568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x5590d29eff80 2024-02-18T16:21:19.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.158+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94080497339568] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x5590d29eff80 2024-02-18T16:21:19.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.158+0000 7f2546345980 20 remove_watcher() i=4 2024-02-18T16:21:19.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.158+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94080497345040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x7f253c0141d0 2024-02-18T16:21:19.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.162+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94080497345040] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.162+0000 7f2546345980 20 remove_watcher() i=5 2024-02-18T16:21:19.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.162+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94080497348720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x7f253c0141d0 2024-02-18T16:21:19.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.162+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94080497348720] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.162+0000 7f2546345980 20 remove_watcher() i=6 2024-02-18T16:21:19.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.162+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94080497347536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5590d29bd450 con 0x7f253c0141d0 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94080497347536] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25340f2040 con 0x7f253c0141d0 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 20 remove_watcher() i=7 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f253c0141d0 msgr2=0x7f253c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f253c0141d0 0x7f253c015940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d29eff80 msgr2=0x5590d29f2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d29eff80 0x5590d29f2440 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f253803fc20 msgr2=0x7f253801a5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f253803fc20 0x7f253801a5e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5590d29f6260 msgr2=0x5590d29f8690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5590d29f6260 0x5590d29f8690 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f240c0342b0 msgr2=0x7f240c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f240c0342b0 0x7f240c036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f253c011010 tx=0x7f253c020000 comp rx=0 tx=0).stop 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 msgr2=0x5590d29e4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/2854097316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29ddac0 0x5590d29e4970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2538049e40 tx=0x7f2538049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 reap_dead start 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2543e60640 1 -- 172.21.15.129:0/2854097316 reap_dead start 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 shutdown_connections 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 >> 172.21.15.129:0/2854097316 conn(0x5590d29d9e00 msgr2=0x5590d29d7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 shutdown_connections 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/2854097316 wait complete. 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f241c034300 msgr2=0x7f241c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f241c034300 0x7f241c0367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5590d29c1b60 tx=0x7f253c005850 comp rx=0 tx=0).stop 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 msgr2=0x5590d29d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 0x5590d29d0eb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2538001ee0 tx=0x7f253800da30 comp rx=0 tx=0).stop 2024-02-18T16:21:19.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 shutdown_connections 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f241c034300 0x7f241c0367c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/3408074004 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d29d0a90 0x5590d29d0eb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 >> 172.21.15.129:0/3408074004 conn(0x5590d29c58a0 msgr2=0x5590d29c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 shutdown_connections 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/3408074004 wait complete. 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d28c5930 msgr2=0x5590d29c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d28c5930 0x5590d29c0230 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f242c0342b0 msgr2=0x7f242c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f242c0342b0 0x7f242c036770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2538000f70 tx=0x7f25380012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 msgr2=0x5590d29b95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d29b95d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f253401b2c0 tx=0x7f2534018020 comp rx=0 tx=0).stop 2024-02-18T16:21:19.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 shutdown_connections 2024-02-18T16:21:19.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5590d28c5930 0x5590d29c0230 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f242c0342b0 0x7f242c036770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 --2- 172.21.15.129:0/1395504862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5590d28c5010 0x5590d29b95d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 >> 172.21.15.129:0/1395504862 conn(0x5590d28c08e0 msgr2=0x5590d29a9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 shutdown_connections 2024-02-18T16:21:19.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.166+0000 7f2546345980 1 -- 172.21.15.129:0/1395504862 wait complete. 2024-02-18T16:21:19.189 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-18T16:21:19.189 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-02-18T16:21:19.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-02-18T16:21:19.190 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-02-18T16:21:19.269 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:19.269 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:19.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9176166980 1 Processor -- start 2024-02-18T16:21:19.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9176166980 1 -- start start 2024-02-18T16:21:19.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9176166980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x563062ee5b80 0x563062ee5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9176166980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563062ebb4c0 con 0x563062ee64a0 2024-02-18T16:21:19.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9176166980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x563062e82180 con 0x563062ee5b80 2024-02-18T16:21:19.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9173c81640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x563062ee5b80 0x563062ee5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9173480640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x563062ee64a0 0x563062ee6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42584/0 (socket says 172.21.15.129:42584) 2024-02-18T16:21:19.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9173480640 1 -- 172.21.15.129:0/2051909299 learned_addr learned my addr 172.21.15.129:0/2051909299 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:19.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9173c81640 1 -- 172.21.15.129:0/2051909299 >> v1:172.21.15.80:6789/0 conn(0x563062ee64a0 legacy=0x563062ee6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.262+0000 7f9173c81640 1 -- 172.21.15.129:0/2051909299 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563062ee7690 con 0x563062ee5b80 2024-02-18T16:21:19.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9173c81640 1 --2- 172.21.15.129:0/2051909299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563062ee5f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f916400a420 tx=0x7f916401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8fdec92c98942e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9172c7f640 1 -- 172.21.15.129:0/2051909299 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91640aa530 con 0x563062ee5b80 2024-02-18T16:21:19.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9172c7f640 1 -- 172.21.15.129:0/2051909299 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640a6050 con 0x563062ee5b80 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9172c7f640 1 -- 172.21.15.129:0/2051909299 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91640aa800 con 0x563062ee5b80 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 -- 172.21.15.129:0/2051909299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 msgr2=0x563062ee5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 --2- 172.21.15.129:0/2051909299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563062ee5f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f916400a420 tx=0x7f916401afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 -- 172.21.15.129:0/2051909299 shutdown_connections 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 --2- 172.21.15.129:0/2051909299 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563062ee5f60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 -- 172.21.15.129:0/2051909299 >> 172.21.15.129:0/2051909299 conn(0x563062ee4a40 msgr2=0x563062ee4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 -- 172.21.15.129:0/2051909299 shutdown_connections 2024-02-18T16:21:19.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.266+0000 7f9176166980 1 -- 172.21.15.129:0/2051909299 wait complete. 2024-02-18T16:21:19.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9176166980 1 Processor -- start 2024-02-18T16:21:19.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9176166980 1 -- start start 2024-02-18T16:21:19.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9176166980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x5630630607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9176166980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563062e7f6b0 con 0x563062ee5b80 2024-02-18T16:21:19.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9173c81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x5630630607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9173c81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x5630630607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47050/0 (socket says 172.21.15.129:47050) 2024-02-18T16:21:19.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9173c81640 1 -- 172.21.15.129:0/1544177769 learned_addr learned my addr 172.21.15.129:0/1544177769 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9173c81640 1 -- 172.21.15.129:0/1544177769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916400a100 con 0x563062ee5b80 2024-02-18T16:21:19.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9173c81640 1 --2- 172.21.15.129:0/1544177769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x5630630607c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f916400a420 tx=0x7f91640033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c134637e28119317 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9061e0b640 1 -- 172.21.15.129:0/1544177769 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91640aa6c0 con 0x563062ee5b80 2024-02-18T16:21:19.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9061e0b640 1 -- 172.21.15.129:0/1544177769 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640aa820 con 0x563062ee5b80 2024-02-18T16:21:19.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9061e0b640 1 -- 172.21.15.129:0/1544177769 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91640aaae0 con 0x563062ee5b80 2024-02-18T16:21:19.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9176166980 1 -- 172.21.15.129:0/1544177769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 msgr2=0x5630630607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.282+0000 7f9176166980 1 --2- 172.21.15.129:0/1544177769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x5630630607c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f916400a420 tx=0x7f91640033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- 172.21.15.129:0/1544177769 shutdown_connections 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 --2- 172.21.15.129:0/1544177769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x5630630607c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- 172.21.15.129:0/1544177769 >> 172.21.15.129:0/1544177769 conn(0x563062ee4a40 msgr2=0x56306305c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- 172.21.15.129:0/1544177769 shutdown_connections 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- 172.21.15.129:0/1544177769 wait complete. 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 Processor -- start 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- start start 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563063067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563062e7ae90 con 0x563062ee5b80 2024-02-18T16:21:19.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9173c81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563063067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9173c81640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563063067510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47064/0 (socket says 172.21.15.129:47064) 2024-02-18T16:21:19.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9173c81640 1 -- 172.21.15.129:0/4018381483 learned_addr learned my addr 172.21.15.129:0/4018381483 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9173c81640 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563062ee7690 con 0x563062ee5b80 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9173c81640 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563063067510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f916400a420 tx=0x7f9164019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f905bfff640 1 -- 172.21.15.129:0/4018381483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91640b6920 con 0x563062ee5b80 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f905bfff640 1 -- 172.21.15.129:0/4018381483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640b6a80 con 0x563062ee5b80 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563063067a50 con 0x563062ee5b80 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f905bfff640 1 -- 172.21.15.129:0/4018381483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91640b6d60 con 0x563062ee5b80 2024-02-18T16:21:19.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563063067e80 con 0x563062ee5b80 2024-02-18T16:21:19.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f905bfff640 1 -- 172.21.15.129:0/4018381483 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f91640b4400 con 0x563062ee5b80 2024-02-18T16:21:19.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f905bfff640 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f905c0342b0 0x7f905c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.286+0000 7f905bfff640 1 -- 172.21.15.129:0/4018381483 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f91640e3830 con 0x563062ee5b80 2024-02-18T16:21:19.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9173480640 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f905c0342b0 0x7f905c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563062ee64a0 0x56306306e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56306306e680 con 0x563062ee64a0 2024-02-18T16:21:19.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563062ee64a0 0x56306306e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9173480640 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f905c0342b0 0x7f905c036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9168000f70 tx=0x7f91680012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563062ee64a0 0x56306306e140 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 -- 172.21.15.129:0/4018381483 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f916c0083f0 con 0x563062ee64a0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56306306ea00 con 0x563062ee64a0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 -- 172.21.15.129:0/4018381483 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f916c0083f0 con 0x563062ee64a0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630702b0 con 0x563062ee64a0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 -- 172.21.15.129:0/4018381483 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f916c0083f0 con 0x563062ee64a0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56306306f4b0 con 0x563062ee64a0 2024-02-18T16:21:19.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 -- 172.21.15.129:0/4018381483 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f916c0083f0 con 0x563062ee64a0 2024-02-18T16:21:19.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56306306f8c0 con 0x563062ee64a0 2024-02-18T16:21:19.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9174482640 1 -- 172.21.15.129:0/4018381483 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f916c012040 con 0x563062ee64a0 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 Processor -- start 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- start start 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 0x56306307ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9176166980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563062e13f20 con 0x56306307e9c0 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9173480640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 0x56306307ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9173480640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 0x56306307ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47076/0 (socket says 172.21.15.129:47076) 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.290+0000 7f9173480640 1 -- 172.21.15.129:0/1880193188 learned_addr learned my addr 172.21.15.129:0/1880193188 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9173480640 1 -- 172.21.15.129:0/1880193188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56306307f320 con 0x56306307e9c0 2024-02-18T16:21:19.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9173480640 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 0x56306307ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9168001ee0 tx=0x7f916800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f90597fa640 1 -- 172.21.15.129:0/1880193188 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9168020070 con 0x56306307e9c0 2024-02-18T16:21:19.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f90597fa640 1 -- 172.21.15.129:0/1880193188 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800c770 con 0x56306307e9c0 2024-02-18T16:21:19.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56306307f570 con 0x56306307e9c0 2024-02-18T16:21:19.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f90597fa640 1 -- 172.21.15.129:0/1880193188 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9168013040 con 0x56306307e9c0 2024-02-18T16:21:19.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630630800c0 con 0x56306307e9c0 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f90597fa640 1 -- 172.21.15.129:0/1880193188 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f916800a040 con 0x56306307e9c0 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f90597fa640 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f904c0342b0 0x7f904c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f90597fa640 1 -- 172.21.15.129:0/1880193188 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f916804b770 con 0x56306307e9c0 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9174482640 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f904c0342b0 0x7f904c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9176166980 1 Processor -- start 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9176166980 1 -- start start 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9176166980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x56306308bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9176166980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563062e07790 con 0x56306308b9a0 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9174482640 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f904c0342b0 0x7f904c036770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x56306306eef0 tx=0x7f916c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9173480640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x56306308bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9173480640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x56306308bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47088/0 (socket says 172.21.15.129:47088) 2024-02-18T16:21:19.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.294+0000 7f9173480640 1 -- 172.21.15.129:0/2879412039 learned_addr learned my addr 172.21.15.129:0/2879412039 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 -- 172.21.15.129:0/2879412039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56306308c390 con 0x56306308b9a0 2024-02-18T16:21:19.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 --2- 172.21.15.129:0/2879412039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x56306308bdc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9168049aa0 tx=0x7f91680198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264a467993893632 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9052ffd640 1 -- 172.21.15.129:0/2879412039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9168048070 con 0x56306308b9a0 2024-02-18T16:21:19.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9052ffd640 1 -- 172.21.15.129:0/2879412039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916801bac0 con 0x56306308b9a0 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9052ffd640 1 -- 172.21.15.129:0/2879412039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f916803a2b0 con 0x56306308b9a0 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/2879412039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 msgr2=0x56306308bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 --2- 172.21.15.129:0/2879412039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x56306308bdc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9168049aa0 tx=0x7f91680198d0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/2879412039 shutdown_connections 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 --2- 172.21.15.129:0/2879412039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x56306308bdc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/2879412039 >> 172.21.15.129:0/2879412039 conn(0x563063087ce0 msgr2=0x563063085d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/2879412039 shutdown_connections 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/2879412039 wait complete. 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 Processor -- start 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- start start 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x563063092860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563063092da0 con 0x56306308b9a0 2024-02-18T16:21:19.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x563063092860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x563063092860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47102/0 (socket says 172.21.15.129:47102) 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 learned_addr learned my addr 172.21.15.129:0/4138674827 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630630800c0 con 0x56306308b9a0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9173480640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x563063092860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f916803f040 tx=0x7f9168049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f90517fa640 1 -- 172.21.15.129:0/4138674827 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9168019e20 con 0x56306308b9a0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f90517fa640 1 -- 172.21.15.129:0/4138674827 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9168048070 con 0x56306308b9a0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563063092fa0 con 0x56306308b9a0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f90517fa640 1 -- 172.21.15.129:0/4138674827 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9168048310 con 0x56306308b9a0 2024-02-18T16:21:19.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.298+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563063093430 con 0x56306308b9a0 2024-02-18T16:21:19.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f90517fa640 1 -- 172.21.15.129:0/4138674827 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9168048470 con 0x56306308b9a0 2024-02-18T16:21:19.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f90517fa640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f903c0342b0 0x7f903c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f90517fa640 1 -- 172.21.15.129:0/4138674827 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9168039cd0 con 0x56306308b9a0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9174482640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f903c0342b0 0x7f903c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56306309de50 0x5630630a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a0a60 con 0x56306309de50 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56306309de50 0x5630630a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9174482640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f903c0342b0 0x7f903c036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f916c008fd0 tx=0x7f916c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56306309de50 0x5630630a0310 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 realm 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a0e30 con 0x56306309de50 2024-02-18T16:21:19.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a1680 con 0x56306309de50 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a19e0 con 0x56306309de50 2024-02-18T16:21:19.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a21e0 con 0x56306309de50 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 20 searching for the correct realm 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5630630a4130 0x5630630a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.302+0000 7f9173480640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5630630a4130 0x5630630a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173480640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5630630a4130 0x5630630a6560 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173480640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9168038070 0x7f916804ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f9168038070 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9174482640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9168038070 0x7f916804ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9174482640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9168038070 0x7f916804ba50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c02c040 con 0x7f9168038070 2024-02-18T16:21:19.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9174482640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f916c027940 0x7f916c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173c81640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f916c027940 0x7f916c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173c81640 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f916c027940 0x7f916c0333c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.306+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f9168038070 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c02c040 con 0x7f9168038070 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f9168038070 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f916c02c040 con 0x7f9168038070 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.310+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f9168038070 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c02c040 con 0x7f9168038070 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.314+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f9168038070 2024-02-18T16:21:19.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c02c040 con 0x7f9168038070 2024-02-18T16:21:19.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x5630630a4130 2024-02-18T16:21:19.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f916c027940 2024-02-18T16:21:19.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x56306309de50 2024-02-18T16:21:19.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.318+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a6be0 con 0x7f9168038070 2024-02-18T16:21:19.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f916c02c040 con 0x7f9168038070 2024-02-18T16:21:19.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a2c00 con 0x56306309de50 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a3450 con 0x56306309de50 2024-02-18T16:21:19.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a3450 con 0x56306309de50 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 zone default found 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 4 Realm: () 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 zonegroup default 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a7020 con 0x7f916c027940 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a8a30 con 0x5630630a4130 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a8ec0 con 0x5630630a4130 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 started sync module instance, tier type = 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:19.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.322+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a3460 con 0x7f9168038070 2024-02-18T16:21:19.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94765820051008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a92e0 con 0x7f9168038070 2024-02-18T16:21:19.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a9ae0 con 0x56306309de50 2024-02-18T16:21:19.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94765820056560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a9d70 con 0x56306309de50 2024-02-18T16:21:19.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630aa840 con 0x5630630a4130 2024-02-18T16:21:19.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.326+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94765820051008] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94765820056560] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94765820057616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630a8330 con 0x5630630a4130 2024-02-18T16:21:19.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ab090 con 0x7f9168038070 2024-02-18T16:21:19.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94765820062976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ab760 con 0x7f9168038070 2024-02-18T16:21:19.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ac230 con 0x56306309de50 2024-02-18T16:21:19.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.330+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94765820057616] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.334+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94765820062976] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.334+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.334+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94765820067088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ac1f0 con 0x56306309de50 2024-02-18T16:21:19.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.334+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ab330 con 0x7f916c027940 2024-02-18T16:21:19.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.338+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.338+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94765820069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ace50 con 0x7f916c027940 2024-02-18T16:21:19.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.338+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ad800 con 0x7f916c027940 2024-02-18T16:21:19.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.338+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94765820067088] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.338+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94765820069264] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94765820060448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ac9b0 con 0x7f916c027940 2024-02-18T16:21:19.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630addb0 con 0x7f916c027940 2024-02-18T16:21:19.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94765820074256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ae1d0 con 0x7f916c027940 2024-02-18T16:21:19.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=0 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=1 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=2 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=3 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=4 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=5 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94765820060448] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.342+0000 7f9176166980 20 add_watcher() i=6 2024-02-18T16:21:19.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94765820074256] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 20 add_watcher() i=7 2024-02-18T16:21:19.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:19.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b1200 con 0x56306309de50 2024-02-18T16:21:19.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94765820075312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ae5f0 con 0x56306309de50 2024-02-18T16:21:19.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94765820075312] v30'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9029fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:19.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:19.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.346+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b9610 con 0x56306309de50 2024-02-18T16:21:19.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.350+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.350+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b9670 con 0x7f916c027940 2024-02-18T16:21:19.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.350+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.350+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b9d20 con 0x5630630a4130 2024-02-18T16:21:19.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.354+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.354+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630ba6f0 con 0x56306309de50 2024-02-18T16:21:19.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.354+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.354+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b7690 con 0x7f9168038070 2024-02-18T16:21:19.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.354+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.354+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b7690 con 0x5630630a4130 2024-02-18T16:21:19.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.358+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.358+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bb8d0 con 0x56306309de50 2024-02-18T16:21:19.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.358+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.358+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bb8d0 con 0x7f916c027940 2024-02-18T16:21:19.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.362+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.362+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bb8d0 con 0x7f9168038070 2024-02-18T16:21:19.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.362+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.362+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b6700 con 0x5630630a4130 2024-02-18T16:21:19.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.366+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.366+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b66c0 con 0x7f9168038070 2024-02-18T16:21:19.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.366+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.366+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc440 con 0x7f916c027940 2024-02-18T16:21:19.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.370+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.370+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc440 con 0x7f9168038070 2024-02-18T16:21:19.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.370+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.370+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc4d0 con 0x7f916c027940 2024-02-18T16:21:19.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.370+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.370+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc4d0 con 0x56306309de50 2024-02-18T16:21:19.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.374+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.374+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc4d0 con 0x5630630a4130 2024-02-18T16:21:19.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.374+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.374+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc6a0 con 0x7f9168038070 2024-02-18T16:21:19.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.378+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.378+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc6a0 con 0x5630630a4130 2024-02-18T16:21:19.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.378+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.378+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc6a0 con 0x56306309de50 2024-02-18T16:21:19.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.378+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.378+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc6a0 con 0x56306309de50 2024-02-18T16:21:19.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.382+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.382+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc6a0 con 0x5630630a4130 2024-02-18T16:21:19.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.382+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.382+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc6a0 con 0x7f9168038070 2024-02-18T16:21:19.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.386+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.386+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc5a0 con 0x5630630a4130 2024-02-18T16:21:19.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.386+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.386+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bca20 con 0x5630630a4130 2024-02-18T16:21:19.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.386+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.386+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bca20 con 0x5630630a4130 2024-02-18T16:21:19.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.390+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.390+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bca20 con 0x5630630a4130 2024-02-18T16:21:19.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.390+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.390+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bca20 con 0x7f916c027940 2024-02-18T16:21:19.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.394+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.394+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bca20 con 0x5630630a4130 2024-02-18T16:21:19.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.394+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.394+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc5a0 con 0x7f916c027940 2024-02-18T16:21:19.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.398+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.398+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc5a0 con 0x5630630a4130 2024-02-18T16:21:19.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.402+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.402+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bc5a0 con 0x7f916c027940 2024-02-18T16:21:19.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.402+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.402+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630bca20 con 0x7f9168038070 2024-02-18T16:21:19.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9028fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:19.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:19.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 20 Filter name: none 2024-02-18T16:21:19.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f8fa27fc640 20 reqs_thread_entry: start 2024-02-18T16:21:19.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-18T16:21:19.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4bd0 con 0x7f916c027940 2024-02-18T16:21:19.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-18T16:21:19.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.406+0000 7f9176166980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-18T16:21:19.417 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, user does not exist 2024-02-18T16:21:19.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.410+0000 7f9029fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.410+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94765820075312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4bd0 con 0x56306309de50 2024-02-18T16:21:19.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.410+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94765820075312] v30'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.410+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94765820051008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4bd0 con 0x7f9168038070 2024-02-18T16:21:19.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94765820051008] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9176166980 20 remove_watcher() i=0 2024-02-18T16:21:19.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9176166980 2 removed watcher, disabling cache 2024-02-18T16:21:19.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94765820056560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x56306309de50 2024-02-18T16:21:19.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94765820056560] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9176166980 20 remove_watcher() i=1 2024-02-18T16:21:19.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.414+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94765820057616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x5630630a4130 2024-02-18T16:21:19.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.418+0000 7f9173480640 1 -- 172.21.15.129:0/4138674827 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94765820057616] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9168022070 con 0x5630630a4130 2024-02-18T16:21:19.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.418+0000 7f9176166980 20 remove_watcher() i=2 2024-02-18T16:21:19.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.418+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94765820062976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x7f9168038070 2024-02-18T16:21:19.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.418+0000 7f9174482640 1 -- 172.21.15.129:0/4138674827 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94765820062976] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f916c03f040 con 0x7f9168038070 2024-02-18T16:21:19.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.418+0000 7f9176166980 20 remove_watcher() i=3 2024-02-18T16:21:19.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.418+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94765820067088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x56306309de50 2024-02-18T16:21:19.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.422+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94765820067088] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x56306309de50 2024-02-18T16:21:19.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.422+0000 7f9176166980 20 remove_watcher() i=4 2024-02-18T16:21:19.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.422+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94765820069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x7f916c027940 2024-02-18T16:21:19.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.422+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94765820069264] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.422+0000 7f9176166980 20 remove_watcher() i=5 2024-02-18T16:21:19.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.422+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94765820060448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x7f916c027940 2024-02-18T16:21:19.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94765820060448] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 20 remove_watcher() i=6 2024-02-18T16:21:19.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94765820074256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5630630b4b90 con 0x7f916c027940 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94765820074256] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f91640c5070 con 0x7f916c027940 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 20 remove_watcher() i=7 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f916c027940 msgr2=0x7f916c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f916c027940 0x7f916c0333c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56306309de50 msgr2=0x5630630a0310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56306309de50 0x5630630a0310 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9168038070 msgr2=0x7f916804ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9168038070 0x7f916804ba50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5630630a4130 msgr2=0x5630630a6560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5630630a4130 0x5630630a6560 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f903c0342b0 msgr2=0x7f903c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f903c0342b0 0x7f903c036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f916c008fd0 tx=0x7f916c01c070 comp rx=0 tx=0).stop 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 msgr2=0x563063092860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 --2- 172.21.15.129:0/4138674827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306308b9a0 0x563063092860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f916803f040 tx=0x7f9168049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 reap_dead start 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9173c81640 1 -- 172.21.15.129:0/4138674827 reap_dead start 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 shutdown_connections 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 >> 172.21.15.129:0/4138674827 conn(0x563063087ce0 msgr2=0x563063085340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 shutdown_connections 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.426+0000 7f9176166980 1 -- 172.21.15.129:0/4138674827 wait complete. 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f904c0342b0 msgr2=0x7f904c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f904c0342b0 0x7f904c036770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x56306306eef0 tx=0x7f916c003070 comp rx=0 tx=0).stop 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 msgr2=0x56306307ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 0x56306307ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9168001ee0 tx=0x7f916800da30 comp rx=0 tx=0).stop 2024-02-18T16:21:19.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 shutdown_connections 2024-02-18T16:21:19.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f904c0342b0 0x7f904c036770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/1880193188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56306307e9c0 0x56306307ede0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 >> 172.21.15.129:0/1880193188 conn(0x5630630737d0 msgr2=0x5630630742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 shutdown_connections 2024-02-18T16:21:19.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/1880193188 wait complete. 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563062ee64a0 msgr2=0x56306306e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563062ee64a0 0x56306306e140 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f905c0342b0 msgr2=0x7f905c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f905c0342b0 0x7f905c036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9168000f70 tx=0x7f91680012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 msgr2=0x563063067510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563063067510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f916400a420 tx=0x7f9164019810 comp rx=0 tx=0).stop 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 shutdown_connections 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563062ee64a0 0x56306306e140 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f905c0342b0 0x7f905c036770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 --2- 172.21.15.129:0/4018381483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563062ee5b80 0x563063067510 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 >> 172.21.15.129:0/4018381483 conn(0x563062ee4a40 msgr2=0x56306305ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 shutdown_connections 2024-02-18T16:21:19.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.430+0000 7f9176166980 1 -- 172.21.15.129:0/4018381483 wait complete. 2024-02-18T16:21:19.450 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-18T16:21:19.451 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-18T16:21:19.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-18T16:21:19.451 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-18T16:21:19.535 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:19.535 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:19.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f994ba90980 1 Processor -- start 2024-02-18T16:21:19.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f994ba90980 1 -- start start 2024-02-18T16:21:19.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f994ba90980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55f2fc50a0c0 0x55f2fc598dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f994ba90980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f2fc4e24c0 con 0x55f2fc599300 2024-02-18T16:21:19.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f994ba90980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f2fc4a9180 con 0x55f2fc50a0c0 2024-02-18T16:21:19.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f99495ab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55f2fc50a0c0 0x55f2fc598dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f9948daa640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55f2fc599300 0x55f2fc59b6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42588/0 (socket says 172.21.15.129:42588) 2024-02-18T16:21:19.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f9948daa640 1 -- 172.21.15.129:0/2995058465 learned_addr learned my addr 172.21.15.129:0/2995058465 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:19.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f99495ab640 1 -- 172.21.15.129:0/2995058465 >> v1:172.21.15.80:6789/0 conn(0x55f2fc599300 legacy=0x55f2fc59b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.526+0000 7f99495ab640 1 -- 172.21.15.129:0/2995058465 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fc59dee0 con 0x55f2fc50a0c0 2024-02-18T16:21:19.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f99495ab640 1 --2- 172.21.15.129:0/2995058465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc598dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a420 tx=0x7f993c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef9ebe677f7e4cd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f993bfff640 1 -- 172.21.15.129:0/2995058465 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f993c0aa530 con 0x55f2fc50a0c0 2024-02-18T16:21:19.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f993bfff640 1 -- 172.21.15.129:0/2995058465 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0a6050 con 0x55f2fc50a0c0 2024-02-18T16:21:19.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f993bfff640 1 -- 172.21.15.129:0/2995058465 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f993c0aa800 con 0x55f2fc50a0c0 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 -- 172.21.15.129:0/2995058465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 msgr2=0x55f2fc598dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 --2- 172.21.15.129:0/2995058465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc598dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a420 tx=0x7f993c01afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 -- 172.21.15.129:0/2995058465 shutdown_connections 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 --2- 172.21.15.129:0/2995058465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc598dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 -- 172.21.15.129:0/2995058465 >> 172.21.15.129:0/2995058465 conn(0x55f2fc5908e0 msgr2=0x55f2fc592d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 -- 172.21.15.129:0/2995058465 shutdown_connections 2024-02-18T16:21:19.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.530+0000 7f994ba90980 1 -- 172.21.15.129:0/2995058465 wait complete. 2024-02-18T16:21:19.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f994ba90980 1 Processor -- start 2024-02-18T16:21:19.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f994ba90980 1 -- start start 2024-02-18T16:21:19.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f994ba90980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc680100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f994ba90980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fc4a66b0 con 0x55f2fc50a0c0 2024-02-18T16:21:19.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f99495ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc680100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f99495ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc680100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47114/0 (socket says 172.21.15.129:47114) 2024-02-18T16:21:19.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f99495ab640 1 -- 172.21.15.129:0/2517861621 learned_addr learned my addr 172.21.15.129:0/2517861621 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.546+0000 7f99495ab640 1 -- 172.21.15.129:0/2517861621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c00a100 con 0x55f2fc50a0c0 2024-02-18T16:21:19.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f99495ab640 1 --2- 172.21.15.129:0/2517861621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc680100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a420 tx=0x7f993c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f50a96e541b785 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f9837606640 1 -- 172.21.15.129:0/2517861621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f993c0aa6c0 con 0x55f2fc50a0c0 2024-02-18T16:21:19.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f9837606640 1 -- 172.21.15.129:0/2517861621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0aa820 con 0x55f2fc50a0c0 2024-02-18T16:21:19.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f9837606640 1 -- 172.21.15.129:0/2517861621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f993c0aaae0 con 0x55f2fc50a0c0 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/2517861621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 msgr2=0x55f2fc680100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 --2- 172.21.15.129:0/2517861621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc680100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a420 tx=0x7f993c0033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/2517861621 shutdown_connections 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 --2- 172.21.15.129:0/2517861621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc680100 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/2517861621 >> 172.21.15.129:0/2517861621 conn(0x55f2fc5908e0 msgr2=0x55f2fc67bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/2517861621 shutdown_connections 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/2517861621 wait complete. 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 Processor -- start 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- start start 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc686e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fc4a1e90 con 0x55f2fc50a0c0 2024-02-18T16:21:19.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f99495ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc686e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f99495ab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc686e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47126/0 (socket says 172.21.15.129:47126) 2024-02-18T16:21:19.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f99495ab640 1 -- 172.21.15.129:0/3961209054 learned_addr learned my addr 172.21.15.129:0/3961209054 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f99495ab640 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fc59dee0 con 0x55f2fc50a0c0 2024-02-18T16:21:19.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f99495ab640 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc686e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a420 tx=0x7f993c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f9835e03640 1 -- 172.21.15.129:0/3961209054 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f993c0b6b10 con 0x55f2fc50a0c0 2024-02-18T16:21:19.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f9835e03640 1 -- 172.21.15.129:0/3961209054 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0b6c70 con 0x55f2fc50a0c0 2024-02-18T16:21:19.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2fc687370 con 0x55f2fc50a0c0 2024-02-18T16:21:19.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f9835e03640 1 -- 172.21.15.129:0/3961209054 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f993c0b4400 con 0x55f2fc50a0c0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.550+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2fc687820 con 0x55f2fc50a0c0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9835e03640 1 -- 172.21.15.129:0/3961209054 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f993c0b45f0 con 0x55f2fc50a0c0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9835e03640 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98300342b0 0x7f9830036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9835e03640 1 -- 172.21.15.129:0/3961209054 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f993c0e3d20 con 0x55f2fc50a0c0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9948daa640 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98300342b0 0x7f9830036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc599300 0x55f2fc68da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc68df80 con 0x55f2fc599300 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc599300 0x55f2fc68da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9948daa640 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98300342b0 0x7f9830036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9940001da0 tx=0x7f9940001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc599300 0x55f2fc68da40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 -- 172.21.15.129:0/3961209054 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99440083f0 con 0x55f2fc599300 2024-02-18T16:21:19.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc68e380 con 0x55f2fc599300 2024-02-18T16:21:19.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 -- 172.21.15.129:0/3961209054 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f99440083f0 con 0x55f2fc599300 2024-02-18T16:21:19.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc68fc30 con 0x55f2fc599300 2024-02-18T16:21:19.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 -- 172.21.15.129:0/3961209054 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f99440083f0 con 0x55f2fc599300 2024-02-18T16:21:19.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc68ed70 con 0x55f2fc599300 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 -- 172.21.15.129:0/3961209054 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f99440083f0 con 0x55f2fc599300 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc68f180 con 0x55f2fc599300 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.554+0000 7f9949dac640 1 -- 172.21.15.129:0/3961209054 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9944012040 con 0x55f2fc599300 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f994ba90980 1 Processor -- start 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f994ba90980 1 -- start start 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f994ba90980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 0x55f2fc69e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f994ba90980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fc43af20 con 0x55f2fc69e310 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f9948daa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 0x55f2fc69e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f9948daa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 0x55f2fc69e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47140/0 (socket says 172.21.15.129:47140) 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f9948daa640 1 -- 172.21.15.129:0/2964780059 learned_addr learned my addr 172.21.15.129:0/2964780059 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f9948daa640 1 -- 172.21.15.129:0/2964780059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fc69ec70 con 0x55f2fc69e310 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f9948daa640 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 0x55f2fc69e730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f994000d660 tx=0x7f994000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f982effd640 1 -- 172.21.15.129:0/2964780059 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9940020070 con 0x55f2fc69e310 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2fc69eec0 con 0x55f2fc69e310 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f982effd640 1 -- 172.21.15.129:0/2964780059 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000c770 con 0x55f2fc69e310 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f982effd640 1 -- 172.21.15.129:0/2964780059 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9940013040 con 0x55f2fc69e310 2024-02-18T16:21:19.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2fc69fa10 con 0x55f2fc69e310 2024-02-18T16:21:19.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f982effd640 1 -- 172.21.15.129:0/2964780059 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f994000a040 con 0x55f2fc69e310 2024-02-18T16:21:19.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f982effd640 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98200342b0 0x7f9820036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f982effd640 1 -- 172.21.15.129:0/2964780059 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f994004b6a0 con 0x55f2fc69e310 2024-02-18T16:21:19.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.558+0000 7f9949dac640 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98200342b0 0x7f9820036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 Processor -- start 2024-02-18T16:21:19.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- start start 2024-02-18T16:21:19.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6ab770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fc42e790 con 0x55f2fc6ab350 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9949dac640 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98200342b0 0x7f9820036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55f2fc68f0d0 tx=0x7f9944003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47152/0 (socket says 172.21.15.129:47152) 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 -- 172.21.15.129:0/2543635743 learned_addr learned my addr 172.21.15.129:0/2543635743 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 -- 172.21.15.129:0/2543635743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fc6abd40 con 0x55f2fc6ab350 2024-02-18T16:21:19.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 --2- 172.21.15.129:0/2543635743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6ab770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9940049bc0 tx=0x7f9940049cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d392260c71bace9f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f982cff9640 1 -- 172.21.15.129:0/2543635743 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f994001ace0 con 0x55f2fc6ab350 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f982cff9640 1 -- 172.21.15.129:0/2543635743 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994001ae40 con 0x55f2fc6ab350 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f982cff9640 1 -- 172.21.15.129:0/2543635743 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f994003a370 con 0x55f2fc6ab350 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- 172.21.15.129:0/2543635743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 msgr2=0x55f2fc6ab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 --2- 172.21.15.129:0/2543635743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6ab770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9940049bc0 tx=0x7f9940049cb0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- 172.21.15.129:0/2543635743 shutdown_connections 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 --2- 172.21.15.129:0/2543635743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6ab770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- 172.21.15.129:0/2543635743 >> 172.21.15.129:0/2543635743 conn(0x55f2fc6a7690 msgr2=0x55f2fc6a56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- 172.21.15.129:0/2543635743 shutdown_connections 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- 172.21.15.129:0/2543635743 wait complete. 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 Processor -- start 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- start start 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f994ba90980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fc6b27d0 con 0x55f2fc6ab350 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47166/0 (socket says 172.21.15.129:47166) 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.562+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 learned_addr learned my addr 172.21.15.129:0/100142709 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fc69fa10 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f9948daa640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6b2290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f994001ac70 tx=0x7f9940049960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f981effd640 1 -- 172.21.15.129:0/100142709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9940048460 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f981effd640 1 -- 172.21.15.129:0/100142709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940034070 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2fc6b29d0 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f981effd640 1 -- 172.21.15.129:0/100142709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9940019320 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2fc6b2e60 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f981effd640 1 -- 172.21.15.129:0/100142709 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9940019480 con 0x55f2fc6ab350 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f981effd640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98140342b0 0x7f9814036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f981effd640 1 -- 172.21.15.129:0/100142709 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9940040020 con 0x55f2fc6ab350 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f9949dac640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98140342b0 0x7f9814036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc6bd690 0x55f2fc6bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c02a0 con 0x55f2fc6bd690 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f99495ab640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc6bd690 0x55f2fc6bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f9949dac640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98140342b0 0x7f9814036770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9944008fd0 tx=0x7f994401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f99495ab640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc6bd690 0x55f2fc6bfb50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 20 realm 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c0670 con 0x55f2fc6bd690 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.566+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c0ef0 con 0x55f2fc6bd690 2024-02-18T16:21:19.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c1250 con 0x55f2fc6bd690 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c1a50 con 0x55f2fc6bd690 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 20 searching for the correct realm 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f2fc6c38e0 0x55f2fc6c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c6420 con 0x55f2fc6c38e0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9948daa640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f2fc6c38e0 0x55f2fc6c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9948daa640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f2fc6c38e0 0x55f2fc6c5d50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9948daa640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f994001a3c0 0x7f9940045070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c6420 con 0x7f994001a3c0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9949dac640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f994001a3c0 0x7f9940045070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9949dac640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f994001a3c0 0x7f9940045070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f994402c040 con 0x7f994001a3c0 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9949dac640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9944027940 0x7f99440333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c6420 con 0x7f9944027940 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f99495ab640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9944027940 0x7f99440333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.570+0000 7f99495ab640 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9944027940 0x7f99440333c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c6420 con 0x55f2fc6bd690 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c6420 con 0x55f2fc6bd690 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x7f9944027940 2024-02-18T16:21:19.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x7f9944027940 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x7f994001a3c0 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f994402c040 con 0x7f994001a3c0 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x55f2fc6bd690 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.574+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x7f9944027940 2024-02-18T16:21:19.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x55f2fc6bd690 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x7f994001a3c0 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f994402c040 con 0x7f994001a3c0 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x7f9944027940 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f993c0ea040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6bd690 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6bd690 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f9944027940 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.578+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f994001a3c0 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f994402c040 con 0x7f994001a3c0 2024-02-18T16:21:19.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6bd690 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x55f2fc6bd690 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f9944027940 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f9944027940 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0c5070 con 0x7f9944027940 2024-02-18T16:21:19.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f994001a3c0 2024-02-18T16:21:19.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f994402c040 con 0x7f994001a3c0 2024-02-18T16:21:19.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6c38e0 2024-02-18T16:21:19.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f9944027940 2024-02-18T16:21:19.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.582+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x55f2fc6bd690 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9940063040 con 0x7f994001a3c0 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f994402c040 con 0x7f994001a3c0 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:19.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c2380 con 0x55f2fc6bd690 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c2bd0 con 0x55f2fc6bd690 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c2bd0 con 0x55f2fc6bd690 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 zone default found 2024-02-18T16:21:19.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 4 Realm: () 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 zonegroup default 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c6860 con 0x7f9944027940 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c8240 con 0x55f2fc6c38e0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c8620 con 0x55f2fc6c38e0 2024-02-18T16:21:19.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 started sync module instance, tier type = 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.586+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c7b20 con 0x7f994001a3c0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94502105413248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c7ed0 con 0x7f994001a3c0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c9380 con 0x55f2fc6bd690 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94502105413248] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94502105418304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c9340 con 0x55f2fc6bd690 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.590+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6c9e00 con 0x55f2fc6c38e0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94502105418304] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94502105422016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6ca160 con 0x55f2fc6c38e0 2024-02-18T16:21:19.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6caad0 con 0x7f994001a3c0 2024-02-18T16:21:19.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94502105425760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cb320 con 0x7f994001a3c0 2024-02-18T16:21:19.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cbd10 con 0x55f2fc6bd690 2024-02-18T16:21:19.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.594+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94502105422016] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94502105430000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cbcd0 con 0x55f2fc6bd690 2024-02-18T16:21:19.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cc6d0 con 0x7f9944027940 2024-02-18T16:21:19.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94502105425760] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94502105427584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cc6d0 con 0x7f9944027940 2024-02-18T16:21:19.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6ccfa0 con 0x7f9944027940 2024-02-18T16:21:19.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.602+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94502105430000] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94502105427584] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94502105419360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cc6d0 con 0x7f9944027940 2024-02-18T16:21:19.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cd400 con 0x7f9944027940 2024-02-18T16:21:19.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94502105419360] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94502105433104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cd400 con 0x7f9944027940 2024-02-18T16:21:19.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=0 2024-02-18T16:21:19.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=1 2024-02-18T16:21:19.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=2 2024-02-18T16:21:19.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=3 2024-02-18T16:21:19.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=4 2024-02-18T16:21:19.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=5 2024-02-18T16:21:19.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.606+0000 7f994ba90980 20 add_watcher() i=6 2024-02-18T16:21:19.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.610+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94502105433104] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.610+0000 7f994ba90980 20 add_watcher() i=7 2024-02-18T16:21:19.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.610+0000 7f994ba90980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:19.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.610+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d0710 con 0x55f2fc6bd690 2024-02-18T16:21:19.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.610+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.610+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94502105448752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cd570 con 0x55f2fc6bd690 2024-02-18T16:21:19.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94502105448752] v30'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f97ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f994ba90980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:19.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f994ba90980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:19.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cf6e0 con 0x55f2fc6bd690 2024-02-18T16:21:19.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.614+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cf760 con 0x7f9944027940 2024-02-18T16:21:19.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.618+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.618+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6cf720 con 0x55f2fc6c38e0 2024-02-18T16:21:19.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.618+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.618+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d9e00 con 0x55f2fc6bd690 2024-02-18T16:21:19.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.618+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.618+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d8df0 con 0x7f994001a3c0 2024-02-18T16:21:19.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.622+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.622+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d8df0 con 0x55f2fc6c38e0 2024-02-18T16:21:19.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.622+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.622+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dab40 con 0x55f2fc6bd690 2024-02-18T16:21:19.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.622+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.622+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dab40 con 0x7f9944027940 2024-02-18T16:21:19.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.626+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.626+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dab40 con 0x7f994001a3c0 2024-02-18T16:21:19.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.630+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.630+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6db070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.630+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.630+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6db510 con 0x7f994001a3c0 2024-02-18T16:21:19.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.630+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.630+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7de0 con 0x7f9944027940 2024-02-18T16:21:19.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.634+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.634+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x7f994001a3c0 2024-02-18T16:21:19.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.634+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.634+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x7f9944027940 2024-02-18T16:21:19.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.638+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.638+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6bd690 2024-02-18T16:21:19.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.638+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.638+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6c38e0 2024-02-18T16:21:19.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.638+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.638+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x7f994001a3c0 2024-02-18T16:21:19.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.642+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.642+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6c38e0 2024-02-18T16:21:19.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.642+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.642+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6bd690 2024-02-18T16:21:19.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.646+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.646+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6bd690 2024-02-18T16:21:19.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.646+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.646+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6c38e0 2024-02-18T16:21:19.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.650+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.650+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x7f994001a3c0 2024-02-18T16:21:19.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.650+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.650+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d83d0 con 0x55f2fc6c38e0 2024-02-18T16:21:19.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.650+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.650+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x55f2fc6c38e0 2024-02-18T16:21:19.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.654+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.654+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x55f2fc6c38e0 2024-02-18T16:21:19.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.654+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.654+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x55f2fc6c38e0 2024-02-18T16:21:19.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.658+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.658+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x7f9944027940 2024-02-18T16:21:19.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.658+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.658+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x55f2fc6c38e0 2024-02-18T16:21:19.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.658+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.658+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x7f9944027940 2024-02-18T16:21:19.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.662+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.662+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x55f2fc6c38e0 2024-02-18T16:21:19.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.662+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.662+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x7f9944027940 2024-02-18T16:21:19.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.666+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.666+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6dc080 con 0x7f994001a3c0 2024-02-18T16:21:19.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f97fe7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:19.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:19.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 20 Filter name: none 2024-02-18T16:21:19.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f976ffff640 20 reqs_thread_entry: start 2024-02-18T16:21:19.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:19.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.681 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d77d0 con 0x7f9944027940 2024-02-18T16:21:19.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-18T16:21:19.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:19.683 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, user does not exist 2024-02-18T16:21:19.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f97ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.670+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94502105448752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x55f2fc6bd690 2024-02-18T16:21:19.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.674+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94502105448752] v30'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.674+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94502105413248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x7f994001a3c0 2024-02-18T16:21:19.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.674+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94502105413248] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.674+0000 7f994ba90980 20 remove_watcher() i=0 2024-02-18T16:21:19.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.674+0000 7f994ba90980 2 removed watcher, disabling cache 2024-02-18T16:21:19.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.674+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94502105418304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x55f2fc6bd690 2024-02-18T16:21:19.686 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.678+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94502105418304] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.686 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.678+0000 7f994ba90980 20 remove_watcher() i=1 2024-02-18T16:21:19.686 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.678+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94502105422016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x55f2fc6c38e0 2024-02-18T16:21:19.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.678+0000 7f9948daa640 1 -- 172.21.15.129:0/100142709 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94502105422016] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9940022070 con 0x55f2fc6c38e0 2024-02-18T16:21:19.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.678+0000 7f994ba90980 20 remove_watcher() i=2 2024-02-18T16:21:19.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.678+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94502105425760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x7f994001a3c0 2024-02-18T16:21:19.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.682+0000 7f9949dac640 1 -- 172.21.15.129:0/100142709 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94502105425760] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f994403f040 con 0x7f994001a3c0 2024-02-18T16:21:19.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.682+0000 7f994ba90980 20 remove_watcher() i=3 2024-02-18T16:21:19.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.682+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94502105430000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x55f2fc6bd690 2024-02-18T16:21:19.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.682+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94502105430000] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x55f2fc6bd690 2024-02-18T16:21:19.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.682+0000 7f994ba90980 20 remove_watcher() i=4 2024-02-18T16:21:19.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.682+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94502105427584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x7f9944027940 2024-02-18T16:21:19.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.686+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94502105427584] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.686+0000 7f994ba90980 20 remove_watcher() i=5 2024-02-18T16:21:19.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.686+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94502105419360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x7f9944027940 2024-02-18T16:21:19.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.686+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94502105419360] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.686+0000 7f994ba90980 20 remove_watcher() i=6 2024-02-18T16:21:19.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.686+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94502105433104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f2fc6d7790 con 0x7f9944027940 2024-02-18T16:21:19.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94502105433104] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f993c0fb040 con 0x7f9944027940 2024-02-18T16:21:19.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 20 remove_watcher() i=7 2024-02-18T16:21:19.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9944027940 msgr2=0x7f99440333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9944027940 0x7f99440333c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc6bd690 msgr2=0x55f2fc6bfb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc6bd690 0x55f2fc6bfb50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f994001a3c0 msgr2=0x7f9940045070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f994001a3c0 0x7f9940045070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f2fc6c38e0 msgr2=0x55f2fc6c5d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f2fc6c38e0 0x55f2fc6c5d50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98140342b0 msgr2=0x7f9814036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98140342b0 0x7f9814036770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9944008fd0 tx=0x7f994401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 msgr2=0x55f2fc6b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f99495ab640 1 -- 172.21.15.129:0/100142709 reap_dead start 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6b2290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f994001ac70 tx=0x7f9940049960 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 shutdown_connections 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/100142709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc6ab350 0x55f2fc6b2290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 >> 172.21.15.129:0/100142709 conn(0x55f2fc6a7690 msgr2=0x55f2fc6a4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 shutdown_connections 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/100142709 wait complete. 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98200342b0 msgr2=0x7f9820036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98200342b0 0x7f9820036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55f2fc68f0d0 tx=0x7f9944003070 comp rx=0 tx=0).stop 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 msgr2=0x55f2fc69e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 0x55f2fc69e730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f994000d660 tx=0x7f994000da60 comp rx=0 tx=0).stop 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 shutdown_connections 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98200342b0 0x7f9820036770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/2964780059 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc69e310 0x55f2fc69e730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 >> 172.21.15.129:0/2964780059 conn(0x55f2fc693120 msgr2=0x55f2fc693c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 shutdown_connections 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/2964780059 wait complete. 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc599300 msgr2=0x55f2fc68da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc599300 0x55f2fc68da40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98300342b0 msgr2=0x7f9830036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98300342b0 0x7f9830036770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9940001da0 tx=0x7f9940001300 comp rx=0 tx=0).stop 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 msgr2=0x55f2fc686e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc686e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a420 tx=0x7f993c019810 comp rx=0 tx=0).stop 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 shutdown_connections 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f2fc599300 0x55f2fc68da40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f98300342b0 0x7f9830036770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 --2- 172.21.15.129:0/3961209054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f2fc50a0c0 0x55f2fc686e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 >> 172.21.15.129:0/3961209054 conn(0x55f2fc5908e0 msgr2=0x55f2fc67a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 shutdown_connections 2024-02-18T16:21:19.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.690+0000 7f994ba90980 1 -- 172.21.15.129:0/3961209054 wait complete. 2024-02-18T16:21:19.711 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-18T16:21:19.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-18T16:21:19.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-18T16:21:19.712 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-18T16:21:19.793 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:19.793 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:19.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa738e86980 1 Processor -- start 2024-02-18T16:21:19.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa738e86980 1 -- start start 2024-02-18T16:21:19.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa738e86980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55770d80f080 0x55770d89de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa738e86980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55770d7e74c0 con 0x55770d89e340 2024-02-18T16:21:19.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa738e86980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55770d7ae180 con 0x55770d80f080 2024-02-18T16:21:19.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa7361a0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55770d89e340 0x55770d8a0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42602/0 (socket says 172.21.15.129:42602) 2024-02-18T16:21:19.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa7369a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55770d80f080 0x55770d89de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa7361a0640 1 -- 172.21.15.129:0/3016969601 learned_addr learned my addr 172.21.15.129:0/3016969601 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:19.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa7369a1640 1 -- 172.21.15.129:0/3016969601 >> v1:172.21.15.80:6789/0 conn(0x55770d89e340 legacy=0x55770d8a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.786+0000 7fa7369a1640 1 -- 172.21.15.129:0/3016969601 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770d8a2ef0 con 0x55770d80f080 2024-02-18T16:21:19.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa7369a1640 1 --2- 172.21.15.129:0/3016969601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d80f080 0x55770d89de00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa72800a480 tx=0x7fa72801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864510902772cee5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa73599f640 1 -- 172.21.15.129:0/3016969601 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7280aa530 con 0x55770d80f080 2024-02-18T16:21:19.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa73599f640 1 -- 172.21.15.129:0/3016969601 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280a6050 con 0x55770d80f080 2024-02-18T16:21:19.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa73599f640 1 -- 172.21.15.129:0/3016969601 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7280aa7e0 con 0x55770d80f080 2024-02-18T16:21:19.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 -- 172.21.15.129:0/3016969601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d80f080 msgr2=0x55770d89de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 --2- 172.21.15.129:0/3016969601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d80f080 0x55770d89de00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa72800a480 tx=0x7fa72801b110 comp rx=0 tx=0).stop 2024-02-18T16:21:19.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 -- 172.21.15.129:0/3016969601 shutdown_connections 2024-02-18T16:21:19.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 --2- 172.21.15.129:0/3016969601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d80f080 0x55770d89de00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 -- 172.21.15.129:0/3016969601 >> 172.21.15.129:0/3016969601 conn(0x55770d8958e0 msgr2=0x55770d897d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 -- 172.21.15.129:0/3016969601 shutdown_connections 2024-02-18T16:21:19.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.790+0000 7fa738e86980 1 -- 172.21.15.129:0/3016969601 wait complete. 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 Processor -- start 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- start start 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d982fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770d7ab6b0 con 0x55770d89e340 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa7369a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d982fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa7369a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d982fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47182/0 (socket says 172.21.15.129:47182) 2024-02-18T16:21:19.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa7369a1640 1 -- 172.21.15.129:0/749390141 learned_addr learned my addr 172.21.15.129:0/749390141 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa7369a1640 1 -- 172.21.15.129:0/749390141 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728005d30 con 0x55770d89e340 2024-02-18T16:21:19.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa7369a1640 1 --2- 172.21.15.129:0/749390141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d982fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa72801b150 tx=0x7fa728003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8edda91eb9d5335 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa624e09640 1 -- 172.21.15.129:0/749390141 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7280aa760 con 0x55770d89e340 2024-02-18T16:21:19.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa624e09640 1 -- 172.21.15.129:0/749390141 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280aa8c0 con 0x55770d89e340 2024-02-18T16:21:19.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa624e09640 1 -- 172.21.15.129:0/749390141 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7280aab60 con 0x55770d89e340 2024-02-18T16:21:19.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- 172.21.15.129:0/749390141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 msgr2=0x55770d982fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 --2- 172.21.15.129:0/749390141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d982fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa72801b150 tx=0x7fa728003030 comp rx=0 tx=0).stop 2024-02-18T16:21:19.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- 172.21.15.129:0/749390141 shutdown_connections 2024-02-18T16:21:19.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 --2- 172.21.15.129:0/749390141 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d982fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- 172.21.15.129:0/749390141 >> 172.21.15.129:0/749390141 conn(0x55770d8958e0 msgr2=0x55770d97ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- 172.21.15.129:0/749390141 shutdown_connections 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- 172.21.15.129:0/749390141 wait complete. 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 Processor -- start 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- start start 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d989d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.806+0000 7fa738e86980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770d7a6e90 con 0x55770d89e340 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7369a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d989d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7369a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d989d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47184/0 (socket says 172.21.15.129:47184) 2024-02-18T16:21:19.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7369a1640 1 -- 172.21.15.129:0/1797043522 learned_addr learned my addr 172.21.15.129:0/1797043522 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7369a1640 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770d8a2ef0 con 0x55770d89e340 2024-02-18T16:21:19.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7369a1640 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d989d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa728018d40 tx=0x7fa728017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa623606640 1 -- 172.21.15.129:0/1797043522 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7280c2070 con 0x55770d89e340 2024-02-18T16:21:19.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa623606640 1 -- 172.21.15.129:0/1797043522 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280bdb00 con 0x55770d89e340 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55770d98a290 con 0x55770d89e340 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa623606640 1 -- 172.21.15.129:0/1797043522 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7280bddc0 con 0x55770d89e340 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55770d98a7a0 con 0x55770d89e340 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa623606640 1 -- 172.21.15.129:0/1797043522 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa7280b1070 con 0x55770d89e340 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa623606640 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa61c0342b0 0x7fa61c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa623606640 1 -- 172.21.15.129:0/1797043522 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa7280e3de0 con 0x55770d89e340 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7361a0640 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa61c0342b0 0x7fa61c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d98e980 0x55770d990d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9912b0 con 0x55770d98e980 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7371a2640 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d98e980 0x55770d990d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7361a0640 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa61c0342b0 0x7fa61c036770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b330 tx=0x7fa72c0014b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7371a2640 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d98e980 0x55770d990d70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa7371a2640 1 -- 172.21.15.129:0/1797043522 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa73000a4d0 con 0x55770d98e980 2024-02-18T16:21:19.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.810+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d98e070 con 0x55770d98e980 2024-02-18T16:21:19.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7371a2640 1 -- 172.21.15.129:0/1797043522 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa73000a4d0 con 0x55770d98e980 2024-02-18T16:21:19.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d992c70 con 0x55770d98e980 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7371a2640 1 -- 172.21.15.129:0/1797043522 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa73000a4d0 con 0x55770d98e980 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d991af0 con 0x55770d98e980 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7371a2640 1 -- 172.21.15.129:0/1797043522 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa73000a4d0 con 0x55770d98e980 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d991f00 con 0x55770d98e980 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7371a2640 1 -- 172.21.15.129:0/1797043522 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa73000a4d0 con 0x55770d98e980 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 Processor -- start 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- start start 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 0x55770d9a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770d73ff20 con 0x55770d9a15c0 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7361a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 0x55770d9a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7361a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 0x55770d9a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47198/0 (socket says 172.21.15.129:47198) 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7361a0640 1 -- 172.21.15.129:0/230960180 learned_addr learned my addr 172.21.15.129:0/230960180 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7361a0640 1 -- 172.21.15.129:0/230960180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770d9a1f20 con 0x55770d9a15c0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa7361a0640 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 0x55770d9a19e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00e620 tx=0x7fa72c00e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa620e01640 1 -- 172.21.15.129:0/230960180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa72c01b380 con 0x55770d9a15c0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55770d9a2170 con 0x55770d9a15c0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa620e01640 1 -- 172.21.15.129:0/230960180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c01b4e0 con 0x55770d9a15c0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa620e01640 1 -- 172.21.15.129:0/230960180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa72c01b7c0 con 0x55770d9a15c0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.814+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55770d9a2cc0 con 0x55770d9a15c0 2024-02-18T16:21:19.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa620e01640 1 -- 172.21.15.129:0/230960180 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa72c01a070 con 0x55770d9a15c0 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa620e01640 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa6100342b0 0x7fa610036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa620e01640 1 -- 172.21.15.129:0/230960180 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa72c017050 con 0x55770d9a15c0 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7371a2640 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa6100342b0 0x7fa610036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 Processor -- start 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- start start 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7371a2640 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa6100342b0 0x7fa610036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55770d9926a0 tx=0x7fa730005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9ae990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770d733790 con 0x55770d9ae570 2024-02-18T16:21:19.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7361a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7361a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47202/0 (socket says 172.21.15.129:47202) 2024-02-18T16:21:19.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7361a0640 1 -- 172.21.15.129:0/1834410411 learned_addr learned my addr 172.21.15.129:0/1834410411 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7361a0640 1 -- 172.21.15.129:0/1834410411 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770d9aef60 con 0x55770d9ae570 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa7361a0640 1 --2- 172.21.15.129:0/1834410411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9ae990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa72c048ba0 tx=0x7fa72c0243d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e963d11b8b2170 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa61a7fc640 1 -- 172.21.15.129:0/1834410411 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa72c046030 con 0x55770d9ae570 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa61a7fc640 1 -- 172.21.15.129:0/1834410411 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00d300 con 0x55770d9ae570 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa61a7fc640 1 -- 172.21.15.129:0/1834410411 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa72c042ba0 con 0x55770d9ae570 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- 172.21.15.129:0/1834410411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 msgr2=0x55770d9ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 --2- 172.21.15.129:0/1834410411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9ae990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa72c048ba0 tx=0x7fa72c0243d0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- 172.21.15.129:0/1834410411 shutdown_connections 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 --2- 172.21.15.129:0/1834410411 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9ae990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- 172.21.15.129:0/1834410411 >> 172.21.15.129:0/1834410411 conn(0x55770d9aa900 msgr2=0x55770d9a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- 172.21.15.129:0/1834410411 shutdown_connections 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.818+0000 7fa738e86980 1 -- 172.21.15.129:0/1834410411 wait complete. 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 1 Processor -- start 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 1 -- start start 2024-02-18T16:21:19.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770d9b5a10 con 0x55770d9ae570 2024-02-18T16:21:19.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa7361a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa7361a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47204/0 (socket says 172.21.15.129:47204) 2024-02-18T16:21:19.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 learned_addr learned my addr 172.21.15.129:0/2427446119 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770d9a2cc0 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa7361a0640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9b54d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00eae0 tx=0x7fa72c044070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa618ff9640 1 -- 172.21.15.129:0/2427446119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa72c041040 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa618ff9640 1 -- 172.21.15.129:0/2427446119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00da60 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55770d9b5c10 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa618ff9640 1 -- 172.21.15.129:0/2427446119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa72c00d470 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55770d9b60a0 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa618ff9640 1 -- 172.21.15.129:0/2427446119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa72c01abd0 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa618ff9640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa600034300 0x7fa6000367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa618ff9640 1 -- 172.21.15.129:0/2427446119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa72c047070 con 0x55770d9ae570 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa7371a2640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa600034300 0x7fa6000367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.822+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d9c0a50 0x55770d9c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c3660 con 0x55770d9c0a50 2024-02-18T16:21:19.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d9c0a50 0x55770d9c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7371a2640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa600034300 0x7fa6000367c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa730011010 tx=0x7fa730020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d9c0a50 0x55770d9c2f10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7280b3370 con 0x55770d9c0a50 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 realm 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c3a30 con 0x55770d9c0a50 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7280b3370 con 0x55770d9c0a50 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:19.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c42b0 con 0x55770d9c0a50 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c4610 con 0x55770d9c0a50 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c4e10 con 0x55770d9c0a50 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 20 searching for the correct realm 2024-02-18T16:21:19.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55770d9c6ca0 0x55770d9c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7361a0640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55770d9c6ca0 0x55770d9c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7361a0640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55770d9c6ca0 0x55770d9c9130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7361a0640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa72c01b920 0x7fa72c03a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa72c01b920 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7371a2640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa72c01b920 0x7fa72c03a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.826+0000 7fa7371a2640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa72c01b920 0x7fa72c03a050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa73000a4d0 con 0x7fa72c01b920 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7371a2640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa7300141d0 0x7fa730015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:19.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa7300141d0 0x7fa730015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa7300141d0 0x7fa730015940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.830+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa72c01b920 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa73000a4d0 con 0x7fa72c01b920 2024-02-18T16:21:19.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa72c01b920 2024-02-18T16:21:19.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.834+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa72c01b920 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.838+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa72c01b920 2024-02-18T16:21:19.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c6ca0 2024-02-18T16:21:19.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa72c00c040 con 0x55770d9c6ca0 2024-02-18T16:21:19.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa7300141d0 2024-02-18T16:21:19.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x55770d9c0a50 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9800 con 0x7fa72c01b920 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c5740 con 0x55770d9c0a50 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c5f90 con 0x55770d9c0a50 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9c40 con 0x55770d9c0a50 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 zone default found 2024-02-18T16:21:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 4 Realm: () 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 zonegroup default 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9c9cd0 con 0x7fa7300141d0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.842+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cbab0 con 0x55770d9c6ca0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cbe40 con 0x55770d9c6ca0 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 20 started sync module instance, tier type = 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cb390 con 0x7fa72c01b920 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969817841392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cb740 con 0x7fa72c01b920 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ccb80 con 0x55770d9c0a50 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.846+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969817841392] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969817846336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ccb00 con 0x55770d9c0a50 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cd530 con 0x55770d9c6ca0 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969817849904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cddb0 con 0x55770d9c6ca0 2024-02-18T16:21:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ce760 con 0x7fa72c01b920 2024-02-18T16:21:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969817846336] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969817847392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ceb10 con 0x7fa72c01b920 2024-02-18T16:21:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.850+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cf480 con 0x55770d9c0a50 2024-02-18T16:21:19.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969817849904] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969817847392] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969817854592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cefe0 con 0x55770d9c0a50 2024-02-18T16:21:19.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cfcd0 con 0x7fa7300141d0 2024-02-18T16:21:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969817854592] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969817852176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9cfa30 con 0x7fa7300141d0 2024-02-18T16:21:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.854+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d0230 con 0x7fa7300141d0 2024-02-18T16:21:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969817852176] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969817859744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d0060 con 0x7fa7300141d0 2024-02-18T16:21:19.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d0b30 con 0x7fa7300141d0 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969817859744] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969817863696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d0af0 con 0x7fa7300141d0 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=0 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=1 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=2 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=3 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=4 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=5 2024-02-18T16:21:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.858+0000 7fa738e86980 20 add_watcher() i=6 2024-02-18T16:21:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969817863696] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 20 add_watcher() i=7 2024-02-18T16:21:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d3f40 con 0x55770d9c0a50 2024-02-18T16:21:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969817860864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d13b0 con 0x55770d9c0a50 2024-02-18T16:21:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969817860864] v30'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa5ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.862+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dc570 con 0x55770d9c0a50 2024-02-18T16:21:19.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.866+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.866+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dc9b0 con 0x7fa7300141d0 2024-02-18T16:21:19.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.870+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.870+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dce50 con 0x55770d9c6ca0 2024-02-18T16:21:19.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.870+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.870+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dd650 con 0x55770d9c0a50 2024-02-18T16:21:19.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.870+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.870+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9da6c0 con 0x7fa72c01b920 2024-02-18T16:21:19.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.874+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.874+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9da6c0 con 0x55770d9c6ca0 2024-02-18T16:21:19.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.874+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.874+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9de8d0 con 0x55770d9c0a50 2024-02-18T16:21:19.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.874+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.874+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d9620 con 0x7fa7300141d0 2024-02-18T16:21:19.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.878+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.878+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d9c30 con 0x7fa72c01b920 2024-02-18T16:21:19.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.882+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.882+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d9c30 con 0x55770d9c6ca0 2024-02-18T16:21:19.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.882+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.882+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9df440 con 0x7fa72c01b920 2024-02-18T16:21:19.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.882+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.882+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9df970 con 0x7fa7300141d0 2024-02-18T16:21:19.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.886+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.886+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9df970 con 0x7fa72c01b920 2024-02-18T16:21:19.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.886+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.886+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dfe10 con 0x7fa7300141d0 2024-02-18T16:21:19.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.890+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.890+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dfe10 con 0x55770d9c0a50 2024-02-18T16:21:19.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.890+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.890+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dfe10 con 0x55770d9c6ca0 2024-02-18T16:21:19.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.894+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.894+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dfe10 con 0x7fa72c01b920 2024-02-18T16:21:19.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.894+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.894+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dfe10 con 0x55770d9c6ca0 2024-02-18T16:21:19.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.898+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.898+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c0a50 2024-02-18T16:21:19.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.898+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.898+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c0a50 2024-02-18T16:21:19.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.898+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.898+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9d8fb0 con 0x55770d9c6ca0 2024-02-18T16:21:19.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.902+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.902+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x7fa72c01b920 2024-02-18T16:21:19.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.902+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.902+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c6ca0 2024-02-18T16:21:19.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.906+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.906+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c6ca0 2024-02-18T16:21:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.906+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.906+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c6ca0 2024-02-18T16:21:19.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.906+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.906+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c6ca0 2024-02-18T16:21:19.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.910+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.910+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x7fa7300141d0 2024-02-18T16:21:19.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.910+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.910+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c6ca0 2024-02-18T16:21:19.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.914+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.914+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x7fa7300141d0 2024-02-18T16:21:19.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.914+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.914+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x55770d9c6ca0 2024-02-18T16:21:19.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.918+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.918+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x7fa7300141d0 2024-02-18T16:21:19.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.918+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9e0190 con 0x7fa72c01b920 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa567fff640 20 reqs_thread_entry: start 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 20 Filter name: none 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa565ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 20 rados->read ofs=0 len=0 2024-02-18T16:21:19.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dedd0 con 0x55770d9c0a50 2024-02-18T16:21:19.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:19.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-18T16:21:19.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.922+0000 7fa738e86980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:19.935 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, user does not exist 2024-02-18T16:21:19.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa5ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:19.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969817860864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dedd0 con 0x55770d9c0a50 2024-02-18T16:21:19.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93969817860864] v30'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969817841392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9dedd0 con 0x7fa72c01b920 2024-02-18T16:21:19.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93969817841392] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa738e86980 20 remove_watcher() i=0 2024-02-18T16:21:19.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.926+0000 7fa738e86980 2 removed watcher, disabling cache 2024-02-18T16:21:19.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.930+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969817846336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x55770d9c0a50 2024-02-18T16:21:19.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.930+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93969817846336] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.930+0000 7fa738e86980 20 remove_watcher() i=1 2024-02-18T16:21:19.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.930+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969817849904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x55770d9c6ca0 2024-02-18T16:21:19.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.934+0000 7fa7361a0640 1 -- 172.21.15.129:0/2427446119 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93969817849904] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa72c060040 con 0x55770d9c6ca0 2024-02-18T16:21:19.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.934+0000 7fa738e86980 20 remove_watcher() i=2 2024-02-18T16:21:19.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.934+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969817847392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x7fa72c01b920 2024-02-18T16:21:19.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.934+0000 7fa7371a2640 1 -- 172.21.15.129:0/2427446119 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93969817847392] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa73003a040 con 0x7fa72c01b920 2024-02-18T16:21:19.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.934+0000 7fa738e86980 20 remove_watcher() i=3 2024-02-18T16:21:19.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.934+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969817854592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x55770d9c0a50 2024-02-18T16:21:19.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.938+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93969817854592] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x55770d9c0a50 2024-02-18T16:21:19.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.938+0000 7fa738e86980 20 remove_watcher() i=4 2024-02-18T16:21:19.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.938+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969817852176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x7fa7300141d0 2024-02-18T16:21:19.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.938+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93969817852176] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.938+0000 7fa738e86980 20 remove_watcher() i=5 2024-02-18T16:21:19.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.938+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969817859744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x7fa7300141d0 2024-02-18T16:21:19.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.942+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93969817859744] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.942+0000 7fa738e86980 20 remove_watcher() i=6 2024-02-18T16:21:19.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.942+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969817863696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55770d9ded90 con 0x7fa7300141d0 2024-02-18T16:21:19.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.942+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93969817863696] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7280d6040 con 0x7fa7300141d0 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.942+0000 7fa738e86980 20 remove_watcher() i=7 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.942+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa7300141d0 msgr2=0x7fa730015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa7300141d0 0x7fa730015940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d9c0a50 msgr2=0x55770d9c2f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d9c0a50 0x55770d9c2f10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa72c01b920 msgr2=0x7fa72c03a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa72c01b920 0x7fa72c03a050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55770d9c6ca0 msgr2=0x55770d9c9130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55770d9c6ca0 0x55770d9c9130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa600034300 msgr2=0x7fa6000367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa600034300 0x7fa6000367c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa730011010 tx=0x7fa730020000 comp rx=0 tx=0).stop 2024-02-18T16:21:19.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 msgr2=0x55770d9b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa7369a1640 1 -- 172.21.15.129:0/2427446119 reap_dead start 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9b54d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00eae0 tx=0x7fa72c044070 comp rx=0 tx=0).stop 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 shutdown_connections 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/2427446119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9ae570 0x55770d9b54d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 >> 172.21.15.129:0/2427446119 conn(0x55770d9aa900 msgr2=0x55770d9a7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 shutdown_connections 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/2427446119 wait complete. 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa6100342b0 msgr2=0x7fa610036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa6100342b0 0x7fa610036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55770d9926a0 tx=0x7fa730005850 comp rx=0 tx=0).stop 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 msgr2=0x55770d9a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 0x55770d9a19e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00e620 tx=0x7fa72c00e650 comp rx=0 tx=0).stop 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 shutdown_connections 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa6100342b0 0x7fa610036770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/230960180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d9a15c0 0x55770d9a19e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 >> 172.21.15.129:0/230960180 conn(0x55770d9963d0 msgr2=0x55770d996ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 shutdown_connections 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/230960180 wait complete. 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d98e980 msgr2=0x55770d990d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d98e980 0x55770d990d70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa61c0342b0 msgr2=0x7fa61c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa61c0342b0 0x7fa61c036770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b330 tx=0x7fa72c0014b0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 msgr2=0x55770d989d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d989d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa728018d40 tx=0x7fa728017eb0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 shutdown_connections 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55770d98e980 0x55770d990d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa61c0342b0 0x7fa61c036770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 --2- 172.21.15.129:0/1797043522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55770d89e340 0x55770d989d50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:19.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 >> 172.21.15.129:0/1797043522 conn(0x55770d8958e0 msgr2=0x55770d97d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:19.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 shutdown_connections 2024-02-18T16:21:19.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:19.946+0000 7fa738e86980 1 -- 172.21.15.129:0/1797043522 wait complete. 2024-02-18T16:21:19.966 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-18T16:21:19.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-18T16:21:19.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-18T16:21:19.967 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-18T16:21:20.048 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:20.048 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:20.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.038+0000 7f002bb82980 1 Processor -- start 2024-02-18T16:21:20.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.038+0000 7f002bb82980 1 -- start start 2024-02-18T16:21:20.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.038+0000 7f002bb82980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b4efe76ad0 0x55b4efe75080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.038+0000 7f002bb82980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b4efe4c460 con 0x55b4efe755c0 2024-02-18T16:21:20.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.038+0000 7f002bb82980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b4efe13180 con 0x55b4efe76ad0 2024-02-18T16:21:20.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.038+0000 7f002969d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b4efe76ad0 0x55b4efe75080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002969d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b4efe76ad0 0x55b4efe75080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47210/0 (socket says 172.21.15.129:47210) 2024-02-18T16:21:20.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002969d640 1 -- 172.21.15.129:0/321740031 learned_addr learned my addr 172.21.15.129:0/321740031 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f0028e9c640 1 --1- 172.21.15.129:0/321740031 >> v1:172.21.15.80:6789/0 conn(0x55b4efe755c0 0x55b4eff08150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42608/0 (socket says 172.21.15.129:42608) 2024-02-18T16:21:20.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002969d640 1 -- 172.21.15.129:0/321740031 >> v1:172.21.15.80:6789/0 conn(0x55b4efe755c0 legacy=0x55b4eff08150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002969d640 1 -- 172.21.15.129:0/321740031 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4efe759d0 con 0x55b4efe76ad0 2024-02-18T16:21:20.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002969d640 1 --2- 172.21.15.129:0/321740031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe76ad0 0x55b4efe75080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f002400a4e0 tx=0x7f002401b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f36ae33c0f4c1c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f001bfff640 1 -- 172.21.15.129:0/321740031 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240ab410 con 0x55b4efe76ad0 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f001bfff640 1 -- 172.21.15.129:0/321740031 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240ab570 con 0x55b4efe76ad0 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f001bfff640 1 -- 172.21.15.129:0/321740031 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240ab890 con 0x55b4efe76ad0 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002bb82980 1 -- 172.21.15.129:0/321740031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe76ad0 msgr2=0x55b4efe75080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002bb82980 1 --2- 172.21.15.129:0/321740031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe76ad0 0x55b4efe75080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f002400a4e0 tx=0x7f002401b030 comp rx=0 tx=0).stop 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002bb82980 1 -- 172.21.15.129:0/321740031 shutdown_connections 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.042+0000 7f002bb82980 1 --2- 172.21.15.129:0/321740031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe76ad0 0x55b4efe75080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.046+0000 7f002bb82980 1 -- 172.21.15.129:0/321740031 >> 172.21.15.129:0/321740031 conn(0x55b4efefba20 msgr2=0x55b4efefde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.046+0000 7f002bb82980 1 -- 172.21.15.129:0/321740031 shutdown_connections 2024-02-18T16:21:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.046+0000 7f002bb82980 1 -- 172.21.15.129:0/321740031 wait complete. 2024-02-18T16:21:20.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.058+0000 7f002bb82980 1 Processor -- start 2024-02-18T16:21:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.058+0000 7f002bb82980 1 -- start start 2024-02-18T16:21:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.058+0000 7f002bb82980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4effec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.058+0000 7f002bb82980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4efe106b0 con 0x55b4efe755c0 2024-02-18T16:21:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4effec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4effec8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47212/0 (socket says 172.21.15.129:47212) 2024-02-18T16:21:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 -- 172.21.15.129:0/972198374 learned_addr learned my addr 172.21.15.129:0/972198374 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 -- 172.21.15.129:0/972198374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002400a1c0 con 0x55b4efe755c0 2024-02-18T16:21:20.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 --2- 172.21.15.129:0/972198374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4effec8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f002400a4e0 tx=0x7f00240033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3449af54d277c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7eff17606640 1 -- 172.21.15.129:0/972198374 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240ab810 con 0x55b4efe755c0 2024-02-18T16:21:20.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7eff17606640 1 -- 172.21.15.129:0/972198374 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240ab970 con 0x55b4efe755c0 2024-02-18T16:21:20.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7eff17606640 1 -- 172.21.15.129:0/972198374 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240abc50 con 0x55b4efe755c0 2024-02-18T16:21:20.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- 172.21.15.129:0/972198374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 msgr2=0x55b4effec8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 --2- 172.21.15.129:0/972198374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4effec8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f002400a4e0 tx=0x7f00240033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- 172.21.15.129:0/972198374 shutdown_connections 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 --2- 172.21.15.129:0/972198374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4effec8b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- 172.21.15.129:0/972198374 >> 172.21.15.129:0/972198374 conn(0x55b4efefba20 msgr2=0x55b4effe8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- 172.21.15.129:0/972198374 shutdown_connections 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- 172.21.15.129:0/972198374 wait complete. 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 Processor -- start 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- start start 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4efff3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002bb82980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4efe0be90 con 0x55b4efe755c0 2024-02-18T16:21:20.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4efff3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4efff3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47218/0 (socket says 172.21.15.129:47218) 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 -- 172.21.15.129:0/2389176001 learned_addr learned my addr 172.21.15.129:0/2389176001 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.062+0000 7f002969d640 1 -- 172.21.15.129:0/2389176001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240af040 con 0x55b4efe755c0 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002969d640 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4efff3600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f002401b070 tx=0x7f0024017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff15e03640 1 -- 172.21.15.129:0/2389176001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240bf870 con 0x55b4efe755c0 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b4efff3b40 con 0x55b4efe755c0 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff15e03640 1 -- 172.21.15.129:0/2389176001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240bf9d0 con 0x55b4efe755c0 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff15e03640 1 -- 172.21.15.129:0/2389176001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240bfc70 con 0x55b4efe755c0 2024-02-18T16:21:20.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4efff3fd0 con 0x55b4efe755c0 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 Processor -- start 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- start start 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f00009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4efda4f20 con 0x55b4f00005c0 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff15e03640 1 -- 172.21.15.129:0/2389176001 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f00240c8410 con 0x55b4efe755c0 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f0029e9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f00009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f0029e9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f00009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47226/0 (socket says 172.21.15.129:47226) 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f0029e9e640 1 -- 172.21.15.129:0/1176006346 learned_addr learned my addr 172.21.15.129:0/1176006346 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff15e03640 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff100342b0 0x7eff10036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff15e03640 1 -- 172.21.15.129:0/2389176001 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f00240e3fb0 con 0x55b4efe755c0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002969d640 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff100342b0 0x7eff10036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f0029e9e640 1 -- 172.21.15.129:0/1176006346 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4f0000f20 con 0x55b4f00005c0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002969d640 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff100342b0 0x7eff10036770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00240bff90 tx=0x7f00240bfe20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f0029e9e640 1 --2- 172.21.15.129:0/1176006346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f00009e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f001c00a440 tx=0x7f001c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895c7027021eb8b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff0f7fe640 1 -- 172.21.15.129:0/1176006346 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f001c008850 con 0x55b4f00005c0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff0f7fe640 1 -- 172.21.15.129:0/1176006346 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c0089d0 con 0x55b4f00005c0 2024-02-18T16:21:20.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7eff0f7fe640 1 -- 172.21.15.129:0/1176006346 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f001c008cb0 con 0x55b4f00005c0 2024-02-18T16:21:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/1176006346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 msgr2=0x55b4f00009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 --2- 172.21.15.129:0/1176006346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f00009e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f001c00a440 tx=0x7f001c00a900 comp rx=0 tx=0).stop 2024-02-18T16:21:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/1176006346 shutdown_connections 2024-02-18T16:21:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 --2- 172.21.15.129:0/1176006346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f00009e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/1176006346 >> 172.21.15.129:0/1176006346 conn(0x55b4efe76ad0 msgr2=0x55b4efffba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/1176006346 shutdown_connections 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.066+0000 7f002bb82980 1 -- 172.21.15.129:0/1176006346 wait complete. 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 1 Processor -- start 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 1 -- start start 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f0007510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4efd98790 con 0x55b4f00005c0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f0029e9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f0007510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f0029e9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f0007510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47240/0 (socket says 172.21.15.129:47240) 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f0029e9e640 1 -- 172.21.15.129:0/846665225 learned_addr learned my addr 172.21.15.129:0/846665225 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f0029e9e640 1 -- 172.21.15.129:0/846665225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c005cd0 con 0x55b4f00005c0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f0029e9e640 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f0007510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55b4f00013a0 tx=0x7f001c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7eff0dffb640 1 -- 172.21.15.129:0/846665225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f001c013aa0 con 0x55b4f00005c0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7eff0dffb640 1 -- 172.21.15.129:0/846665225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c013c00 con 0x55b4f00005c0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7eff0dffb640 1 -- 172.21.15.129:0/846665225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f001c013ea0 con 0x55b4f00005c0 2024-02-18T16:21:20.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b4f0007a50 con 0x55b4f00005c0 2024-02-18T16:21:20.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4f0007e80 con 0x55b4f00005c0 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7f002bb82980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.070+0000 7eff0dffb640 1 -- 172.21.15.129:0/846665225 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f001c028460 con 0x55b4f00005c0 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 Processor -- start 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7eff0dffb640 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff000342b0 0x7eff00036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 -- start start 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7eff0dffb640 1 -- 172.21.15.129:0/846665225 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f001c0497e0 con 0x55b4f00005c0 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f0029e9e640 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff000342b0 0x7eff00036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 0x55b4f00216b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4f0021bf0 con 0x55b4f0021290 2024-02-18T16:21:20.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f0029e9e640 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff000342b0 0x7eff00036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f001c0058b0 tx=0x7f001c0287f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002969d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 0x55b4f00216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002969d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 0x55b4f00216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47256/0 (socket says 172.21.15.129:47256) 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002969d640 1 -- 172.21.15.129:0/3374560282 learned_addr learned my addr 172.21.15.129:0/3374560282 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002969d640 1 -- 172.21.15.129:0/3374560282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4f0021d30 con 0x55b4f0021290 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002969d640 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 0x55b4f00216b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00240e2310 tx=0x7f00240e2270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efeee7dc640 1 -- 172.21.15.129:0/3374560282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240c7b40 con 0x55b4f0021290 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b4f0022620 con 0x55b4f0021290 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efeee7dc640 1 -- 172.21.15.129:0/3374560282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240c7ca0 con 0x55b4f0021290 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efeee7dc640 1 -- 172.21.15.129:0/3374560282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240b36e0 con 0x55b4f0021290 2024-02-18T16:21:20.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4f0022ab0 con 0x55b4f0021290 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efeee7dc640 1 -- 172.21.15.129:0/3374560282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f00240b3840 con 0x55b4f0021290 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efeee7dc640 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe6c0342b0 0x7efe6c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efeee7dc640 1 -- 172.21.15.129:0/3374560282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f00240d30b0 con 0x55b4f0021290 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f0028e9c640 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe6c0342b0 0x7efe6c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7efe5ffff640 20 reqs_thread_entry: start 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b4f0026200 0x55b4f00285f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b4f0028b30 con 0x55b4f0026200 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.074+0000 7f0028e9c640 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe6c0342b0 0x7efe6c036770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55b4efffc670 tx=0x7f0020001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f0029e9e640 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b4f0026200 0x55b4f00285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f0029e9e640 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b4f0026200 0x55b4f00285f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f0029e9e640 1 -- 172.21.15.129:0/2389176001 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f001c024020 con 0x55b4f0026200 2024-02-18T16:21:20.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b4f0029ea0 con 0x55b4f0026200 2024-02-18T16:21:20.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f0029e9e640 1 -- 172.21.15.129:0/2389176001 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f001c024020 con 0x55b4f0026200 2024-02-18T16:21:20.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b4f002e8a0 con 0x55b4f0026200 2024-02-18T16:21:20.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f0029e9e640 1 -- 172.21.15.129:0/2389176001 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [stat,call,call,writefull 0~874] v30'2 uv2 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f001c024020 con 0x55b4f0026200 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff000342b0 msgr2=0x7eff00036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff000342b0 0x7eff00036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f001c0058b0 tx=0x7f001c0287f0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 msgr2=0x55b4f0007510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f0007510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55b4f00013a0 tx=0x7f001c003000 comp rx=0 tx=0).stop 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 shutdown_connections 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff000342b0 0x7eff00036770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 --2- 172.21.15.129:0/846665225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f00005c0 0x55b4f0007510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 >> 172.21.15.129:0/846665225 conn(0x55b4efe76ad0 msgr2=0x55b4efffa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 shutdown_connections 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.078+0000 7f002bb82980 1 -- 172.21.15.129:0/846665225 wait complete. 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe6c0342b0 msgr2=0x7efe6c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe6c0342b0 0x7efe6c036770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55b4efffc670 tx=0x7f0020001330 comp rx=0 tx=0).stop 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 msgr2=0x55b4f00216b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 0x55b4f00216b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00240e2310 tx=0x7f00240e2270 comp rx=0 tx=0).stop 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 shutdown_connections 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe6c0342b0 0x7efe6c036770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/3374560282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4f0021290 0x55b4f00216b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 >> 172.21.15.129:0/3374560282 conn(0x55b4f0015fb0 msgr2=0x55b4f00169d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 shutdown_connections 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/3374560282 wait complete. 2024-02-18T16:21:20.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b4f0026200 msgr2=0x55b4f00285f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b4f0026200 0x55b4f00285f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff100342b0 msgr2=0x7eff10036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff100342b0 0x7eff10036770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00240bff90 tx=0x7f00240bfe20 comp rx=0 tx=0).stop 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 msgr2=0x55b4efff3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4efff3600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f002401b070 tx=0x7f0024017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 shutdown_connections 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b4f0026200 0x55b4f00285f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7eff100342b0 0x7eff10036770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 --2- 172.21.15.129:0/2389176001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b4efe755c0 0x55b4efff3600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 >> 172.21.15.129:0/2389176001 conn(0x55b4efefba20 msgr2=0x55b4effe6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 shutdown_connections 2024-02-18T16:21:20.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.082+0000 7f002bb82980 1 -- 172.21.15.129:0/2389176001 wait complete. 2024-02-18T16:21:20.100 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-18T16:21:20.101 DEBUG:tasks.util.rgw: json result: {'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-18T16:21:20.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-18T16:21:20.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-18T16:21:20.102 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-18T16:21:20.174 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:20.174 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:20.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8bacaf980 1 Processor -- start 2024-02-18T16:21:20.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8bacaf980 1 -- start start 2024-02-18T16:21:20.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8bacaf980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56155e107540 0x56155e109930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8bacaf980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56155e0504b0 con 0x56155e103030 2024-02-18T16:21:20.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8bacaf980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x56155e017180 con 0x56155e107540 2024-02-18T16:21:20.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8b7fc9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56155e107540 0x56155e109930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8b87ca640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x56155e103030 0x56155e103410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42622/0 (socket says 172.21.15.129:42622) 2024-02-18T16:21:20.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1069456364 learned_addr learned my addr 172.21.15.129:0/1069456364 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:20.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8b7fc9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56155e107540 0x56155e109930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47268/0 (socket says 172.21.15.129:47268) 2024-02-18T16:21:20.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1069456364 >> v1:172.21.15.80:6789/0 conn(0x56155e103030 legacy=0x56155e103410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.166+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1069456364 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155e10ae80 con 0x56155e107540 2024-02-18T16:21:20.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1069456364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e109930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a420 tx=0x7fa8a801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99af1310035f1bcf server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8b77c8640 1 -- 172.21.15.129:0/1069456364 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80aa530 con 0x56155e107540 2024-02-18T16:21:20.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8b77c8640 1 -- 172.21.15.129:0/1069456364 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80a6050 con 0x56155e107540 2024-02-18T16:21:20.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8b77c8640 1 -- 172.21.15.129:0/1069456364 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80aa800 con 0x56155e107540 2024-02-18T16:21:20.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1069456364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 msgr2=0x56155e109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1069456364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e109930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a420 tx=0x7fa8a801afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1069456364 shutdown_connections 2024-02-18T16:21:20.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1069456364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e109930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1069456364 >> 172.21.15.129:0/1069456364 conn(0x56155e0fe900 msgr2=0x56155e100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1069456364 shutdown_connections 2024-02-18T16:21:20.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.170+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1069456364 wait complete. 2024-02-18T16:21:20.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 Processor -- start 2024-02-18T16:21:20.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- start start 2024-02-18T16:21:20.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 0x56155e1f0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155e0146b0 con 0x56155e103030 2024-02-18T16:21:20.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8b87ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 0x56155e1f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8b87ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 0x56155e1f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47282/0 (socket says 172.21.15.129:47282) 2024-02-18T16:21:20.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8b87ca640 1 -- 172.21.15.129:0/3588186515 learned_addr learned my addr 172.21.15.129:0/3588186515 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8b87ca640 1 -- 172.21.15.129:0/3588186515 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a800a100 con 0x56155e103030 2024-02-18T16:21:20.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8b87ca640 1 --2- 172.21.15.129:0/3588186515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 0x56155e1f0250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0001c00 tx=0x7fa8a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a0974515d67212 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa7a660c640 1 -- 172.21.15.129:0/3588186515 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a000e690 con 0x56155e103030 2024-02-18T16:21:20.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa7a660c640 1 -- 172.21.15.129:0/3588186515 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a000e810 con 0x56155e103030 2024-02-18T16:21:20.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa7a660c640 1 -- 172.21.15.129:0/3588186515 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a000eb30 con 0x56155e103030 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- 172.21.15.129:0/3588186515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 msgr2=0x56155e1f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/3588186515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 0x56155e1f0250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0001c00 tx=0x7fa8a000b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- 172.21.15.129:0/3588186515 shutdown_connections 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/3588186515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e103030 0x56155e1f0250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- 172.21.15.129:0/3588186515 >> 172.21.15.129:0/3588186515 conn(0x56155e0fe900 msgr2=0x56155e1e79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- 172.21.15.129:0/3588186515 shutdown_connections 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.186+0000 7fa8bacaf980 1 -- 172.21.15.129:0/3588186515 wait complete. 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 Processor -- start 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 -- start start 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e1f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155e00fe90 con 0x56155e107540 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b87ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e1f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b87ca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e1f73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47296/0 (socket says 172.21.15.129:47296) 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1985650430 learned_addr learned my addr 172.21.15.129:0/1985650430 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155e0504b0 con 0x56155e107540 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b87ca640 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e1f73b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0004000 tx=0x7fa8a0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa7a4e09640 1 -- 172.21.15.129:0/1985650430 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a001f070 con 0x56155e107540 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56155e1f78f0 con 0x56155e107540 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa7a4e09640 1 -- 172.21.15.129:0/1985650430 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0001410 con 0x56155e107540 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa7a4e09640 1 -- 172.21.15.129:0/1985650430 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a001aa30 con 0x56155e107540 2024-02-18T16:21:20.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56155e1f7d40 con 0x56155e107540 2024-02-18T16:21:20.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa7a4e09640 1 -- 172.21.15.129:0/1985650430 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa8a000a040 con 0x56155e107540 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa7a4e09640 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7a00342b0 0x7fa7a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa7a4e09640 1 -- 172.21.15.129:0/1985650430 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa8a0049d70 con 0x56155e107540 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7a00342b0 0x7fa7a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e1fbfb0 0x56155e1fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e1fe8e0 con 0x56155e1fbfb0 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e1fbfb0 0x56155e1fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.190+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7a00342b0 0x7fa7a0036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80ac000 tx=0x7fa8a80a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e1fbfb0 0x56155e1fe3a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1985650430 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8b00083f0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e1fecf0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1985650430 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8b00083f0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2005a0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1985650430 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa8b00083f0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e1ff6e0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1985650430 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8b00083f0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e1ffaf0 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1985650430 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa8b0012040 con 0x56155e1fbfb0 2024-02-18T16:21:20.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 Processor -- start 2024-02-18T16:21:20.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 -- start start 2024-02-18T16:21:20.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 0x56155e20f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8bacaf980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155dfa8f20 con 0x56155e20ec00 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b7fc9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 0x56155e20f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b7fc9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 0x56155e20f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47302/0 (socket says 172.21.15.129:47302) 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/2991926497 learned_addr learned my addr 172.21.15.129:0/2991926497 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/2991926497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155e20f560 con 0x56155e20ec00 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 0x56155e20f020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a420 tx=0x7fa8a8017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.194+0000 7fa79dffb640 1 -- 172.21.15.129:0/2991926497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80bb070 con 0x56155e20ec00 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56155e20f750 con 0x56155e20ec00 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa79dffb640 1 -- 172.21.15.129:0/2991926497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80b6ce0 con 0x56155e20ec00 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa79dffb640 1 -- 172.21.15.129:0/2991926497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80c0470 con 0x56155e20ec00 2024-02-18T16:21:20.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56155e210240 con 0x56155e20ec00 2024-02-18T16:21:20.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa79dffb640 1 -- 172.21.15.129:0/2991926497 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa8a80b4400 con 0x56155e20ec00 2024-02-18T16:21:20.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa79dffb640 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7900342b0 0x7fa790036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa79dffb640 1 -- 172.21.15.129:0/2991926497 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa8a80e5410 con 0x56155e20ec00 2024-02-18T16:21:20.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7900342b0 0x7fa790036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8bacaf980 1 Processor -- start 2024-02-18T16:21:20.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8bacaf980 1 -- start start 2024-02-18T16:21:20.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7900342b0 0x7fa790036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x56155e1ffa40 tx=0x7fa8b0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8bacaf980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 0x56155e21c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8bacaf980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155df9c790 con 0x56155e21bc50 2024-02-18T16:21:20.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b7fc9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 0x56155e21c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b7fc9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 0x56155e21c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47312/0 (socket says 172.21.15.129:47312) 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/4054916166 learned_addr learned my addr 172.21.15.129:0/4054916166 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/4054916166 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155e21c620 con 0x56155e21bc50 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/4054916166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 0x56155e21c050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80bef40 tx=0x7fa8a80b3af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3aae81e446be14 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa7977fe640 1 -- 172.21.15.129:0/4054916166 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80b46b0 con 0x56155e21bc50 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa7977fe640 1 -- 172.21.15.129:0/4054916166 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80b4a80 con 0x56155e21bc50 2024-02-18T16:21:20.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.198+0000 7fa7977fe640 1 -- 172.21.15.129:0/4054916166 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80b33a0 con 0x56155e21bc50 2024-02-18T16:21:20.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/4054916166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 msgr2=0x56155e21c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/4054916166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 0x56155e21c050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80bef40 tx=0x7fa8a80b3af0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/4054916166 shutdown_connections 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/4054916166 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e21bc50 0x56155e21c050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/4054916166 >> 172.21.15.129:0/4054916166 conn(0x56155e217f90 msgr2=0x56155e215ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/4054916166 shutdown_connections 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/4054916166 wait complete. 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 Processor -- start 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- start start 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 0x56155e223170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155e2236b0 con 0x56155e222d50 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8b7fc9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 0x56155e223170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8b7fc9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 0x56155e223170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47324/0 (socket says 172.21.15.129:47324) 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 learned_addr learned my addr 172.21.15.129:0/1659189460 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155e210240 con 0x56155e222d50 2024-02-18T16:21:20.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 0x56155e223170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80b3da0 tx=0x7fa8a80e3790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa795ffb640 1 -- 172.21.15.129:0/1659189460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80b4bf0 con 0x56155e222d50 2024-02-18T16:21:20.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa795ffb640 1 -- 172.21.15.129:0/1659189460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80be370 con 0x56155e222d50 2024-02-18T16:21:20.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56155e2238b0 con 0x56155e222d50 2024-02-18T16:21:20.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa795ffb640 1 -- 172.21.15.129:0/1659189460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a80e5770 con 0x56155e222d50 2024-02-18T16:21:20.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56155e226420 con 0x56155e222d50 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa795ffb640 1 -- 172.21.15.129:0/1659189460 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa8a80e58d0 con 0x56155e222d50 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.202+0000 7fa795ffb640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa788034260 0x7fa788036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa795ffb640 1 -- 172.21.15.129:0/1659189460 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa8a80f0ca0 con 0x56155e222d50 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa788034260 0x7fa788036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e22e710 0x56155e230bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e231300 con 0x56155e22e710 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e22e710 0x56155e230bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa788034260 0x7fa788036720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0008fd0 tx=0x7fa8b001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e22e710 0x56155e230bb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 realm 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2316d0 con 0x56155e22e710 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e231f20 con 0x56155e22e710 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e232280 con 0x56155e22e710 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e231bc0 con 0x56155e22e710 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 20 searching for the correct realm 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56155e2344d0 0x56155e2368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56155e2344d0 0x56155e2368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56155e2344d0 0x56155e2368e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b7fc9640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa8a80ef060 0x7fa8a80d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8a80ef060 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa8a80ef060 0x7fa8a80d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa8a80ef060 0x7fa8a80d0a20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.206+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b002c040 con 0x7fa8a80ef060 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b8fcb640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa8b0027940 0x7fa8b00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa8b0027940 0x7fa8b00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa8b0027940 0x7fa8b00333c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8a80ef060 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b002c040 con 0x7fa8a80ef060 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.210+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8a80ef060 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa8b002c040 con 0x7fa8a80ef060 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.214+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8a80ef060 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b002c040 con 0x7fa8a80ef060 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8a80ef060 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b002c040 con 0x7fa8a80ef060 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e2344d0 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.218+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8b0027940 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x56155e22e710 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e236fb0 con 0x7fa8a80ef060 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b002c040 con 0x7fa8a80ef060 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2330b0 con 0x56155e22e710 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e232d00 con 0x56155e22e710 2024-02-18T16:21:20.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e233990 con 0x56155e22e710 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 zone default found 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 4 Realm: () 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 zonegroup default 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2373f0 con 0x7fa8b0027940 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e239270 con 0x56155e2344d0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2395d0 con 0x56155e2344d0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 started sync module instance, tier type = 2024-02-18T16:21:20.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.222+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e238840 con 0x7fa8a80ef060 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94649773689840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e238840 con 0x7fa8a80ef060 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23a010 con 0x56155e22e710 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94649773689840] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94649773693680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e238840 con 0x56155e22e710 2024-02-18T16:21:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.226+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23a9d0 con 0x56155e2344d0 2024-02-18T16:21:20.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94649773693680] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94649773687712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2387c0 con 0x56155e2344d0 2024-02-18T16:21:20.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23b6c0 con 0x7fa8a80ef060 2024-02-18T16:21:20.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94649773699888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23bf10 con 0x7fa8a80ef060 2024-02-18T16:21:20.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23c910 con 0x56155e22e710 2024-02-18T16:21:20.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94649773687712] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.230+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94649773699888] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94649773704208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23ba70 con 0x56155e22e710 2024-02-18T16:21:20.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23d160 con 0x7fa8b0027940 2024-02-18T16:21:20.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94649773706000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23d3d0 con 0x7fa8b0027940 2024-02-18T16:21:20.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23dbd0 con 0x7fa8b0027940 2024-02-18T16:21:20.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94649773704208] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.234+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94649773706000] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94649773707056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23d7f0 con 0x7fa8b0027940 2024-02-18T16:21:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23dff0 con 0x7fa8b0027940 2024-02-18T16:21:20.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94649773707056] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94649773708592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23df30 con 0x7fa8b0027940 2024-02-18T16:21:20.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=0 2024-02-18T16:21:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=1 2024-02-18T16:21:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=2 2024-02-18T16:21:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=3 2024-02-18T16:21:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=4 2024-02-18T16:21:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=5 2024-02-18T16:21:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.238+0000 7fa8bacaf980 20 add_watcher() i=6 2024-02-18T16:21:20.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94649773708592] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 20 add_watcher() i=7 2024-02-18T16:21:20.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:20.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e241400 con 0x56155e22e710 2024-02-18T16:21:20.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94649773709776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e23e8b0 con 0x56155e22e710 2024-02-18T16:21:20.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94649773709776] v30'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa76e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 5 note: GC not initialized 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa76d7e2640 20 reqs_thread_entry: start 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 20 Filter name: none 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa6e6ffd640 20 reqs_thread_entry: start 2024-02-18T16:21:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2639d0 con 0x56155e22e710 2024-02-18T16:21:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e263d90 con 0x7fa8a80ef060 2024-02-18T16:21:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e263d90 con 0x56155e22e710 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.242+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e263d90 con 0x56155e2344d0 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e2640f0 con 0x56155e2344d0 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8a80ef060 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.246+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8a80ef060 2024-02-18T16:21:20.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.250+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa76e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94649773709776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94649773709776] v30'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.254+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94649773689840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8a80ef060 2024-02-18T16:21:20.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94649773689840] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8bacaf980 20 remove_watcher() i=0 2024-02-18T16:21:20.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8bacaf980 2 removed watcher, disabling cache 2024-02-18T16:21:20.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94649773693680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94649773693680] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8bacaf980 20 remove_watcher() i=1 2024-02-18T16:21:20.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.258+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94649773687712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e2344d0 2024-02-18T16:21:20.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.262+0000 7fa8b7fc9640 1 -- 172.21.15.129:0/1659189460 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94649773687712] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a80b1040 con 0x56155e2344d0 2024-02-18T16:21:20.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.262+0000 7fa8bacaf980 20 remove_watcher() i=2 2024-02-18T16:21:20.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.262+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94649773699888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8a80ef060 2024-02-18T16:21:20.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.262+0000 7fa8b8fcb640 1 -- 172.21.15.129:0/1659189460 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94649773699888] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b003f040 con 0x7fa8a80ef060 2024-02-18T16:21:20.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.262+0000 7fa8bacaf980 20 remove_watcher() i=3 2024-02-18T16:21:20.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.262+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94649773704208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x56155e22e710 2024-02-18T16:21:20.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.266+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94649773704208] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x56155e22e710 2024-02-18T16:21:20.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.266+0000 7fa8bacaf980 20 remove_watcher() i=4 2024-02-18T16:21:20.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.266+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94649773706000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.266+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94649773706000] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.266+0000 7fa8bacaf980 20 remove_watcher() i=5 2024-02-18T16:21:20.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.266+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94649773707056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94649773707056] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 20 remove_watcher() i=6 2024-02-18T16:21:20.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94649773708592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56155e264450 con 0x7fa8b0027940 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94649773708592] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a000dc70 con 0x7fa8b0027940 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 20 remove_watcher() i=7 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa8b0027940 msgr2=0x7fa8b00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa8b0027940 0x7fa8b00333c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e22e710 msgr2=0x56155e230bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e22e710 0x56155e230bb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa8a80ef060 msgr2=0x7fa8a80d0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa8a80ef060 0x7fa8a80d0a20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56155e2344d0 msgr2=0x56155e2368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56155e2344d0 0x56155e2368e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa788034260 msgr2=0x7fa788036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa788034260 0x7fa788036720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0008fd0 tx=0x7fa8b001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 msgr2=0x56155e223170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 0x56155e223170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80b3da0 tx=0x7fa8a80e3790 comp rx=0 tx=0).stop 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8b87ca640 1 -- 172.21.15.129:0/1659189460 reap_dead start 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 shutdown_connections 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1659189460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e222d50 0x56155e223170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 >> 172.21.15.129:0/1659189460 conn(0x56155e217f90 msgr2=0x56155e2155f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 shutdown_connections 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.270+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1659189460 wait complete. 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7900342b0 msgr2=0x7fa790036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7900342b0 0x7fa790036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x56155e1ffa40 tx=0x7fa8b0003070 comp rx=0 tx=0).stop 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 msgr2=0x56155e20f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 0x56155e20f020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a420 tx=0x7fa8a8017d70 comp rx=0 tx=0).stop 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 shutdown_connections 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7900342b0 0x7fa790036770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/2991926497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e20ec00 0x56155e20f020 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 >> 172.21.15.129:0/2991926497 conn(0x56155e203a10 msgr2=0x56155e204520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 shutdown_connections 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/2991926497 wait complete. 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e1fbfb0 msgr2=0x56155e1fe3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e1fbfb0 0x56155e1fe3a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7a00342b0 msgr2=0x7fa7a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7a00342b0 0x7fa7a0036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80ac000 tx=0x7fa8a80a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 msgr2=0x56155e1f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e1f73b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0004000 tx=0x7fa8a0000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 shutdown_connections 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56155e1fbfb0 0x56155e1fe3a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa7a00342b0 0x7fa7a0036770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 --2- 172.21.15.129:0/1985650430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56155e107540 0x56155e1f73b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 >> 172.21.15.129:0/1985650430 conn(0x56155e0fe900 msgr2=0x56155e1e64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 shutdown_connections 2024-02-18T16:21:20.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.274+0000 7fa8bacaf980 1 -- 172.21.15.129:0/1985650430 wait complete. 2024-02-18T16:21:20.293 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[],"summary":[]} 2024-02-18T16:21:20.293 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-18T16:21:20.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:20.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:20.293 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:20.374 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:20.374 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:20.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c27b13980 1 Processor -- start 2024-02-18T16:21:20.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c27b13980 1 -- start start 2024-02-18T16:21:20.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c27b13980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55863927f150 0x55863927d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c27b13980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5586392554c0 con 0x55863927dc40 2024-02-18T16:21:20.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c27b13980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55863921c180 con 0x55863927f150 2024-02-18T16:21:20.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c2562e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55863927f150 0x55863927d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c24e2d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55863927dc40 0x558639311170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42630/0 (socket says 172.21.15.129:42630) 2024-02-18T16:21:20.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1023447517 learned_addr learned my addr 172.21.15.129:0/1023447517 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:20.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c2562e640 1 -- 172.21.15.129:0/1023447517 >> v1:172.21.15.80:6789/0 conn(0x55863927dc40 legacy=0x558639311170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.366+0000 7f7c2562e640 1 -- 172.21.15.129:0/1023447517 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55863927e050 con 0x55863927f150 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c2562e640 1 --2- 172.21.15.129:0/1023447517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927f150 0x55863927d700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800a480 tx=0x7f7c1801b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8180f88a6eab4b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c17fff640 1 -- 172.21.15.129:0/1023447517 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c180aa400 con 0x55863927f150 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c17fff640 1 -- 172.21.15.129:0/1023447517 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180a6050 con 0x55863927f150 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c17fff640 1 -- 172.21.15.129:0/1023447517 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c180aa6b0 con 0x55863927f150 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 -- 172.21.15.129:0/1023447517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927f150 msgr2=0x55863927d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1023447517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927f150 0x55863927d700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800a480 tx=0x7f7c1801b220 comp rx=0 tx=0).stop 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 -- 172.21.15.129:0/1023447517 shutdown_connections 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1023447517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927f150 0x55863927d700 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 -- 172.21.15.129:0/1023447517 >> 172.21.15.129:0/1023447517 conn(0x558639304a40 msgr2=0x558639306e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 -- 172.21.15.129:0/1023447517 shutdown_connections 2024-02-18T16:21:20.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.370+0000 7f7c27b13980 1 -- 172.21.15.129:0/1023447517 wait complete. 2024-02-18T16:21:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c27b13980 1 Processor -- start 2024-02-18T16:21:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c27b13980 1 -- start start 2024-02-18T16:21:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c27b13980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c27b13980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586392196b0 con 0x55863927dc40 2024-02-18T16:21:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c2562e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c2562e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47344/0 (socket says 172.21.15.129:47344) 2024-02-18T16:21:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.386+0000 7f7c2562e640 1 -- 172.21.15.129:0/226409631 learned_addr learned my addr 172.21.15.129:0/226409631 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 -- 172.21.15.129:0/226409631 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18005d30 con 0x55863927dc40 2024-02-18T16:21:20.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 --2- 172.21.15.129:0/226409631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393f57e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c180ad040 tx=0x7f7c18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132ba014dd875a63 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7b13606640 1 -- 172.21.15.129:0/226409631 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c180aa6f0 con 0x55863927dc40 2024-02-18T16:21:20.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7b13606640 1 -- 172.21.15.129:0/226409631 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180aa850 con 0x55863927dc40 2024-02-18T16:21:20.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7b13606640 1 -- 172.21.15.129:0/226409631 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c180aaaf0 con 0x55863927dc40 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- 172.21.15.129:0/226409631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 msgr2=0x5586393f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 --2- 172.21.15.129:0/226409631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393f57e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c180ad040 tx=0x7f7c18003030 comp rx=0 tx=0).stop 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- 172.21.15.129:0/226409631 shutdown_connections 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 --2- 172.21.15.129:0/226409631 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393f57e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- 172.21.15.129:0/226409631 >> 172.21.15.129:0/226409631 conn(0x558639304a40 msgr2=0x5586393f1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- 172.21.15.129:0/226409631 shutdown_connections 2024-02-18T16:21:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- 172.21.15.129:0/226409631 wait complete. 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 Processor -- start 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- start start 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393fc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c27b13980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639214e90 con 0x55863927dc40 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393fc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47352/0 (socket says 172.21.15.129:47352) 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 -- 172.21.15.129:0/3535148188 learned_addr learned my addr 172.21.15.129:0/3535148188 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55863927e050 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.390+0000 7f7c2562e640 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393fc490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c18018eb0 tx=0x7f7c18018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7b11e03640 1 -- 172.21.15.129:0/3535148188 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c180b4b20 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7b11e03640 1 -- 172.21.15.129:0/3535148188 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180b4c80 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5586393fc9d0 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7b11e03640 1 -- 172.21.15.129:0/3535148188 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c180c6470 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586393fce80 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7b11e03640 1 -- 172.21.15.129:0/3535148188 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7c180c3070 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7b11e03640 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7b0c0342b0 0x7f7b0c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7b11e03640 1 -- 172.21.15.129:0/3535148188 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7c180e3fd0 con 0x55863927dc40 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7b0c0342b0 0x7f7b0c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55863927f150 0x5586394030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639403600 con 0x55863927f150 2024-02-18T16:21:20.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55863927f150 0x5586394030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7b0c0342b0 0x7f7b0c036770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0012f0 tx=0x7f7c1c006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55863927f150 0x5586394030c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c25e2f640 1 -- 172.21.15.129:0/3535148188 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7c200083f0 con 0x55863927f150 2024-02-18T16:21:20.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394007c0 con 0x55863927f150 2024-02-18T16:21:20.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c25e2f640 1 -- 172.21.15.129:0/3535148188 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7c200083f0 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639405300 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c25e2f640 1 -- 172.21.15.129:0/3535148188 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7c200083f0 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639404500 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c25e2f640 1 -- 172.21.15.129:0/3535148188 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7c200083f0 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.394+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639404910 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c25e2f640 1 -- 172.21.15.129:0/3535148188 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7c20012040 con 0x55863927f150 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c27b13980 1 Processor -- start 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c27b13980 1 -- start start 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c27b13980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 0x558639413da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c27b13980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586391adf20 con 0x558639413980 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c24e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 0x558639413da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c24e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 0x558639413da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47354/0 (socket says 172.21.15.129:47354) 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c24e2d640 1 -- 172.21.15.129:0/2720535513 learned_addr learned my addr 172.21.15.129:0/2720535513 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c24e2d640 1 -- 172.21.15.129:0/2720535513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586394142e0 con 0x558639413980 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 0x558639413da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c004f20 tx=0x7f7c1c006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7b0affd640 1 -- 172.21.15.129:0/2720535513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c01a070 con 0x558639413980 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7b0affd640 1 -- 172.21.15.129:0/2720535513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c011440 con 0x558639413980 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558639414530 con 0x558639413980 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7b0affd640 1 -- 172.21.15.129:0/2720535513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c011700 con 0x558639413980 2024-02-18T16:21:20.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558639415080 con 0x558639413980 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7b0affd640 1 -- 172.21.15.129:0/2720535513 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7c1c011860 con 0x558639413980 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7b0affd640 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7afc034300 0x7f7afc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7b0affd640 1 -- 172.21.15.129:0/2720535513 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7c1c04a9c0 con 0x558639413980 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.398+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7afc034300 0x7f7afc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 Processor -- start 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- start start 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7afc034300 0x7f7afc0367c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558639403f40 tx=0x7f7c20003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639420cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586391a1790 con 0x5586394208d0 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639420cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639420cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47366/0 (socket says 172.21.15.129:47366) 2024-02-18T16:21:20.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1183693034 learned_addr learned my addr 172.21.15.129:0/1183693034 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1183693034 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586394212c0 con 0x5586394208d0 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/1183693034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639420cf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c048de0 tx=0x7f7c1c0137b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c9a7bea523a381 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7b08ff9640 1 -- 172.21.15.129:0/1183693034 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c047070 con 0x5586394208d0 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7b08ff9640 1 -- 172.21.15.129:0/1183693034 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c01f4c0 con 0x5586394208d0 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7b08ff9640 1 -- 172.21.15.129:0/1183693034 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c01f7a0 con 0x5586394208d0 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- 172.21.15.129:0/1183693034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 msgr2=0x558639420cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1183693034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639420cf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c048de0 tx=0x7f7c1c0137b0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- 172.21.15.129:0/1183693034 shutdown_connections 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1183693034 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639420cf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- 172.21.15.129:0/1183693034 >> 172.21.15.129:0/1183693034 conn(0x55863941cc60 msgr2=0x55863941acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- 172.21.15.129:0/1183693034 shutdown_connections 2024-02-18T16:21:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- 172.21.15.129:0/1183693034 wait complete. 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 Processor -- start 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- start start 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639427840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c27b13980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639427d80 con 0x5586394208d0 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639427840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639427840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47368/0 (socket says 172.21.15.129:47368) 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.402+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 learned_addr learned my addr 172.21.15.129:0/1245499939 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558639415080 con 0x5586394208d0 2024-02-18T16:21:20.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639427840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c01f000 tx=0x7f7c1c048d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7afaffd640 1 -- 172.21.15.129:0/1245499939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c042310 con 0x5586394208d0 2024-02-18T16:21:20.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7afaffd640 1 -- 172.21.15.129:0/1245499939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c042470 con 0x5586394208d0 2024-02-18T16:21:20.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7afaffd640 1 -- 172.21.15.129:0/1245499939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c1c042710 con 0x5586394208d0 2024-02-18T16:21:20.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558639427f80 con 0x5586394208d0 2024-02-18T16:21:20.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586394283b0 con 0x5586394208d0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7afaffd640 1 -- 172.21.15.129:0/1245499939 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7c1c042870 con 0x5586394208d0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7afaffd640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7af00342b0 0x7f7af0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7afaffd640 1 -- 172.21.15.129:0/1245499939 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7c1c02e070 con 0x5586394208d0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7af00342b0 0x7f7af0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558639432e10 0x5586394352b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639435a00 con 0x558639432e10 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c2562e640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558639432e10 0x5586394352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7af00342b0 0x7f7af0036770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c20008fd0 tx=0x7f7c2001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c2562e640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558639432e10 0x5586394352b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 20 realm 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639435dd0 con 0x558639432e10 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.406+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639436620 con 0x558639432e10 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639436980 con 0x558639432e10 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394362c0 con 0x558639432e10 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 20 searching for the correct realm 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558639438bd0 0x55863943b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558639438bd0 0x55863943b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558639438bd0 0x55863943b020 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c24e2d640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7c1c014b50 0x7f7c1c0143f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c1c014b50 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7c1c014b50 0x7f7c1c0143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7c1c014b50 0x7f7c1c0143f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c2002c040 con 0x7f7c1c014b50 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c25e2f640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7c20027940 0x7f7c200333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.410+0000 7f7c2562e640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7c20027940 0x7f7c200333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7c20027940 0x7f7c200333c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c1c014b50 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c2002c040 con 0x7f7c1c014b50 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.414+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c1c014b50 2024-02-18T16:21:20.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7c2002c040 con 0x7f7c1c014b50 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.418+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c1c014b50 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c2002c040 con 0x7f7c1c014b50 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639432e10 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x7f7c20027940 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943b6f0 con 0x558639438bd0 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7c1c064040 con 0x7f7c20027940 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7c1c064040 con 0x7f7c1c014b50 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c2002c040 con 0x7f7c1c014b50 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7c1c064040 con 0x558639438bd0 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7c1c064040 con 0x7f7c20027940 2024-02-18T16:21:20.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7c1c064040 con 0x558639432e10 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.422+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7c1c064040 con 0x7f7c1c014b50 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7c2002c040 con 0x7f7c1c014b50 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394377f0 con 0x558639432e10 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639437470 con 0x558639432e10 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639438140 con 0x558639432e10 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 zone default found 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 4 Realm: () 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:20.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 zonegroup default 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943bfd0 con 0x7f7c20027940 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943d9b0 con 0x558639438bd0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943dd10 con 0x558639438bd0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 started sync module instance, tier type = 2024-02-18T16:21:20.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:20.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943cf80 con 0x7f7c1c014b50 2024-02-18T16:21:20.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c2003f040 con 0x7f7c1c014b50 2024-02-18T16:21:20.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94034974724912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943cf80 con 0x7f7c1c014b50 2024-02-18T16:21:20.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.426+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943e750 con 0x558639432e10 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.430+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94034974724912] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c2003f040 con 0x7f7c1c014b50 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.430+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.430+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94034974728784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943cf80 con 0x558639432e10 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.430+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943f110 con 0x558639438bd0 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.430+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94034974728784] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94034974722784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943cf00 con 0x558639438bd0 2024-02-18T16:21:20.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943fe40 con 0x7f7c1c014b50 2024-02-18T16:21:20.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c2003f040 con 0x7f7c1c014b50 2024-02-18T16:21:20.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94034974734688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55863943fd80 con 0x7f7c1c014b50 2024-02-18T16:21:20.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639440d40 con 0x558639432e10 2024-02-18T16:21:20.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94034974722784] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94034974734688] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c2003f040 con 0x7f7c1c014b50 2024-02-18T16:21:20.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94034974736880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639440d40 con 0x558639432e10 2024-02-18T16:21:20.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.434+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394409a0 con 0x7f7c20027940 2024-02-18T16:21:20.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94034974736880] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94034974733504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394411e0 con 0x7f7c20027940 2024-02-18T16:21:20.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639441b50 con 0x7f7c20027940 2024-02-18T16:21:20.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94034974742192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639441f70 con 0x7f7c20027940 2024-02-18T16:21:20.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.438+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639442a10 con 0x7f7c20027940 2024-02-18T16:21:20.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94034974733504] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94034974745840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394429d0 con 0x7f7c20027940 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=0 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=1 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=2 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=3 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=4 2024-02-18T16:21:20.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=5 2024-02-18T16:21:20.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94034974742192] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c27b13980 20 add_watcher() i=6 2024-02-18T16:21:20.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.442+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94034974745840] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 add_watcher() i=7 2024-02-18T16:21:20.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:20.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639441ad0 con 0x558639432e10 2024-02-18T16:21:20.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94034974739776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639441ad0 con 0x558639432e10 2024-02-18T16:21:20.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94034974739776] v30'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7adb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 5 note: GC not initialized 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7ada7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 Filter name: none 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7a4bfff640 20 reqs_thread_entry: start 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558639467430 con 0x558639432e10 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.457 INFO:teuthology.orchestra.run.smithi129.stderr:could not fetch user info: no user info saved 2024-02-18T16:21:20.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7adb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.446+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94034974739776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x558639432e10 2024-02-18T16:21:20.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.450+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94034974739776] v30'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.450+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94034974724912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x7f7c1c014b50 2024-02-18T16:21:20.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.450+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94034974724912] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c2003f040 con 0x7f7c1c014b50 2024-02-18T16:21:20.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.450+0000 7f7c27b13980 20 remove_watcher() i=0 2024-02-18T16:21:20.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.450+0000 7f7c27b13980 2 removed watcher, disabling cache 2024-02-18T16:21:20.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.450+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94034974728784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x558639432e10 2024-02-18T16:21:20.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94034974728784] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c27b13980 20 remove_watcher() i=1 2024-02-18T16:21:20.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94034974722784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x558639438bd0 2024-02-18T16:21:20.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c24e2d640 1 -- 172.21.15.129:0/1245499939 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94034974722784] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c1c041040 con 0x558639438bd0 2024-02-18T16:21:20.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c27b13980 20 remove_watcher() i=2 2024-02-18T16:21:20.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94034974734688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x7f7c1c014b50 2024-02-18T16:21:20.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c25e2f640 1 -- 172.21.15.129:0/1245499939 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94034974734688] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c2003f040 con 0x7f7c1c014b50 2024-02-18T16:21:20.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c27b13980 20 remove_watcher() i=3 2024-02-18T16:21:20.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.454+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94034974736880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x558639432e10 2024-02-18T16:21:20.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.458+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94034974736880] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x558639432e10 2024-02-18T16:21:20.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.458+0000 7f7c27b13980 20 remove_watcher() i=4 2024-02-18T16:21:20.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.458+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94034974733504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x7f7c20027940 2024-02-18T16:21:20.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.458+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94034974733504] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.458+0000 7f7c27b13980 20 remove_watcher() i=5 2024-02-18T16:21:20.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.458+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94034974742192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x7f7c20027940 2024-02-18T16:21:20.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94034974742192] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 20 remove_watcher() i=6 2024-02-18T16:21:20.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94034974745840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5586394673f0 con 0x7f7c20027940 2024-02-18T16:21:20.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94034974745840] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7c180c2030 con 0x7f7c20027940 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 20 remove_watcher() i=7 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7c20027940 msgr2=0x7f7c200333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7c20027940 0x7f7c200333c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558639432e10 msgr2=0x5586394352b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558639432e10 0x5586394352b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7c1c014b50 msgr2=0x7f7c1c0143f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7c1c014b50 0x7f7c1c0143f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558639438bd0 msgr2=0x55863943b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.462+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558639438bd0 0x55863943b020 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7af00342b0 msgr2=0x7f7af0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7af00342b0 0x7f7af0036770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c20008fd0 tx=0x7f7c2001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 msgr2=0x558639427840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c2562e640 1 -- 172.21.15.129:0/1245499939 reap_dead start 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639427840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c01f000 tx=0x7f7c1c048d40 comp rx=0 tx=0).stop 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 shutdown_connections 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/1245499939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5586394208d0 0x558639427840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 >> 172.21.15.129:0/1245499939 conn(0x55863941cc60 msgr2=0x55863941a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 shutdown_connections 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/1245499939 wait complete. 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7afc034300 msgr2=0x7f7afc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7afc034300 0x7f7afc0367c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558639403f40 tx=0x7f7c20003070 comp rx=0 tx=0).stop 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 msgr2=0x558639413da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 0x558639413da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c004f20 tx=0x7f7c1c006500 comp rx=0 tx=0).stop 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 shutdown_connections 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7afc034300 0x7f7afc0367c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/2720535513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558639413980 0x558639413da0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 >> 172.21.15.129:0/2720535513 conn(0x558639408790 msgr2=0x5586394092a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 shutdown_connections 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/2720535513 wait complete. 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55863927f150 msgr2=0x5586394030c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55863927f150 0x5586394030c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7b0c0342b0 msgr2=0x7f7b0c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7b0c0342b0 0x7f7b0c036770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0012f0 tx=0x7f7c1c006700 comp rx=0 tx=0).stop 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 msgr2=0x5586393fc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393fc490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c18018eb0 tx=0x7f7c18018020 comp rx=0 tx=0).stop 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 shutdown_connections 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55863927f150 0x5586394030c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7b0c0342b0 0x7f7b0c036770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 --2- 172.21.15.129:0/3535148188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55863927dc40 0x5586393fc490 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 >> 172.21.15.129:0/3535148188 conn(0x558639304a40 msgr2=0x5586393efe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 shutdown_connections 2024-02-18T16:21:20.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.466+0000 7f7c27b13980 1 -- 172.21.15.129:0/3535148188 wait complete. 2024-02-18T16:21:20.485 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-18T16:21:20.486 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-18T16:21:20.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-18T16:21:20.486 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-02-18T16:21:20.571 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:20.571 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 Processor -- start 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- start start 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560c4a4dd5e0 0x560c4a4df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560c4a425460 con 0x560c4a4d90d0 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x560c4a3ec180 con 0x560c4a4dd5e0 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84be047640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560c4a4dd5e0 0x560c4a4df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84be848640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x560c4a4d90d0 0x560c4a4d94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42636/0 (socket says 172.21.15.129:42636) 2024-02-18T16:21:20.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84be848640 1 -- 172.21.15.129:0/356997306 learned_addr learned my addr 172.21.15.129:0/356997306 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:20.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84be047640 1 -- 172.21.15.129:0/356997306 >> v1:172.21.15.80:6789/0 conn(0x560c4a4d90d0 legacy=0x560c4a4d94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84be047640 1 -- 172.21.15.129:0/356997306 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c4a4e0f20 con 0x560c4a4dd5e0 2024-02-18T16:21:20.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84be047640 1 --2- 172.21.15.129:0/356997306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4dd5e0 0x560c4a4df9d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84a800a480 tx=0x7f84a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929d22a9ca2b6513 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84bd846640 1 -- 172.21.15.129:0/356997306 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80ab540 con 0x560c4a4dd5e0 2024-02-18T16:21:20.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84bd846640 1 -- 172.21.15.129:0/356997306 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80ab6a0 con 0x560c4a4dd5e0 2024-02-18T16:21:20.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84bd846640 1 -- 172.21.15.129:0/356997306 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80ab960 con 0x560c4a4dd5e0 2024-02-18T16:21:20.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- 172.21.15.129:0/356997306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4dd5e0 msgr2=0x560c4a4df9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/356997306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4dd5e0 0x560c4a4df9d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84a800a480 tx=0x7f84a801b280 comp rx=0 tx=0).stop 2024-02-18T16:21:20.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- 172.21.15.129:0/356997306 shutdown_connections 2024-02-18T16:21:20.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/356997306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4dd5e0 0x560c4a4df9d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- 172.21.15.129:0/356997306 >> 172.21.15.129:0/356997306 conn(0x560c4a4d49a0 msgr2=0x560c4a4d6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- 172.21.15.129:0/356997306 shutdown_connections 2024-02-18T16:21:20.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.566+0000 7f84c0d2d980 1 -- 172.21.15.129:0/356997306 wait complete. 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84c0d2d980 1 Processor -- start 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84c0d2d980 1 -- start start 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84c0d2d980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84c0d2d980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c4a3e96b0 con 0x560c4a4d90d0 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84be848640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84be848640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47394/0 (socket says 172.21.15.129:47394) 2024-02-18T16:21:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84be848640 1 -- 172.21.15.129:0/190715953 learned_addr learned my addr 172.21.15.129:0/190715953 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84be848640 1 -- 172.21.15.129:0/190715953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8005d30 con 0x560c4a4d90d0 2024-02-18T16:21:20.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.582+0000 7f84be848640 1 --2- 172.21.15.129:0/190715953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c30d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84b0001c00 tx=0x7f84b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7e400be1467070 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f83ace09640 1 -- 172.21.15.129:0/190715953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b000e690 con 0x560c4a4d90d0 2024-02-18T16:21:20.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f83ace09640 1 -- 172.21.15.129:0/190715953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000e810 con 0x560c4a4d90d0 2024-02-18T16:21:20.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f83ace09640 1 -- 172.21.15.129:0/190715953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b000eb30 con 0x560c4a4d90d0 2024-02-18T16:21:20.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/190715953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 msgr2=0x560c4a5c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/190715953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c30d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f84b0001c00 tx=0x7f84b000b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/190715953 shutdown_connections 2024-02-18T16:21:20.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/190715953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c30d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/190715953 >> 172.21.15.129:0/190715953 conn(0x560c4a4d49a0 msgr2=0x560c4a5bec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/190715953 shutdown_connections 2024-02-18T16:21:20.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/190715953 wait complete. 2024-02-18T16:21:20.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 Processor -- start 2024-02-18T16:21:20.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- start start 2024-02-18T16:21:20.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c4a3e4e90 con 0x560c4a4d90d0 2024-02-18T16:21:20.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84be848640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84be848640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47402/0 (socket says 172.21.15.129:47402) 2024-02-18T16:21:20.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84be848640 1 -- 172.21.15.129:0/770286262 learned_addr learned my addr 172.21.15.129:0/770286262 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84be848640 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c4a425460 con 0x560c4a4d90d0 2024-02-18T16:21:20.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84be848640 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c9f60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f84b000b710 tx=0x7f84b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f83ab606640 1 -- 172.21.15.129:0/770286262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b001f070 con 0x560c4a4d90d0 2024-02-18T16:21:20.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f83ab606640 1 -- 172.21.15.129:0/770286262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b001a910 con 0x560c4a4d90d0 2024-02-18T16:21:20.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c4a5ca4a0 con 0x560c4a4d90d0 2024-02-18T16:21:20.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f83ab606640 1 -- 172.21.15.129:0/770286262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84b001abf0 con 0x560c4a4d90d0 2024-02-18T16:21:20.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.586+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c4a5ca950 con 0x560c4a4d90d0 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f83ab606640 1 -- 172.21.15.129:0/770286262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f84b000a040 con 0x560c4a4d90d0 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f83ab606640 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83a4034300 0x7f83a40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f83ab606640 1 -- 172.21.15.129:0/770286262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f84b004a010 con 0x560c4a4d90d0 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84be047640 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83a4034300 0x7f83a40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a4dd5e0 0x560c4a5d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a5d1130 con 0x560c4a4dd5e0 2024-02-18T16:21:20.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a4dd5e0 0x560c4a5d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84be047640 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83a4034300 0x7f83a40367c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ad000 tx=0x7f84a80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a4dd5e0 0x560c4a5d0bf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 -- 172.21.15.129:0/770286262 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84b800a4d0 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a5ce300 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 -- 172.21.15.129:0/770286262 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f84b800a4d0 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a5d2e30 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 -- 172.21.15.129:0/770286262 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f84b800a4d0 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a5d2030 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 -- 172.21.15.129:0/770286262 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f84b800a4d0 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a5d2440 con 0x560c4a4dd5e0 2024-02-18T16:21:20.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84bf049640 1 -- 172.21.15.129:0/770286262 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f84b800a4d0 con 0x560c4a4dd5e0 2024-02-18T16:21:20.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 Processor -- start 2024-02-18T16:21:20.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- start start 2024-02-18T16:21:20.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 0x560c4a5e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.590+0000 7f84c0d2d980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c4a37df20 con 0x560c4a5e14d0 2024-02-18T16:21:20.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84be047640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 0x560c4a5e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84be047640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 0x560c4a5e18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47408/0 (socket says 172.21.15.129:47408) 2024-02-18T16:21:20.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84be047640 1 -- 172.21.15.129:0/1625112360 learned_addr learned my addr 172.21.15.129:0/1625112360 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84be047640 1 -- 172.21.15.129:0/1625112360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c4a5e1e30 con 0x560c4a5e14d0 2024-02-18T16:21:20.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84be047640 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 0x560c4a5e18f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000c10 tx=0x7f84a8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f83a8e01640 1 -- 172.21.15.129:0/1625112360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80bf410 con 0x560c4a5e14d0 2024-02-18T16:21:20.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c4a5e2020 con 0x560c4a5e14d0 2024-02-18T16:21:20.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f83a8e01640 1 -- 172.21.15.129:0/1625112360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80bf570 con 0x560c4a5e14d0 2024-02-18T16:21:20.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f83a8e01640 1 -- 172.21.15.129:0/1625112360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80bf850 con 0x560c4a5e14d0 2024-02-18T16:21:20.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c4a5e2b70 con 0x560c4a5e14d0 2024-02-18T16:21:20.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f83a8e01640 1 -- 172.21.15.129:0/1625112360 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f84a80bfa00 con 0x560c4a5e14d0 2024-02-18T16:21:20.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f83a8e01640 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83980342b0 0x7f8398036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f83a8e01640 1 -- 172.21.15.129:0/1625112360 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f84a80e5fe0 con 0x560c4a5e14d0 2024-02-18T16:21:20.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84bf049640 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83980342b0 0x7f8398036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84c0d2d980 1 Processor -- start 2024-02-18T16:21:20.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84c0d2d980 1 -- start start 2024-02-18T16:21:20.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84bf049640 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83980342b0 0x7f8398036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560c4a5d1a70 tx=0x7f84b8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84c0d2d980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a44f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.594+0000 7f84c0d2d980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c4a371790 con 0x560c4a44f560 2024-02-18T16:21:20.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a44f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a44f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47422/0 (socket says 172.21.15.129:47422) 2024-02-18T16:21:20.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 -- 172.21.15.129:0/3870745482 learned_addr learned my addr 172.21.15.129:0/3870745482 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 -- 172.21.15.129:0/3870745482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c4a44ddb0 con 0x560c4a44f560 2024-02-18T16:21:20.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 --2- 172.21.15.129:0/3870745482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a44f980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84a8005730 tx=0x7f84a8006390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc68da1a9e1facc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f83a27fc640 1 -- 172.21.15.129:0/3870745482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80c6860 con 0x560c4a44f560 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f83a27fc640 1 -- 172.21.15.129:0/3870745482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a8006990 con 0x560c4a44f560 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f83a27fc640 1 -- 172.21.15.129:0/3870745482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a8006c70 con 0x560c4a44f560 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- 172.21.15.129:0/3870745482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 msgr2=0x560c4a44f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/3870745482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a44f980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84a8005730 tx=0x7f84a8006390 comp rx=0 tx=0).stop 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- 172.21.15.129:0/3870745482 shutdown_connections 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/3870745482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a44f980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- 172.21.15.129:0/3870745482 >> 172.21.15.129:0/3870745482 conn(0x560c4a5ea840 msgr2=0x560c4a5e88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- 172.21.15.129:0/3870745482 shutdown_connections 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- 172.21.15.129:0/3870745482 wait complete. 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 Processor -- start 2024-02-18T16:21:20.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- start start 2024-02-18T16:21:20.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a5f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84c0d2d980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c4a5f7b10 con 0x560c4a44f560 2024-02-18T16:21:20.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a5f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a5f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47430/0 (socket says 172.21.15.129:47430) 2024-02-18T16:21:20.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 learned_addr learned my addr 172.21.15.129:0/2087126551 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.598+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c4a5e2b70 con 0x560c4a44f560 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84be047640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a5f75d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f84a80e3270 tx=0x7f84a80e42e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f83a0ff9640 1 -- 172.21.15.129:0/2087126551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80ed070 con 0x560c4a44f560 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f83a0ff9640 1 -- 172.21.15.129:0/2087126551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80e1040 con 0x560c4a44f560 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f83a0ff9640 1 -- 172.21.15.129:0/2087126551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84a80beda0 con 0x560c4a44f560 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c4a5f7d10 con 0x560c4a44f560 2024-02-18T16:21:20.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c4a5f8140 con 0x560c4a44f560 2024-02-18T16:21:20.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f83a0ff9640 1 -- 172.21.15.129:0/2087126551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f84a80e46f0 con 0x560c4a44f560 2024-02-18T16:21:20.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f83a0ff9640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83880342b0 0x7f8388036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f83a0ff9640 1 -- 172.21.15.129:0/2087126551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f84a80d41d0 con 0x560c4a44f560 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84bf049640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83880342b0 0x7f8388036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a602b50 0x560c4a605010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a605760 con 0x560c4a602b50 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84be848640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a602b50 0x560c4a605010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84bf049640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83880342b0 0x7f8388036770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f84b8011010 tx=0x7f84b8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84be848640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a602b50 0x560c4a605010 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 realm 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a605b80 con 0x560c4a602b50 2024-02-18T16:21:20.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6063d0 con 0x560c4a602b50 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.602+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a606730 con 0x560c4a602b50 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a606f30 con 0x560c4a602b50 2024-02-18T16:21:20.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:20.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 20 searching for the correct realm 2024-02-18T16:21:20.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560c4a608e80 0x560c4a60b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be047640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560c4a608e80 0x560c4a60b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be047640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560c4a608e80 0x560c4a60b290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be047640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f84a80c8070 0x7f84a80f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84a80c8070 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84bf049640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f84a80c8070 0x7f84a80f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84bf049640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f84a80c8070 0x7f84a80f2410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b800a4d0 con 0x7f84a80c8070 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84bf049640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f84b80141d0 0x7f84b8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be848640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f84b80141d0 0x7f84b8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be848640 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f84b80141d0 0x7f84b8015940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.606+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84a80c8070 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b800a4d0 con 0x7f84a80c8070 2024-02-18T16:21:20.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84a80c8070 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.610+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84a80c8070 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.614+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84a80c8070 2024-02-18T16:21:20.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a608e80 2024-02-18T16:21:20.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84b80141d0 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x560c4a602b50 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60b910 con 0x7f84a80c8070 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6078f0 con 0x560c4a602b50 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.618+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a608140 con 0x560c4a602b50 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60bd50 con 0x560c4a602b50 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 zone default found 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 4 Realm: () 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:20.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 zonegroup default 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60bd50 con 0x7f84b80141d0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60db10 con 0x560c4a608e80 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60de70 con 0x560c4a608e80 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 started sync module instance, tier type = 2024-02-18T16:21:20.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:20.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60d3f0 con 0x7f84a80c8070 2024-02-18T16:21:20.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94610787454800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60d7a0 con 0x7f84a80c8070 2024-02-18T16:21:20.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.622+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60ebd0 con 0x560c4a602b50 2024-02-18T16:21:20.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.626+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94610787454800] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.626+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.626+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94610787459728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60eb50 con 0x560c4a602b50 2024-02-18T16:21:20.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.626+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60f600 con 0x560c4a608e80 2024-02-18T16:21:20.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.626+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94610787459728] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94610787460784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60ead0 con 0x560c4a608e80 2024-02-18T16:21:20.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a610320 con 0x7f84a80c8070 2024-02-18T16:21:20.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94610787467184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a610b70 con 0x7f84a80c8070 2024-02-18T16:21:20.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611550 con 0x560c4a602b50 2024-02-18T16:21:20.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94610787460784] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94610787467184] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94610787465696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6106d0 con 0x560c4a602b50 2024-02-18T16:21:20.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.630+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611dd0 con 0x7f84b80141d0 2024-02-18T16:21:20.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94610787465696] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94610787471472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6106d0 con 0x7f84b80141d0 2024-02-18T16:21:20.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6122d0 con 0x7f84b80141d0 2024-02-18T16:21:20.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94610787474864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a612730 con 0x7f84b80141d0 2024-02-18T16:21:20.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.634+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a613120 con 0x7f84b80141d0 2024-02-18T16:21:20.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94610787471472] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94610787474864] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94610787478528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a612290 con 0x7f84b80141d0 2024-02-18T16:21:20.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=0 2024-02-18T16:21:20.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=1 2024-02-18T16:21:20.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=2 2024-02-18T16:21:20.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=3 2024-02-18T16:21:20.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=4 2024-02-18T16:21:20.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=5 2024-02-18T16:21:20.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=6 2024-02-18T16:21:20.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94610787478528] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 20 add_watcher() i=7 2024-02-18T16:21:20.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:20.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a616220 con 0x560c4a602b50 2024-02-18T16:21:20.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.638+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94610787473184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a613690 con 0x560c4a602b50 2024-02-18T16:21:20.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94610787473184] v30'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f83757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:20.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:20.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 5 note: GC not initialized 2024-02-18T16:21:20.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f82effff640 20 reqs_thread_entry: start 2024-02-18T16:21:20.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:20.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 Filter name: none 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f82edffb640 20 reqs_thread_entry: start 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a637f80 con 0x560c4a602b50 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a636750 con 0x560c4a602b50 2024-02-18T16:21:20.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a636750 con 0x7f84b80141d0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-18T16:21:20.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.642+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a636c40 con 0x560c4a602b50 2024-02-18T16:21:20.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~357] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84c0d2d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84c0d2d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84c0d2d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94610787629536 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a63b380 con 0x560c4a602b50 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== watch-notify(notify (1) cookie 94610787465696 notify 128849018880 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x560c4a5ca950 con 0x560c4a602b50 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f83a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94610787465696 notifier 4287 bl.length()=533 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f83a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f83a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(66 notify.4 [notify cookie 94610787629536 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f83a27fc640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8384003ea0 con 0x560c4a602b50 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== watch-notify(notify_complete (2) cookie 94610787629536 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560c4a5ca4a0 con 0x560c4a602b50 2024-02-18T16:21:20.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.646+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6379e0 con 0x560c4a602b50 2024-02-18T16:21:20.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-18T16:21:20.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-18T16:21:20.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-18T16:21:20.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94610787629536 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a63b4e0 con 0x7f84a80c8070 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== watch-notify(notify (1) cookie 94610787467184 notify 128849018880 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x7f84b8026b50 con 0x7f84a80c8070 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(69 notify.3 [notify cookie 94610787629536 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94610787467184 notifier 4287 bl.length()=169 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f82f4003400 con 0x7f84a80c8070 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== watch-notify(notify_complete (2) cookie 94610787629536 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f84b8026db0 con 0x7f84a80c8070 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6394c0 con 0x7f84b80141d0 2024-02-18T16:21:20.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-18T16:21:20.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-18T16:21:20.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-18T16:21:20.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94610787627040 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a63b820 con 0x7f84a80c8070 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== watch-notify(notify (1) cookie 94610787467184 notify 128849018881 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f84b8026db0 con 0x7f84a80c8070 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94610787467184 notifier 4287 bl.length()=177 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 notify.3 [notify cookie 94610787627040 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.650+0000 7f83a1ffb640 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f82f4003430 con 0x7f84a80c8070 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== watch-notify(notify_complete (2) cookie 94610787627040 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f84b8030620 con 0x7f84a80c8070 2024-02-18T16:21:20.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.663 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:20.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f83757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94610787473184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a6187f0 con 0x560c4a602b50 2024-02-18T16:21:20.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94610787473184] v30'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94610787454800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611720 con 0x7f84a80c8070 2024-02-18T16:21:20.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94610787454800] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84c0d2d980 20 remove_watcher() i=0 2024-02-18T16:21:20.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84c0d2d980 2 removed watcher, disabling cache 2024-02-18T16:21:20.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.654+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94610787459728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611720 con 0x560c4a602b50 2024-02-18T16:21:20.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.658+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94610787459728] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.658+0000 7f84c0d2d980 20 remove_watcher() i=1 2024-02-18T16:21:20.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.658+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94610787460784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60e290 con 0x560c4a608e80 2024-02-18T16:21:20.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.658+0000 7f84be047640 1 -- 172.21.15.129:0/2087126551 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94610787460784] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84a80b2040 con 0x560c4a608e80 2024-02-18T16:21:20.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.658+0000 7f84c0d2d980 20 remove_watcher() i=2 2024-02-18T16:21:20.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.658+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94610787467184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611720 con 0x7f84a80c8070 2024-02-18T16:21:20.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.662+0000 7f84bf049640 1 -- 172.21.15.129:0/2087126551 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94610787467184] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b803a040 con 0x7f84a80c8070 2024-02-18T16:21:20.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.662+0000 7f84c0d2d980 20 remove_watcher() i=3 2024-02-18T16:21:20.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.662+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94610787465696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611720 con 0x560c4a602b50 2024-02-18T16:21:20.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.662+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94610787465696] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x560c4a602b50 2024-02-18T16:21:20.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.662+0000 7f84c0d2d980 20 remove_watcher() i=4 2024-02-18T16:21:20.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.662+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94610787471472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611720 con 0x7f84b80141d0 2024-02-18T16:21:20.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.666+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94610787471472] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.666+0000 7f84c0d2d980 20 remove_watcher() i=5 2024-02-18T16:21:20.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.666+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94610787474864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a611070 con 0x7f84b80141d0 2024-02-18T16:21:20.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.666+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94610787474864] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.666+0000 7f84c0d2d980 20 remove_watcher() i=6 2024-02-18T16:21:20.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.666+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94610787478528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c4a60cf50 con 0x7f84b80141d0 2024-02-18T16:21:20.681 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94610787478528] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f84b0024cd0 con 0x7f84b80141d0 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 20 remove_watcher() i=7 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f84b80141d0 msgr2=0x7f84b8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f84b80141d0 0x7f84b8015940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a602b50 msgr2=0x560c4a605010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a602b50 0x560c4a605010 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f84a80c8070 msgr2=0x7f84a80f2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f84a80c8070 0x7f84a80f2410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560c4a608e80 msgr2=0x560c4a60b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560c4a608e80 0x560c4a60b290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83880342b0 msgr2=0x7f8388036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83880342b0 0x7f8388036770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f84b8011010 tx=0x7f84b8020000 comp rx=0 tx=0).stop 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 msgr2=0x560c4a5f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84be848640 1 -- 172.21.15.129:0/2087126551 reap_dead start 2024-02-18T16:21:20.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a5f75d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f84a80e3270 tx=0x7f84a80e42e0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 shutdown_connections 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/2087126551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a44f560 0x560c4a5f75d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 >> 172.21.15.129:0/2087126551 conn(0x560c4a5ea840 msgr2=0x560c4a5e7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 shutdown_connections 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/2087126551 wait complete. 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83980342b0 msgr2=0x7f8398036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83980342b0 0x7f8398036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560c4a5d1a70 tx=0x7f84b8005850 comp rx=0 tx=0).stop 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 msgr2=0x560c4a5e18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 0x560c4a5e18f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000c10 tx=0x7f84a8018020 comp rx=0 tx=0).stop 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 shutdown_connections 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83980342b0 0x7f8398036770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/1625112360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a5e14d0 0x560c4a5e18f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 >> 172.21.15.129:0/1625112360 conn(0x560c4a5d62e0 msgr2=0x560c4a5d6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 shutdown_connections 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/1625112360 wait complete. 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a4dd5e0 msgr2=0x560c4a5d0bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a4dd5e0 0x560c4a5d0bf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83a4034300 msgr2=0x7f83a40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83a4034300 0x7f83a40367c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ad000 tx=0x7f84a80a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 msgr2=0x560c4a5c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c9f60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f84b000b710 tx=0x7f84b0000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 shutdown_connections 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560c4a4dd5e0 0x560c4a5d0bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f83a4034300 0x7f83a40367c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 --2- 172.21.15.129:0/770286262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560c4a4d90d0 0x560c4a5c9f60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 >> 172.21.15.129:0/770286262 conn(0x560c4a4d49a0 msgr2=0x560c4a5bd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 shutdown_connections 2024-02-18T16:21:20.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.670+0000 7f84c0d2d980 1 -- 172.21.15.129:0/770286262 wait complete. 2024-02-18T16:21:20.692 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:20.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-18T16:21:20.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-18T16:21:20.692 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-02-18T16:21:20.771 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:20.771 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:20.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689f910980 1 Processor -- start 2024-02-18T16:21:20.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689f910980 1 -- start start 2024-02-18T16:21:20.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689f910980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x559fca480020 0x559fca480430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689f910980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559fca453460 con 0x559fca47db20 2024-02-18T16:21:20.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689f910980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x559fca41a180 con 0x559fca480020 2024-02-18T16:21:20.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689cc2a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x559fca480020 0x559fca480430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689d42b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x559fca47db20 0x559fca47df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42638/0 (socket says 172.21.15.129:42638) 2024-02-18T16:21:20.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689d42b640 1 -- 172.21.15.129:0/1489654723 learned_addr learned my addr 172.21.15.129:0/1489654723 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:20.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689cc2a640 1 -- 172.21.15.129:0/1489654723 >> v1:172.21.15.80:6789/0 conn(0x559fca47db20 legacy=0x559fca47df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.762+0000 7f689cc2a640 1 -- 172.21.15.129:0/1489654723 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fca481980 con 0x559fca480020 2024-02-18T16:21:20.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689cc2a640 1 --2- 172.21.15.129:0/1489654723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca480020 0x559fca480430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f689400a480 tx=0x7f689401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0a6fd5b041f913 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f688ffff640 1 -- 172.21.15.129:0/1489654723 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940ab540 con 0x559fca480020 2024-02-18T16:21:20.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f688ffff640 1 -- 172.21.15.129:0/1489654723 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940ab6a0 con 0x559fca480020 2024-02-18T16:21:20.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f688ffff640 1 -- 172.21.15.129:0/1489654723 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940ab960 con 0x559fca480020 2024-02-18T16:21:20.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 -- 172.21.15.129:0/1489654723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca480020 msgr2=0x559fca480430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 --2- 172.21.15.129:0/1489654723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca480020 0x559fca480430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f689400a480 tx=0x7f689401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:20.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 -- 172.21.15.129:0/1489654723 shutdown_connections 2024-02-18T16:21:20.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 --2- 172.21.15.129:0/1489654723 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca480020 0x559fca480430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 -- 172.21.15.129:0/1489654723 >> 172.21.15.129:0/1489654723 conn(0x559fca47c9e0 msgr2=0x559fca47cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 -- 172.21.15.129:0/1489654723 shutdown_connections 2024-02-18T16:21:20.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.766+0000 7f689f910980 1 -- 172.21.15.129:0/1489654723 wait complete. 2024-02-18T16:21:20.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689f910980 1 Processor -- start 2024-02-18T16:21:20.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689f910980 1 -- start start 2024-02-18T16:21:20.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689f910980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5f7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689f910980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fca4176b0 con 0x559fca47db20 2024-02-18T16:21:20.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689d42b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689d42b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5f7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47440/0 (socket says 172.21.15.129:47440) 2024-02-18T16:21:20.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689d42b640 1 -- 172.21.15.129:0/2954324943 learned_addr learned my addr 172.21.15.129:0/2954324943 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689d42b640 1 -- 172.21.15.129:0/2954324943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894005d30 con 0x559fca47db20 2024-02-18T16:21:20.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f689d42b640 1 --2- 172.21.15.129:0/2954324943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5f7670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6898006fb0 tx=0x7f6898001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a54817afab113de server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f678b606640 1 -- 172.21.15.129:0/2954324943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898004530 con 0x559fca47db20 2024-02-18T16:21:20.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f678b606640 1 -- 172.21.15.129:0/2954324943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898004690 con 0x559fca47db20 2024-02-18T16:21:20.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.782+0000 7f678b606640 1 -- 172.21.15.129:0/2954324943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68980049b0 con 0x559fca47db20 2024-02-18T16:21:20.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/2954324943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 msgr2=0x559fca5f7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 --2- 172.21.15.129:0/2954324943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5f7670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6898006fb0 tx=0x7f6898001940 comp rx=0 tx=0).stop 2024-02-18T16:21:20.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/2954324943 shutdown_connections 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 --2- 172.21.15.129:0/2954324943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5f7670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/2954324943 >> 172.21.15.129:0/2954324943 conn(0x559fca47c9e0 msgr2=0x559fca5f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/2954324943 shutdown_connections 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/2954324943 wait complete. 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 Processor -- start 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- start start 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fca412e90 con 0x559fca47db20 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689d42b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689d42b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47450/0 (socket says 172.21.15.129:47450) 2024-02-18T16:21:20.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689d42b640 1 -- 172.21.15.129:0/1864627737 learned_addr learned my addr 172.21.15.129:0/1864627737 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689d42b640 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fca453460 con 0x559fca47db20 2024-02-18T16:21:20.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689d42b640 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5fe5e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x559fca5f8500 tx=0x7f6898000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f6789e03640 1 -- 172.21.15.129:0/1864627737 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898013760 con 0x559fca47db20 2024-02-18T16:21:20.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fca5feb20 con 0x559fca47db20 2024-02-18T16:21:20.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fca5fef50 con 0x559fca47db20 2024-02-18T16:21:20.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f6789e03640 1 -- 172.21.15.129:0/1864627737 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980138c0 con 0x559fca47db20 2024-02-18T16:21:20.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.786+0000 7f6789e03640 1 -- 172.21.15.129:0/1864627737 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6898013b60 con 0x559fca47db20 2024-02-18T16:21:20.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f6789e03640 1 -- 172.21.15.129:0/1864627737 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6898013cc0 con 0x559fca47db20 2024-02-18T16:21:20.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f6789e03640 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6784034300 0x7f67840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f6789e03640 1 -- 172.21.15.129:0/1864627737 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f68980495a0 con 0x559fca47db20 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689cc2a640 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6784034300 0x7f67840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca480020 0x559fca6051c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca605700 con 0x559fca480020 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca480020 0x559fca6051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689cc2a640 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6784034300 0x7f67840367c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f68940ad000 tx=0x7f68940a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca480020 0x559fca6051c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 -- 172.21.15.129:0/1864627737 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f68900083f0 con 0x559fca480020 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca605a60 con 0x559fca480020 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 -- 172.21.15.129:0/1864627737 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f68900083f0 con 0x559fca480020 2024-02-18T16:21:20.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca6072f0 con 0x559fca480020 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 -- 172.21.15.129:0/1864627737 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f68900083f0 con 0x559fca480020 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca606430 con 0x559fca480020 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 -- 172.21.15.129:0/1864627737 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f68900083f0 con 0x559fca480020 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca606840 con 0x559fca480020 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689dc2c640 1 -- 172.21.15.129:0/1864627737 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6890012040 con 0x559fca480020 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 Processor -- start 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- start start 2024-02-18T16:21:20.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 0x559fca615db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689f910980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fca3abf20 con 0x559fca615990 2024-02-18T16:21:20.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689cc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 0x559fca615db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689cc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 0x559fca615db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47454/0 (socket says 172.21.15.129:47454) 2024-02-18T16:21:20.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.790+0000 7f689cc2a640 1 -- 172.21.15.129:0/1027506576 learned_addr learned my addr 172.21.15.129:0/1027506576 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689cc2a640 1 -- 172.21.15.129:0/1027506576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fca6162f0 con 0x559fca615990 2024-02-18T16:21:20.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689cc2a640 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 0x559fca615db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6894096e80 tx=0x7f6894018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f6782ffd640 1 -- 172.21.15.129:0/1027506576 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940bd8a0 con 0x559fca615990 2024-02-18T16:21:20.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fca6164e0 con 0x559fca615990 2024-02-18T16:21:20.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f6782ffd640 1 -- 172.21.15.129:0/1027506576 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940bda00 con 0x559fca615990 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fca617030 con 0x559fca615990 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f6782ffd640 1 -- 172.21.15.129:0/1027506576 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940bdca0 con 0x559fca615990 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f6782ffd640 1 -- 172.21.15.129:0/1027506576 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f68940be480 con 0x559fca615990 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f6782ffd640 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67740342b0 0x7f6774036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f6782ffd640 1 -- 172.21.15.129:0/1027506576 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f68940e66c0 con 0x559fca615990 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689dc2c640 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67740342b0 0x7f6774036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689f910980 1 Processor -- start 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689dc2c640 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67740342b0 0x7f6774036770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x559fca605e70 tx=0x7f6890003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689f910980 1 -- start start 2024-02-18T16:21:20.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689f910980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca622d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689f910980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fca39f790 con 0x559fca622970 2024-02-18T16:21:20.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689cc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca622d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689cc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca622d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47460/0 (socket says 172.21.15.129:47460) 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.794+0000 7f689cc2a640 1 -- 172.21.15.129:0/3565660533 learned_addr learned my addr 172.21.15.129:0/3565660533 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 -- 172.21.15.129:0/3565660533 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fca623360 con 0x559fca622970 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 --2- 172.21.15.129:0/3565660533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca622d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f68940b5fb0 tx=0x7f68940be7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df49b124c0f69939 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f6780ff9640 1 -- 172.21.15.129:0/3565660533 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940d0dd0 con 0x559fca622970 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f6780ff9640 1 -- 172.21.15.129:0/3565660533 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940c7b00 con 0x559fca622970 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f6780ff9640 1 -- 172.21.15.129:0/3565660533 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940c7da0 con 0x559fca622970 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3565660533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 msgr2=0x559fca622d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 --2- 172.21.15.129:0/3565660533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca622d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f68940b5fb0 tx=0x7f68940be7f0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3565660533 shutdown_connections 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 --2- 172.21.15.129:0/3565660533 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca622d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3565660533 >> 172.21.15.129:0/3565660533 conn(0x559fca61ed00 msgr2=0x559fca61cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3565660533 shutdown_connections 2024-02-18T16:21:20.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3565660533 wait complete. 2024-02-18T16:21:20.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 Processor -- start 2024-02-18T16:21:20.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- start start 2024-02-18T16:21:20.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca629880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fca629dc0 con 0x559fca622970 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca629880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca629880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47476/0 (socket says 172.21.15.129:47476) 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 learned_addr learned my addr 172.21.15.129:0/3454792122 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fca617030 con 0x559fca622970 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689cc2a640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca629880 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68940bdfd0 tx=0x7f68940bef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f6772ffd640 1 -- 172.21.15.129:0/3454792122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940df040 con 0x559fca622970 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fca629fc0 con 0x559fca622970 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fca62a3f0 con 0x559fca622970 2024-02-18T16:21:20.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f6772ffd640 1 -- 172.21.15.129:0/3454792122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940bc360 con 0x559fca622970 2024-02-18T16:21:20.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.798+0000 7f6772ffd640 1 -- 172.21.15.129:0/3454792122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68940e6d60 con 0x559fca622970 2024-02-18T16:21:20.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f6772ffd640 1 -- 172.21.15.129:0/3454792122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f68940e32d0 con 0x559fca622970 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f6772ffd640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67680342b0 0x7f6768036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f6772ffd640 1 -- 172.21.15.129:0/3454792122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f68940f0c60 con 0x559fca622970 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689dc2c640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67680342b0 0x7f6768036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca634e30 0x559fca6372f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca637a40 con 0x559fca634e30 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca634e30 0x559fca6372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689dc2c640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67680342b0 0x7f6768036770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6890008fd0 tx=0x7f689001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca634e30 0x559fca6372f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 realm 2024-02-18T16:21:20.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca637e10 con 0x559fca634e30 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca638690 con 0x559fca634e30 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca6389f0 con 0x559fca634e30 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca6391f0 con 0x559fca634e30 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 20 searching for the correct realm 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x559fca63b080 0x559fca63d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689cc2a640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x559fca63b080 0x559fca63d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.802+0000 7f689cc2a640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x559fca63b080 0x559fca63d540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689cc2a640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f68940ef020 0x7f68940d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f68940ef020 2024-02-18T16:21:20.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689dc2c640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f68940ef020 0x7f68940d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689dc2c640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f68940ef020 0x7f68940d03a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689002c040 con 0x7f68940ef020 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689dc2c640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6890027940 0x7f68900333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6890027940 0x7f68900333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6890027940 0x7f68900333c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.806+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f68940ef020 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689002c040 con 0x7f68940ef020 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f68940ef020 2024-02-18T16:21:20.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f689002c040 con 0x7f68940ef020 2024-02-18T16:21:20.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.810+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f68940ef020 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689002c040 con 0x7f68940ef020 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.814+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f68940ef020 2024-02-18T16:21:20.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689002c040 con 0x7f68940ef020 2024-02-18T16:21:20.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca63b080 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f6890027940 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x559fca634e30 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63dc10 con 0x7f68940ef020 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f689002c040 con 0x7f68940ef020 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:20.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca639b20 con 0x559fca634e30 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63a370 con 0x559fca634e30 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63e050 con 0x559fca634e30 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 zone default found 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 4 Realm: () 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:20.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 zonegroup default 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.818+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63e0c0 con 0x7f6890027940 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63fea0 con 0x559fca63b080 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca6402b0 con 0x559fca63b080 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 started sync module instance, tier type = 2024-02-18T16:21:20.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:20.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63f780 con 0x7f68940ef020 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689003f040 con 0x7f68940ef020 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94144783708896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63fb30 con 0x7f68940ef020 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca641010 con 0x559fca634e30 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.822+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94144783708896] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689003f040 con 0x7f68940ef020 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94144783714000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca640f90 con 0x559fca634e30 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca641a20 con 0x559fca63b080 2024-02-18T16:21:20.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94144783714000] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94144783715056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca640f10 con 0x559fca63b080 2024-02-18T16:21:20.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.826+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca642710 con 0x7f68940ef020 2024-02-18T16:21:20.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689003f040 con 0x7f68940ef020 2024-02-18T16:21:20.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94144783721376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca642f60 con 0x7f68940ef020 2024-02-18T16:21:20.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca643980 con 0x559fca634e30 2024-02-18T16:21:20.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94144783715056] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94144783721376] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689003f040 con 0x7f68940ef020 2024-02-18T16:21:20.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94144783725664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca642ac0 con 0x559fca634e30 2024-02-18T16:21:20.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.830+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca6441d0 con 0x7f6890027940 2024-02-18T16:21:20.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94144783725664] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94144783719888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca642ac0 con 0x7f6890027940 2024-02-18T16:21:20.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca6446a0 con 0x7f6890027940 2024-02-18T16:21:20.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94144783719888] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94144783729056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca644660 con 0x7f6890027940 2024-02-18T16:21:20.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.834+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca644fd0 con 0x7f6890027940 2024-02-18T16:21:20.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94144783729056] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94144783727376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca644fd0 con 0x7f6890027940 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=0 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=1 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=2 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=3 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=4 2024-02-18T16:21:20.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=5 2024-02-18T16:21:20.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=6 2024-02-18T16:21:20.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94144783727376] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 20 add_watcher() i=7 2024-02-18T16:21:20.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:20.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca648420 con 0x559fca634e30 2024-02-18T16:21:20.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.838+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94144783731968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca645930 con 0x559fca634e30 2024-02-18T16:21:20.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94144783731968] v30'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f67537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 5 note: GC not initialized 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f67527e4640 20 reqs_thread_entry: start 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 Filter name: none 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f66c3fff640 20 reqs_thread_entry: start 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca66a360 con 0x7f6890027940 2024-02-18T16:21:20.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:20.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-18T16:21:20.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca66a360 con 0x559fca634e30 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rados_obj.operate() r=0 bl.length=7 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rados->read ofs=0 len=0 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca668c10 con 0x559fca634e30 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 foo [call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+405 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-02-18T16:21:20.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:20.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.842+0000 7f689f910980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-02-18T16:21:20.856 INFO:teuthology.orchestra.run.smithi129.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-02-18T16:21:20.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f67537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:20.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94144783731968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca669820 con 0x559fca634e30 2024-02-18T16:21:20.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94144783731968] v30'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94144783708896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca669380 con 0x7f68940ef020 2024-02-18T16:21:20.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94144783708896] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689003f040 con 0x7f68940ef020 2024-02-18T16:21:20.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689f910980 20 remove_watcher() i=0 2024-02-18T16:21:20.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689f910980 2 removed watcher, disabling cache 2024-02-18T16:21:20.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.846+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94144783714000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63f2e0 con 0x559fca634e30 2024-02-18T16:21:20.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.850+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94144783714000] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.850+0000 7f689f910980 20 remove_watcher() i=1 2024-02-18T16:21:20.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.850+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94144783715056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca668cb0 con 0x559fca63b080 2024-02-18T16:21:20.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.850+0000 7f689cc2a640 1 -- 172.21.15.129:0/3454792122 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94144783715056] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f68940ec070 con 0x559fca63b080 2024-02-18T16:21:20.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.850+0000 7f689f910980 20 remove_watcher() i=2 2024-02-18T16:21:20.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.850+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94144783721376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63f2e0 con 0x7f68940ef020 2024-02-18T16:21:20.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.854+0000 7f689dc2c640 1 -- 172.21.15.129:0/3454792122 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94144783721376] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f689003f040 con 0x7f68940ef020 2024-02-18T16:21:20.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.854+0000 7f689f910980 20 remove_watcher() i=3 2024-02-18T16:21:20.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.854+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94144783725664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63f2e0 con 0x559fca634e30 2024-02-18T16:21:20.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.854+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94144783725664] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x559fca634e30 2024-02-18T16:21:20.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.854+0000 7f689f910980 20 remove_watcher() i=4 2024-02-18T16:21:20.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.854+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94144783719888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca63f2e0 con 0x7f6890027940 2024-02-18T16:21:20.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.858+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94144783719888] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.858+0000 7f689f910980 20 remove_watcher() i=5 2024-02-18T16:21:20.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.858+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94144783729056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca641dd0 con 0x7f6890027940 2024-02-18T16:21:20.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.858+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94144783729056] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.858+0000 7f689f910980 20 remove_watcher() i=6 2024-02-18T16:21:20.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.858+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94144783727376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fca641dd0 con 0x7f6890027940 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94144783727376] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6898024020 con 0x7f6890027940 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 20 remove_watcher() i=7 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6890027940 msgr2=0x7f68900333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6890027940 0x7f68900333c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca634e30 msgr2=0x559fca6372f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca634e30 0x559fca6372f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f68940ef020 msgr2=0x7f68940d03a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f68940ef020 0x7f68940d03a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x559fca63b080 msgr2=0x559fca63d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x559fca63b080 0x559fca63d540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67680342b0 msgr2=0x7f6768036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67680342b0 0x7f6768036770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6890008fd0 tx=0x7f689001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689d42b640 1 -- 172.21.15.129:0/3454792122 reap_dead start 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 msgr2=0x559fca629880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca629880 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68940bdfd0 tx=0x7f68940bef50 comp rx=0 tx=0).stop 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 shutdown_connections 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/3454792122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca622970 0x559fca629880 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 >> 172.21.15.129:0/3454792122 conn(0x559fca61ed00 msgr2=0x559fca61c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 shutdown_connections 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/3454792122 wait complete. 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67740342b0 msgr2=0x7f6774036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67740342b0 0x7f6774036770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x559fca605e70 tx=0x7f6890003070 comp rx=0 tx=0).stop 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 msgr2=0x559fca615db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 0x559fca615db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6894096e80 tx=0x7f6894018020 comp rx=0 tx=0).stop 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 shutdown_connections 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f67740342b0 0x7f6774036770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1027506576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca615990 0x559fca615db0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 >> 172.21.15.129:0/1027506576 conn(0x559fca60a7a0 msgr2=0x559fca60b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 shutdown_connections 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1027506576 wait complete. 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca480020 msgr2=0x559fca6051c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca480020 0x559fca6051c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6784034300 msgr2=0x7f67840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6784034300 0x7f67840367c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f68940ad000 tx=0x7f68940a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 msgr2=0x559fca5fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5fe5e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x559fca5f8500 tx=0x7f6898000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 shutdown_connections 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x559fca480020 0x559fca6051c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6784034300 0x7f67840367c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 --2- 172.21.15.129:0/1864627737 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x559fca47db20 0x559fca5fe5e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 >> 172.21.15.129:0/1864627737 conn(0x559fca47c9e0 msgr2=0x559fca5f1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 shutdown_connections 2024-02-18T16:21:20.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.862+0000 7f689f910980 1 -- 172.21.15.129:0/1864627737 wait complete. 2024-02-18T16:21:20.883 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-02-18T16:21:20.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:20.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:20.884 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:20.958 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:20.958 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:20.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 Processor -- start 2024-02-18T16:21:20.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- start start 2024-02-18T16:21:20.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x562594b6b520 0x562594b6d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562594ab34c0 con 0x562594adb080 2024-02-18T16:21:20.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x562594a7a180 con 0x562594b6b520 2024-02-18T16:21:20.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61689a0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x562594b6b520 0x562594b6d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61689a0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x562594b6b520 0x562594b6d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47480/0 (socket says 172.21.15.129:47480) 2024-02-18T16:21:20.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61691a1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x562594adb080 0x562594b69e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42642/0 (socket says 172.21.15.129:42642) 2024-02-18T16:21:20.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61689a0640 1 -- 172.21.15.129:0/2464740149 learned_addr learned my addr 172.21.15.129:0/2464740149 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61689a0640 1 -- 172.21.15.129:0/2464740149 >> v1:172.21.15.80:6789/0 conn(0x562594adb080 legacy=0x562594b69e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61689a0640 1 -- 172.21.15.129:0/2464740149 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562594b6eef0 con 0x562594b6b520 2024-02-18T16:21:20.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f61689a0640 1 --2- 172.21.15.129:0/2464740149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594b6b520 0x562594b6d910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f615400a5c0 tx=0x7f615401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f068fb113a480 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f6163fff640 1 -- 172.21.15.129:0/2464740149 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540aa470 con 0x562594b6b520 2024-02-18T16:21:20.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f6163fff640 1 -- 172.21.15.129:0/2464740149 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540aa5d0 con 0x562594b6b520 2024-02-18T16:21:20.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f6163fff640 1 -- 172.21.15.129:0/2464740149 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540aa890 con 0x562594b6b520 2024-02-18T16:21:20.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- 172.21.15.129:0/2464740149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594b6b520 msgr2=0x562594b6d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 --2- 172.21.15.129:0/2464740149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594b6b520 0x562594b6d910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f615400a5c0 tx=0x7f615401b340 comp rx=0 tx=0).stop 2024-02-18T16:21:20.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- 172.21.15.129:0/2464740149 shutdown_connections 2024-02-18T16:21:20.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 --2- 172.21.15.129:0/2464740149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594b6b520 0x562594b6d910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- 172.21.15.129:0/2464740149 >> 172.21.15.129:0/2464740149 conn(0x562594b618e0 msgr2=0x562594b63d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- 172.21.15.129:0/2464740149 shutdown_connections 2024-02-18T16:21:20.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.954+0000 7f616b686980 1 -- 172.21.15.129:0/2464740149 wait complete. 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f616b686980 1 Processor -- start 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f616b686980 1 -- start start 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f616b686980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594c510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f616b686980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562594a776b0 con 0x562594adb080 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f61691a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594c510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f61691a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594c510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47488/0 (socket says 172.21.15.129:47488) 2024-02-18T16:21:20.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f61691a1640 1 -- 172.21.15.129:0/3852405214 learned_addr learned my addr 172.21.15.129:0/3852405214 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f61691a1640 1 -- 172.21.15.129:0/3852405214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154005df0 con 0x562594adb080 2024-02-18T16:21:20.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f61691a1640 1 --2- 172.21.15.129:0/3852405214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594c510b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fb0 tx=0x7f615c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a242a77d0317438 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f6057606640 1 -- 172.21.15.129:0/3852405214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f615c013420 con 0x562594adb080 2024-02-18T16:21:20.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f6057606640 1 -- 172.21.15.129:0/3852405214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c013580 con 0x562594adb080 2024-02-18T16:21:20.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.970+0000 7f6057606640 1 -- 172.21.15.129:0/3852405214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f615c013860 con 0x562594adb080 2024-02-18T16:21:20.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/3852405214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 msgr2=0x562594c510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 --2- 172.21.15.129:0/3852405214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594c510b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fb0 tx=0x7f615c001940 comp rx=0 tx=0).stop 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/3852405214 shutdown_connections 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 --2- 172.21.15.129:0/3852405214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594c510b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/3852405214 >> 172.21.15.129:0/3852405214 conn(0x562594b618e0 msgr2=0x562594c4cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/3852405214 shutdown_connections 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/3852405214 wait complete. 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 Processor -- start 2024-02-18T16:21:20.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- start start 2024-02-18T16:21:20.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594b67560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562594a72e90 con 0x562594adb080 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f61691a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594b67560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f61691a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594b67560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47504/0 (socket says 172.21.15.129:47504) 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f61691a1640 1 -- 172.21.15.129:0/2713362806 learned_addr learned my addr 172.21.15.129:0/2713362806 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f61691a1640 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562594ab34c0 con 0x562594adb080 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f61691a1640 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594b67560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x562594c51f40 tx=0x7f615c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f6055e03640 1 -- 172.21.15.129:0/2713362806 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f615c0037a0 con 0x562594adb080 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f6055e03640 1 -- 172.21.15.129:0/2713362806 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c003900 con 0x562594adb080 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562594b67aa0 con 0x562594adb080 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f6055e03640 1 -- 172.21.15.129:0/2713362806 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f615c003ba0 con 0x562594adb080 2024-02-18T16:21:20.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.974+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562594b65f40 con 0x562594adb080 2024-02-18T16:21:20.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f6055e03640 1 -- 172.21.15.129:0/2713362806 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f615c028460 con 0x562594adb080 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f6055e03640 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60500342b0 0x7f6050036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f6055e03640 1 -- 172.21.15.129:0/2713362806 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f615c049550 con 0x562594adb080 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61689a0640 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60500342b0 0x7f6050036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594b6b520 0x562594c5aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c5af60 con 0x562594b6b520 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594b6b520 0x562594c5aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61689a0640 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60500342b0 0x7f6050036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61540ae000 tx=0x7f61540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594b6b520 0x562594c5aa20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 -- 172.21.15.129:0/2713362806 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61640083f0 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c5b2f0 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 -- 172.21.15.129:0/2713362806 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61640083f0 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c5bb40 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 -- 172.21.15.129:0/2713362806 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f61640083f0 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c5b700 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 -- 172.21.15.129:0/2713362806 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61640083f0 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c67c80 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61699a2640 1 -- 172.21.15.129:0/2713362806 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6164012040 con 0x562594b6b520 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 Processor -- start 2024-02-18T16:21:20.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- start start 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 0x562594c75e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f616b686980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562594a0bf20 con 0x562594c75a40 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.978+0000 7f61689a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 0x562594c75e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 0x562594c75e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47518/0 (socket says 172.21.15.129:47518) 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 -- 172.21.15.129:0/3610295669 learned_addr learned my addr 172.21.15.129:0/3610295669 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 -- 172.21.15.129:0/3610295669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562594c763a0 con 0x562594c75a40 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 0x562594c75e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61540ac040 tx=0x7f61540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f604effd640 1 -- 172.21.15.129:0/3610295669 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540b3cd0 con 0x562594c75a40 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562594c76590 con 0x562594c75a40 2024-02-18T16:21:20.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f604effd640 1 -- 172.21.15.129:0/3610295669 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540c3070 con 0x562594c75a40 2024-02-18T16:21:20.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f604effd640 1 -- 172.21.15.129:0/3610295669 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540c8430 con 0x562594c75a40 2024-02-18T16:21:20.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562594c77080 con 0x562594c75a40 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f604effd640 1 -- 172.21.15.129:0/3610295669 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61540c5030 con 0x562594c75a40 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f604effd640 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60400342b0 0x7f6040036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f604effd640 1 -- 172.21.15.129:0/3610295669 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f61540e6900 con 0x562594c75a40 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61699a2640 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60400342b0 0x7f6040036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f616b686980 1 Processor -- start 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f616b686980 1 -- start start 2024-02-18T16:21:20.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61699a2640 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60400342b0 0x7f6040036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562594c5bb10 tx=0x7f6164003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f616b686980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c82e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f616b686980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625949ff790 con 0x562594c82a40 2024-02-18T16:21:20.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c82e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c82e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47528/0 (socket says 172.21.15.129:47528) 2024-02-18T16:21:20.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.982+0000 7f61689a0640 1 -- 172.21.15.129:0/2467964355 learned_addr learned my addr 172.21.15.129:0/2467964355 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 -- 172.21.15.129:0/2467964355 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562594c83430 con 0x562594c82a40 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 --2- 172.21.15.129:0/2467964355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c82e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61540e4d20 tx=0x7f61540c7ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d40951f20faa9ad server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f604cff9640 1 -- 172.21.15.129:0/2467964355 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540bc3b0 con 0x562594c82a40 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f604cff9640 1 -- 172.21.15.129:0/2467964355 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154006390 con 0x562594c82a40 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f604cff9640 1 -- 172.21.15.129:0/2467964355 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540c76c0 con 0x562594c82a40 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/2467964355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 msgr2=0x562594c82e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 --2- 172.21.15.129:0/2467964355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c82e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61540e4d20 tx=0x7f61540c7ef0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/2467964355 shutdown_connections 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 --2- 172.21.15.129:0/2467964355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c82e60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/2467964355 >> 172.21.15.129:0/2467964355 conn(0x562594c7edd0 msgr2=0x562594c7ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:20.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/2467964355 shutdown_connections 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/2467964355 wait complete. 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 Processor -- start 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- start start 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c89970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562594c89eb0 con 0x562594c82a40 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c89970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c89970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47540/0 (socket says 172.21.15.129:47540) 2024-02-18T16:21:20.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 learned_addr learned my addr 172.21.15.129:0/722403005 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540d6040 con 0x562594c82a40 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f61689a0640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c89970 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61540bd730 tx=0x7f61540e4c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f603effd640 1 -- 172.21.15.129:0/722403005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540bdbe0 con 0x562594c82a40 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562594c8a0b0 con 0x562594c82a40 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f603effd640 1 -- 172.21.15.129:0/722403005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540ea070 con 0x562594c82a40 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f603effd640 1 -- 172.21.15.129:0/722403005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61540bde70 con 0x562594c82a40 2024-02-18T16:21:20.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.986+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562594c8a0b0 con 0x562594c82a40 2024-02-18T16:21:21.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f603effd640 1 -- 172.21.15.129:0/722403005 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61540e2050 con 0x562594c82a40 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f603effd640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60340342b0 0x7f6034036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f603effd640 1 -- 172.21.15.129:0/722403005 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f61540ec070 con 0x562594c82a40 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61699a2640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60340342b0 0x7f6034036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594c94be0 0x562594c97080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c977d0 con 0x562594c94be0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594c94be0 0x562594c97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61699a2640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60340342b0 0x7f6034036770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6164008fd0 tx=0x7f616401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594c94be0 0x562594c97080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 realm 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c97ba0 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c983f0 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c98750 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c98090 con 0x562594c94be0 2024-02-18T16:21:21.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:21.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 20 searching for the correct realm 2024-02-18T16:21:21.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562594c9a9a0 0x562594c9cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61689a0640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562594c9a9a0 0x562594c9cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.990+0000 7f61689a0640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562594c9a9a0 0x562594c9cdd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61540b0020 con 0x562594c9a9a0 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61689a0640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6154009040 0x7f61540e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6154009040 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61699a2640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6154009040 0x7f61540e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61699a2640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6154009040 0x7f61540e6290 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f616402c040 con 0x7f6154009040 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61699a2640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6164027940 0x7f61640333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6164027940 0x7f61640333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6164027940 0x7f61640333c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x7f6164027940 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.994+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x7f6164027940 2024-02-18T16:21:21.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x7f6164027940 2024-02-18T16:21:21.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6154009040 2024-02-18T16:21:21.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f616402c040 con 0x7f6154009040 2024-02-18T16:21:21.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61540b0020 con 0x562594c9a9a0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x7f6164027940 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6154009040 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f616402c040 con 0x7f6154009040 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:20.998+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x7f6164027940 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f615c024020 con 0x562594c94be0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6154009040 2024-02-18T16:21:21.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f616402c040 con 0x7f6154009040 2024-02-18T16:21:21.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.002+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6154009040 2024-02-18T16:21:21.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f616402c040 con 0x7f6154009040 2024-02-18T16:21:21.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c9a9a0 2024-02-18T16:21:21.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6164027940 2024-02-18T16:21:21.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x562594c94be0 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9d4a0 con 0x7f6154009040 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f616402c040 con 0x7f6154009040 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c995c0 con 0x562594c94be0 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c99240 con 0x562594c94be0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c99f10 con 0x562594c94be0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 zone default found 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 4 Realm: () 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:21.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 zonegroup default 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.006+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9dd80 con 0x7f6164027940 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9f760 con 0x562594c9a9a0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9fac0 con 0x562594c9a9a0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 started sync module instance, tier type = 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:21.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9ed30 con 0x7f6154009040 2024-02-18T16:21:21.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f616403f040 con 0x7f6154009040 2024-02-18T16:21:21.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719410041056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9ed30 con 0x7f6154009040 2024-02-18T16:21:21.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca0540 con 0x562594c94be0 2024-02-18T16:21:21.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.010+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719410041056] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f616403f040 con 0x7f6154009040 2024-02-18T16:21:21.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719410044992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9ed30 con 0x562594c94be0 2024-02-18T16:21:21.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca0f00 con 0x562594c9a9a0 2024-02-18T16:21:21.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719410044992] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719410047584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca1260 con 0x562594c9a9a0 2024-02-18T16:21:21.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.014+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca1c30 con 0x7f6154009040 2024-02-18T16:21:21.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f616403f040 con 0x7f6154009040 2024-02-18T16:21:21.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719410050864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca2480 con 0x7f6154009040 2024-02-18T16:21:21.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca2e50 con 0x562594c94be0 2024-02-18T16:21:21.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719410047584] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719410050864] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f616403f040 con 0x7f6154009040 2024-02-18T16:21:21.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719410055504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca1fe0 con 0x562594c94be0 2024-02-18T16:21:21.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.018+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca36d0 con 0x7f6164027940 2024-02-18T16:21:21.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719410055504] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719410038928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca1fe0 con 0x7f6164027940 2024-02-18T16:21:21.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca3bb0 con 0x7f6164027940 2024-02-18T16:21:21.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719410058896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca4010 con 0x7f6164027940 2024-02-18T16:21:21.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca4ac0 con 0x7f6164027940 2024-02-18T16:21:21.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.022+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719410038928] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719410058896] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719410062784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca3b70 con 0x7f6164027940 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=0 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=1 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=2 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=3 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=4 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=5 2024-02-18T16:21:21.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=6 2024-02-18T16:21:21.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719410062784] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 20 add_watcher() i=7 2024-02-18T16:21:21.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:21.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca7bc0 con 0x562594c94be0 2024-02-18T16:21:21.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.026+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719410057216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca5030 con 0x562594c94be0 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719410057216] v30'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f601f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 5 note: GC not initialized 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f601e7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 20 Filter name: none 2024-02-18T16:21:21.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f5f8ffff640 20 reqs_thread_entry: start 2024-02-18T16:21:21.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594cc9430 con 0x562594c94be0 2024-02-18T16:21:21.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:21.041 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:21.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f601f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.030+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719410057216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca9fb0 con 0x562594c94be0 2024-02-18T16:21:21.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94719410057216] v30'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719410041056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca3000 con 0x7f6154009040 2024-02-18T16:21:21.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94719410041056] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f616403f040 con 0x7f6154009040 2024-02-18T16:21:21.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f616b686980 20 remove_watcher() i=0 2024-02-18T16:21:21.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f616b686980 2 removed watcher, disabling cache 2024-02-18T16:21:21.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719410044992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca3000 con 0x562594c94be0 2024-02-18T16:21:21.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94719410044992] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f616b686980 20 remove_watcher() i=1 2024-02-18T16:21:21.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.034+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719410047584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca0040 con 0x562594c9a9a0 2024-02-18T16:21:21.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.038+0000 7f61689a0640 1 -- 172.21.15.129:0/722403005 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94719410047584] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6154108040 con 0x562594c9a9a0 2024-02-18T16:21:21.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.038+0000 7f616b686980 20 remove_watcher() i=2 2024-02-18T16:21:21.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.038+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719410050864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca3000 con 0x7f6154009040 2024-02-18T16:21:21.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.038+0000 7f61699a2640 1 -- 172.21.15.129:0/722403005 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94719410050864] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f616403f040 con 0x7f6154009040 2024-02-18T16:21:21.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.038+0000 7f616b686980 20 remove_watcher() i=3 2024-02-18T16:21:21.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.038+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719410055504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca0a60 con 0x562594c94be0 2024-02-18T16:21:21.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.042+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94719410055504] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x562594c94be0 2024-02-18T16:21:21.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.042+0000 7f616b686980 20 remove_watcher() i=4 2024-02-18T16:21:21.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.042+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719410038928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca1730 con 0x7f6164027940 2024-02-18T16:21:21.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.042+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94719410038928] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.042+0000 7f616b686980 20 remove_watcher() i=5 2024-02-18T16:21:21.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.042+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719410058896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594ca0a60 con 0x7f6164027940 2024-02-18T16:21:21.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94719410058896] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 20 remove_watcher() i=6 2024-02-18T16:21:21.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719410062784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562594c9e890 con 0x7f6164027940 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94719410062784] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f615c059040 con 0x7f6164027940 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 20 remove_watcher() i=7 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6164027940 msgr2=0x7f61640333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6164027940 0x7f61640333c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594c94be0 msgr2=0x562594c97080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594c94be0 0x562594c97080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6154009040 msgr2=0x7f61540e6290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6154009040 0x7f61540e6290 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562594c9a9a0 msgr2=0x562594c9cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562594c9a9a0 0x562594c9cdd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60340342b0 msgr2=0x7f6034036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60340342b0 0x7f6034036770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6164008fd0 tx=0x7f616401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:21.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 msgr2=0x562594c89970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/722403005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c82a40 0x562594c89970 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61540bd730 tx=0x7f61540e4c80 comp rx=0 tx=0).stop 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 reap_dead start 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f61691a1640 1 -- 172.21.15.129:0/722403005 reap_dead start 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 shutdown_connections 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 >> 172.21.15.129:0/722403005 conn(0x562594c7edd0 msgr2=0x562594c7c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 shutdown_connections 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/722403005 wait complete. 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60400342b0 msgr2=0x7f6040036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60400342b0 0x7f6040036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562594c5bb10 tx=0x7f6164003070 comp rx=0 tx=0).stop 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 msgr2=0x562594c75e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 0x562594c75e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61540ac040 tx=0x7f61540180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 shutdown_connections 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60400342b0 0x7f6040036770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 --2- 172.21.15.129:0/3610295669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594c75a40 0x562594c75e60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.046+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 >> 172.21.15.129:0/3610295669 conn(0x562594c6a850 msgr2=0x562594c6b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 shutdown_connections 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/3610295669 wait complete. 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594b6b520 msgr2=0x562594c5aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594b6b520 0x562594c5aa20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60500342b0 msgr2=0x7f6050036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60500342b0 0x7f6050036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61540ae000 tx=0x7f61540a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 msgr2=0x562594b67560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594b67560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x562594c51f40 tx=0x7f615c000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 shutdown_connections 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562594b6b520 0x562594c5aa20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f60500342b0 0x7f6050036770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 --2- 172.21.15.129:0/2713362806 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562594adb080 0x562594b67560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 >> 172.21.15.129:0/2713362806 conn(0x562594b618e0 msgr2=0x562594c4b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 shutdown_connections 2024-02-18T16:21:21.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.050+0000 7f616b686980 1 -- 172.21.15.129:0/2713362806 wait complete. 2024-02-18T16:21:21.069 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:21.069 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-18T16:21:21.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-18T16:21:21.069 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7d4d6980 1 Processor -- start 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7d4d6980 1 -- start start 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7d4d6980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e43fe72e10 0x55e43ff07180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7d4d6980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e43fe4a4c0 con 0x55e43fe74150 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7d4d6980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e43fe11180 con 0x55e43fe72e10 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7a7f0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e43fe72e10 0x55e43ff07180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7aff1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55e43fe74150 0x55e43fe72700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42648/0 (socket says 172.21.15.129:42648) 2024-02-18T16:21:21.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7aff1640 1 -- 172.21.15.129:0/729768804 learned_addr learned my addr 172.21.15.129:0/729768804 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:21.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/729768804 >> v1:172.21.15.80:6789/0 conn(0x55e43fe74150 legacy=0x55e43fe72700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/729768804 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e43fe73220 con 0x55e43fe72e10 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.134+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/729768804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ff07180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400a480 tx=0x7fbe6401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c65b5f8419922c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe79fef640 1 -- 172.21.15.129:0/729768804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640aa530 con 0x55e43fe72e10 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe79fef640 1 -- 172.21.15.129:0/729768804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640a6050 con 0x55e43fe72e10 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe79fef640 1 -- 172.21.15.129:0/729768804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640aa7e0 con 0x55e43fe72e10 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/729768804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 msgr2=0x55e43ff07180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/729768804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ff07180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400a480 tx=0x7fbe6401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/729768804 shutdown_connections 2024-02-18T16:21:21.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/729768804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ff07180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/729768804 >> 172.21.15.129:0/729768804 conn(0x55e43fef9a40 msgr2=0x55e43fefbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/729768804 shutdown_connections 2024-02-18T16:21:21.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.138+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/729768804 wait complete. 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 Processor -- start 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- start start 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ffea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e43fe0e6b0 con 0x55e43fe72e10 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7aff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ffea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7aff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ffea5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47562/0 (socket says 172.21.15.129:47562) 2024-02-18T16:21:21.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3716625694 learned_addr learned my addr 172.21.15.129:0/3716625694 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3716625694 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64005d30 con 0x55e43fe72e10 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7aff1640 1 --2- 172.21.15.129:0/3716625694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ffea5b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c001c90 tx=0x7fbe6c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01131af918204c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbd68e09640 1 -- 172.21.15.129:0/3716625694 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c00e690 con 0x55e43fe72e10 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbd68e09640 1 -- 172.21.15.129:0/3716625694 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00e7f0 con 0x55e43fe72e10 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbd68e09640 1 -- 172.21.15.129:0/3716625694 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c00eaf0 con 0x55e43fe72e10 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3716625694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 msgr2=0x55e43ffea5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3716625694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ffea5b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c001c90 tx=0x7fbe6c00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3716625694 shutdown_connections 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3716625694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43ffea5b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3716625694 >> 172.21.15.129:0/3716625694 conn(0x55e43fef9a40 msgr2=0x55e43ffe6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3716625694 shutdown_connections 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3716625694 wait complete. 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 Processor -- start 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.154+0000 7fbe7d4d6980 1 -- start start 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7d4d6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43fff1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7d4d6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e43fe09e90 con 0x55e43fe72e10 2024-02-18T16:21:21.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7aff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43fff1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7aff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43fff1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47572/0 (socket says 172.21.15.129:47572) 2024-02-18T16:21:21.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3611102048 learned_addr learned my addr 172.21.15.129:0/3611102048 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e43fe4a4c0 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7aff1640 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43fff1420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c001ee0 tx=0x7fbe6c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbd67606640 1 -- 172.21.15.129:0/3611102048 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c01f070 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e43fff1960 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbd67606640 1 -- 172.21.15.129:0/3611102048 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c01a4d0 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbd67606640 1 -- 172.21.15.129:0/3611102048 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c01a770 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e43fff1db0 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbd67606640 1 -- 172.21.15.129:0/3611102048 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe6c00a040 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbd67606640 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd60034300 0x7fbd600367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbd67606640 1 -- 172.21.15.129:0/3611102048 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbe6c049680 con 0x55e43fe72e10 2024-02-18T16:21:21.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd60034300 0x7fbd600367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e43fe74150 0x55e43fff8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e43fff85c0 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e43fe74150 0x55e43fff8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd60034300 0x7fbd600367c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ac000 tx=0x7fbe640a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.158+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e43fe74150 0x55e43fff8080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3611102048 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe7400a4d0 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e43fff8980 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3611102048 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbe7400a4d0 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e43fffa230 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3611102048 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fbe7400a4d0 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e43fff9430 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3611102048 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbe7400a4d0 con 0x55e43fe74150 2024-02-18T16:21:21.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e43fff9840 con 0x55e43fe74150 2024-02-18T16:21:21.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3611102048 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbe7400a4d0 con 0x55e43fe74150 2024-02-18T16:21:21.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 Processor -- start 2024-02-18T16:21:21.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- start start 2024-02-18T16:21:21.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 0x55e440008d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e43fda2f20 con 0x55e440008910 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7a7f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 0x55e440008d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7a7f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 0x55e440008d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47582/0 (socket says 172.21.15.129:47582) 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3083277681 learned_addr learned my addr 172.21.15.129:0/3083277681 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3083277681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e440009270 con 0x55e440008910 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 0x55e440008d30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ad040 tx=0x7fbe64018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbd64e01640 1 -- 172.21.15.129:0/3083277681 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640b4c40 con 0x55e440008910 2024-02-18T16:21:21.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e440009460 con 0x55e440008910 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e440009fb0 con 0x55e440008910 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbd64e01640 1 -- 172.21.15.129:0/3083277681 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640b4da0 con 0x55e440008910 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.162+0000 7fbd64e01640 1 -- 172.21.15.129:0/3083277681 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640bd5b0 con 0x55e440008910 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbd64e01640 1 -- 172.21.15.129:0/3083277681 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe640bd710 con 0x55e440008910 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbd64e01640 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd54034300 0x7fbd540367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbd64e01640 1 -- 172.21.15.129:0/3083277681 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbe640e5f20 con 0x55e440008910 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd54034300 0x7fbd540367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7d4d6980 1 Processor -- start 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7d4d6980 1 -- start start 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd54034300 0x7fbd540367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55e43fff8e70 tx=0x7fbe74005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7d4d6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e440015ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7d4d6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e43fd96790 con 0x55e4400158c0 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7a7f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e440015ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7a7f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e440015ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47594/0 (socket says 172.21.15.129:47594) 2024-02-18T16:21:21.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/648419622 learned_addr learned my addr 172.21.15.129:0/648419622 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/648419622 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4400162b0 con 0x55e4400158c0 2024-02-18T16:21:21.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/648419622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e440015ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe640c6fd0 tx=0x7fbe640bdf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fa6b9fe178c107 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbd5e7fc640 1 -- 172.21.15.129:0/648419622 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640e4760 con 0x55e4400158c0 2024-02-18T16:21:21.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbd5e7fc640 1 -- 172.21.15.129:0/648419622 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640e48c0 con 0x55e4400158c0 2024-02-18T16:21:21.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.166+0000 7fbd5e7fc640 1 -- 172.21.15.129:0/648419622 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640e4b60 con 0x55e4400158c0 2024-02-18T16:21:21.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/648419622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 msgr2=0x55e440015ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/648419622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e440015ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe640c6fd0 tx=0x7fbe640bdf30 comp rx=0 tx=0).stop 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/648419622 shutdown_connections 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/648419622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e440015ce0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/648419622 >> 172.21.15.129:0/648419622 conn(0x55e440011c50 msgr2=0x55e44000fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/648419622 shutdown_connections 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/648419622 wait complete. 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 Processor -- start 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- start start 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e44001c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44001cd00 con 0x55e4400158c0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7a7f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e44001c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7a7f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e44001c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47602/0 (socket says 172.21.15.129:47602) 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 learned_addr learned my addr 172.21.15.129:0/3432631837 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e440009fb0 con 0x55e4400158c0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e44001c7c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe64005af0 tx=0x7fbe64005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbd5cff9640 1 -- 172.21.15.129:0/3432631837 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640de040 con 0x55e4400158c0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e44001cf00 con 0x55e4400158c0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbd5cff9640 1 -- 172.21.15.129:0/3432631837 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640b3a70 con 0x55e4400158c0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbd5cff9640 1 -- 172.21.15.129:0/3432631837 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640b3d10 con 0x55e4400158c0 2024-02-18T16:21:21.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e44001d330 con 0x55e4400158c0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbd5cff9640 1 -- 172.21.15.129:0/3432631837 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe640ba2c0 con 0x55e4400158c0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbd5cff9640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd440342b0 0x7fbd44036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbd5cff9640 1 -- 172.21.15.129:0/3432631837 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbe640f8ca0 con 0x55e4400158c0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.170+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd440342b0 0x7fbd44036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e440027d90 0x55e44002a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002a9a0 con 0x55e440027d90 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e440027d90 0x55e44002a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd440342b0 0x7fbd44036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe74011010 tx=0x7fbe74020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e440027d90 0x55e44002a250 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 realm 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002ad70 con 0x55e440027d90 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002b5f0 con 0x55e440027d90 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002b950 con 0x55e440027d90 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002c150 con 0x55e440027d90 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 20 searching for the correct realm 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e44002e000 0x55e4400304c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e44002e000 0x55e4400304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e44002e000 0x55e4400304c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7a7f0640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbe640f7060 0x7fbe640a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe640f7060 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbe640f7060 0x7fbe640a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.174+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbe640f7060 0x7fbe640a58a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe7400a4d0 con 0x7fbe640f7060 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7b7f2640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbe740141d0 0x7fbe74015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbe740141d0 0x7fbe74015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbe740141d0 0x7fbe74015940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x7fbe740141d0 2024-02-18T16:21:21.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x7fbe740141d0 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x7fbe740141d0 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe640f7060 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe7400a4d0 con 0x7fbe640f7060 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.178+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x7fbe740141d0 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe640f7060 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x7fbe740141d0 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.182+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbe6c014070 con 0x55e440027d90 2024-02-18T16:21:21.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe640f7060 2024-02-18T16:21:21.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe640f7060 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.186+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e44002e000 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe740141d0 2024-02-18T16:21:21.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x55e440027d90 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030b90 con 0x7fbe640f7060 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002ca50 con 0x55e440027d90 2024-02-18T16:21:21.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44002d2a0 con 0x55e440027d90 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440030fd0 con 0x55e440027d90 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 zone default found 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 4 Realm: () 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:21.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 zonegroup default 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440031000 con 0x7fbe740141d0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440032d90 con 0x55e44002e000 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033180 con 0x55e44002e000 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 started sync module instance, tier type = 2024-02-18T16:21:21.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:21.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.190+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440032670 con 0x7fbe640f7060 2024-02-18T16:21:21.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94438814851536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440032a20 con 0x7fbe640f7060 2024-02-18T16:21:21.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033ee0 con 0x55e440027d90 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94438814851536] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94438814856608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033e60 con 0x55e440027d90 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.194+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400348b0 con 0x55e44002e000 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94438814856608] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94438814857664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033de0 con 0x55e44002e000 2024-02-18T16:21:21.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400355a0 con 0x7fbe640f7060 2024-02-18T16:21:21.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94438814863920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440035df0 con 0x7fbe640f7060 2024-02-18T16:21:21.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440036810 con 0x55e440027d90 2024-02-18T16:21:21.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.198+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94438814857664] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94438814863920] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94438814868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440035950 con 0x55e440027d90 2024-02-18T16:21:21.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440037060 con 0x7fbe740141d0 2024-02-18T16:21:21.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94438814870000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400372b0 con 0x7fbe740141d0 2024-02-18T16:21:21.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440037ab0 con 0x7fbe740141d0 2024-02-18T16:21:21.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.202+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94438814868208] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94438814870000] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94438814871056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400376d0 con 0x7fbe740141d0 2024-02-18T16:21:21.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440037ed0 con 0x7fbe740141d0 2024-02-18T16:21:21.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94438814871056] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94438814872384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440037d60 con 0x7fbe740141d0 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=0 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=1 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=2 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=3 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=4 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=5 2024-02-18T16:21:21.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.206+0000 7fbe7d4d6980 20 add_watcher() i=6 2024-02-18T16:21:21.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94438814872384] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 20 add_watcher() i=7 2024-02-18T16:21:21.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:21.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44003b290 con 0x55e440027d90 2024-02-18T16:21:21.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94438814873600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440038730 con 0x55e440027d90 2024-02-18T16:21:21.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94438814873600] v30'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbd317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.210+0000 7fbe7d4d6980 5 note: GC not initialized 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbcabfff640 20 reqs_thread_entry: start 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:21.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 20 Filter name: none 2024-02-18T16:21:21.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbca9ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:21.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44005d230 con 0x55e440027d90 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44005f670 con 0x7fbe640f7060 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440062cd0 con 0x55e440027d90 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v30'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94438815049584 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44005fb10 con 0x55e440027d90 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94438814868208 notify 128849018881 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55e43fff1db0 con 0x55e440027d90 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbd5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94438814868208 notifier 4308 bl.length()=533 2024-02-18T16:21:21.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(65 notify.4 [notify cookie 94438815049584 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbd5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:21.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbd5e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:21.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbd5e7fc640 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbd40003ea0 con 0x55e440027d90 2024-02-18T16:21:21.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.214+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94438815049584 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e43fff1960 con 0x55e440027d90 2024-02-18T16:21:21.228 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbd317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94438814873600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e44005c190 con 0x55e440027d90 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94438814873600] v30'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94438814851536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400377c0 con 0x7fbe640f7060 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94438814851536] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7d4d6980 20 remove_watcher() i=0 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7d4d6980 2 removed watcher, disabling cache 2024-02-18T16:21:21.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.218+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94438814856608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400321d0 con 0x55e440027d90 2024-02-18T16:21:21.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.222+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94438814856608] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.222+0000 7fbe7d4d6980 20 remove_watcher() i=1 2024-02-18T16:21:21.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.222+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94438814857664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e4400321d0 con 0x55e44002e000 2024-02-18T16:21:21.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.222+0000 7fbe7a7f0640 1 -- 172.21.15.129:0/3432631837 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94438814857664] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe640ea070 con 0x55e44002e000 2024-02-18T16:21:21.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.222+0000 7fbe7d4d6980 20 remove_watcher() i=2 2024-02-18T16:21:21.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.222+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94438814863920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033a40 con 0x7fbe640f7060 2024-02-18T16:21:21.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.226+0000 7fbe7b7f2640 1 -- 172.21.15.129:0/3432631837 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94438814863920] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe7403a040 con 0x7fbe640f7060 2024-02-18T16:21:21.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.226+0000 7fbe7d4d6980 20 remove_watcher() i=3 2024-02-18T16:21:21.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.226+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94438814868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033a40 con 0x55e440027d90 2024-02-18T16:21:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.226+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94438814868208] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x55e440027d90 2024-02-18T16:21:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.226+0000 7fbe7d4d6980 20 remove_watcher() i=4 2024-02-18T16:21:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.226+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94438814870000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033a40 con 0x7fbe740141d0 2024-02-18T16:21:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.230+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94438814870000] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.230+0000 7fbe7d4d6980 20 remove_watcher() i=5 2024-02-18T16:21:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.230+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94438814871056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033a40 con 0x7fbe740141d0 2024-02-18T16:21:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.230+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94438814871056] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.230+0000 7fbe7d4d6980 20 remove_watcher() i=6 2024-02-18T16:21:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.230+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94438814872384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e440033a40 con 0x7fbe740141d0 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94438814872384] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe6c04f040 con 0x7fbe740141d0 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 20 remove_watcher() i=7 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbe740141d0 msgr2=0x7fbe74015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbe740141d0 0x7fbe74015940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e440027d90 msgr2=0x55e44002a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e440027d90 0x55e44002a250 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbe640f7060 msgr2=0x7fbe640a58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbe640f7060 0x7fbe640a58a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e44002e000 msgr2=0x55e4400304c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e44002e000 0x55e4400304c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd440342b0 msgr2=0x7fbd44036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd440342b0 0x7fbd44036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe74011010 tx=0x7fbe74020000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 msgr2=0x55e44001c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7aff1640 1 -- 172.21.15.129:0/3432631837 reap_dead start 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e44001c7c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe64005af0 tx=0x7fbe64005a80 comp rx=0 tx=0).stop 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 shutdown_connections 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3432631837 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e4400158c0 0x55e44001c7c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 >> 172.21.15.129:0/3432631837 conn(0x55e440011c50 msgr2=0x55e44000f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 shutdown_connections 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3432631837 wait complete. 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd54034300 msgr2=0x7fbd540367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd54034300 0x7fbd540367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55e43fff8e70 tx=0x7fbe74005850 comp rx=0 tx=0).stop 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 msgr2=0x55e440008d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 0x55e440008d30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ad040 tx=0x7fbe64018020 comp rx=0 tx=0).stop 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 shutdown_connections 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd54034300 0x7fbd540367c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3083277681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e440008910 0x55e440008d30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 >> 172.21.15.129:0/3083277681 conn(0x55e43fffd720 msgr2=0x55e43fffe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 shutdown_connections 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3083277681 wait complete. 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e43fe74150 msgr2=0x55e43fff8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e43fe74150 0x55e43fff8080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd60034300 msgr2=0x7fbd600367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd60034300 0x7fbd600367c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ac000 tx=0x7fbe640a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 msgr2=0x55e43fff1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43fff1420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c001ee0 tx=0x7fbe6c000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 shutdown_connections 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e43fe74150 0x55e43fff8080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbd60034300 0x7fbd600367c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 --2- 172.21.15.129:0/3611102048 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e43fe72e10 0x55e43fff1420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 >> 172.21.15.129:0/3611102048 conn(0x55e43fef9a40 msgr2=0x55e43ffe4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 shutdown_connections 2024-02-18T16:21:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.234+0000 7fbe7d4d6980 1 -- 172.21.15.129:0/3611102048 wait complete. 2024-02-18T16:21:21.255 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:21.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:21.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:21.255 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:21.329 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:21.329 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:21.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.318+0000 7fb9d1cae980 1 Processor -- start 2024-02-18T16:21:21.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9d1cae980 1 -- start start 2024-02-18T16:21:21.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9d1cae980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55f806b35040 0x55f806b35420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9d1cae980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f806a824c0 con 0x55f806b35960 2024-02-18T16:21:21.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9d1cae980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f806a49180 con 0x55f806b35040 2024-02-18T16:21:21.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9cf7c9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55f806b35040 0x55f806b35420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9cefc8640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55f806b35960 0x55f806b36320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42652/0 (socket says 172.21.15.129:42652) 2024-02-18T16:21:21.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9cefc8640 1 -- 172.21.15.129:0/338140666 learned_addr learned my addr 172.21.15.129:0/338140666 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:21.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/338140666 >> v1:172.21.15.80:6789/0 conn(0x55f806b35960 legacy=0x55f806b36320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/338140666 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f806b36b50 con 0x55f806b35040 2024-02-18T16:21:21.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.322+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/338140666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806b35420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000a480 tx=0x7fb9c001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ef4b6954c6986d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9ce7c7640 1 -- 172.21.15.129:0/338140666 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00ab540 con 0x55f806b35040 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9ce7c7640 1 -- 172.21.15.129:0/338140666 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c00ab6a0 con 0x55f806b35040 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9ce7c7640 1 -- 172.21.15.129:0/338140666 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00ab960 con 0x55f806b35040 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 -- 172.21.15.129:0/338140666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 msgr2=0x55f806b35420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/338140666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806b35420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000a480 tx=0x7fb9c001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 -- 172.21.15.129:0/338140666 shutdown_connections 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/338140666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806b35420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 -- 172.21.15.129:0/338140666 >> 172.21.15.129:0/338140666 conn(0x55f806b30910 msgr2=0x55f806b32d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 -- 172.21.15.129:0/338140666 shutdown_connections 2024-02-18T16:21:21.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.326+0000 7fb9d1cae980 1 -- 172.21.15.129:0/338140666 wait complete. 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 Processor -- start 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- start start 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f806a466b0 con 0x55f806b35040 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47608/0 (socket says 172.21.15.129:47608) 2024-02-18T16:21:21.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/2980781556 learned_addr learned my addr 172.21.15.129:0/2980781556 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/2980781556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0005d30 con 0x55f806b35040 2024-02-18T16:21:21.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/2980781556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c206b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0018eb0 tx=0x7fb9c0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdb067d29a4363c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb8bd60a640 1 -- 172.21.15.129:0/2980781556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00ab810 con 0x55f806b35040 2024-02-18T16:21:21.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb8bd60a640 1 -- 172.21.15.129:0/2980781556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c00ab970 con 0x55f806b35040 2024-02-18T16:21:21.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb8bd60a640 1 -- 172.21.15.129:0/2980781556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00abc30 con 0x55f806b35040 2024-02-18T16:21:21.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2980781556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 msgr2=0x55f806c206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/2980781556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c206b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0018eb0 tx=0x7fb9c0003030 comp rx=0 tx=0).stop 2024-02-18T16:21:21.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2980781556 shutdown_connections 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/2980781556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c206b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2980781556 >> 172.21.15.129:0/2980781556 conn(0x55f806b30910 msgr2=0x55f806c1c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2980781556 shutdown_connections 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2980781556 wait complete. 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 Processor -- start 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- start start 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c27360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9d1cae980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f806a41e90 con 0x55f806b35040 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c27360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c27360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47616/0 (socket says 172.21.15.129:47616) 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/4277725566 learned_addr learned my addr 172.21.15.129:0/4277725566 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f806b36b50 con 0x55f806b35040 2024-02-18T16:21:21.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.342+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c27360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c001b2c0 tx=0x7fb9c0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb8bbe07640 1 -- 172.21.15.129:0/4277725566 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00c3070 con 0x55f806b35040 2024-02-18T16:21:21.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f806c278a0 con 0x55f806b35040 2024-02-18T16:21:21.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb8bbe07640 1 -- 172.21.15.129:0/4277725566 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c00beaa0 con 0x55f806b35040 2024-02-18T16:21:21.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb8bbe07640 1 -- 172.21.15.129:0/4277725566 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00bed40 con 0x55f806b35040 2024-02-18T16:21:21.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f806c27cf0 con 0x55f806b35040 2024-02-18T16:21:21.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb8bbe07640 1 -- 172.21.15.129:0/4277725566 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb9c00b2070 con 0x55f806b35040 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb8bbe07640 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8b40342b0 0x7fb8b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb8bbe07640 1 -- 172.21.15.129:0/4277725566 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb9c00e3950 con 0x55f806b35040 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8b40342b0 0x7fb8b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806b35960 0x55f806c2df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c2e4d0 con 0x55f806b35960 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cffca640 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806b35960 0x55f806c2df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8b40342b0 0x7fb8b4036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4000f70 tx=0x7fb9c40012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cffca640 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806b35960 0x55f806c2df90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cffca640 1 -- 172.21.15.129:0/4277725566 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9c800a4d0 con 0x55f806b35960 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c2e850 con 0x55f806b35960 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cffca640 1 -- 172.21.15.129:0/4277725566 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9c800a4d0 con 0x55f806b35960 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c30100 con 0x55f806b35960 2024-02-18T16:21:21.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cffca640 1 -- 172.21.15.129:0/4277725566 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb9c800a4d0 con 0x55f806b35960 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c2f300 con 0x55f806b35960 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9cffca640 1 -- 172.21.15.129:0/4277725566 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9c800a4d0 con 0x55f806b35960 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.346+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c2f710 con 0x55f806b35960 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cffca640 1 -- 172.21.15.129:0/4277725566 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb9c800a4d0 con 0x55f806b35960 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 Processor -- start 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 -- start start 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 0x55f806c3ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8069daf20 con 0x55f806c3e800 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cefc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 0x55f806c3ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cefc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 0x55f806c3ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47626/0 (socket says 172.21.15.129:47626) 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cefc8640 1 -- 172.21.15.129:0/2679420364 learned_addr learned my addr 172.21.15.129:0/2679420364 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cefc8640 1 -- 172.21.15.129:0/2679420364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f806c3f160 con 0x55f806c3e800 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 0x55f806c3ec20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001ee0 tx=0x7fb9c400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb8b9602640 1 -- 172.21.15.129:0/2679420364 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c4020070 con 0x55f806c3e800 2024-02-18T16:21:21.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb8b9602640 1 -- 172.21.15.129:0/2679420364 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400c770 con 0x55f806c3e800 2024-02-18T16:21:21.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f806c3f3b0 con 0x55f806c3e800 2024-02-18T16:21:21.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb8b9602640 1 -- 172.21.15.129:0/2679420364 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c4013040 con 0x55f806c3e800 2024-02-18T16:21:21.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f806c3ff00 con 0x55f806c3e800 2024-02-18T16:21:21.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb8b9602640 1 -- 172.21.15.129:0/2679420364 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb9c400a040 con 0x55f806c3e800 2024-02-18T16:21:21.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb8b9602640 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8a8034320 0x7fb8a80367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb8b9602640 1 -- 172.21.15.129:0/2679420364 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb9c404b6b0 con 0x55f806c3e800 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9cffca640 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8a8034320 0x7fb8a80367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.350+0000 7fb9d1cae980 1 Processor -- start 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- start start 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c18040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8069ce790 con 0x55f806c17c60 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cffca640 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8a8034320 0x7fb8a80367e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55f806c2ed40 tx=0x7fb9c8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c18040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c18040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47634/0 (socket says 172.21.15.129:47634) 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1841850993 learned_addr learned my addr 172.21.15.129:0/1841850993 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1841850993 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f806c16490 con 0x55f806c17c60 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/1841850993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c18040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4049aa0 tx=0x7fb9c40198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92e9d7e621513cd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb8b2ffd640 1 -- 172.21.15.129:0/1841850993 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c4048070 con 0x55f806c17c60 2024-02-18T16:21:21.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb8b2ffd640 1 -- 172.21.15.129:0/1841850993 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c403a2b0 con 0x55f806c17c60 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb8b2ffd640 1 -- 172.21.15.129:0/1841850993 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c403a440 con 0x55f806c17c60 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1841850993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 msgr2=0x55f806c18040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1841850993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c18040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4049aa0 tx=0x7fb9c40198d0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1841850993 shutdown_connections 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1841850993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c18040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1841850993 >> 172.21.15.129:0/1841850993 conn(0x55f806c47b20 msgr2=0x55f806c45b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1841850993 shutdown_connections 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1841850993 wait complete. 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 Processor -- start 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- start start 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c54880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9d1cae980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f806c54dc0 con 0x55f806c17c60 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c54880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c54880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47646/0 (socket says 172.21.15.129:47646) 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 learned_addr learned my addr 172.21.15.129:0/1432214950 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f806c3ff00 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.354+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c54880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9c403f040 tx=0x7fb9c4049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb8b17fa640 1 -- 172.21.15.129:0/1432214950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c403bbe0 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb8b17fa640 1 -- 172.21.15.129:0/1432214950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c403bd40 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f806c54fc0 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb8b17fa640 1 -- 172.21.15.129:0/1432214950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9c4048070 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f806c55450 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb8b17fa640 1 -- 172.21.15.129:0/1432214950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb9c404ba10 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb8b17fa640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8980342b0 0x7fb898036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb8b17fa640 1 -- 172.21.15.129:0/1432214950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb9c4039c60 con 0x55f806c17c60 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cffca640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8980342b0 0x7fb898036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806c5fe50 0x55f806c622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c62a40 con 0x55f806c5fe50 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806c5fe50 0x55f806c622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cffca640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8980342b0 0x7fb898036770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8011010 tx=0x7fb9c8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806c5fe50 0x55f806c622f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 realm 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c62e10 con 0x55f806c5fe50 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c63660 con 0x55f806c5fe50 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c639c0 con 0x55f806c5fe50 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c63300 con 0x55f806c5fe50 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 20 searching for the correct realm 2024-02-18T16:21:21.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f806c65c10 0x55f806c68040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.358+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f806c65c10 0x55f806c68040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f806c65c10 0x55f806c68040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cefc8640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb9c4038020 0x7fb9c402f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c4038020 2024-02-18T16:21:21.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cffca640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb9c4038020 0x7fb9c402f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cffca640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb9c4038020 0x7fb9c402f460 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c800a4d0 con 0x7fb9c4038020 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cffca640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb9c80141d0 0x7fb9c8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb9c80141d0 0x7fb9c8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb9c80141d0 0x7fb9c8015940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.362+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c4038020 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c800a4d0 con 0x7fb9c4038020 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c4038020 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.366+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c4038020 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x55f806c5fe50 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.370+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c4038020 2024-02-18T16:21:21.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c65c10 2024-02-18T16:21:21.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c80141d0 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c00aabd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x55f806c5fe50 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68710 con 0x7fb9c4038020 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:21.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c64830 con 0x55f806c5fe50 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c644b0 con 0x55f806c5fe50 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c65180 con 0x55f806c5fe50 2024-02-18T16:21:21.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 zone default found 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 4 Realm: () 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 zonegroup default 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c68ff0 con 0x7fb9c80141d0 2024-02-18T16:21:21.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6a9d0 con 0x55f806c65c10 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6ad30 con 0x55f806c65c10 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 started sync module instance, tier type = 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.374+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c69fa0 con 0x7fb9c4038020 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94523753931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c69fa0 con 0x7fb9c4038020 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6b720 con 0x55f806c5fe50 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94523753931600] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94523753935360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c69fa0 con 0x55f806c5fe50 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.378+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6c120 con 0x55f806c65c10 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94523753937984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6c970 con 0x55f806c65c10 2024-02-18T16:21:21.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6d340 con 0x7fb9c4038020 2024-02-18T16:21:21.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94523753935360] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94523753942592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6d6f0 con 0x7fb9c4038020 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6e060 con 0x55f806c5fe50 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94523753937984] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.382+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94523753942592] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94523753929472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6dbc0 con 0x55f806c5fe50 2024-02-18T16:21:21.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6e8b0 con 0x7fb9c80141d0 2024-02-18T16:21:21.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94523753929472] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94523753940176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6e610 con 0x7fb9c80141d0 2024-02-18T16:21:21.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6ee10 con 0x7fb9c80141d0 2024-02-18T16:21:21.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94523753948960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6f200 con 0x7fb9c80141d0 2024-02-18T16:21:21.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6fcd0 con 0x7fb9c80141d0 2024-02-18T16:21:21.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94523753940176] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94523753948960] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94523753953200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6ec60 con 0x7fb9c80141d0 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=0 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=1 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=2 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=3 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=4 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=5 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.390+0000 7fb9d1cae980 20 add_watcher() i=6 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94523753953200] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 add_watcher() i=7 2024-02-18T16:21:21.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:21.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c72cc0 con 0x55f806c5fe50 2024-02-18T16:21:21.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94523753947504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c70130 con 0x55f806c5fe50 2024-02-18T16:21:21.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94523753947504] v30'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:21.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 5 note: GC not initialized 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb884fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 Filter name: none 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb7fe7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c94610 con 0x55f806c5fe50 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.394+0000 7fb9d1cae980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:21.406 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:21.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94523753947504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c751e0 con 0x55f806c5fe50 2024-02-18T16:21:21.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94523753947504] v30'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94523753931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6e170 con 0x7fb9c4038020 2024-02-18T16:21:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94523753931600] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 20 remove_watcher() i=0 2024-02-18T16:21:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 2 removed watcher, disabling cache 2024-02-18T16:21:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94523753935360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6a350 con 0x55f806c5fe50 2024-02-18T16:21:21.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94523753935360] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 20 remove_watcher() i=1 2024-02-18T16:21:21.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.398+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94523753937984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6a350 con 0x55f806c65c10 2024-02-18T16:21:21.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.402+0000 7fb9cefc8640 1 -- 172.21.15.129:0/1432214950 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94523753937984] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c4035070 con 0x55f806c65c10 2024-02-18T16:21:21.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.402+0000 7fb9d1cae980 20 remove_watcher() i=2 2024-02-18T16:21:21.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.402+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94523753942592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6b200 con 0x7fb9c4038020 2024-02-18T16:21:21.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.402+0000 7fb9cffca640 1 -- 172.21.15.129:0/1432214950 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94523753942592] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c803a040 con 0x7fb9c4038020 2024-02-18T16:21:21.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.402+0000 7fb9d1cae980 20 remove_watcher() i=3 2024-02-18T16:21:21.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.402+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94523753929472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6b200 con 0x55f806c5fe50 2024-02-18T16:21:21.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.406+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94523753929472] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x55f806c5fe50 2024-02-18T16:21:21.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.406+0000 7fb9d1cae980 20 remove_watcher() i=4 2024-02-18T16:21:21.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.406+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94523753940176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c69b00 con 0x7fb9c80141d0 2024-02-18T16:21:21.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.406+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94523753940176] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.406+0000 7fb9d1cae980 20 remove_watcher() i=5 2024-02-18T16:21:21.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.406+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94523753948960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6b200 con 0x7fb9c80141d0 2024-02-18T16:21:21.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94523753948960] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 20 remove_watcher() i=6 2024-02-18T16:21:21.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94523753953200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f806c6c4d0 con 0x7fb9c80141d0 2024-02-18T16:21:21.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94523753953200] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c00f20c0 con 0x7fb9c80141d0 2024-02-18T16:21:21.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 20 remove_watcher() i=7 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb9c80141d0 msgr2=0x7fb9c8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb9c80141d0 0x7fb9c8015940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806c5fe50 msgr2=0x55f806c622f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806c5fe50 0x55f806c622f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb9c4038020 msgr2=0x7fb9c402f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb9c4038020 0x7fb9c402f460 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f806c65c10 msgr2=0x55f806c68040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f806c65c10 0x55f806c68040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8980342b0 msgr2=0x7fb898036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8980342b0 0x7fb898036770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8011010 tx=0x7fb9c8020000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 msgr2=0x55f806c54880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9cf7c9640 1 -- 172.21.15.129:0/1432214950 reap_dead start 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c54880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9c403f040 tx=0x7fb9c4049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:21.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 shutdown_connections 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/1432214950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c17c60 0x55f806c54880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 >> 172.21.15.129:0/1432214950 conn(0x55f806c47b20 msgr2=0x55f806c45180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 shutdown_connections 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/1432214950 wait complete. 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8a8034320 msgr2=0x7fb8a80367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8a8034320 0x7fb8a80367e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55f806c2ed40 tx=0x7fb9c8005850 comp rx=0 tx=0).stop 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 msgr2=0x55f806c3ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 0x55f806c3ec20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001ee0 tx=0x7fb9c400da30 comp rx=0 tx=0).stop 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 shutdown_connections 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8a8034320 0x7fb8a80367e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/2679420364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806c3e800 0x55f806c3ec20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 >> 172.21.15.129:0/2679420364 conn(0x55f806c33610 msgr2=0x55f806c34120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 shutdown_connections 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/2679420364 wait complete. 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806b35960 msgr2=0x55f806c2df90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806b35960 0x55f806c2df90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8b40342b0 msgr2=0x7fb8b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8b40342b0 0x7fb8b4036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4000f70 tx=0x7fb9c40012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 msgr2=0x55f806c27360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c27360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c001b2c0 tx=0x7fb9c0018020 comp rx=0 tx=0).stop 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 shutdown_connections 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f806b35960 0x55f806c2df90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb8b40342b0 0x7fb8b4036770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 --2- 172.21.15.129:0/4277725566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f806b35040 0x55f806c27360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 >> 172.21.15.129:0/4277725566 conn(0x55f806b30910 msgr2=0x55f806c1ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 shutdown_connections 2024-02-18T16:21:21.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.410+0000 7fb9d1cae980 1 -- 172.21.15.129:0/4277725566 wait complete. 2024-02-18T16:21:21.431 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:21.432 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-18T16:21:21.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-18T16:21:21.432 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-18T16:21:21.502 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:21.503 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe489cc9980 1 Processor -- start 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe489cc9980 1 -- start start 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe489cc9980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d35ccff130 0x55d35ccff510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe489cc9980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d35cc4b4c0 con 0x55d35ccffa50 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe489cc9980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d35cc12180 con 0x55d35ccff130 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe4877e4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d35ccff130 0x55d35ccff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe486fe3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55d35ccffa50 0x55d35cd00410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42660/0 (socket says 172.21.15.129:42660) 2024-02-18T16:21:21.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe486fe3640 1 -- 172.21.15.129:0/1646764801 learned_addr learned my addr 172.21.15.129:0/1646764801 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:21.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe4877e4640 1 -- 172.21.15.129:0/1646764801 >> v1:172.21.15.80:6789/0 conn(0x55d35ccffa50 legacy=0x55d35cd00410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.494+0000 7fe4877e4640 1 -- 172.21.15.129:0/1646764801 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35cd00c40 con 0x55d35ccff130 2024-02-18T16:21:21.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe4877e4640 1 --2- 172.21.15.129:0/1646764801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35ccff510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a480 tx=0x7fe48001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544c795a00357f15 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe4867e2640 1 -- 172.21.15.129:0/1646764801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4800ab540 con 0x55d35ccff130 2024-02-18T16:21:21.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe4867e2640 1 -- 172.21.15.129:0/1646764801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4800ab6a0 con 0x55d35ccff130 2024-02-18T16:21:21.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe4867e2640 1 -- 172.21.15.129:0/1646764801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4800ab960 con 0x55d35ccff130 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 -- 172.21.15.129:0/1646764801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 msgr2=0x55d35ccff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1646764801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35ccff510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a480 tx=0x7fe48001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 -- 172.21.15.129:0/1646764801 shutdown_connections 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1646764801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35ccff510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 -- 172.21.15.129:0/1646764801 >> 172.21.15.129:0/1646764801 conn(0x55d35ccfaa00 msgr2=0x55d35ccfce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 -- 172.21.15.129:0/1646764801 shutdown_connections 2024-02-18T16:21:21.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.498+0000 7fe489cc9980 1 -- 172.21.15.129:0/1646764801 wait complete. 2024-02-18T16:21:21.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe489cc9980 1 Processor -- start 2024-02-18T16:21:21.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe489cc9980 1 -- start start 2024-02-18T16:21:21.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe489cc9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cde9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe489cc9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35cc0f6b0 con 0x55d35ccff130 2024-02-18T16:21:21.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe4877e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cde9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe4877e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cde9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47672/0 (socket says 172.21.15.129:47672) 2024-02-18T16:21:21.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.510+0000 7fe4877e4640 1 -- 172.21.15.129:0/1562050046 learned_addr learned my addr 172.21.15.129:0/1562050046 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 -- 172.21.15.129:0/1562050046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480005d30 con 0x55d35ccff130 2024-02-18T16:21:21.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 --2- 172.21.15.129:0/1562050046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cde9670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe480018eb0 tx=0x7fe480003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b466145663c068 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe37560a640 1 -- 172.21.15.129:0/1562050046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4800ab810 con 0x55d35ccff130 2024-02-18T16:21:21.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe37560a640 1 -- 172.21.15.129:0/1562050046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4800ab970 con 0x55d35ccff130 2024-02-18T16:21:21.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe37560a640 1 -- 172.21.15.129:0/1562050046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4800abc30 con 0x55d35ccff130 2024-02-18T16:21:21.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1562050046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 msgr2=0x55d35cde9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1562050046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cde9670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe480018eb0 tx=0x7fe480003030 comp rx=0 tx=0).stop 2024-02-18T16:21:21.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1562050046 shutdown_connections 2024-02-18T16:21:21.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1562050046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cde9670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1562050046 >> 172.21.15.129:0/1562050046 conn(0x55d35ccfaa00 msgr2=0x55d35cde5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1562050046 shutdown_connections 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1562050046 wait complete. 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 Processor -- start 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- start start 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cdf0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35cc0ae90 con 0x55d35ccff130 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cdf0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cdf0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47676/0 (socket says 172.21.15.129:47676) 2024-02-18T16:21:21.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 -- 172.21.15.129:0/1056881017 learned_addr learned my addr 172.21.15.129:0/1056881017 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35cd00c40 con 0x55d35ccff130 2024-02-18T16:21:21.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe4877e4640 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cdf0360 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe48001b2c0 tx=0x7fe480018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe373e07640 1 -- 172.21.15.129:0/1056881017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4800c3070 con 0x55d35ccff130 2024-02-18T16:21:21.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d35cdf08a0 con 0x55d35ccff130 2024-02-18T16:21:21.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe373e07640 1 -- 172.21.15.129:0/1056881017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4800beaa0 con 0x55d35ccff130 2024-02-18T16:21:21.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe373e07640 1 -- 172.21.15.129:0/1056881017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4800bed40 con 0x55d35ccff130 2024-02-18T16:21:21.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.514+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d35cdf0d50 con 0x55d35ccff130 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe373e07640 1 -- 172.21.15.129:0/1056881017 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe4800b2070 con 0x55d35ccff130 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe373e07640 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe36c0342b0 0x7fe36c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe373e07640 1 -- 172.21.15.129:0/1056881017 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe4800e39c0 con 0x55d35ccff130 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe486fe3640 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe36c0342b0 0x7fe36c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ccffa50 0x55d35cdf6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35cdf74e0 con 0x55d35ccffa50 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ccffa50 0x55d35cdf6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe486fe3640 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe36c0342b0 0x7fe36c036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe470000f70 tx=0x7fe4700012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ccffa50 0x55d35cdf6fa0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 -- 172.21.15.129:0/1056881017 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe47800a4d0 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35cdf7880 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 -- 172.21.15.129:0/1056881017 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe47800a4d0 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35cdf9100 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 -- 172.21.15.129:0/1056881017 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe47800a4d0 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35cdf8300 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 -- 172.21.15.129:0/1056881017 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe47800a4d0 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35cdf8710 con 0x55d35ccffa50 2024-02-18T16:21:21.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe487fe5640 1 -- 172.21.15.129:0/1056881017 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe47800a4d0 con 0x55d35ccffa50 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 Processor -- start 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.518+0000 7fe489cc9980 1 -- start start 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 0x55d35cc74010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35cba3f20 con 0x55d35cc75b70 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe486fe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 0x55d35cc74010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe486fe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 0x55d35cc74010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47686/0 (socket says 172.21.15.129:47686) 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe486fe3640 1 -- 172.21.15.129:0/226094430 learned_addr learned my addr 172.21.15.129:0/226094430 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe486fe3640 1 -- 172.21.15.129:0/226094430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35cc74550 con 0x55d35cc75b70 2024-02-18T16:21:21.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe486fe3640 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 0x55d35cc74010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe470001ee0 tx=0x7fe47000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe371602640 1 -- 172.21.15.129:0/226094430 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe470020070 con 0x55d35cc75b70 2024-02-18T16:21:21.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe371602640 1 -- 172.21.15.129:0/226094430 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000c770 con 0x55d35cc75b70 2024-02-18T16:21:21.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d35cc74800 con 0x55d35cc75b70 2024-02-18T16:21:21.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe371602640 1 -- 172.21.15.129:0/226094430 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe470013040 con 0x55d35cc75b70 2024-02-18T16:21:21.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d35cc74c90 con 0x55d35cc75b70 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe371602640 1 -- 172.21.15.129:0/226094430 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe47000a040 con 0x55d35cc75b70 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe371602640 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe360034300 0x7fe3600367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe371602640 1 -- 172.21.15.129:0/226094430 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe47004b800 con 0x55d35cc75b70 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe487fe5640 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe360034300 0x7fe3600367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 Processor -- start 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 -- start start 2024-02-18T16:21:21.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe487fe5640 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe360034300 0x7fe3600367c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55d35cdf7d40 tx=0x7fe478005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce16f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe489cc9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35cb97790 con 0x55d35ce16b50 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.522+0000 7fe486fe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce16f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce16f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47700/0 (socket says 172.21.15.129:47700) 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 -- 172.21.15.129:0/4018042988 learned_addr learned my addr 172.21.15.129:0/4018042988 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 -- 172.21.15.129:0/4018042988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35ce17520 con 0x55d35ce16b50 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 --2- 172.21.15.129:0/4018042988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce16f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe470049c20 tx=0x7fe4700198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958c3938fbd31a6b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe36affd640 1 -- 172.21.15.129:0/4018042988 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe470048070 con 0x55d35ce16b50 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe36affd640 1 -- 172.21.15.129:0/4018042988 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47003a3f0 con 0x55d35ce16b50 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe36affd640 1 -- 172.21.15.129:0/4018042988 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe47003a560 con 0x55d35ce16b50 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/4018042988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 msgr2=0x55d35ce16f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 --2- 172.21.15.129:0/4018042988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce16f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe470049c20 tx=0x7fe4700198d0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/4018042988 shutdown_connections 2024-02-18T16:21:21.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 --2- 172.21.15.129:0/4018042988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce16f50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/4018042988 >> 172.21.15.129:0/4018042988 conn(0x55d35ce12e90 msgr2=0x55d35ce10ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/4018042988 shutdown_connections 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/4018042988 wait complete. 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 Processor -- start 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- start start 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce1da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d35ce1dfa0 con 0x55d35ce16b50 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce1da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce1da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47716/0 (socket says 172.21.15.129:47716) 2024-02-18T16:21:21.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 learned_addr learned my addr 172.21.15.129:0/444860253 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d35cc74c90 con 0x55d35ce16b50 2024-02-18T16:21:21.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe486fe3640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce1da60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe470045040 tx=0x7fe470049b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe3697fa640 1 -- 172.21.15.129:0/444860253 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe470019e20 con 0x55d35ce16b50 2024-02-18T16:21:21.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d35ce1e1a0 con 0x55d35ce16b50 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe3697fa640 1 -- 172.21.15.129:0/444860253 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47003be20 con 0x55d35ce16b50 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe3697fa640 1 -- 172.21.15.129:0/444860253 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe470043430 con 0x55d35ce16b50 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.526+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d35ce1e630 con 0x55d35ce16b50 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe3697fa640 1 -- 172.21.15.129:0/444860253 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe470042050 con 0x55d35ce16b50 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe3697fa640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe3500342b0 0x7fe350036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe3697fa640 1 -- 172.21.15.129:0/444860253 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe470038cb0 con 0x55d35ce16b50 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe487fe5640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe3500342b0 0x7fe350036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ce28e90 0x55d35ce2b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2ba80 con 0x55d35ce28e90 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ce28e90 0x55d35ce2b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe487fe5640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe3500342b0 0x7fe350036770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe478011010 tx=0x7fe478020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ce28e90 0x55d35ce2b330 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 realm 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2be50 con 0x55d35ce28e90 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2c6a0 con 0x55d35ce28e90 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2ca00 con 0x55d35ce28e90 2024-02-18T16:21:21.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2d200 con 0x55d35ce28e90 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 20 searching for the correct realm 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d35ce2f150 0x55d35ce31560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe486fe3640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d35ce2f150 0x55d35ce31560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.530+0000 7fe486fe3640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d35ce2f150 0x55d35ce31560 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe486fe3640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe470037070 0x7fe4700146c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe470037070 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe487fe5640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe470037070 0x7fe4700146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe487fe5640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe470037070 0x7fe4700146c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe47800a4d0 con 0x7fe470037070 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe487fe5640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe4780141d0 0x7fe478015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe4780141d0 0x7fe478015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe4780141d0 0x7fe478015940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x7fe4780141d0 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x7fe4780141d0 2024-02-18T16:21:21.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.534+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x7fe4780141d0 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe470037070 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe47800a4d0 con 0x7fe470037070 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x7fe4780141d0 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe470037070 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x7fe4780141d0 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.538+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe4800b5930 con 0x55d35ce28e90 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe470037070 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.542+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe470037070 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce2f150 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe4780141d0 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x55d35ce28e90 2024-02-18T16:21:21.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce31be0 con 0x7fe470037070 2024-02-18T16:21:21.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:21.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2dbf0 con 0x55d35ce28e90 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce2e440 con 0x55d35ce28e90 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce32020 con 0x55d35ce28e90 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 zone default found 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 4 Realm: () 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 zonegroup default 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce324c0 con 0x7fe4780141d0 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce33ea0 con 0x55d35ce2f150 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.546+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce34290 con 0x55d35ce2f150 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 20 started sync module instance, tier type = 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce33470 con 0x7fe470037070 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94366284855328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce33470 con 0x7fe470037070 2024-02-18T16:21:21.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce34d20 con 0x55d35ce28e90 2024-02-18T16:21:21.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94366284855328] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94366284859424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce33470 con 0x55d35ce28e90 2024-02-18T16:21:21.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.550+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce356e0 con 0x55d35ce2f150 2024-02-18T16:21:21.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94366284862016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce35f30 con 0x55d35ce2f150 2024-02-18T16:21:21.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce36930 con 0x7fe470037070 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94366284859424] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94366284866608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce36ce0 con 0x7fe470037070 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37650 con 0x55d35ce28e90 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94366284862016] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.554+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94366284866608] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94366284853200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce371b0 con 0x55d35ce28e90 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37ea0 con 0x7fe4780141d0 2024-02-18T16:21:21.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94366284853200] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94366284864144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37bd0 con 0x7fe4780141d0 2024-02-18T16:21:21.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.558+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce383d0 con 0x7fe4780141d0 2024-02-18T16:21:21.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94366284864144] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94366284871744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce381a0 con 0x7fe4780141d0 2024-02-18T16:21:21.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce38c40 con 0x7fe4780141d0 2024-02-18T16:21:21.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94366284871744] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94366284875552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce38c00 con 0x7fe4780141d0 2024-02-18T16:21:21.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=0 2024-02-18T16:21:21.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=1 2024-02-18T16:21:21.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=2 2024-02-18T16:21:21.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=3 2024-02-18T16:21:21.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=4 2024-02-18T16:21:21.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=5 2024-02-18T16:21:21.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.562+0000 7fe489cc9980 20 add_watcher() i=6 2024-02-18T16:21:21.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94366284875552] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 add_watcher() i=7 2024-02-18T16:21:21.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:21.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce3c080 con 0x55d35ce28e90 2024-02-18T16:21:21.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94366284872800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce39520 con 0x55d35ce28e90 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94366284872800] v30'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 5 note: GC not initialized 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe33cfe1640 20 reqs_thread_entry: start 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 Filter name: none 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe2b67fc640 20 reqs_thread_entry: start 2024-02-18T16:21:21.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce5e020 con 0x55d35ce28e90 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce603e0 con 0x7fe470037070 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.566+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce63b60 con 0x55d35ce28e90 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v30'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94366285051904 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce60880 con 0x55d35ce28e90 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94366284853200 notify 128849018882 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55d35cdf0d50 con 0x55d35ce28e90 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe36affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94366284853200 notifier 4322 bl.length()=533 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe36affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe36affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(65 notify.4 [notify cookie 94366285051904 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe36affd640 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe34c003ea0 con 0x55d35ce28e90 2024-02-18T16:21:21.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94366285051904 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d35cdf08a0 con 0x55d35ce28e90 2024-02-18T16:21:21.581 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94366284872800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce5cf80 con 0x55d35ce28e90 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94366284872800] v30'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94366284855328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37c60 con 0x7fe470037070 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94366284855328] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 20 remove_watcher() i=0 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 2 removed watcher, disabling cache 2024-02-18T16:21:21.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.570+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94366284859424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37c60 con 0x55d35ce28e90 2024-02-18T16:21:21.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.574+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94366284859424] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.574+0000 7fe489cc9980 20 remove_watcher() i=1 2024-02-18T16:21:21.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.574+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94366284862016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce34820 con 0x55d35ce2f150 2024-02-18T16:21:21.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.574+0000 7fe486fe3640 1 -- 172.21.15.129:0/444860253 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94366284862016] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe470022070 con 0x55d35ce2f150 2024-02-18T16:21:21.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.574+0000 7fe489cc9980 20 remove_watcher() i=2 2024-02-18T16:21:21.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.574+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94366284866608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37c60 con 0x7fe470037070 2024-02-18T16:21:21.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.578+0000 7fe487fe5640 1 -- 172.21.15.129:0/444860253 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94366284866608] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe47803a040 con 0x7fe470037070 2024-02-18T16:21:21.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.578+0000 7fe489cc9980 20 remove_watcher() i=3 2024-02-18T16:21:21.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.578+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94366284853200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37c60 con 0x55d35ce28e90 2024-02-18T16:21:21.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.578+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94366284853200] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x55d35ce28e90 2024-02-18T16:21:21.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.578+0000 7fe489cc9980 20 remove_watcher() i=4 2024-02-18T16:21:21.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.578+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94366284864144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce32fd0 con 0x7fe4780141d0 2024-02-18T16:21:21.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.582+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94366284864144] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.582+0000 7fe489cc9980 20 remove_watcher() i=5 2024-02-18T16:21:21.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.582+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94366284871744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce37c60 con 0x7fe4780141d0 2024-02-18T16:21:21.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.582+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94366284871744] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.582+0000 7fe489cc9980 20 remove_watcher() i=6 2024-02-18T16:21:21.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.582+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94366284875552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d35ce32fd0 con 0x7fe4780141d0 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94366284875552] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4800f3040 con 0x7fe4780141d0 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 20 remove_watcher() i=7 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe4780141d0 msgr2=0x7fe478015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe4780141d0 0x7fe478015940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ce28e90 msgr2=0x55d35ce2b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ce28e90 0x55d35ce2b330 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe470037070 msgr2=0x7fe4700146c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe470037070 0x7fe4700146c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d35ce2f150 msgr2=0x55d35ce31560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d35ce2f150 0x55d35ce31560 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe3500342b0 msgr2=0x7fe350036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe3500342b0 0x7fe350036770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe478011010 tx=0x7fe478020000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 msgr2=0x55d35ce1da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/444860253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ce16b50 0x55d35ce1da60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe470045040 tx=0x7fe470049b80 comp rx=0 tx=0).stop 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 reap_dead start 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe4877e4640 1 -- 172.21.15.129:0/444860253 reap_dead start 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 shutdown_connections 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 >> 172.21.15.129:0/444860253 conn(0x55d35ce12e90 msgr2=0x55d35ce104f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 shutdown_connections 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/444860253 wait complete. 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe360034300 msgr2=0x7fe3600367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe360034300 0x7fe3600367c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55d35cdf7d40 tx=0x7fe478005850 comp rx=0 tx=0).stop 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 msgr2=0x55d35cc74010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 0x55d35cc74010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe470001ee0 tx=0x7fe47000da30 comp rx=0 tx=0).stop 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 shutdown_connections 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe360034300 0x7fe3600367c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/226094430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35cc75b70 0x55d35cc74010 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 >> 172.21.15.129:0/226094430 conn(0x55d35cdfc5f0 msgr2=0x55d35cdfd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 shutdown_connections 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/226094430 wait complete. 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ccffa50 msgr2=0x55d35cdf6fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ccffa50 0x55d35cdf6fa0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe36c0342b0 msgr2=0x7fe36c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe36c0342b0 0x7fe36c036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe470000f70 tx=0x7fe4700012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 msgr2=0x55d35cdf0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cdf0360 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe48001b2c0 tx=0x7fe480018020 comp rx=0 tx=0).stop 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 shutdown_connections 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d35ccffa50 0x55d35cdf6fa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe36c0342b0 0x7fe36c036770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 --2- 172.21.15.129:0/1056881017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d35ccff130 0x55d35cdf0360 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 >> 172.21.15.129:0/1056881017 conn(0x55d35ccfaa00 msgr2=0x55d35cde3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 shutdown_connections 2024-02-18T16:21:21.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.586+0000 7fe489cc9980 1 -- 172.21.15.129:0/1056881017 wait complete. 2024-02-18T16:21:21.604 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:21.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:21.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:21.605 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:21.671 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:21.671 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:21.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18333b2980 1 Processor -- start 2024-02-18T16:21:21.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18333b2980 1 -- start start 2024-02-18T16:21:21.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18333b2980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55dcc0b3a850 0x55dcc0b3cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18333b2980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dcc0a804c0 con 0x55dcc0b36350 2024-02-18T16:21:21.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18333b2980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dcc0a47180 con 0x55dcc0b3a850 2024-02-18T16:21:21.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18306cc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55dcc0b3a850 0x55dcc0b3cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18306cc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55dcc0b3a850 0x55dcc0b3cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47722/0 (socket says 172.21.15.129:47722) 2024-02-18T16:21:21.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f1830ecd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55dcc0b36350 0x55dcc0b36730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42666/0 (socket says 172.21.15.129:42666) 2024-02-18T16:21:21.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18306cc640 1 -- 172.21.15.129:0/2493583173 learned_addr learned my addr 172.21.15.129:0/2493583173 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18306cc640 1 -- 172.21.15.129:0/2493583173 >> v1:172.21.15.80:6789/0 conn(0x55dcc0b36350 legacy=0x55dcc0b36730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.662+0000 7f18306cc640 1 -- 172.21.15.129:0/2493583173 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc0b3e190 con 0x55dcc0b3a850 2024-02-18T16:21:21.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18306cc640 1 --2- 172.21.15.129:0/2493583173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b3a850 0x55dcc0b3cc40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f182400a5c0 tx=0x7f182401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfac91137622600f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f182fecb640 1 -- 172.21.15.129:0/2493583173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240aa470 con 0x55dcc0b3a850 2024-02-18T16:21:21.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f182fecb640 1 -- 172.21.15.129:0/2493583173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240aa5d0 con 0x55dcc0b3a850 2024-02-18T16:21:21.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f182fecb640 1 -- 172.21.15.129:0/2493583173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240aa890 con 0x55dcc0b3a850 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 -- 172.21.15.129:0/2493583173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b3a850 msgr2=0x55dcc0b3cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 --2- 172.21.15.129:0/2493583173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b3a850 0x55dcc0b3cc40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f182400a5c0 tx=0x7f182401b340 comp rx=0 tx=0).stop 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 -- 172.21.15.129:0/2493583173 shutdown_connections 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 --2- 172.21.15.129:0/2493583173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b3a850 0x55dcc0b3cc40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 -- 172.21.15.129:0/2493583173 >> 172.21.15.129:0/2493583173 conn(0x55dcc0aa9a40 msgr2=0x55dcc0aa9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 -- 172.21.15.129:0/2493583173 shutdown_connections 2024-02-18T16:21:21.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.666+0000 7f18333b2980 1 -- 172.21.15.129:0/2493583173 wait complete. 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.682+0000 7f18333b2980 1 Processor -- start 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.682+0000 7f18333b2980 1 -- start start 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c20250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc0a446b0 con 0x55dcc0b36350 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c20250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c20250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47738/0 (socket says 172.21.15.129:47738) 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 -- 172.21.15.129:0/1885361614 learned_addr learned my addr 172.21.15.129:0/1885361614 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 -- 172.21.15.129:0/1885361614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824005df0 con 0x55dcc0b36350 2024-02-18T16:21:21.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 --2- 172.21.15.129:0/1885361614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c20250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1820001cc0 tx=0x7f182000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d8047c2ebdbe12 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f171ee0d640 1 -- 172.21.15.129:0/1885361614 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1820014070 con 0x55dcc0b36350 2024-02-18T16:21:21.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f171ee0d640 1 -- 172.21.15.129:0/1885361614 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000f590 con 0x55dcc0b36350 2024-02-18T16:21:21.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f171ee0d640 1 -- 172.21.15.129:0/1885361614 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1820007040 con 0x55dcc0b36350 2024-02-18T16:21:21.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- 172.21.15.129:0/1885361614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 msgr2=0x55dcc0c20250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 --2- 172.21.15.129:0/1885361614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c20250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1820001cc0 tx=0x7f182000b610 comp rx=0 tx=0).stop 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- 172.21.15.129:0/1885361614 shutdown_connections 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 --2- 172.21.15.129:0/1885361614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c20250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- 172.21.15.129:0/1885361614 >> 172.21.15.129:0/1885361614 conn(0x55dcc0aa9a40 msgr2=0x55dcc0c1bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- 172.21.15.129:0/1885361614 shutdown_connections 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- 172.21.15.129:0/1885361614 wait complete. 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 Processor -- start 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- start start 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f18333b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc0a3fe90 con 0x55dcc0b36350 2024-02-18T16:21:21.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c270a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47746/0 (socket says 172.21.15.129:47746) 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 -- 172.21.15.129:0/2624532888 learned_addr learned my addr 172.21.15.129:0/2624532888 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.686+0000 7f1830ecd640 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc0a804c0 con 0x55dcc0b36350 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f1830ecd640 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c270a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55dcc0c210e0 tx=0x7f1820000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f171d60a640 1 -- 172.21.15.129:0/2624532888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1820014030 con 0x55dcc0b36350 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f171d60a640 1 -- 172.21.15.129:0/2624532888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182001c840 con 0x55dcc0b36350 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f171d60a640 1 -- 172.21.15.129:0/2624532888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182001cb40 con 0x55dcc0b36350 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc0c275e0 con 0x55dcc0b36350 2024-02-18T16:21:21.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc0c27a30 con 0x55dcc0b36350 2024-02-18T16:21:21.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f171d60a640 1 -- 172.21.15.129:0/2624532888 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f182001cca0 con 0x55dcc0b36350 2024-02-18T16:21:21.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f171d60a640 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1718034300 0x7f17180367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f171d60a640 1 -- 172.21.15.129:0/2624532888 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1820006070 con 0x55dcc0b36350 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18306cc640 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1718034300 0x7f17180367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0b3a850 0x55dcc0c2dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c2e260 con 0x55dcc0b3a850 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18316ce640 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0b3a850 0x55dcc0c2dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18306cc640 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1718034300 0x7f17180367c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18240ae000 tx=0x7f18240a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18316ce640 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0b3a850 0x55dcc0c2dd20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18316ce640 1 -- 172.21.15.129:0/2624532888 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182800a4d0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c2e640 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18316ce640 1 -- 172.21.15.129:0/2624532888 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f182800a4d0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c2fef0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18316ce640 1 -- 172.21.15.129:0/2624532888 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f182800a4d0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c2f0f0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18316ce640 1 -- 172.21.15.129:0/2624532888 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182800a4d0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.690+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c2f500 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18316ce640 1 -- 172.21.15.129:0/2624532888 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f182800a4d0 con 0x55dcc0b3a850 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 Processor -- start 2024-02-18T16:21:21.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 -- start start 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 0x55dcc0c3e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc09d8f20 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18306cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 0x55dcc0c3e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18306cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 0x55dcc0c3e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47754/0 (socket says 172.21.15.129:47754) 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18306cc640 1 -- 172.21.15.129:0/4016280923 learned_addr learned my addr 172.21.15.129:0/4016280923 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18306cc640 1 -- 172.21.15.129:0/4016280923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc0c3ef30 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18306cc640 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 0x55dcc0c3e9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f18240ac040 tx=0x7f18240180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f17167fc640 1 -- 172.21.15.129:0/4016280923 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240b3cd0 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc0c3f120 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f17167fc640 1 -- 172.21.15.129:0/4016280923 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240c3070 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc0c3fc10 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f17167fc640 1 -- 172.21.15.129:0/4016280923 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240c8430 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f17167fc640 1 -- 172.21.15.129:0/4016280923 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f18240c5030 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f17167fc640 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f17080342b0 0x7f1708036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f17167fc640 1 -- 172.21.15.129:0/4016280923 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f18240e6900 con 0x55dcc0c3e5d0 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18316ce640 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f17080342b0 0x7f1708036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 Processor -- start 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.694+0000 7f18333b2980 1 -- start start 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18316ce640 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f17080342b0 0x7f1708036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55dcc0c2eb30 tx=0x7f1828005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c4b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc09cc790 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c4b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c4b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47760/0 (socket says 172.21.15.129:47760) 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 -- 172.21.15.129:0/1250618185 learned_addr learned my addr 172.21.15.129:0/1250618185 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 -- 172.21.15.129:0/1250618185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc0c4bfc0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 --2- 172.21.15.129:0/1250618185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c4b9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18240e4d20 tx=0x7f18240c7ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ffde94aadea96b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f1707fff640 1 -- 172.21.15.129:0/1250618185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240bc3b0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f1707fff640 1 -- 172.21.15.129:0/1250618185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824006390 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f1707fff640 1 -- 172.21.15.129:0/1250618185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240c76c0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- 172.21.15.129:0/1250618185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 msgr2=0x55dcc0c4b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 --2- 172.21.15.129:0/1250618185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c4b9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18240e4d20 tx=0x7f18240c7ef0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- 172.21.15.129:0/1250618185 shutdown_connections 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 --2- 172.21.15.129:0/1250618185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c4b9f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- 172.21.15.129:0/1250618185 >> 172.21.15.129:0/1250618185 conn(0x55dcc0c47960 msgr2=0x55dcc0c459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- 172.21.15.129:0/1250618185 shutdown_connections 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- 172.21.15.129:0/1250618185 wait complete. 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 Processor -- start 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- start start 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c52590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18333b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc0c52ad0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c52590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c52590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47766/0 (socket says 172.21.15.129:47766) 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 learned_addr learned my addr 172.21.15.129:0/661927755 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18240d6040 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.698+0000 7f18306cc640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c52590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f18240de040 tx=0x7f18240e4c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f17067fc640 1 -- 172.21.15.129:0/661927755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240bdbe0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc0c52cd0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f17067fc640 1 -- 172.21.15.129:0/661927755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240ea070 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f17067fc640 1 -- 172.21.15.129:0/661927755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240bde70 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc0c52cd0 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f17067fc640 1 -- 172.21.15.129:0/661927755 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f18240e2050 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f17067fc640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f16fc0342b0 0x7f16fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f17067fc640 1 -- 172.21.15.129:0/661927755 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f18240ec070 con 0x55dcc0c4b5d0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18316ce640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f16fc0342b0 0x7f16fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0c5d800 0x55dcc0c5fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c603e0 con 0x55dcc0c5d800 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0c5d800 0x55dcc0c5fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18316ce640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f16fc0342b0 0x7f16fc036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1828011010 tx=0x7f1828020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0c5d800 0x55dcc0c5fc90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 realm 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c607b0 con 0x55dcc0c5d800 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c61030 con 0x55dcc0c5d800 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c61390 con 0x55dcc0c5d800 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c60c90 con 0x55dcc0c5d800 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 20 searching for the correct realm 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dcc0c63710 0x55dcc0c65b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18306cc640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dcc0c63710 0x55dcc0c65b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.702+0000 7f18306cc640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dcc0c63710 0x55dcc0c65b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18306cc640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1824009040 0x7f18240e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f1824009040 2024-02-18T16:21:21.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18316ce640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1824009040 0x7f18240e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18316ce640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1824009040 0x7f18240e6290 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a4d0 con 0x7f1824009040 2024-02-18T16:21:21.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18316ce640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f18280141d0 0x7f1828015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f18280141d0 0x7f1828015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f18280141d0 0x7f1828015940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.706+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f1824009040 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a4d0 con 0x7f1824009040 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f1824009040 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.710+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f1824009040 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f1824009040 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c63710 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.714+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f18280141d0 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x55dcc0c5d800 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c66090 con 0x7f1824009040 2024-02-18T16:21:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c621c0 con 0x55dcc0c5d800 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c61e10 con 0x55dcc0c5d800 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c62a60 con 0x55dcc0c5d800 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 zone default found 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 4 Realm: () 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 zonegroup default 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c664b0 con 0x7f18280141d0 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c68240 con 0x55dcc0c63710 2024-02-18T16:21:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c685d0 con 0x55dcc0c63710 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 started sync module instance, tier type = 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.718+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c67b20 con 0x7f1824009040 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406615398016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c67ed0 con 0x7f1824009040 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c69330 con 0x55dcc0c5d800 2024-02-18T16:21:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406615398016] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406615402992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c69350 con 0x55dcc0c5d800 2024-02-18T16:21:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.722+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c69df0 con 0x55dcc0c63710 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406615406800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6a640 con 0x55dcc0c63710 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6b030 con 0x7f1824009040 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406615402992] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406615411472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6b3e0 con 0x7f1824009040 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6bd50 con 0x55dcc0c5d800 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406615406800] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406615411472] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406615404048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6b8b0 con 0x55dcc0c5d800 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.726+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6c5a0 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406615404048] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406615409056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6c300 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6cb00 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406615409056] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406615416688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6c990 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.730+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6d460 con 0x7f18280141d0 2024-02-18T16:21:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406615420736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6d900 con 0x7f18280141d0 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=0 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=1 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=2 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=3 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=4 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=5 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406615416688] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=6 2024-02-18T16:21:21.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406615420736] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 20 add_watcher() i=7 2024-02-18T16:21:21.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:21.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6c430 con 0x55dcc0c5d800 2024-02-18T16:21:21.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.734+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406615417840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6ddd0 con 0x55dcc0c5d800 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406615417840] v30'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f16e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 5 note: GC not initialized 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f16e5fe3640 20 reqs_thread_entry: start 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 20 Filter name: none 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f16577fe640 20 reqs_thread_entry: start 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 20 rados->read ofs=0 len=0 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c92380 con 0x55dcc0c5d800 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:21.747 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f16e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406615417840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c72f30 con 0x55dcc0c5d800 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94406615417840] v30'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.738+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406615398016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6c3f0 con 0x7f1824009040 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94406615398016] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f18333b2980 20 remove_watcher() i=0 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f18333b2980 2 removed watcher, disabling cache 2024-02-18T16:21:21.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406615402992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c67680 con 0x55dcc0c5d800 2024-02-18T16:21:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94406615402992] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f18333b2980 20 remove_watcher() i=1 2024-02-18T16:21:21.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.742+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406615406800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c67680 con 0x55dcc0c63710 2024-02-18T16:21:21.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18306cc640 1 -- 172.21.15.129:0/661927755 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94406615406800] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18240b0020 con 0x55dcc0c63710 2024-02-18T16:21:21.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18333b2980 20 remove_watcher() i=2 2024-02-18T16:21:21.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406615411472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c698d0 con 0x7f1824009040 2024-02-18T16:21:21.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18316ce640 1 -- 172.21.15.129:0/661927755 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94406615411472] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182803a040 con 0x7f1824009040 2024-02-18T16:21:21.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18333b2980 20 remove_watcher() i=3 2024-02-18T16:21:21.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406615404048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c6ab10 con 0x55dcc0c5d800 2024-02-18T16:21:21.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94406615404048] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x55dcc0c5d800 2024-02-18T16:21:21.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18333b2980 20 remove_watcher() i=4 2024-02-18T16:21:21.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.746+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406615409056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c68e90 con 0x7f18280141d0 2024-02-18T16:21:21.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.750+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94406615409056] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.750+0000 7f18333b2980 20 remove_watcher() i=5 2024-02-18T16:21:21.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.750+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406615416688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c68e90 con 0x7f18280141d0 2024-02-18T16:21:21.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.750+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94406615416688] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.750+0000 7f18333b2980 20 remove_watcher() i=6 2024-02-18T16:21:21.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.750+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406615420736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dcc0c68e90 con 0x7f18280141d0 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94406615420736] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820016070 con 0x7f18280141d0 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 20 remove_watcher() i=7 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f18280141d0 msgr2=0x7f1828015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f18280141d0 0x7f1828015940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0c5d800 msgr2=0x55dcc0c5fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0c5d800 0x55dcc0c5fc90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1824009040 msgr2=0x7f18240e6290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1824009040 0x7f18240e6290 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dcc0c63710 msgr2=0x55dcc0c65b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dcc0c63710 0x55dcc0c65b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f16fc0342b0 msgr2=0x7f16fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f16fc0342b0 0x7f16fc036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1828011010 tx=0x7f1828020000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 msgr2=0x55dcc0c52590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f1830ecd640 1 -- 172.21.15.129:0/661927755 reap_dead start 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c52590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f18240de040 tx=0x7f18240e4c80 comp rx=0 tx=0).stop 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 shutdown_connections 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/661927755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c4b5d0 0x55dcc0c52590 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 >> 172.21.15.129:0/661927755 conn(0x55dcc0c47960 msgr2=0x55dcc0c44fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 shutdown_connections 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/661927755 wait complete. 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f17080342b0 msgr2=0x7f1708036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f17080342b0 0x7f1708036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55dcc0c2eb30 tx=0x7f1828005850 comp rx=0 tx=0).stop 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 msgr2=0x55dcc0c3e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 0x55dcc0c3e9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f18240ac040 tx=0x7f18240180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 shutdown_connections 2024-02-18T16:21:21.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f17080342b0 0x7f1708036770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/4016280923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0c3e5d0 0x55dcc0c3e9f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 >> 172.21.15.129:0/4016280923 conn(0x55dcc0c333e0 msgr2=0x55dcc0c33ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 shutdown_connections 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/4016280923 wait complete. 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0b3a850 msgr2=0x55dcc0c2dd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0b3a850 0x55dcc0c2dd20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1718034300 msgr2=0x7f17180367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1718034300 0x7f17180367c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18240ae000 tx=0x7f18240a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 msgr2=0x55dcc0c270a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c270a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55dcc0c210e0 tx=0x7f1820000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 shutdown_connections 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dcc0b3a850 0x55dcc0c2dd20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1718034300 0x7f17180367c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 --2- 172.21.15.129:0/2624532888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dcc0b36350 0x55dcc0c270a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 >> 172.21.15.129:0/2624532888 conn(0x55dcc0aa9a40 msgr2=0x55dcc0c1a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 shutdown_connections 2024-02-18T16:21:21.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.754+0000 7f18333b2980 1 -- 172.21.15.129:0/2624532888 wait complete. 2024-02-18T16:21:21.769 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:21.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-18T16:21:21.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-18T16:21:21.770 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-02-18T16:21:21.844 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:21.844 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:21.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.838+0000 7f42f9e76980 1 Processor -- start 2024-02-18T16:21:21.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.838+0000 7f42f9e76980 1 -- start start 2024-02-18T16:21:21.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.838+0000 7f42f9e76980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56353133b480 0x56353133d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:21.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.838+0000 7f42f9e76980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563531283460 con 0x5635312ab060 2024-02-18T16:21:21.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.838+0000 7f42f9e76980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x56353124a180 con 0x56353133b480 2024-02-18T16:21:21.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f7190640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56353133b480 0x56353133d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:21.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f7991640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5635312ab060 0x563531339d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42680/0 (socket says 172.21.15.129:42680) 2024-02-18T16:21:21.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f7991640 1 -- 172.21.15.129:0/4111386689 learned_addr learned my addr 172.21.15.129:0/4111386689 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:21.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f7190640 1 -- 172.21.15.129:0/4111386689 >> v1:172.21.15.80:6789/0 conn(0x5635312ab060 legacy=0x563531339d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f7190640 1 -- 172.21.15.129:0/4111386689 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56353133ee80 con 0x56353133b480 2024-02-18T16:21:21.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f7190640 1 --2- 172.21.15.129:0/4111386689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353133b480 0x56353133d870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00a480 tx=0x7f42ec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469e5f07f469df59 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:21.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f698f640 1 -- 172.21.15.129:0/4111386689 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0ab540 con 0x56353133b480 2024-02-18T16:21:21.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f698f640 1 -- 172.21.15.129:0/4111386689 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0ab6a0 con 0x56353133b480 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f698f640 1 -- 172.21.15.129:0/4111386689 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0ab960 con 0x56353133b480 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 -- 172.21.15.129:0/4111386689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353133b480 msgr2=0x56353133d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 --2- 172.21.15.129:0/4111386689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353133b480 0x56353133d870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00a480 tx=0x7f42ec01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 -- 172.21.15.129:0/4111386689 shutdown_connections 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 --2- 172.21.15.129:0/4111386689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353133b480 0x56353133d870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 -- 172.21.15.129:0/4111386689 >> 172.21.15.129:0/4111386689 conn(0x563531331880 msgr2=0x563531333ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 -- 172.21.15.129:0/4111386689 shutdown_connections 2024-02-18T16:21:21.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.842+0000 7f42f9e76980 1 -- 172.21.15.129:0/4111386689 wait complete. 2024-02-18T16:21:21.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 Processor -- start 2024-02-18T16:21:22.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- start start 2024-02-18T16:21:22.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531421190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635312476b0 con 0x5635312ab060 2024-02-18T16:21:22.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531421190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531421190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47792/0 (socket says 172.21.15.129:47792) 2024-02-18T16:21:22.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 -- 172.21.15.129:0/1547327934 learned_addr learned my addr 172.21.15.129:0/1547327934 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 -- 172.21.15.129:0/1547327934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec005d30 con 0x5635312ab060 2024-02-18T16:21:22.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 --2- 172.21.15.129:0/1547327934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531421190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001c90 tx=0x7f42e800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1110844de27a7bb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f41e5e0b640 1 -- 172.21.15.129:0/1547327934 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42e800e690 con 0x5635312ab060 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f41e5e0b640 1 -- 172.21.15.129:0/1547327934 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e800e7f0 con 0x5635312ab060 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f41e5e0b640 1 -- 172.21.15.129:0/1547327934 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42e800eaf0 con 0x5635312ab060 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- 172.21.15.129:0/1547327934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 msgr2=0x563531421190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1547327934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531421190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001c90 tx=0x7f42e800b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- 172.21.15.129:0/1547327934 shutdown_connections 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1547327934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531421190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- 172.21.15.129:0/1547327934 >> 172.21.15.129:0/1547327934 conn(0x563531331880 msgr2=0x56353141cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- 172.21.15.129:0/1547327934 shutdown_connections 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- 172.21.15.129:0/1547327934 wait complete. 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 Processor -- start 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- start start 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531337420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f9e76980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563531242e90 con 0x5635312ab060 2024-02-18T16:21:22.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531337420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531337420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47798/0 (socket says 172.21.15.129:47798) 2024-02-18T16:21:22.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 -- 172.21.15.129:0/3436477349 learned_addr learned my addr 172.21.15.129:0/3436477349 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.858+0000 7f42f7991640 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563531283460 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f7991640 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531337420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001ee0 tx=0x7f42e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f41dffff640 1 -- 172.21.15.129:0/3436477349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42e801f070 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563531337960 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f41dffff640 1 -- 172.21.15.129:0/3436477349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e801a4d0 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f41dffff640 1 -- 172.21.15.129:0/3436477349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42e801a770 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563531335ea0 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f41dffff640 1 -- 172.21.15.129:0/3436477349 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f42e800a040 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f41dffff640 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41e00342b0 0x7f41e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f41dffff640 1 -- 172.21.15.129:0/3436477349 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f42e80498e0 con 0x5635312ab060 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f7190640 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41e00342b0 0x7f41e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56353133b480 0x563531431040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531431580 con 0x56353133b480 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56353133b480 0x563531431040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f7190640 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41e00342b0 0x7f41e0036770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0ad000 tx=0x7f42ec0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56353133b480 0x563531431040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 -- 172.21.15.129:0/3436477349 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42f000a4d0 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314318e0 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 -- 172.21.15.129:0/3436477349 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42f000a4d0 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314330f0 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 -- 172.21.15.129:0/3436477349 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f42f000a4d0 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531432230 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 -- 172.21.15.129:0/3436477349 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42f000a4d0 con 0x56353133b480 2024-02-18T16:21:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531432640 con 0x56353133b480 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.862+0000 7f42f8192640 1 -- 172.21.15.129:0/3436477349 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f42f000a4d0 con 0x56353133b480 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 Processor -- start 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 -- start start 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 0x563531441b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635311dbf20 con 0x563531441770 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f7190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 0x563531441b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f7190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 0x563531441b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47802/0 (socket says 172.21.15.129:47802) 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f7190640 1 -- 172.21.15.129:0/3134513261 learned_addr learned my addr 172.21.15.129:0/3134513261 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f7190640 1 -- 172.21.15.129:0/3134513261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635314420d0 con 0x563531441770 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f7190640 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 0x563531441b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0ab670 tx=0x7f42ec018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f41dd7fa640 1 -- 172.21.15.129:0/3134513261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0be7c0 con 0x563531441770 2024-02-18T16:21:22.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f41dd7fa640 1 -- 172.21.15.129:0/3134513261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0be920 con 0x563531441770 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635314422c0 con 0x563531441770 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f41dd7fa640 1 -- 172.21.15.129:0/3134513261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0bebc0 con 0x563531441770 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563531442e10 con 0x563531441770 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f41dd7fa640 1 -- 172.21.15.129:0/3134513261 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f42ec0bd3e0 con 0x563531441770 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f41dd7fa640 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41d00342b0 0x7f41d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f41dd7fa640 1 -- 172.21.15.129:0/3134513261 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f42ec0e6300 con 0x563531441770 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f8192640 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41d00342b0 0x7f41d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 Processor -- start 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 -- start start 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f8192640 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41d00342b0 0x7f41d0036770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x563531336d00 tx=0x7f42f0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x56353144eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.866+0000 7f42f9e76980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635311cf790 con 0x56353144e720 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x56353144eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x56353144eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47816/0 (socket says 172.21.15.129:47816) 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 -- 172.21.15.129:0/1030981121 learned_addr learned my addr 172.21.15.129:0/1030981121 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 -- 172.21.15.129:0/1030981121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56353144f110 con 0x56353144e720 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 --2- 172.21.15.129:0/1030981121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x56353144eb40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0e4720 tx=0x7f42ec0b4de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266775b90b265d2b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f41d6ffd640 1 -- 172.21.15.129:0/1030981121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0e3070 con 0x56353144e720 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f41d6ffd640 1 -- 172.21.15.129:0/1030981121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0bd690 con 0x56353144e720 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f41d6ffd640 1 -- 172.21.15.129:0/1030981121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0c5360 con 0x56353144e720 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1030981121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 msgr2=0x56353144eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1030981121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x56353144eb40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0e4720 tx=0x7f42ec0b4de0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1030981121 shutdown_connections 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1030981121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x56353144eb40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1030981121 >> 172.21.15.129:0/1030981121 conn(0x56353144aab0 msgr2=0x563531448b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1030981121 shutdown_connections 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1030981121 wait complete. 2024-02-18T16:21:22.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 Processor -- start 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- start start 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x563531455640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563531455b80 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x563531455640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x563531455640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47818/0 (socket says 172.21.15.129:47818) 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 learned_addr learned my addr 172.21.15.129:0/1574743915 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563531442e10 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f7190640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x563531455640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0c58f0 tx=0x7f42ec0e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f41d57fa640 1 -- 172.21.15.129:0/1574743915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0bd800 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f41d57fa640 1 -- 172.21.15.129:0/1574743915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0e60d0 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f41d57fa640 1 -- 172.21.15.129:0/1574743915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42ec0adad0 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563531455d80 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.870+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635314561b0 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f41d57fa640 1 -- 172.21.15.129:0/1574743915 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f42ec0adc30 con 0x56353144e720 2024-02-18T16:21:22.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f41d57fa640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41c0034350 0x7f41c0036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f41d57fa640 1 -- 172.21.15.129:0/1574743915 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f42ec0f59c0 con 0x56353144e720 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f8192640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41c0034350 0x7f41c0036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f8192640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41c0034350 0x7f41c0036810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f0011010 tx=0x7f42f0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563531460a60 0x563531462f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531463670 con 0x563531460a60 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563531460a60 0x563531462f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563531460a60 0x563531462f20 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 realm 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531463a40 con 0x563531460a60 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314642c0 con 0x563531460a60 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531464620 con 0x563531460a60 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531464e20 con 0x563531460a60 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 20 searching for the correct realm 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563531466cb0 0x563531469100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7190640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563531466cb0 0x563531469100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.874+0000 7f42f7190640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563531466cb0 0x563531469100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7190640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f42ec0c7070 0x7f42ec0dd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f8192640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f42ec0c7070 0x7f42ec0dd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f8192640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f42ec0c7070 0x7f42ec0dd830 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42f000a4d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f8192640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f42f00141d0 0x7f42f0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f42f00141d0 0x7f42f0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f42f00141d0 0x7f42f0015940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x7f42f00141d0 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x7f42f00141d0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.878+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x7f42f00141d0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42f000a4d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x7f42f00141d0 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x7f42f00141d0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.882+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f42e8014070 con 0x563531460a60 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531466cb0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.886+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42f00141d0 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x563531460a60 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314697d0 con 0x7f42ec0c7070 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531465780 con 0x563531460a60 2024-02-18T16:21:22.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531465fd0 con 0x563531460a60 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531469c10 con 0x563531460a60 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 zone default found 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 4 Realm: () 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:22.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 zonegroup default 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146a0b0 con 0x7f42f00141d0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146ba90 con 0x563531466cb0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146bdf0 con 0x563531466cb0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 started sync module instance, tier type = 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b060 con 0x7f42ec0c7070 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.890+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94786459972624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b060 con 0x7f42ec0c7070 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146c840 con 0x563531460a60 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94786459972624] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94786459976512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b060 con 0x563531460a60 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146d200 con 0x563531466cb0 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94786459979104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146da50 con 0x563531466cb0 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.894+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146e470 con 0x7f42ec0c7070 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94786459983696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146ecc0 con 0x7f42ec0c7070 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146f6e0 con 0x563531460a60 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94786459976512] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94786459983696] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94786459979104] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94786459981232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146abc0 con 0x563531460a60 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.898+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146ecc0 con 0x7f42f00141d0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94786459981232] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94786459988416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146ecc0 con 0x7f42f00141d0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146ff70 con 0x7f42f00141d0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94786459988416] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94786459985952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146ff70 con 0x7f42f00141d0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.902+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314707b0 con 0x7f42f00141d0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94786459985952] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94786459991920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531470990 con 0x7f42f00141d0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=1 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=2 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=3 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=4 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=5 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=6 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94786459991920] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 20 add_watcher() i=7 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531473d50 con 0x563531460a60 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.906+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94786459994240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531471170 con 0x563531460a60 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94786459994240] v30'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f41adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 5 note: GC not initialized 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f41acfe1640 20 reqs_thread_entry: start 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 Filter name: none 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f41267fc640 20 reqs_thread_entry: start 2024-02-18T16:21:22.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531495c50 con 0x563531460a60 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531495ff0 con 0x7f42f00141d0 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-18T16:21:22.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353149b7d0 con 0x563531460a60 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~459] v30'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.910+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94786460168944 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314984b0 con 0x563531460a60 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94786459981232 notify 128849018883 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x563531335ea0 con 0x563531460a60 2024-02-18T16:21:22.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94786459981232 notifier 4336 bl.length()=635 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(65 notify.4 [notify cookie 94786460168944 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d6ffd640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f41bc003ea0 con 0x563531460a60 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94786460168944 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563531337960 con 0x563531460a60 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353149b2f0 con 0x7f42f00141d0 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f9e76980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f9e76980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f9e76980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94786460151808 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5635314988d0 con 0x563531466cb0 2024-02-18T16:21:22.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== watch-notify(notify (1) cookie 94786459979104 notify 128849018880 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x563531455d80 con 0x563531466cb0 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94786459979104 notifier 4336 bl.length()=177 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 notify.2 [notify cookie 94786460151808 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f41d67fc640 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f412c003400 con 0x563531466cb0 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.914+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== watch-notify(notify_complete (2) cookie 94786460151808 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563531442e10 con 0x563531466cb0 2024-02-18T16:21:22.065 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:22.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f41adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94786459994240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531494fa0 con 0x563531460a60 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94786459994240] v30'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94786459972624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531470880 con 0x7f42ec0c7070 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94786459972624] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f9e76980 20 remove_watcher() i=0 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f9e76980 2 removed watcher, disabling cache 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.918+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94786459976512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531470880 con 0x563531460a60 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94786459976512] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f9e76980 20 remove_watcher() i=1 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94786459979104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563531470880 con 0x563531466cb0 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f7190640 1 -- 172.21.15.129:0/1574743915 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94786459979104] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42ec0ec020 con 0x563531466cb0 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f9e76980 20 remove_watcher() i=2 2024-02-18T16:21:22.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94786459983696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b410 con 0x7f42ec0c7070 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f8192640 1 -- 172.21.15.129:0/1574743915 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94786459983696] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42f003a040 con 0x7f42ec0c7070 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f9e76980 20 remove_watcher() i=3 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.922+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94786459981232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b410 con 0x563531460a60 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.926+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94786459981232] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x563531460a60 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.926+0000 7f42f9e76980 20 remove_watcher() i=4 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.926+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94786459988416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b410 con 0x7f42f00141d0 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.926+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94786459988416] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.926+0000 7f42f9e76980 20 remove_watcher() i=5 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.926+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94786459985952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146f1c0 con 0x7f42f00141d0 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94786459985952] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 20 remove_watcher() i=6 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94786459991920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56353146b410 con 0x7f42f00141d0 2024-02-18T16:21:22.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94786459991920] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42e8059040 con 0x7f42f00141d0 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 20 remove_watcher() i=7 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f42f00141d0 msgr2=0x7f42f0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f42f00141d0 0x7f42f0015940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563531460a60 msgr2=0x563531462f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563531460a60 0x563531462f20 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f42ec0c7070 msgr2=0x7f42ec0dd830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f42ec0c7070 0x7f42ec0dd830 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563531466cb0 msgr2=0x563531469100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563531466cb0 0x563531469100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41c0034350 msgr2=0x7f41c0036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41c0034350 0x7f41c0036810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f0011010 tx=0x7f42f0020000 comp rx=0 tx=0).stop 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f7991640 1 -- 172.21.15.129:0/1574743915 reap_dead start 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 msgr2=0x563531455640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x563531455640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0c58f0 tx=0x7f42ec0e4680 comp rx=0 tx=0).stop 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 shutdown_connections 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/1574743915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56353144e720 0x563531455640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 >> 172.21.15.129:0/1574743915 conn(0x56353144aab0 msgr2=0x563531448110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 shutdown_connections 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/1574743915 wait complete. 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41d00342b0 msgr2=0x7f41d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41d00342b0 0x7f41d0036770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x563531336d00 tx=0x7f42f0005850 comp rx=0 tx=0).stop 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 msgr2=0x563531441b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 0x563531441b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0ab670 tx=0x7f42ec018020 comp rx=0 tx=0).stop 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 shutdown_connections 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41d00342b0 0x7f41d0036770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3134513261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563531441770 0x563531441b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 >> 172.21.15.129:0/3134513261 conn(0x563531436580 msgr2=0x563531437090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 shutdown_connections 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3134513261 wait complete. 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56353133b480 msgr2=0x563531431040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56353133b480 0x563531431040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41e00342b0 msgr2=0x7f41e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41e00342b0 0x7f41e0036770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0ad000 tx=0x7f42ec0a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 msgr2=0x563531337420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531337420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001ee0 tx=0x7f42e8000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 shutdown_connections 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56353133b480 0x563531431040 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41e00342b0 0x7f41e0036770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 --2- 172.21.15.129:0/3436477349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5635312ab060 0x563531337420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 >> 172.21.15.129:0/3436477349 conn(0x563531331880 msgr2=0x56353141b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.930+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 shutdown_connections 2024-02-18T16:21:22.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:21.934+0000 7f42f9e76980 1 -- 172.21.15.129:0/3436477349 wait complete. 2024-02-18T16:21:22.076 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:22.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:22.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:22.076 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:22.149 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:22.150 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:22.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dd49b980 1 Processor -- start 2024-02-18T16:21:22.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dd49b980 1 -- start start 2024-02-18T16:21:22.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dd49b980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e570827040 0x55e570827420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dd49b980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e5707744c0 con 0x55e570827960 2024-02-18T16:21:22.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dd49b980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e57073b180 con 0x55e570827040 2024-02-18T16:21:22.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dafb6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e570827040 0x55e570827420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1da7b5640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55e570827960 0x55e570828320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42686/0 (socket says 172.21.15.129:42686) 2024-02-18T16:21:22.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1da7b5640 1 -- 172.21.15.129:0/2332644674 learned_addr learned my addr 172.21.15.129:0/2332644674 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:22.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dafb6640 1 -- 172.21.15.129:0/2332644674 >> v1:172.21.15.80:6789/0 conn(0x55e570827960 legacy=0x55e570828320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.146+0000 7fd1dafb6640 1 -- 172.21.15.129:0/2332644674 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e570828b50 con 0x55e570827040 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/2332644674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570827420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a420 tx=0x7fd1cc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838cf598286e186b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1d9fb4640 1 -- 172.21.15.129:0/2332644674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0aa530 con 0x55e570827040 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1d9fb4640 1 -- 172.21.15.129:0/2332644674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0a6050 con 0x55e570827040 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1d9fb4640 1 -- 172.21.15.129:0/2332644674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0aa800 con 0x55e570827040 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2332644674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 msgr2=0x55e570827420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/2332644674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570827420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00a420 tx=0x7fd1cc01afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2332644674 shutdown_connections 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/2332644674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570827420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2332644674 >> 172.21.15.129:0/2332644674 conn(0x55e570822910 msgr2=0x55e570824d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2332644674 shutdown_connections 2024-02-18T16:21:22.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.150+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2332644674 wait complete. 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dd49b980 1 Processor -- start 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dd49b980 1 -- start start 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dd49b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e57079c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dd49b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5707386b0 con 0x55e570827040 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dafb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e57079c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dafb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e57079c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47832/0 (socket says 172.21.15.129:47832) 2024-02-18T16:21:22.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dafb6640 1 -- 172.21.15.129:0/1902291998 learned_addr learned my addr 172.21.15.129:0/1902291998 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.162+0000 7fd1dafb6640 1 -- 172.21.15.129:0/1902291998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc00a100 con 0x55e570827040 2024-02-18T16:21:22.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/1902291998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e57079c020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0ad040 tx=0x7fd1cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb92da40de5e570 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd0c7e17640 1 -- 172.21.15.129:0/1902291998 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0aa6c0 con 0x55e570827040 2024-02-18T16:21:22.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd0c7e17640 1 -- 172.21.15.129:0/1902291998 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0aa820 con 0x55e570827040 2024-02-18T16:21:22.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd0c7e17640 1 -- 172.21.15.129:0/1902291998 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0aaac0 con 0x55e570827040 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1902291998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 msgr2=0x55e57079c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1902291998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e57079c020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0ad040 tx=0x7fd1cc0033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1902291998 shutdown_connections 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1902291998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e57079c020 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1902291998 >> 172.21.15.129:0/1902291998 conn(0x55e570822910 msgr2=0x55e57090d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1902291998 shutdown_connections 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1902291998 wait complete. 2024-02-18T16:21:22.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 Processor -- start 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- start start 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570912b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e570733e90 con 0x55e570827040 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dafb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570912b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dafb6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570912b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47834/0 (socket says 172.21.15.129:47834) 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dafb6640 1 -- 172.21.15.129:0/1602377058 learned_addr learned my addr 172.21.15.129:0/1602377058 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dafb6640 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e570828b50 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570912b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc003430 tx=0x7fd1cc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd0c6614640 1 -- 172.21.15.129:0/1602377058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0b6950 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e570913040 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd0c6614640 1 -- 172.21.15.129:0/1602377058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0b6ab0 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd0c6614640 1 -- 172.21.15.129:0/1602377058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1cc0b6d50 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.166+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5709115b0 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd0c6614640 1 -- 172.21.15.129:0/1602377058 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd1cc0c0450 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd0c6614640 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0c00342b0 0x7fd0c0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd0c6614640 1 -- 172.21.15.129:0/1602377058 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd1cc0e3ff0 con 0x55e570827040 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0c00342b0 0x7fd0c0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570827960 0x55e5709221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570922720 con 0x55e570827960 2024-02-18T16:21:22.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570827960 0x55e5709221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0c00342b0 0x7fd0c0036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4001da0 tx=0x7fd1c4001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570827960 0x55e5709221e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 -- 172.21.15.129:0/1602377058 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1d40083f0 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570922a80 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 -- 172.21.15.129:0/1602377058 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1d40083f0 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570924310 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 -- 172.21.15.129:0/1602377058 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fd1d40083f0 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570923510 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 -- 172.21.15.129:0/1602377058 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1d40083f0 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570923920 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1db7b7640 1 -- 172.21.15.129:0/1602377058 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd1d4012040 con 0x55e570827960 2024-02-18T16:21:22.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 Processor -- start 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- start start 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 0x55e570932df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1dd49b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5706ccf20 con 0x55e5709329d0 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1da7b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 0x55e570932df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1da7b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 0x55e570932df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47836/0 (socket says 172.21.15.129:47836) 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.170+0000 7fd1da7b5640 1 -- 172.21.15.129:0/3504620780 learned_addr learned my addr 172.21.15.129:0/3504620780 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1da7b5640 1 -- 172.21.15.129:0/3504620780 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e570933330 con 0x55e5709329d0 2024-02-18T16:21:22.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 0x55e570932df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400d660 tx=0x7fd1c400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd0bf7fe640 1 -- 172.21.15.129:0/3504620780 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c4020070 con 0x55e5709329d0 2024-02-18T16:21:22.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd0bf7fe640 1 -- 172.21.15.129:0/3504620780 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400c770 con 0x55e5709329d0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e570933580 con 0x55e5709329d0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd0bf7fe640 1 -- 172.21.15.129:0/3504620780 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c4013040 con 0x55e5709329d0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5709340d0 con 0x55e5709329d0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd0bf7fe640 1 -- 172.21.15.129:0/3504620780 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd1c400a040 con 0x55e5709329d0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd0bf7fe640 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0b4034300 0x7fd0b40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd0bf7fe640 1 -- 172.21.15.129:0/3504620780 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd1c404b580 con 0x55e5709329d0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0b4034300 0x7fd0b40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1dd49b980 1 Processor -- start 2024-02-18T16:21:22.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0b4034300 0x7fd0b40367c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55e570922f50 tx=0x7fd1d4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1dd49b980 1 -- start start 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1dd49b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e57093fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1dd49b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5706c0790 con 0x55e57093f9a0 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1da7b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e57093fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1da7b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e57093fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47838/0 (socket says 172.21.15.129:47838) 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.174+0000 7fd1da7b5640 1 -- 172.21.15.129:0/2972621061 learned_addr learned my addr 172.21.15.129:0/2972621061 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 -- 172.21.15.129:0/2972621061 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e570940390 con 0x55e57093f9a0 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/2972621061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e57093fdc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4019ef0 tx=0x7fd1c40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351a572ed43afa5b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd0bd7fa640 1 -- 172.21.15.129:0/2972621061 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c401b7a0 con 0x55e57093f9a0 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd0bd7fa640 1 -- 172.21.15.129:0/2972621061 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c401b900 con 0x55e57093f9a0 2024-02-18T16:21:22.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd0bd7fa640 1 -- 172.21.15.129:0/2972621061 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c401acc0 con 0x55e57093f9a0 2024-02-18T16:21:22.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2972621061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 msgr2=0x55e57093fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/2972621061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e57093fdc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4019ef0 tx=0x7fd1c40196f0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2972621061 shutdown_connections 2024-02-18T16:21:22.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/2972621061 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e57093fdc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2972621061 >> 172.21.15.129:0/2972621061 conn(0x55e57093bd30 msgr2=0x55e570939d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2972621061 shutdown_connections 2024-02-18T16:21:22.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/2972621061 wait complete. 2024-02-18T16:21:22.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 Processor -- start 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- start start 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e570946940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e570946e80 con 0x55e57093f9a0 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e570946940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e570946940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47846/0 (socket says 172.21.15.129:47846) 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 learned_addr learned my addr 172.21.15.129:0/630996311 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5709340d0 con 0x55e57093f9a0 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e570946940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40199a0 tx=0x7fd1c4049900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd0ab7fe640 1 -- 172.21.15.129:0/630996311 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c401b420 con 0x55e57093f9a0 2024-02-18T16:21:22.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e570947080 con 0x55e57093f9a0 2024-02-18T16:21:22.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd0ab7fe640 1 -- 172.21.15.129:0/630996311 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4034070 con 0x55e57093f9a0 2024-02-18T16:21:22.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd0ab7fe640 1 -- 172.21.15.129:0/630996311 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1c40485d0 con 0x55e57093f9a0 2024-02-18T16:21:22.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.178+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e570947510 con 0x55e57093f9a0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd0ab7fe640 1 -- 172.21.15.129:0/630996311 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd1c400ca30 con 0x55e57093f9a0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd0ab7fe640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0a40342b0 0x7fd0a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd0ab7fe640 1 -- 172.21.15.129:0/630996311 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd1c4040020 con 0x55e57093f9a0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0a40342b0 0x7fd0a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570951e80 0x55e570954320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570954a70 con 0x55e570951e80 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570951e80 0x55e570954320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0a40342b0 0x7fd0a4036770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4008fd0 tx=0x7fd1d401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570951e80 0x55e570954320 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 realm 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570954e40 con 0x55e570951e80 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570955690 con 0x55e570951e80 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5709559f0 con 0x55e570951e80 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570955330 con 0x55e570951e80 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 20 searching for the correct realm 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e570957c40 0x55e57095a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e570957c40 0x55e57095a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.182+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e570957c40 0x55e57095a050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1da7b5640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd1c4014a30 0x7fd1c403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1c4014a30 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd1c4014a30 0x7fd1c403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd1c4014a30 0x7fd1c403b050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d402c040 con 0x7fd1c4014a30 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1db7b7640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd1d4027940 0x7fd1d40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd1d4027940 0x7fd1d40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd1d4027940 0x7fd1d40333c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.186+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1c4014a30 2024-02-18T16:21:22.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d402c040 con 0x7fd1c4014a30 2024-02-18T16:21:22.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1c4014a30 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd1d402c040 con 0x7fd1c4014a30 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.190+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1c4014a30 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d402c040 con 0x7fd1c4014a30 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1c4014a30 2024-02-18T16:21:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d402c040 con 0x7fd1c4014a30 2024-02-18T16:21:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570957c40 2024-02-18T16:21:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.194+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1d4027940 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x55e570951e80 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095a720 con 0x7fd1c4014a30 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd1d402c040 con 0x7fd1c4014a30 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570956890 con 0x55e570951e80 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570956510 con 0x55e570951e80 2024-02-18T16:21:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5709571e0 con 0x55e570951e80 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 zone default found 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 4 Realm: () 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 zonegroup default 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095b000 con 0x7fd1d4027940 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095c9e0 con 0x55e570957c40 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095cd40 con 0x55e570957c40 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 started sync module instance, tier type = 2024-02-18T16:21:22.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095bfb0 con 0x7fd1c4014a30 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403f040 con 0x7fd1c4014a30 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.198+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443924734848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095bfb0 con 0x7fd1c4014a30 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095d780 con 0x55e570951e80 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443924734848] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403f040 con 0x7fd1c4014a30 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443924738656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095bfb0 con 0x55e570951e80 2024-02-18T16:21:22.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095e140 con 0x55e570957c40 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443924741280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095e9c0 con 0x55e570957c40 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.202+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095f3c0 con 0x7fd1c4014a30 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443924738656] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403f040 con 0x7fd1c4014a30 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443924745920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095f770 con 0x7fd1c4014a30 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570960120 con 0x55e570951e80 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443924741280] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443924745920] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403f040 con 0x7fd1c4014a30 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443924732688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095fc40 con 0x55e570951e80 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.206+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570960970 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443924732688] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443924743456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570960660 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570960e60 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443924743456] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443924751264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570960d40 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.210+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570961810 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443924751264] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443924755184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5709617d0 con 0x7fd1d4027940 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=0 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=1 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=2 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=3 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=4 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=5 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=6 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443924755184] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 20 add_watcher() i=7 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570964d00 con 0x55e570951e80 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.214+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443924752320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570962090 con 0x55e570951e80 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443924752320] v30'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd08b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 5 note: GC not initialized 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd08a7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 20 Filter name: none 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fcffbfff640 20 reqs_thread_entry: start 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5709866c0 con 0x55e570951e80 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 20 rados_obj.operate() r=0 bl.length=459 2024-02-18T16:21:22.231 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd08b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443924752320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e570985730 con 0x55e570951e80 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94443924752320] v30'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.218+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443924734848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5709607c0 con 0x7fd1c4014a30 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94443924734848] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403f040 con 0x7fd1c4014a30 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1dd49b980 20 remove_watcher() i=0 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1dd49b980 2 removed watcher, disabling cache 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443924738656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095c360 con 0x55e570951e80 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94443924738656] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1dd49b980 20 remove_watcher() i=1 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.222+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443924741280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095d260 con 0x55e570957c40 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.226+0000 7fd1da7b5640 1 -- 172.21.15.129:0/630996311 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94443924741280] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1c4022070 con 0x55e570957c40 2024-02-18T16:21:22.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.226+0000 7fd1dd49b980 20 remove_watcher() i=2 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.226+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443924745920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095c360 con 0x7fd1c4014a30 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.226+0000 7fd1db7b7640 1 -- 172.21.15.129:0/630996311 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94443924745920] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1d403f040 con 0x7fd1c4014a30 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.226+0000 7fd1dd49b980 20 remove_watcher() i=3 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.226+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443924732688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095eec0 con 0x55e570951e80 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94443924732688] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x55e570951e80 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dd49b980 20 remove_watcher() i=4 2024-02-18T16:21:22.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443924743456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095eec0 con 0x7fd1d4027940 2024-02-18T16:21:22.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94443924743456] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dd49b980 20 remove_watcher() i=5 2024-02-18T16:21:22.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443924751264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095e520 con 0x7fd1d4027940 2024-02-18T16:21:22.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94443924751264] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dd49b980 20 remove_watcher() i=6 2024-02-18T16:21:22.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.230+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443924755184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e57095e520 con 0x7fd1d4027940 2024-02-18T16:21:22.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94443924755184] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd1cc0c6070 con 0x7fd1d4027940 2024-02-18T16:21:22.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 20 remove_watcher() i=7 2024-02-18T16:21:22.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd1d4027940 msgr2=0x7fd1d40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd1d4027940 0x7fd1d40333c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570951e80 msgr2=0x55e570954320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570951e80 0x55e570954320 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd1c4014a30 msgr2=0x7fd1c403b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd1c4014a30 0x7fd1c403b050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e570957c40 msgr2=0x55e57095a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e570957c40 0x55e57095a050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0a40342b0 msgr2=0x7fd0a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0a40342b0 0x7fd0a4036770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4008fd0 tx=0x7fd1d401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 msgr2=0x55e570946940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/630996311 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e57093f9a0 0x55e570946940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40199a0 tx=0x7fd1c4049900 comp rx=0 tx=0).stop 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dafb6640 1 -- 172.21.15.129:0/630996311 reap_dead start 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 shutdown_connections 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 >> 172.21.15.129:0/630996311 conn(0x55e57093bd30 msgr2=0x55e570939390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 shutdown_connections 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/630996311 wait complete. 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0b4034300 msgr2=0x7fd0b40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0b4034300 0x7fd0b40367c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55e570922f50 tx=0x7fd1d4003070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 msgr2=0x55e570932df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 0x55e570932df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400d660 tx=0x7fd1c400da60 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 shutdown_connections 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0b4034300 0x7fd0b40367c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/3504620780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5709329d0 0x55e570932df0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 >> 172.21.15.129:0/3504620780 conn(0x55e5709277e0 msgr2=0x55e5709282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 shutdown_connections 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/3504620780 wait complete. 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570827960 msgr2=0x55e5709221e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570827960 0x55e5709221e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0c00342b0 msgr2=0x7fd0c0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0c00342b0 0x7fd0c0036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4001da0 tx=0x7fd1c4001300 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 msgr2=0x55e570912b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570912b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc003430 tx=0x7fd1cc019810 comp rx=0 tx=0).stop 2024-02-18T16:21:22.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 shutdown_connections 2024-02-18T16:21:22.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e570827960 0x55e5709221e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd0c00342b0 0x7fd0c0036770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 --2- 172.21.15.129:0/1602377058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e570827040 0x55e570912b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 >> 172.21.15.129:0/1602377058 conn(0x55e570822910 msgr2=0x55e57090bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 shutdown_connections 2024-02-18T16:21:22.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.234+0000 7fd1dd49b980 1 -- 172.21.15.129:0/1602377058 wait complete. 2024-02-18T16:21:22.249 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:22.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-18T16:21:22.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-18T16:21:22.250 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-02-18T16:21:22.324 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:22.325 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:22.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.318+0000 7fe7d4bc3980 1 Processor -- start 2024-02-18T16:21:22.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.318+0000 7fe7d4bc3980 1 -- start start 2024-02-18T16:21:22.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.318+0000 7fe7d4bc3980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5623dba876f0 0x5623dba89ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.318+0000 7fe7d4bc3980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5623db9cf4d0 con 0x5623dba815e0 2024-02-18T16:21:22.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.318+0000 7fe7d4bc3980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5623db996180 con 0x5623dba876f0 2024-02-18T16:21:22.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d1edd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5623dba876f0 0x5623dba89ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d26de640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5623dba815e0 0x5623dba819c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42698/0 (socket says 172.21.15.129:42698) 2024-02-18T16:21:22.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d26de640 1 -- 172.21.15.129:0/3029663275 learned_addr learned my addr 172.21.15.129:0/3029663275 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:22.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d1edd640 1 -- 172.21.15.129:0/3029663275 >> v1:172.21.15.80:6789/0 conn(0x5623dba815e0 legacy=0x5623dba819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d1edd640 1 -- 172.21.15.129:0/3029663275 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623dba8b030 con 0x5623dba876f0 2024-02-18T16:21:22.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/3029663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba876f0 0x5623dba89ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00a480 tx=0x7fe7bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5932b42ebae11bd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d16dc640 1 -- 172.21.15.129:0/3029663275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0ab540 con 0x5623dba876f0 2024-02-18T16:21:22.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d16dc640 1 -- 172.21.15.129:0/3029663275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0ab6a0 con 0x5623dba876f0 2024-02-18T16:21:22.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d16dc640 1 -- 172.21.15.129:0/3029663275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0ab960 con 0x5623dba876f0 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/3029663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba876f0 msgr2=0x5623dba89ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/3029663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba876f0 0x5623dba89ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00a480 tx=0x7fe7bc01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/3029663275 shutdown_connections 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/3029663275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba876f0 0x5623dba89ae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/3029663275 >> 172.21.15.129:0/3029663275 conn(0x5623dba7d070 msgr2=0x5623dba7f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/3029663275 shutdown_connections 2024-02-18T16:21:22.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.322+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/3029663275 wait complete. 2024-02-18T16:21:22.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 Processor -- start 2024-02-18T16:21:22.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- start start 2024-02-18T16:21:22.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb6d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623db9936b0 con 0x5623dba815e0 2024-02-18T16:21:22.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb6d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb6d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47870/0 (socket says 172.21.15.129:47870) 2024-02-18T16:21:22.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 -- 172.21.15.129:0/2111368883 learned_addr learned my addr 172.21.15.129:0/2111368883 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 -- 172.21.15.129:0/2111368883 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc005d30 con 0x5623dba815e0 2024-02-18T16:21:22.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 --2- 172.21.15.129:0/2111368883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb6d110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4001c00 tx=0x7fe7c400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a95f6f6cce5eed server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe6c0608640 1 -- 172.21.15.129:0/2111368883 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c400e690 con 0x5623dba815e0 2024-02-18T16:21:22.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe6c0608640 1 -- 172.21.15.129:0/2111368883 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c400e810 con 0x5623dba815e0 2024-02-18T16:21:22.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe6c0608640 1 -- 172.21.15.129:0/2111368883 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c400eb30 con 0x5623dba815e0 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2111368883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 msgr2=0x5623dbb6d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2111368883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb6d110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4001c00 tx=0x7fe7c400b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2111368883 shutdown_connections 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2111368883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb6d110 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2111368883 >> 172.21.15.129:0/2111368883 conn(0x5623dba7d070 msgr2=0x5623dbb68ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2111368883 shutdown_connections 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2111368883 wait complete. 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 Processor -- start 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- start start 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb73f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d4bc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623db98ee90 con 0x5623dba815e0 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb73f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb73f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47876/0 (socket says 172.21.15.129:47876) 2024-02-18T16:21:22.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.338+0000 7fe7d26de640 1 -- 172.21.15.129:0/1289718055 learned_addr learned my addr 172.21.15.129:0/1289718055 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d26de640 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623db9cf4d0 con 0x5623dba815e0 2024-02-18T16:21:22.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d26de640 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb73f60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400b710 tx=0x7fe7c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe6bee05640 1 -- 172.21.15.129:0/1289718055 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c401f070 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe6bee05640 1 -- 172.21.15.129:0/1289718055 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c401a910 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5623dbb744a0 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe6bee05640 1 -- 172.21.15.129:0/1289718055 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c401abf0 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623dbb748f0 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe6bee05640 1 -- 172.21.15.129:0/1289718055 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe7c400a040 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe6bee05640 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6b8034300 0x7fe6b80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe6bee05640 1 -- 172.21.15.129:0/1289718055 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe7c4049f50 con 0x5623dba815e0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6b8034300 0x7fe6b80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dba876f0 0x5623dbb7abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbb7b120 con 0x5623dba876f0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dba876f0 0x5623dbb7abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6b8034300 0x7fe6b80367c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0ad000 tx=0x7fe7bc0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dba876f0 0x5623dbb7abe0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d2edf640 1 -- 172.21.15.129:0/1289718055 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x5623dba876f0 2024-02-18T16:21:22.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbb7b510 con 0x5623dba876f0 2024-02-18T16:21:22.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d2edf640 1 -- 172.21.15.129:0/1289718055 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x5623dba876f0 2024-02-18T16:21:22.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbb7cdc0 con 0x5623dba876f0 2024-02-18T16:21:22.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.342+0000 7fe7d2edf640 1 -- 172.21.15.129:0/1289718055 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x5623dba876f0 2024-02-18T16:21:22.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbb7bfc0 con 0x5623dba876f0 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d2edf640 1 -- 172.21.15.129:0/1289718055 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x5623dba876f0 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbb7c3d0 con 0x5623dba876f0 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d2edf640 1 -- 172.21.15.129:0/1289718055 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x5623dba876f0 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 Processor -- start 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 -- start start 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 0x5623dba82680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623db927f20 con 0x5623dba841e0 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d1edd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 0x5623dba82680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d1edd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 0x5623dba82680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47884/0 (socket says 172.21.15.129:47884) 2024-02-18T16:21:22.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2624677317 learned_addr learned my addr 172.21.15.129:0/2624677317 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2624677317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623dba82bc0 con 0x5623dba841e0 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 0x5623dba82680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc096e80 tx=0x7fe7bc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe6b7fff640 1 -- 172.21.15.129:0/2624677317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0bd8a0 con 0x5623dba841e0 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe6b7fff640 1 -- 172.21.15.129:0/2624677317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0bda00 con 0x5623dba841e0 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5623dba82e10 con 0x5623dba841e0 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe6b7fff640 1 -- 172.21.15.129:0/2624677317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0bdca0 con 0x5623dba841e0 2024-02-18T16:21:22.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623dba832a0 con 0x5623dba841e0 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.346+0000 7fe6b7fff640 1 -- 172.21.15.129:0/2624677317 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe7bc0be480 con 0x5623dba841e0 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe6b7fff640 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6ac0342b0 0x7fe6ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe6b7fff640 1 -- 172.21.15.129:0/2624677317 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe7bc0e6360 con 0x5623dba841e0 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6ac0342b0 0x7fe6ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 Processor -- start 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- start start 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbb9aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623db91b790 con 0x5623dbb9a6a0 2024-02-18T16:21:22.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6ac0342b0 0x7fe6ac036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5623dbb7ba00 tx=0x7fe7cc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbb9aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbb9aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47900/0 (socket says 172.21.15.129:47900) 2024-02-18T16:21:22.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2600473550 learned_addr learned my addr 172.21.15.129:0/2600473550 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2600473550 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623dbb9b090 con 0x5623dbb9a6a0 2024-02-18T16:21:22.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/2600473550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbb9aac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0e4780 tx=0x7fe7bc0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b7f2aab65c273e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe6b5ffb640 1 -- 172.21.15.129:0/2600473550 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0064c0 con 0x5623dbb9a6a0 2024-02-18T16:21:22.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe6b5ffb640 1 -- 172.21.15.129:0/2600473550 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0be730 con 0x5623dbb9a6a0 2024-02-18T16:21:22.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe6b5ffb640 1 -- 172.21.15.129:0/2600473550 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0b4c50 con 0x5623dbb9a6a0 2024-02-18T16:21:22.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2600473550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 msgr2=0x5623dbb9aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2600473550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbb9aac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0e4780 tx=0x7fe7bc0aae30 comp rx=0 tx=0).stop 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2600473550 shutdown_connections 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2600473550 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbb9aac0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2600473550 >> 172.21.15.129:0/2600473550 conn(0x5623dbb969e0 msgr2=0x5623dbb94a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2600473550 shutdown_connections 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2600473550 wait complete. 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 Processor -- start 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- start start 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbba15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d4bc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dbba1ae0 con 0x5623dbb9a6a0 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbba15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbba15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47910/0 (socket says 172.21.15.129:47910) 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 learned_addr learned my addr 172.21.15.129:0/2830758397 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.350+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623dba832a0 con 0x5623dbb9a6a0 2024-02-18T16:21:22.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbba15a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0aae70 tx=0x7fe7bc0e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe6a3fff640 1 -- 172.21.15.129:0/2830758397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0d5050 con 0x5623dbb9a6a0 2024-02-18T16:21:22.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5623dbba1ce0 con 0x5623dbb9a6a0 2024-02-18T16:21:22.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe6a3fff640 1 -- 172.21.15.129:0/2830758397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0d6040 con 0x5623dbb9a6a0 2024-02-18T16:21:22.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623dbba20b0 con 0x5623dbb9a6a0 2024-02-18T16:21:22.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe6a3fff640 1 -- 172.21.15.129:0/2830758397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7bc0be8a0 con 0x5623dbb9a6a0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe6a3fff640 1 -- 172.21.15.129:0/2830758397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe7bc0b4c50 con 0x5623dbb9a6a0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe6a3fff640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe69c0342b0 0x7fe69c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe6a3fff640 1 -- 172.21.15.129:0/2830758397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe7bc0ddc70 con 0x5623dbb9a6a0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe69c0342b0 0x7fe69c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dbbacb70 0x5623dbbaf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbaf780 con 0x5623dbbacb70 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dbbacb70 0x5623dbbaf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe69c0342b0 0x7fe69c036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc011010 tx=0x7fe7cc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dbbacb70 0x5623dbbaf030 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 realm 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbafb50 con 0x5623dbbacb70 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb03a0 con 0x5623dbbacb70 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb0700 con 0x5623dbbacb70 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb0f00 con 0x5623dbbacb70 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 20 searching for the correct realm 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5623dbbb2e50 0x5623dbbb52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.354+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5623dbbb2e50 0x5623dbbb52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5623dbbb2e50 0x5623dbbb52a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0d8070 con 0x5623dbbb2e50 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d1edd640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe7bc0c7070 0x7fe7bc0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7bc0c7070 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe7bc0c7070 0x7fe7bc0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe7bc0c7070 0x7fe7bc0c9080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x7fe7bc0c7070 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d2edf640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe7cc0141d0 0x7fe7cc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe7cc0141d0 0x7fe7cc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe7cc0141d0 0x7fe7cc015940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c401ad50 con 0x7fe7cc0141d0 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c401ad50 con 0x5623dbbacb70 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.358+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7bc0c7070 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7cc00a4d0 con 0x7fe7bc0c7070 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x5623dbbacb70 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x5623dbbacb70 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7bc0c7070 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.362+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x5623dbbacb70 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe7c404b040 con 0x5623dbbacb70 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7bc0c7070 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x5623dbbacb70 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7bc0c7070 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbb2e50 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.366+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7cc0141d0 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7c404b040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x5623dbbacb70 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5920 con 0x7fe7bc0c7070 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb18c0 con 0x5623dbbacb70 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb2110 con 0x5623dbbacb70 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5d60 con 0x5623dbbacb70 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 zone default found 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 4 Realm: () 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 zonegroup default 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb5d90 con 0x7fe7cc0141d0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb7b70 con 0x5623dbbb2e50 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb7f00 con 0x5623dbbb2e50 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 started sync module instance, tier type = 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb7450 con 0x7fe7bc0c7070 2024-02-18T16:21:22.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94712010338224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb7800 con 0x7fe7bc0c7070 2024-02-18T16:21:22.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.370+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb8c60 con 0x5623dbbacb70 2024-02-18T16:21:22.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.374+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94712010338224] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.374+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.374+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94712010343200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb8c60 con 0x5623dbbacb70 2024-02-18T16:21:22.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.374+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb9700 con 0x5623dbbb2e50 2024-02-18T16:21:22.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94712010343200] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94712010346976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb9ab0 con 0x5623dbbb2e50 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbba420 con 0x7fe7bc0c7070 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94712010350736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbab70 con 0x7fe7bc0c7070 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbb620 con 0x5623dbbacb70 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94712010346976] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94712010350736] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94712010354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbb5e0 con 0x5623dbbacb70 2024-02-18T16:21:22.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.378+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbba740 con 0x7fe7cc0141d0 2024-02-18T16:21:22.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94712010354976] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94712010344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbbe50 con 0x7fe7cc0141d0 2024-02-18T16:21:22.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbc7c0 con 0x7fe7cc0141d0 2024-02-18T16:21:22.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94712010344256] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94712010357168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbc7c0 con 0x7fe7cc0141d0 2024-02-18T16:21:22.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.382+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbd000 con 0x7fe7cc0141d0 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94712010357168] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94712010360064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbcf20 con 0x7fe7cc0141d0 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=0 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=1 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=2 2024-02-18T16:21:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=3 2024-02-18T16:21:22.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=4 2024-02-18T16:21:22.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=5 2024-02-18T16:21:22.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=6 2024-02-18T16:21:22.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94712010360064] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 20 add_watcher() i=7 2024-02-18T16:21:22.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:22.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbc03f0 con 0x5623dbbacb70 2024-02-18T16:21:22.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.386+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94712010361280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbd890 con 0x5623dbbacb70 2024-02-18T16:21:22.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94712010361280] v30'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe688fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 5 note: GC not initialized 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe6037fe640 20 reqs_thread_entry: start 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 20 Filter name: none 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe6017fa640 20 reqs_thread_entry: start 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbe2400 con 0x5623dbbacb70 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 20 rados_obj.operate() r=0 bl.length=459 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:22.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:22.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbe7f40 con 0x5623dbbacb70 2024-02-18T16:21:22.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94712010537952 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbe4c60 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94712010354976 notify 128849018884 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fe7c4056040 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe6b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94712010354976 notifier 4350 bl.length()=533 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe6b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 94712010537952 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe6b5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe6b5ffb640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe698003ea0 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94712010537952 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5623dbb748f0 con 0x5623dbbacb70 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.390+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94712010537952 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbe4c60 con 0x5623dbbb2e50 2024-02-18T16:21:22.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== watch-notify(notify (1) cookie 94712010346976 notify 128849018881 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5623dbba20b0 con 0x5623dbbb2e50 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe6b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94712010346976 notifier 4350 bl.length()=170 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(66 notify.2 [notify cookie 94712010537952 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe6b5ffb640 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe698003ea0 con 0x5623dbbb2e50 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== watch-notify(notify_complete (2) cookie 94712010537952 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5623dbba1ce0 con 0x5623dbbb2e50 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbe7be0 con 0x7fe7cc0141d0 2024-02-18T16:21:22.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.401 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:22.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe688fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94712010361280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbe1310 con 0x5623dbbacb70 2024-02-18T16:21:22.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.394+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94712010361280] v30'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94712010338224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbc980 con 0x7fe7bc0c7070 2024-02-18T16:21:22.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94712010338224] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d4bc3980 20 remove_watcher() i=0 2024-02-18T16:21:22.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d4bc3980 2 removed watcher, disabling cache 2024-02-18T16:21:22.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94712010343200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb6fb0 con 0x5623dbbacb70 2024-02-18T16:21:22.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94712010343200] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d4bc3980 20 remove_watcher() i=1 2024-02-18T16:21:22.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.398+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94712010346976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb6fb0 con 0x5623dbbb2e50 2024-02-18T16:21:22.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d1edd640 1 -- 172.21.15.129:0/2830758397 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94712010346976] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7bc0f7040 con 0x5623dbbb2e50 2024-02-18T16:21:22.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d4bc3980 20 remove_watcher() i=2 2024-02-18T16:21:22.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94712010350736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbb91e0 con 0x7fe7bc0c7070 2024-02-18T16:21:22.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d2edf640 1 -- 172.21.15.129:0/2830758397 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94712010350736] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7cc03a040 con 0x7fe7bc0c7070 2024-02-18T16:21:22.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d4bc3980 20 remove_watcher() i=3 2024-02-18T16:21:22.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94712010354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbba090 con 0x5623dbbacb70 2024-02-18T16:21:22.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94712010354976] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x5623dbbacb70 2024-02-18T16:21:22.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d4bc3980 20 remove_watcher() i=4 2024-02-18T16:21:22.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.402+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94712010344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbbb120 con 0x7fe7cc0141d0 2024-02-18T16:21:22.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.406+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94712010344256] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.406+0000 7fe7d4bc3980 20 remove_watcher() i=5 2024-02-18T16:21:22.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.406+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94712010357168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbba090 con 0x7fe7cc0141d0 2024-02-18T16:21:22.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.406+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94712010357168] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.406+0000 7fe7d4bc3980 20 remove_watcher() i=6 2024-02-18T16:21:22.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.406+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94712010360064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623dbbba090 con 0x7fe7cc0141d0 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94712010360064] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7c405c040 con 0x7fe7cc0141d0 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 20 remove_watcher() i=7 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe7cc0141d0 msgr2=0x7fe7cc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe7cc0141d0 0x7fe7cc015940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dbbacb70 msgr2=0x5623dbbaf030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dbbacb70 0x5623dbbaf030 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe7bc0c7070 msgr2=0x7fe7bc0c9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe7bc0c7070 0x7fe7bc0c9080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5623dbbb2e50 msgr2=0x5623dbbb52a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5623dbbb2e50 0x5623dbbb52a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe69c0342b0 msgr2=0x7fe69c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe69c0342b0 0x7fe69c036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc011010 tx=0x7fe7cc020000 comp rx=0 tx=0).stop 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 msgr2=0x5623dbba15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2830758397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dbb9a6a0 0x5623dbba15a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0aae70 tx=0x7fe7bc0e46e0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 reap_dead start 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d26de640 1 -- 172.21.15.129:0/2830758397 reap_dead start 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 shutdown_connections 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 >> 172.21.15.129:0/2830758397 conn(0x5623dbb969e0 msgr2=0x5623dbb94a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 shutdown_connections 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2830758397 wait complete. 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6ac0342b0 msgr2=0x7fe6ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6ac0342b0 0x7fe6ac036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5623dbb7ba00 tx=0x7fe7cc005850 comp rx=0 tx=0).stop 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 msgr2=0x5623dba82680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 0x5623dba82680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc096e80 tx=0x7fe7bc018020 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 shutdown_connections 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6ac0342b0 0x7fe6ac036770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/2624677317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba841e0 0x5623dba82680 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 >> 172.21.15.129:0/2624677317 conn(0x5623dbb80270 msgr2=0x5623dbb80d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 shutdown_connections 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/2624677317 wait complete. 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dba876f0 msgr2=0x5623dbb7abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dba876f0 0x5623dbb7abe0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6b8034300 msgr2=0x7fe6b80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6b8034300 0x7fe6b80367c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0ad000 tx=0x7fe7bc0a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 msgr2=0x5623dbb73f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb73f60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400b710 tx=0x7fe7c4000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 shutdown_connections 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5623dba876f0 0x5623dbb7abe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe6b8034300 0x7fe6b80367c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 --2- 172.21.15.129:0/1289718055 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5623dba815e0 0x5623dbb73f60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 >> 172.21.15.129:0/1289718055 conn(0x5623dba7d070 msgr2=0x5623dbb677b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 shutdown_connections 2024-02-18T16:21:22.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.410+0000 7fe7d4bc3980 1 -- 172.21.15.129:0/1289718055 wait complete. 2024-02-18T16:21:22.425 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:22.425 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-18T16:21:22.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-18T16:21:22.426 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-02-18T16:21:22.495 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:22.495 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:22.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febcc4c5980 1 Processor -- start 2024-02-18T16:21:22.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febcc4c5980 1 -- start start 2024-02-18T16:21:22.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febcc4c5980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b23ea54930 0x55b23ea56d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febcc4c5980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b23e99a4d0 con 0x55b23e9c2090 2024-02-18T16:21:22.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febcc4c5980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b23e961180 con 0x55b23ea54930 2024-02-18T16:21:22.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febc97df640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b23ea54930 0x55b23ea56d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febc9fe0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55b23e9c2090 0x55b23ea53210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42712/0 (socket says 172.21.15.129:42712) 2024-02-18T16:21:22.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febc9fe0640 1 -- 172.21.15.129:0/2523795443 learned_addr learned my addr 172.21.15.129:0/2523795443 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:22.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febc97df640 1 -- 172.21.15.129:0/2523795443 >> v1:172.21.15.80:6789/0 conn(0x55b23e9c2090 legacy=0x55b23ea53210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.490+0000 7febc97df640 1 -- 172.21.15.129:0/2523795443 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b23ea58270 con 0x55b23ea54930 2024-02-18T16:21:22.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febc97df640 1 --2- 172.21.15.129:0/2523795443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23ea54930 0x55b23ea56d20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febbc00a480 tx=0x7febbc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7da12e05cd8d5c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febc8fde640 1 -- 172.21.15.129:0/2523795443 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0ab540 con 0x55b23ea54930 2024-02-18T16:21:22.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febc8fde640 1 -- 172.21.15.129:0/2523795443 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc0ab6a0 con 0x55b23ea54930 2024-02-18T16:21:22.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febc8fde640 1 -- 172.21.15.129:0/2523795443 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0ab960 con 0x55b23ea54930 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 -- 172.21.15.129:0/2523795443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23ea54930 msgr2=0x55b23ea56d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2523795443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23ea54930 0x55b23ea56d20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febbc00a480 tx=0x7febbc01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 -- 172.21.15.129:0/2523795443 shutdown_connections 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2523795443 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23ea54930 0x55b23ea56d20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 -- 172.21.15.129:0/2523795443 >> 172.21.15.129:0/2523795443 conn(0x55b23ea488f0 msgr2=0x55b23ea4ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 -- 172.21.15.129:0/2523795443 shutdown_connections 2024-02-18T16:21:22.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.494+0000 7febcc4c5980 1 -- 172.21.15.129:0/2523795443 wait complete. 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.506+0000 7febcc4c5980 1 Processor -- start 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.506+0000 7febcc4c5980 1 -- start start 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.506+0000 7febcc4c5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb3a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.506+0000 7febcc4c5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b23e95e6b0 con 0x55b23e9c2090 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb3a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb3a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47936/0 (socket says 172.21.15.129:47936) 2024-02-18T16:21:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 -- 172.21.15.129:0/657813755 learned_addr learned my addr 172.21.15.129:0/657813755 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 -- 172.21.15.129:0/657813755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc005d30 con 0x55b23e9c2090 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 --2- 172.21.15.129:0/657813755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb3a390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7febb4006fb0 tx=0x7febb4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cf69ae7b0a9a0e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7feab7e07640 1 -- 172.21.15.129:0/657813755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febb4004530 con 0x55b23e9c2090 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7feab7e07640 1 -- 172.21.15.129:0/657813755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb4004690 con 0x55b23e9c2090 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7feab7e07640 1 -- 172.21.15.129:0/657813755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febb40049b0 con 0x55b23e9c2090 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- 172.21.15.129:0/657813755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 msgr2=0x55b23eb3a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 --2- 172.21.15.129:0/657813755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb3a390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7febb4006fb0 tx=0x7febb4001940 comp rx=0 tx=0).stop 2024-02-18T16:21:22.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- 172.21.15.129:0/657813755 shutdown_connections 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 --2- 172.21.15.129:0/657813755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb3a390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- 172.21.15.129:0/657813755 >> 172.21.15.129:0/657813755 conn(0x55b23ea488f0 msgr2=0x55b23eb35e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- 172.21.15.129:0/657813755 shutdown_connections 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- 172.21.15.129:0/657813755 wait complete. 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 Processor -- start 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- start start 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb41430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b23e959e90 con 0x55b23e9c2090 2024-02-18T16:21:22.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb41430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47938/0 (socket says 172.21.15.129:47938) 2024-02-18T16:21:22.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 -- 172.21.15.129:0/1005517273 learned_addr learned my addr 172.21.15.129:0/1005517273 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b23e99a4d0 con 0x55b23e9c2090 2024-02-18T16:21:22.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febc9fe0640 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb41430 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55b23eb3b140 tx=0x7febb4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7feab6604640 1 -- 172.21.15.129:0/1005517273 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febb4013760 con 0x55b23e9c2090 2024-02-18T16:21:22.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7feab6604640 1 -- 172.21.15.129:0/1005517273 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb40138c0 con 0x55b23e9c2090 2024-02-18T16:21:22.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b23eb41970 con 0x55b23e9c2090 2024-02-18T16:21:22.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.510+0000 7feab6604640 1 -- 172.21.15.129:0/1005517273 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febb4013b60 con 0x55b23e9c2090 2024-02-18T16:21:22.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b23eb41da0 con 0x55b23e9c2090 2024-02-18T16:21:22.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7feab6604640 1 -- 172.21.15.129:0/1005517273 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7febb4013cc0 con 0x55b23e9c2090 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7feab6604640 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feab0034300 0x7feab00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7feab6604640 1 -- 172.21.15.129:0/1005517273 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7febb4049590 con 0x55b23e9c2090 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febc97df640 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feab0034300 0x7feab00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23ea54930 0x55b23eb48060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb485a0 con 0x55b23ea54930 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23ea54930 0x55b23eb48060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febc97df640 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feab0034300 0x7feab00367c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ad000 tx=0x7febbc0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23ea54930 0x55b23eb48060 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 -- 172.21.15.129:0/1005517273 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febc40083f0 con 0x55b23ea54930 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb48920 con 0x55b23ea54930 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 -- 172.21.15.129:0/1005517273 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7febc40083f0 con 0x55b23ea54930 2024-02-18T16:21:22.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb4a1d0 con 0x55b23ea54930 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 -- 172.21.15.129:0/1005517273 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7febc40083f0 con 0x55b23ea54930 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb493d0 con 0x55b23ea54930 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 -- 172.21.15.129:0/1005517273 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7febc40083f0 con 0x55b23ea54930 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb497e0 con 0x55b23ea54930 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febca7e1640 1 -- 172.21.15.129:0/1005517273 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7febc4012040 con 0x55b23ea54930 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 Processor -- start 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- start start 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 0x55b23eb58c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.514+0000 7febcc4c5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b23e8f2f20 con 0x55b23eb58870 2024-02-18T16:21:22.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 0x55b23eb58c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 0x55b23eb58c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47946/0 (socket says 172.21.15.129:47946) 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 -- 172.21.15.129:0/1511305259 learned_addr learned my addr 172.21.15.129:0/1511305259 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 -- 172.21.15.129:0/1511305259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b23eb591d0 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 0x55b23eb58c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7febbc096e80 tx=0x7febbc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7feaaf7fe640 1 -- 172.21.15.129:0/1511305259 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0bd8a0 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7feaaf7fe640 1 -- 172.21.15.129:0/1511305259 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc0bda00 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7feaaf7fe640 1 -- 172.21.15.129:0/1511305259 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0bdca0 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b23eb593c0 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b23eb59f10 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7feaaf7fe640 1 -- 172.21.15.129:0/1511305259 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7febbc0be480 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7feaaf7fe640 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feaa4034300 0x7feaa40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7feaaf7fe640 1 -- 172.21.15.129:0/1511305259 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7febbc0e6320 con 0x55b23eb58870 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febca7e1640 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feaa4034300 0x7feaa40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febcc4c5980 1 Processor -- start 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febcc4c5980 1 -- start start 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febca7e1640 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feaa4034300 0x7feaa40367c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55b23eb48e10 tx=0x7febc4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febcc4c5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb65c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febcc4c5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b23e8e6790 con 0x55b23eb65850 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb65c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb65c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47954/0 (socket says 172.21.15.129:47954) 2024-02-18T16:21:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.518+0000 7febc97df640 1 -- 172.21.15.129:0/3561340538 learned_addr learned my addr 172.21.15.129:0/3561340538 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 -- 172.21.15.129:0/3561340538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b23eb66240 con 0x55b23eb65850 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 --2- 172.21.15.129:0/3561340538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb65c70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7febbc006c40 tx=0x7febbc0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211d13b573a4f13 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7feaad7fa640 1 -- 172.21.15.129:0/3561340538 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0be860 con 0x55b23eb65850 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7feaad7fa640 1 -- 172.21.15.129:0/3561340538 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc006cb0 con 0x55b23eb65850 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7feaad7fa640 1 -- 172.21.15.129:0/3561340538 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0b4c50 con 0x55b23eb65850 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/3561340538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 msgr2=0x55b23eb65c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 --2- 172.21.15.129:0/3561340538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb65c70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7febbc006c40 tx=0x7febbc0aae30 comp rx=0 tx=0).stop 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/3561340538 shutdown_connections 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 --2- 172.21.15.129:0/3561340538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb65c70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/3561340538 >> 172.21.15.129:0/3561340538 conn(0x55b23eb61be0 msgr2=0x55b23eb5fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/3561340538 shutdown_connections 2024-02-18T16:21:22.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/3561340538 wait complete. 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 Processor -- start 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- start start 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb6c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b23eb6ccc0 con 0x55b23eb65850 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb6c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb6c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47968/0 (socket says 172.21.15.129:47968) 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 learned_addr learned my addr 172.21.15.129:0/2995539994 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b23eb59f10 con 0x55b23eb65850 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febc97df640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb6c780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7febbc006c40 tx=0x7febbc0e46a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7fea9b7fe640 1 -- 172.21.15.129:0/2995539994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0e4e90 con 0x55b23eb65850 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b23eb6cec0 con 0x55b23eb65850 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7fea9b7fe640 1 -- 172.21.15.129:0/2995539994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc006890 con 0x55b23eb65850 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7fea9b7fe640 1 -- 172.21.15.129:0/2995539994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0b4c50 con 0x55b23eb65850 2024-02-18T16:21:22.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.522+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b23eb6d2f0 con 0x55b23eb65850 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7fea9b7fe640 1 -- 172.21.15.129:0/2995539994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7febbc0b4370 con 0x55b23eb65850 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7fea9b7fe640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fea940342b0 0x7fea94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7fea9b7fe640 1 -- 172.21.15.129:0/2995539994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7febbc0f59c0 con 0x55b23eb65850 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febca7e1640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fea940342b0 0x7fea94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23eb77ba0 0x55b23eb7a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7a7b0 con 0x55b23eb77ba0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23eb77ba0 0x55b23eb7a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febca7e1640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fea940342b0 0x7fea94036770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7febc4008fd0 tx=0x7febc401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23eb77ba0 0x55b23eb7a060 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febb4024020 con 0x55b23eb77ba0 2024-02-18T16:21:22.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 realm 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7ab80 con 0x55b23eb77ba0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febb4024020 con 0x55b23eb77ba0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7b3d0 con 0x55b23eb77ba0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febb4024020 con 0x55b23eb77ba0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7b730 con 0x55b23eb77ba0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7febb4024020 con 0x55b23eb77ba0 2024-02-18T16:21:22.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7bf30 con 0x55b23eb77ba0 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7febb4024020 con 0x55b23eb77ba0 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 20 searching for the correct realm 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b23eb7de80 0x55b23eb802b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc97df640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b23eb7de80 0x55b23eb802b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc97df640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b23eb7de80 0x55b23eb802b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc97df640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7febbc0c7070 0x7febbc0f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febbc0c7070 2024-02-18T16:21:22.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febca7e1640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7febbc0c7070 0x7febbc0f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.526+0000 7febca7e1640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7febbc0c7070 0x7febbc0f6820 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febc402c040 con 0x7febbc0c7070 2024-02-18T16:21:22.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febca7e1640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7febc4027940 0x7febc40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7febc4027940 0x7febc40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7febc4027940 0x7febc40333c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb4024020 con 0x7febc4027940 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febbc0c7070 2024-02-18T16:21:22.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febc402c040 con 0x7febbc0c7070 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.530+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febbc0c7070 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7febc402c040 con 0x7febbc0c7070 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.534+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febbc0c7070 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febc402c040 con 0x7febbc0c7070 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x55b23eb77ba0 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb403e080 con 0x7febc4027940 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febbc0c7070 2024-02-18T16:21:22.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febc402c040 con 0x7febbc0c7070 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb7de80 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febc4027940 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x55b23eb77ba0 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80930 con 0x7febbc0c7070 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febc402c040 con 0x7febbc0c7070 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:22.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.538+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7c920 con 0x55b23eb77ba0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb7d170 con 0x55b23eb77ba0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb80d70 con 0x55b23eb77ba0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 zone default found 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 4 Realm: () 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 zonegroup default 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb81210 con 0x7febc4027940 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82bf0 con 0x55b23eb7de80 2024-02-18T16:21:22.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82f50 con 0x55b23eb7de80 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 started sync module instance, tier type = 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:22.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82170 con 0x7febbc0c7070 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94224044795216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82170 con 0x7febbc0c7070 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb838c0 con 0x55b23eb77ba0 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.542+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94224044795216] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94224044799280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82170 con 0x55b23eb77ba0 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb84280 con 0x55b23eb7de80 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94224044799280] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94224044793040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb820f0 con 0x55b23eb7de80 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.546+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb84f70 con 0x7febbc0c7070 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94224044805088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb856c0 con 0x7febbc0c7070 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb86190 con 0x55b23eb77ba0 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94224044793040] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94224044805088] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94224044809328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb86150 con 0x55b23eb77ba0 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb85290 con 0x7febc4027940 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.550+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94224044809328] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94224044810576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb86a10 con 0x7febc4027940 2024-02-18T16:21:22.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb87250 con 0x7febc4027940 2024-02-18T16:21:22.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94224044810576] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94224044811632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb87360 con 0x7febc4027940 2024-02-18T16:21:22.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.554+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb87b60 con 0x7febc4027940 2024-02-18T16:21:22.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94224044811632] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94224044815200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb87c20 con 0x7febc4027940 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=0 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=1 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=2 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=3 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=4 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=5 2024-02-18T16:21:22.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=6 2024-02-18T16:21:22.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94224044815200] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 add_watcher() i=7 2024-02-18T16:21:22.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:22.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb8af50 con 0x55b23eb77ba0 2024-02-18T16:21:22.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94224044829008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb87d90 con 0x55b23eb77ba0 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94224044829008] v30'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7fea7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.558+0000 7febcc4c5980 5 note: GC not initialized 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7fea7a7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 20 Filter name: none 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7fe9ebfff640 20 reqs_thread_entry: start 2024-02-18T16:21:22.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebacfc0 con 0x55b23eb77ba0 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebad360 con 0x55b23eb77ba0 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebb2bc0 con 0x55b23eb77ba0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~513] v30'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94224044992224 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebaf820 con 0x55b23eb77ba0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== watch-notify(notify (1) cookie 94224044809328 notify 128849018885 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x55b23eb41da0 con 0x55b23eb77ba0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7feaad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94224044809328 notifier 4357 bl.length()=689 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7feaad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7feaad7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7feaad7fa640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fea8c003ea0 con 0x55b23eb77ba0 2024-02-18T16:21:22.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify cookie 94224044992224 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94224044992224 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7febb402d070 con 0x55b23eb77ba0 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.562+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebb26e0 con 0x55b23eb77ba0 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94224044992224 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebaf820 con 0x7febbc0c7070 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== watch-notify(notify (1) cookie 94224044795216 notify 128849018882 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7febc401a970 con 0x7febbc0c7070 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7feaacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94224044795216 notifier 4357 bl.length()=166 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7feaacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7feaacff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-18T16:21:22.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(68 notify.0 [notify cookie 94224044992224 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7feaacff9640 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe9f4003400 con 0x7febbc0c7070 2024-02-18T16:21:22.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== watch-notify(notify_complete (2) cookie 94224044992224 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7febc401abd0 con 0x7febbc0c7070 2024-02-18T16:21:22.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.575 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"ETyKIFFD3mnbCoaIksMNVBNhiZYupb7zWgaCKIsl"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:22.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7fea7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94224044829008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebac0d0 con 0x55b23eb77ba0 2024-02-18T16:21:22.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94224044829008] v30'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94224044795216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23ebabc30 con 0x7febbc0c7070 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94224044795216] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 20 remove_watcher() i=0 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 2 removed watcher, disabling cache 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.566+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94224044799280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82550 con 0x55b23eb77ba0 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.570+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94224044799280] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.570+0000 7febcc4c5980 20 remove_watcher() i=1 2024-02-18T16:21:22.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.570+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94224044793040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb82550 con 0x55b23eb7de80 2024-02-18T16:21:22.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.570+0000 7febc97df640 1 -- 172.21.15.129:0/2995539994 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94224044793040] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febbc0ec020 con 0x55b23eb7de80 2024-02-18T16:21:22.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.570+0000 7febcc4c5980 20 remove_watcher() i=2 2024-02-18T16:21:22.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.570+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94224044805088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb81cd0 con 0x7febbc0c7070 2024-02-18T16:21:22.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.574+0000 7febca7e1640 1 -- 172.21.15.129:0/2995539994 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94224044805088] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febc403f040 con 0x7febbc0c7070 2024-02-18T16:21:22.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.574+0000 7febcc4c5980 20 remove_watcher() i=3 2024-02-18T16:21:22.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.574+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94224044809328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb84be0 con 0x55b23eb77ba0 2024-02-18T16:21:22.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.574+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94224044809328] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x55b23eb77ba0 2024-02-18T16:21:22.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.574+0000 7febcc4c5980 20 remove_watcher() i=4 2024-02-18T16:21:22.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.574+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94224044810576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb81cd0 con 0x7febc4027940 2024-02-18T16:21:22.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94224044810576] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febcc4c5980 20 remove_watcher() i=5 2024-02-18T16:21:22.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94224044811632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb84be0 con 0x7febc4027940 2024-02-18T16:21:22.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94224044811632] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febcc4c5980 20 remove_watcher() i=6 2024-02-18T16:21:22.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94224044815200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b23eb81cd0 con 0x7febc4027940 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94224044815200] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febb4059040 con 0x7febc4027940 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febcc4c5980 20 remove_watcher() i=7 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.578+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7febc4027940 msgr2=0x7febc40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7febc4027940 0x7febc40333c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23eb77ba0 msgr2=0x55b23eb7a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23eb77ba0 0x55b23eb7a060 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7febbc0c7070 msgr2=0x7febbc0f6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7febbc0c7070 0x7febbc0f6820 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b23eb7de80 msgr2=0x55b23eb802b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b23eb7de80 0x55b23eb802b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fea940342b0 msgr2=0x7fea94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fea940342b0 0x7fea94036770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7febc4008fd0 tx=0x7febc401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 msgr2=0x55b23eb6c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/2995539994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb65850 0x55b23eb6c780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7febbc006c40 tx=0x7febbc0e46a0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febc9fe0640 1 -- 172.21.15.129:0/2995539994 reap_dead start 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 shutdown_connections 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 >> 172.21.15.129:0/2995539994 conn(0x55b23eb61be0 msgr2=0x55b23eb5f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 shutdown_connections 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/2995539994 wait complete. 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feaa4034300 msgr2=0x7feaa40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feaa4034300 0x7feaa40367c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55b23eb48e10 tx=0x7febc4003070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 msgr2=0x55b23eb58c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 0x55b23eb58c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7febbc096e80 tx=0x7febbc018020 comp rx=0 tx=0).stop 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 shutdown_connections 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feaa4034300 0x7feaa40367c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1511305259 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23eb58870 0x55b23eb58c90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 >> 172.21.15.129:0/1511305259 conn(0x55b23eb4d680 msgr2=0x55b23eb4e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 shutdown_connections 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1511305259 wait complete. 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23ea54930 msgr2=0x55b23eb48060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23ea54930 0x55b23eb48060 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feab0034300 msgr2=0x7feab00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feab0034300 0x7feab00367c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ad000 tx=0x7febbc0a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 msgr2=0x55b23eb41430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb41430 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55b23eb3b140 tx=0x7febb4000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 shutdown_connections 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b23ea54930 0x55b23eb48060 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7feab0034300 0x7feab00367c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 --2- 172.21.15.129:0/1005517273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b23e9c2090 0x55b23eb41430 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 >> 172.21.15.129:0/1005517273 conn(0x55b23ea488f0 msgr2=0x55b23eb34950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 shutdown_connections 2024-02-18T16:21:22.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.582+0000 7febcc4c5980 1 -- 172.21.15.129:0/1005517273 wait complete. 2024-02-18T16:21:22.596 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'ETyKIFFD3mnbCoaIksMNVBNhiZYupb7zWgaCKIsl'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:22.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-18T16:21:22.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-18T16:21:22.597 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-02-18T16:21:22.671 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:22.671 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:22.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091deea980 1 Processor -- start 2024-02-18T16:21:22.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091deea980 1 -- start start 2024-02-18T16:21:22.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091deea980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55c0534577f0 0x55c053459be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091deea980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c05339d460 con 0x55c0534532f0 2024-02-18T16:21:22.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091deea980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c053364180 con 0x55c0534577f0 2024-02-18T16:21:22.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091b204640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55c0534577f0 0x55c053459be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091ba05640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55c0534532f0 0x55c0534536d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42724/0 (socket says 172.21.15.129:42724) 2024-02-18T16:21:22.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091ba05640 1 -- 172.21.15.129:0/224929251 learned_addr learned my addr 172.21.15.129:0/224929251 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:22.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091b204640 1 -- 172.21.15.129:0/224929251 >> v1:172.21.15.80:6789/0 conn(0x55c0534532f0 legacy=0x55c0534536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.666+0000 7f091b204640 1 -- 172.21.15.129:0/224929251 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05345b130 con 0x55c0534577f0 2024-02-18T16:21:22.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091b204640 1 --2- 172.21.15.129:0/224929251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534577f0 0x55c053459be0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f091400a480 tx=0x7f091401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e449e4b04d65e72d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091aa03640 1 -- 172.21.15.129:0/224929251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140ab540 con 0x55c0534577f0 2024-02-18T16:21:22.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091aa03640 1 -- 172.21.15.129:0/224929251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140ab6a0 con 0x55c0534577f0 2024-02-18T16:21:22.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091aa03640 1 -- 172.21.15.129:0/224929251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140ab960 con 0x55c0534577f0 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 -- 172.21.15.129:0/224929251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534577f0 msgr2=0x55c053459be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 --2- 172.21.15.129:0/224929251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534577f0 0x55c053459be0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f091400a480 tx=0x7f091401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 -- 172.21.15.129:0/224929251 shutdown_connections 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 --2- 172.21.15.129:0/224929251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534577f0 0x55c053459be0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 -- 172.21.15.129:0/224929251 >> 172.21.15.129:0/224929251 conn(0x55c0533c69e0 msgr2=0x55c0533c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 -- 172.21.15.129:0/224929251 shutdown_connections 2024-02-18T16:21:22.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.670+0000 7f091deea980 1 -- 172.21.15.129:0/224929251 wait complete. 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.682+0000 7f091deea980 1 Processor -- start 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.682+0000 7f091deea980 1 -- start start 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.682+0000 7f091deea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c05353d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.682+0000 7f091deea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0533616b0 con 0x55c0534532f0 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c05353d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c05353d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47980/0 (socket says 172.21.15.129:47980) 2024-02-18T16:21:22.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 -- 172.21.15.129:0/3520392645 learned_addr learned my addr 172.21.15.129:0/3520392645 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 -- 172.21.15.129:0/3520392645 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914005d30 con 0x55c0534532f0 2024-02-18T16:21:22.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 --2- 172.21.15.129:0/3520392645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c05353d2d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f090c001590 tx=0x7f090c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fcd4b883f3eab server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f0808e19640 1 -- 172.21.15.129:0/3520392645 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f090c004530 con 0x55c0534532f0 2024-02-18T16:21:22.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f0808e19640 1 -- 172.21.15.129:0/3520392645 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c004690 con 0x55c0534532f0 2024-02-18T16:21:22.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f0808e19640 1 -- 172.21.15.129:0/3520392645 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f090c004950 con 0x55c0534532f0 2024-02-18T16:21:22.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- 172.21.15.129:0/3520392645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 msgr2=0x55c05353d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 --2- 172.21.15.129:0/3520392645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c05353d2d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f090c001590 tx=0x7f090c001a50 comp rx=0 tx=0).stop 2024-02-18T16:21:22.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- 172.21.15.129:0/3520392645 shutdown_connections 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 --2- 172.21.15.129:0/3520392645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c05353d2d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- 172.21.15.129:0/3520392645 >> 172.21.15.129:0/3520392645 conn(0x55c0533c69e0 msgr2=0x55c053538e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- 172.21.15.129:0/3520392645 shutdown_connections 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- 172.21.15.129:0/3520392645 wait complete. 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 Processor -- start 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- start start 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c053544240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091deea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05335ce90 con 0x55c0534532f0 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c053544240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c053544240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:47990/0 (socket says 172.21.15.129:47990) 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 -- 172.21.15.129:0/3149481670 learned_addr learned my addr 172.21.15.129:0/3149481670 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.686+0000 7f091ba05640 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05339d460 con 0x55c0534532f0 2024-02-18T16:21:22.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091ba05640 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c053544240 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f090c001a90 tx=0x7f090c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f0807616640 1 -- 172.21.15.129:0/3149481670 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f090c013760 con 0x55c0534532f0 2024-02-18T16:21:22.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f0807616640 1 -- 172.21.15.129:0/3149481670 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0138c0 con 0x55c0534532f0 2024-02-18T16:21:22.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f0807616640 1 -- 172.21.15.129:0/3149481670 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f090c013ba0 con 0x55c0534532f0 2024-02-18T16:21:22.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c053544780 con 0x55c0534532f0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c053544bb0 con 0x55c0534532f0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f0807616640 1 -- 172.21.15.129:0/3149481670 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f090c013d00 con 0x55c0534532f0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f0807616640 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f08000342b0 0x7f0800036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f0807616640 1 -- 172.21.15.129:0/3149481670 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f090c049540 con 0x55c0534532f0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091b204640 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f08000342b0 0x7f0800036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c0534577f0 0x55c05354ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05354b360 con 0x55c0534577f0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091c206640 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c0534577f0 0x55c05354ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091b204640 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f08000342b0 0x7f0800036770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09140ad000 tx=0x7f09140a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091c206640 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c0534577f0 0x55c05354ae20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091c206640 1 -- 172.21.15.129:0/3149481670 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f09040083f0 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05354b770 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091c206640 1 -- 172.21.15.129:0/3149481670 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f09040083f0 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05354d020 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091c206640 1 -- 172.21.15.129:0/3149481670 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f09040083f0 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05354c220 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091c206640 1 -- 172.21.15.129:0/3149481670 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f09040083f0 con 0x55c0534577f0 2024-02-18T16:21:22.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.690+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05354c630 con 0x55c0534577f0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091c206640 1 -- 172.21.15.129:0/3149481670 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0904012040 con 0x55c0534577f0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091deea980 1 Processor -- start 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091deea980 1 -- start start 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091deea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 0x55c05355bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091deea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0532f5f20 con 0x55c05355b6c0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091b204640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 0x55c05355bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091b204640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 0x55c05355bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48002/0 (socket says 172.21.15.129:48002) 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091b204640 1 -- 172.21.15.129:0/3642224121 learned_addr learned my addr 172.21.15.129:0/3642224121 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091b204640 1 -- 172.21.15.129:0/3642224121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05355c020 con 0x55c05355b6c0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091b204640 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 0x55c05355bae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f09140ab670 tx=0x7f0914018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f0804e11640 1 -- 172.21.15.129:0/3642224121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140be7c0 con 0x55c05355b6c0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c05355c210 con 0x55c05355b6c0 2024-02-18T16:21:22.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f0804e11640 1 -- 172.21.15.129:0/3642224121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140be920 con 0x55c05355b6c0 2024-02-18T16:21:22.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f0804e11640 1 -- 172.21.15.129:0/3642224121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140bebc0 con 0x55c05355b6c0 2024-02-18T16:21:22.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c05355cd60 con 0x55c05355b6c0 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f0804e11640 1 -- 172.21.15.129:0/3642224121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f09140bd3e0 con 0x55c05355b6c0 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f0804e11640 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07f40342b0 0x7f07f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f0804e11640 1 -- 172.21.15.129:0/3642224121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f09140e6300 con 0x55c05355b6c0 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.694+0000 7f091c206640 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07f40342b0 0x7f07f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 Processor -- start 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- start start 2024-02-18T16:21:22.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091c206640 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07f40342b0 0x7f07f4036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55c05354bc60 tx=0x7f0904003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c053568a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0532e9790 con 0x55c053568670 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c053568a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c053568a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48014/0 (socket says 172.21.15.129:48014) 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 -- 172.21.15.129:0/3027703082 learned_addr learned my addr 172.21.15.129:0/3027703082 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 -- 172.21.15.129:0/3027703082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c053569060 con 0x55c053568670 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 --2- 172.21.15.129:0/3027703082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c053568a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09140e4720 tx=0x7f09140c5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2851262b2dfdb615 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f07fe7fc640 1 -- 172.21.15.129:0/3027703082 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140b49a0 con 0x55c053568670 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f07fe7fc640 1 -- 172.21.15.129:0/3027703082 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140bccd0 con 0x55c053568670 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f07fe7fc640 1 -- 172.21.15.129:0/3027703082 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140e31d0 con 0x55c053568670 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- 172.21.15.129:0/3027703082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 msgr2=0x55c053568a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 --2- 172.21.15.129:0/3027703082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c053568a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09140e4720 tx=0x7f09140c5f50 comp rx=0 tx=0).stop 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- 172.21.15.129:0/3027703082 shutdown_connections 2024-02-18T16:21:22.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 --2- 172.21.15.129:0/3027703082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c053568a90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- 172.21.15.129:0/3027703082 >> 172.21.15.129:0/3027703082 conn(0x55c053564a00 msgr2=0x55c053562a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- 172.21.15.129:0/3027703082 shutdown_connections 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- 172.21.15.129:0/3027703082 wait complete. 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 Processor -- start 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- start start 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c05356f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091deea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05356fb30 con 0x55c053568670 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c05356f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c05356f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48020/0 (socket says 172.21.15.129:48020) 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 learned_addr learned my addr 172.21.15.129:0/2592078481 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05355cd60 con 0x55c053568670 2024-02-18T16:21:22.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.698+0000 7f091b204640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c05356f5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f09140b5ec0 tx=0x7f09140e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f07fcff9640 1 -- 172.21.15.129:0/2592078481 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140d5040 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c05356fd30 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f07fcff9640 1 -- 172.21.15.129:0/2592078481 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140e60d0 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f07fcff9640 1 -- 172.21.15.129:0/2592078481 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140bc4b0 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c053570160 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f07fcff9640 1 -- 172.21.15.129:0/2592078481 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f09140aaa30 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f07fcff9640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07e40342b0 0x7f07e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f07fcff9640 1 -- 172.21.15.129:0/2592078481 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f09140e7e70 con 0x55c053568670 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091c206640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07e40342b0 0x7f07e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c05357abc0 0x55c05357d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05357d7d0 con 0x55c05357abc0 2024-02-18T16:21:22.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c05357abc0 0x55c05357d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091c206640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07e40342b0 0x7f07e4036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0904008fd0 tx=0x7f090401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c05357abc0 0x55c05357d080 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 realm 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05357dba0 con 0x55c05357abc0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05357e420 con 0x55c05357abc0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05357e780 con 0x55c05357abc0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05357ef80 con 0x55c05357abc0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 20 searching for the correct realm 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c053580e10 0x55c053583280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091b204640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c053580e10 0x55c053583280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.702+0000 7f091b204640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c053580e10 0x55c053583280 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091b204640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f09140f0060 0x7f09140c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f09140f0060 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091c206640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f09140f0060 0x7f09140c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091c206640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f09140f0060 0x7f09140c87c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090402c040 con 0x7f09140f0060 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091c206640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0904027940 0x7f09040333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0904027940 0x7f09040333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0904027940 0x7f09040333c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x7f0904027940 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x7f0904027940 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.706+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x7f0904027940 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f09140f0060 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090402c040 con 0x7f09140f0060 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x7f0904027940 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f09140f0060 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f090402c040 con 0x7f09140f0060 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x7f0904027940 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.710+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f090c024020 con 0x55c05357abc0 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f09140f0060 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090402c040 con 0x7f09140f0060 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f09140f0060 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090402c040 con 0x7f09140f0060 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c053580e10 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.714+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f0904027940 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x55c05357abc0 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583950 con 0x7f09140f0060 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f090402c040 con 0x7f09140f0060 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:22.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05357f880 con 0x55c05357abc0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535800d0 con 0x55c05357abc0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583d90 con 0x55c05357abc0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:22.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 zone default found 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 4 Realm: () 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 zonegroup default 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053583dd0 con 0x7f0904027940 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053585bb0 con 0x55c053580e10 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053585f40 con 0x55c053580e10 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 started sync module instance, tier type = 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053585490 con 0x7f09140f0060 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090403f040 con 0x7f09140f0060 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94284520378352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053585840 con 0x7f09140f0060 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.718+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053586ca0 con 0x55c05357abc0 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94284520378352] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090403f040 con 0x7f09140f0060 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94284520383328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053586c20 con 0x55c05357abc0 2024-02-18T16:21:22.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535876a0 con 0x55c053580e10 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94284520386976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053587ea0 con 0x55c053580e10 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535888d0 con 0x7f09140f0060 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.722+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94284520383328] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090403f040 con 0x7f09140f0060 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94284520391632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053588c80 con 0x7f09140f0060 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535895f0 con 0x55c05357abc0 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94284520386976] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94284520391632] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090403f040 con 0x7f09140f0060 2024-02-18T16:21:22.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94284520384384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053589150 con 0x55c05357abc0 2024-02-18T16:21:22.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.726+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053589e40 con 0x7f0904027940 2024-02-18T16:21:22.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94284520384384] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94284520389120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053589b70 con 0x7f0904027940 2024-02-18T16:21:22.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358a370 con 0x7f0904027940 2024-02-18T16:21:22.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94284520389120] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94284520396496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358a150 con 0x7f0904027940 2024-02-18T16:21:22.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.730+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358abc0 con 0x7f0904027940 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94284520396496] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94284520400544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358b020 con 0x7f0904027940 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=0 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=1 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=2 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=3 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=4 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=5 2024-02-18T16:21:22.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=6 2024-02-18T16:21:22.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94284520400544] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 20 add_watcher() i=7 2024-02-18T16:21:22.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:22.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358b020 con 0x55c05357abc0 2024-02-18T16:21:22.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.734+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94284520401792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358afa0 con 0x55c05357abc0 2024-02-18T16:21:22.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94284520401792] v30'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f07d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 5 note: GC not initialized 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f074bfff640 20 reqs_thread_entry: start 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 20 Filter name: none 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f0749ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535b0020 con 0x55c05357abc0 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 20 rados_obj.operate() r=0 bl.length=513 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535b5d60 con 0x55c05357abc0 2024-02-18T16:21:22.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v30'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:22.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94284520577056 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535b1870 con 0x55c05357abc0 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94284520384384 notify 128849018886 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x55c053544bb0 con 0x55c05357abc0 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f07fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94284520384384 notifier 4364 bl.length()=689 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f07fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f07fe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 94284520577056 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f07fe7fc640 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f07e0003ea0 con 0x55c05357abc0 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.738+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94284520577056 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f090c02d070 con 0x55c05357abc0 2024-02-18T16:21:22.746 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:22.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f07d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94284520401792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c0535b4c10 con 0x55c05357abc0 2024-02-18T16:21:22.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94284520401792] v30'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94284520378352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358ab80 con 0x7f09140f0060 2024-02-18T16:21:22.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94284520378352] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090403f040 con 0x7f09140f0060 2024-02-18T16:21:22.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091deea980 20 remove_watcher() i=0 2024-02-18T16:21:22.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091deea980 2 removed watcher, disabling cache 2024-02-18T16:21:22.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.742+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94284520383328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358ab80 con 0x55c05357abc0 2024-02-18T16:21:22.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94284520383328] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091deea980 20 remove_watcher() i=1 2024-02-18T16:21:22.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94284520386976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053586360 con 0x55c053580e10 2024-02-18T16:21:22.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091b204640 1 -- 172.21.15.129:0/2592078481 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94284520386976] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f09140c7d50 con 0x55c053580e10 2024-02-18T16:21:22.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091deea980 20 remove_watcher() i=2 2024-02-18T16:21:22.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94284520391632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358ab80 con 0x7f09140f0060 2024-02-18T16:21:22.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091c206640 1 -- 172.21.15.129:0/2592078481 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94284520391632] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090403f040 con 0x7f09140f0060 2024-02-18T16:21:22.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091deea980 20 remove_watcher() i=3 2024-02-18T16:21:22.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.746+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94284520384384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358ab80 con 0x55c05357abc0 2024-02-18T16:21:22.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.750+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94284520384384] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x55c05357abc0 2024-02-18T16:21:22.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.750+0000 7f091deea980 20 remove_watcher() i=4 2024-02-18T16:21:22.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.750+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94284520389120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c05358ab80 con 0x7f0904027940 2024-02-18T16:21:22.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.750+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94284520389120] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.750+0000 7f091deea980 20 remove_watcher() i=5 2024-02-18T16:21:22.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.750+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94284520396496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053587a00 con 0x7f0904027940 2024-02-18T16:21:22.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94284520396496] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 20 remove_watcher() i=6 2024-02-18T16:21:22.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94284520400544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c053587a00 con 0x7f0904027940 2024-02-18T16:21:22.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94284520400544] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f090c059040 con 0x7f0904027940 2024-02-18T16:21:22.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 20 remove_watcher() i=7 2024-02-18T16:21:22.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0904027940 msgr2=0x7f09040333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0904027940 0x7f09040333c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c05357abc0 msgr2=0x55c05357d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c05357abc0 0x55c05357d080 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f09140f0060 msgr2=0x7f09140c87c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f09140f0060 0x7f09140c87c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c053580e10 msgr2=0x55c053583280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c053580e10 0x55c053583280 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07e40342b0 msgr2=0x7f07e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07e40342b0 0x7f07e4036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0904008fd0 tx=0x7f090401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 msgr2=0x55c05356f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c05356f5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f09140b5ec0 tx=0x7f09140e4680 comp rx=0 tx=0).stop 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091ba05640 1 -- 172.21.15.129:0/2592078481 reap_dead start 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 shutdown_connections 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/2592078481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c053568670 0x55c05356f5f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 >> 172.21.15.129:0/2592078481 conn(0x55c053564a00 msgr2=0x55c053562060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 shutdown_connections 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/2592078481 wait complete. 2024-02-18T16:21:22.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07f40342b0 msgr2=0x7f07f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07f40342b0 0x7f07f4036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55c05354bc60 tx=0x7f0904003070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 msgr2=0x55c05355bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 0x55c05355bae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f09140ab670 tx=0x7f0914018020 comp rx=0 tx=0).stop 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 shutdown_connections 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f07f40342b0 0x7f07f4036770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3642224121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c05355b6c0 0x55c05355bae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 >> 172.21.15.129:0/3642224121 conn(0x55c0535504d0 msgr2=0x55c053550fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 shutdown_connections 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3642224121 wait complete. 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c0534577f0 msgr2=0x55c05354ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c0534577f0 0x55c05354ae20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f08000342b0 msgr2=0x7f0800036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f08000342b0 0x7f0800036770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09140ad000 tx=0x7f09140a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:22.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 msgr2=0x55c053544240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c053544240 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f090c001a90 tx=0x7f090c001260 comp rx=0 tx=0).stop 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 shutdown_connections 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c0534577f0 0x55c05354ae20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f08000342b0 0x7f0800036770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 --2- 172.21.15.129:0/3149481670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c0534532f0 0x55c053544240 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 >> 172.21.15.129:0/3149481670 conn(0x55c0533c69e0 msgr2=0x55c053537970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 shutdown_connections 2024-02-18T16:21:22.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.754+0000 7f091deea980 1 -- 172.21.15.129:0/3149481670 wait complete. 2024-02-18T16:21:22.770 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:22.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:22.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:22.771 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:22.846 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:22.846 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:22.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343f468980 1 Processor -- start 2024-02-18T16:21:22.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343f468980 1 -- start start 2024-02-18T16:21:22.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343f468980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56549c19f520 0x56549c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343f468980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56549c0e74c0 con 0x56549c10f080 2024-02-18T16:21:22.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343f468980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x56549c0ae180 con 0x56549c19f520 2024-02-18T16:21:22.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343c782640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56549c19f520 0x56549c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343cf83640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x56549c10f080 0x56549c19de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42730/0 (socket says 172.21.15.129:42730) 2024-02-18T16:21:22.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343cf83640 1 -- 172.21.15.129:0/3170869687 learned_addr learned my addr 172.21.15.129:0/3170869687 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:22.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343c782640 1 -- 172.21.15.129:0/3170869687 >> v1:172.21.15.80:6789/0 conn(0x56549c10f080 legacy=0x56549c19de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.842+0000 7f343c782640 1 -- 172.21.15.129:0/3170869687 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549c1a2ef0 con 0x56549c19f520 2024-02-18T16:21:22.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343c782640 1 --2- 172.21.15.129:0/3170869687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c1a1910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f342400a420 tx=0x7f342401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156cb4afd1e2a281 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343bf81640 1 -- 172.21.15.129:0/3170869687 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240aa530 con 0x56549c19f520 2024-02-18T16:21:22.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343bf81640 1 -- 172.21.15.129:0/3170869687 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240a6050 con 0x56549c19f520 2024-02-18T16:21:22.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343bf81640 1 -- 172.21.15.129:0/3170869687 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240aa800 con 0x56549c19f520 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 -- 172.21.15.129:0/3170869687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 msgr2=0x56549c1a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 --2- 172.21.15.129:0/3170869687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c1a1910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f342400a420 tx=0x7f342401afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 -- 172.21.15.129:0/3170869687 shutdown_connections 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 --2- 172.21.15.129:0/3170869687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c1a1910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 -- 172.21.15.129:0/3170869687 >> 172.21.15.129:0/3170869687 conn(0x56549c1958e0 msgr2=0x56549c197d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 -- 172.21.15.129:0/3170869687 shutdown_connections 2024-02-18T16:21:22.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.846+0000 7f343f468980 1 -- 172.21.15.129:0/3170869687 wait complete. 2024-02-18T16:21:22.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.858+0000 7f343f468980 1 Processor -- start 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.858+0000 7f343f468980 1 -- start start 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 0x56549c285120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549c0ab6b0 con 0x56549c10f080 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 0x56549c285120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 0x56549c285120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48044/0 (socket says 172.21.15.129:48044) 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 -- 172.21.15.129:0/3733782567 learned_addr learned my addr 172.21.15.129:0/3733782567 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 -- 172.21.15.129:0/3733782567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342400a100 con 0x56549c10f080 2024-02-18T16:21:22.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 --2- 172.21.15.129:0/3733782567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 0x56549c285120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3434001c90 tx=0x7f343400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e788dbf7f78669 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f332ae0d640 1 -- 172.21.15.129:0/3733782567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343400e690 con 0x56549c10f080 2024-02-18T16:21:22.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f332ae0d640 1 -- 172.21.15.129:0/3733782567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400e7f0 con 0x56549c10f080 2024-02-18T16:21:22.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f332ae0d640 1 -- 172.21.15.129:0/3733782567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343400eaf0 con 0x56549c10f080 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- 172.21.15.129:0/3733782567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 msgr2=0x56549c285120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 --2- 172.21.15.129:0/3733782567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 0x56549c285120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3434001c90 tx=0x7f343400b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- 172.21.15.129:0/3733782567 shutdown_connections 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 --2- 172.21.15.129:0/3733782567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c10f080 0x56549c285120 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- 172.21.15.129:0/3733782567 >> 172.21.15.129:0/3733782567 conn(0x56549c1958e0 msgr2=0x56549c280cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- 172.21.15.129:0/3733782567 shutdown_connections 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- 172.21.15.129:0/3733782567 wait complete. 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 Processor -- start 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- start start 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c28c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343f468980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549c0a6e90 con 0x56549c19f520 2024-02-18T16:21:22.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c28c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c28c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48048/0 (socket says 172.21.15.129:48048) 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 -- 172.21.15.129:0/547599716 learned_addr learned my addr 172.21.15.129:0/547599716 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549c0e74c0 con 0x56549c19f520 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.862+0000 7f343cf83640 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c28c180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3434001ee0 tx=0x7f3434000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f332960a640 1 -- 172.21.15.129:0/547599716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343401f070 con 0x56549c19f520 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f332960a640 1 -- 172.21.15.129:0/547599716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434018770 con 0x56549c19f520 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f332960a640 1 -- 172.21.15.129:0/547599716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3434018a50 con 0x56549c19f520 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56549c28c6c0 con 0x56549c19f520 2024-02-18T16:21:22.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56549c28cb10 con 0x56549c19f520 2024-02-18T16:21:22.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f332960a640 1 -- 172.21.15.129:0/547599716 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f343400a040 con 0x56549c19f520 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f332960a640 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3324034300 0x7f33240367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f332960a640 1 -- 172.21.15.129:0/547599716 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3434049670 con 0x56549c19f520 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343c782640 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3324034300 0x7f33240367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c290df0 0x56549c2931e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c293720 con 0x56549c290df0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343d784640 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c290df0 0x56549c2931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343c782640 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3324034300 0x7f33240367c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f34240ac000 tx=0x7f34240a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343d784640 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c290df0 0x56549c2931e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343d784640 1 -- 172.21.15.129:0/547599716 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f342c0083f0 con 0x56549c290df0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c293ac0 con 0x56549c290df0 2024-02-18T16:21:22.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343d784640 1 -- 172.21.15.129:0/547599716 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f342c0083f0 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c295340 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343d784640 1 -- 172.21.15.129:0/547599716 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f342c0083f0 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.866+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c294540 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343d784640 1 -- 172.21.15.129:0/547599716 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f342c0083f0 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c294950 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343d784640 1 -- 172.21.15.129:0/547599716 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f342c012040 con 0x56549c290df0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 Processor -- start 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 -- start start 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 0x56549c199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549c03ff20 con 0x56549c19b940 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343c782640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 0x56549c199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343c782640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 0x56549c199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48056/0 (socket says 172.21.15.129:48056) 2024-02-18T16:21:22.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343c782640 1 -- 172.21.15.129:0/566107153 learned_addr learned my addr 172.21.15.129:0/566107153 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343c782640 1 -- 172.21.15.129:0/566107153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549c19a320 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343c782640 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 0x56549c199de0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3424017be0 tx=0x7f3424017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f33227fc640 1 -- 172.21.15.129:0/566107153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240bb070 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56549c19a570 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f33227fc640 1 -- 172.21.15.129:0/566107153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240b6c80 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f33227fc640 1 -- 172.21.15.129:0/566107153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240c0470 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56549c19a9a0 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.870+0000 7f33227fc640 1 -- 172.21.15.129:0/566107153 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f34240b4400 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f33227fc640 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33140342b0 0x7f3314036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f33227fc640 1 -- 172.21.15.129:0/566107153 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f34240e5460 con 0x56549c19b940 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343d784640 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33140342b0 0x7f3314036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 Processor -- start 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- start start 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549c033790 con 0x56549c2b2d00 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343d784640 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33140342b0 0x7f3314036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56549c293f80 tx=0x7f342c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48072/0 (socket says 172.21.15.129:48072) 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 -- 172.21.15.129:0/3554956963 learned_addr learned my addr 172.21.15.129:0/3554956963 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 -- 172.21.15.129:0/3554956963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549c2b36b0 con 0x56549c2b2d00 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 --2- 172.21.15.129:0/3554956963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b30e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f34240af1e0 tx=0x7f34240e3a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db6ef5cd35f80ab server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f3313fff640 1 -- 172.21.15.129:0/3554956963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240b4880 con 0x56549c2b2d00 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f3313fff640 1 -- 172.21.15.129:0/3554956963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240e2280 con 0x56549c2b2d00 2024-02-18T16:21:22.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f3313fff640 1 -- 172.21.15.129:0/3554956963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240e5070 con 0x56549c2b2d00 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- 172.21.15.129:0/3554956963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 msgr2=0x56549c2b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 --2- 172.21.15.129:0/3554956963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b30e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f34240af1e0 tx=0x7f34240e3a50 comp rx=0 tx=0).stop 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- 172.21.15.129:0/3554956963 shutdown_connections 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 --2- 172.21.15.129:0/3554956963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b30e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- 172.21.15.129:0/3554956963 >> 172.21.15.129:0/3554956963 conn(0x56549c2af040 msgr2=0x56549c2ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- 172.21.15.129:0/3554956963 shutdown_connections 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- 172.21.15.129:0/3554956963 wait complete. 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 Processor -- start 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- start start 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343f468980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549c2ba0f0 con 0x56549c2b2d00 2024-02-18T16:21:22.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48084/0 (socket says 172.21.15.129:48084) 2024-02-18T16:21:22.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 learned_addr learned my addr 172.21.15.129:0/2898733449 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:22.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.874+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549c19a9a0 con 0x56549c2b2d00 2024-02-18T16:21:22.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343c782640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b9bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f34240bf6e0 tx=0x7f34240e3720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f33127fc640 1 -- 172.21.15.129:0/2898733449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240b4880 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56549c2ba2f0 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f33127fc640 1 -- 172.21.15.129:0/2898733449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240c8730 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f33127fc640 1 -- 172.21.15.129:0/2898733449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34240bf9d0 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56549c2ba720 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f33127fc640 1 -- 172.21.15.129:0/2898733449 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f34240dc070 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f33127fc640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33080342b0 0x7f3308036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f33127fc640 1 -- 172.21.15.129:0/2898733449 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f34240b5280 con 0x56549c2b2d00 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c2c4fb0 0x56549c2c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343d784640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33080342b0 0x7f3308036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c7ba0 con 0x56549c2c4fb0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c2c4fb0 0x56549c2c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343d784640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33080342b0 0x7f3308036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f342c008fd0 tx=0x7f342c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c2c4fb0 0x56549c2c7450 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 realm 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c7f70 con 0x56549c2c4fb0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c87c0 con 0x56549c2c4fb0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c8b20 con 0x56549c2c4fb0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c9320 con 0x56549c2c4fb0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:22.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 20 searching for the correct realm 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56549c2cb040 0x56549c2cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.878+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343c782640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56549c2cb040 0x56549c2cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343c782640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56549c2cb040 0x56549c2cd430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343c782640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f34240d6040 0x7f34240e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f34240d6040 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343d784640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f34240d6040 0x7f34240e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343d784640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f34240d6040 0x7f34240e6750 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342c02c040 con 0x7f34240d6040 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343d784640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f342c027940 0x7f342c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:22.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f342c027940 0x7f342c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f342c027940 0x7f342c0333c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.882+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f34240d6040 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342c02c040 con 0x7f34240d6040 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f34240d6040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f342c02c040 con 0x7f34240d6040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.886+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f34240d6040 2024-02-18T16:21:22.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342c02c040 con 0x7f34240d6040 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.890+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f34240d6040 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342c02c040 con 0x7f34240d6040 2024-02-18T16:21:22.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2cb040 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f342c027940 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x56549c2c4fb0 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cd970 con 0x7f34240d6040 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342c02c040 con 0x7f34240d6040 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:22.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c9c20 con 0x56549c2c4fb0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2c98a0 con 0x56549c2c4fb0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2ca570 con 0x56549c2c4fb0 2024-02-18T16:21:22.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 zone default found 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 4 Realm: () 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 zonegroup default 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2ce170 con 0x7f342c027940 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cfb50 con 0x56549c2cb040 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cfeb0 con 0x56549c2cb040 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 started sync module instance, tier type = 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:22.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.894+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cf120 con 0x7f34240d6040 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342c03f040 con 0x7f34240d6040 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94921397433552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cf120 con 0x7f34240d6040 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d08a0 con 0x56549c2c4fb0 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94921397433552] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342c03f040 con 0x7f34240d6040 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94921397437312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cf120 con 0x56549c2c4fb0 2024-02-18T16:21:22.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.898+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d1260 con 0x56549c2cb040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94921397439936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d1ab0 con 0x56549c2cb040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d2480 con 0x7f34240d6040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94921397437312] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342c03f040 con 0x7f34240d6040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94921397444480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d2830 con 0x7f34240d6040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d31a0 con 0x56549c2c4fb0 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94921397439936] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94921397444480] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342c03f040 con 0x7f34240d6040 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94921397431424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d2d00 con 0x56549c2c4fb0 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.902+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d39f0 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.906+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94921397431424] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.906+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.906+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94921397442064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d3720 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.906+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d3f20 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94921397442064] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94921397449616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d3d90 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d4860 con 0x7f342c027940 2024-02-18T16:21:22.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94921397449616] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94921397453632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d4820 con 0x7f342c027940 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=0 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=1 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=2 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=3 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=4 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=5 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.910+0000 7f343f468980 20 add_watcher() i=6 2024-02-18T16:21:22.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94921397453632] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 add_watcher() i=7 2024-02-18T16:21:22.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:22.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d7d00 con 0x56549c2c4fb0 2024-02-18T16:21:22.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94921397450736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d5210 con 0x56549c2c4fb0 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94921397450736] v30'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f32f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 5 note: GC not initialized 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f32f1fe3640 20 reqs_thread_entry: start 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 Filter name: none 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f32637fe640 20 reqs_thread_entry: start 2024-02-18T16:21:22.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 rados->read ofs=0 len=0 2024-02-18T16:21:22.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2f9780 con 0x56549c2c4fb0 2024-02-18T16:21:22.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 20 rados_obj.operate() r=0 bl.length=513 2024-02-18T16:21:22.923 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:22.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f32f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:22.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.914+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94921397450736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2f8820 con 0x56549c2c4fb0 2024-02-18T16:21:22.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94921397450736] v30'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94921397433552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d37f0 con 0x7f34240d6040 2024-02-18T16:21:22.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94921397433552] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342c03f040 con 0x7f34240d6040 2024-02-18T16:21:22.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343f468980 20 remove_watcher() i=0 2024-02-18T16:21:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343f468980 2 removed watcher, disabling cache 2024-02-18T16:21:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94921397437312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cf4d0 con 0x56549c2c4fb0 2024-02-18T16:21:22.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.918+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94921397437312] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343f468980 20 remove_watcher() i=1 2024-02-18T16:21:22.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94921397439936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cf4d0 con 0x56549c2cb040 2024-02-18T16:21:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343c782640 1 -- 172.21.15.129:0/2898733449 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94921397439936] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f34240db030 con 0x56549c2cb040 2024-02-18T16:21:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343f468980 20 remove_watcher() i=2 2024-02-18T16:21:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94921397444480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d0dc0 con 0x7f34240d6040 2024-02-18T16:21:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343d784640 1 -- 172.21.15.129:0/2898733449 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94921397444480] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342c03f040 con 0x7f34240d6040 2024-02-18T16:21:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343f468980 20 remove_watcher() i=3 2024-02-18T16:21:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.922+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94921397431424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d0dc0 con 0x56549c2c4fb0 2024-02-18T16:21:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.926+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94921397431424] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x56549c2c4fb0 2024-02-18T16:21:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.926+0000 7f343f468980 20 remove_watcher() i=4 2024-02-18T16:21:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.926+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94921397442064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cec80 con 0x7f342c027940 2024-02-18T16:21:22.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.926+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94921397442064] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.926+0000 7f343f468980 20 remove_watcher() i=5 2024-02-18T16:21:22.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.926+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94921397449616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2d0dc0 con 0x7f342c027940 2024-02-18T16:21:22.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94921397449616] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 20 remove_watcher() i=6 2024-02-18T16:21:22.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94921397453632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56549c2cec80 con 0x7f342c027940 2024-02-18T16:21:22.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94921397453632] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3434047db0 con 0x7f342c027940 2024-02-18T16:21:22.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 20 remove_watcher() i=7 2024-02-18T16:21:22.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f342c027940 msgr2=0x7f342c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f342c027940 0x7f342c0333c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c2c4fb0 msgr2=0x56549c2c7450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c2c4fb0 0x56549c2c7450 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f34240d6040 msgr2=0x7f34240e6750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f34240d6040 0x7f34240e6750 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56549c2cb040 msgr2=0x56549c2cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56549c2cb040 0x56549c2cd430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33080342b0 msgr2=0x7f3308036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33080342b0 0x7f3308036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f342c008fd0 tx=0x7f342c01c070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 msgr2=0x56549c2b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343cf83640 1 -- 172.21.15.129:0/2898733449 reap_dead start 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b9bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f34240bf6e0 tx=0x7f34240e3720 comp rx=0 tx=0).stop 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 shutdown_connections 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 --2- 172.21.15.129:0/2898733449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c2b2d00 0x56549c2b9bb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 >> 172.21.15.129:0/2898733449 conn(0x56549c2af040 msgr2=0x56549c2ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 shutdown_connections 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/2898733449 wait complete. 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.930+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33140342b0 msgr2=0x7f3314036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33140342b0 0x7f3314036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56549c293f80 tx=0x7f342c003070 comp rx=0 tx=0).stop 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 msgr2=0x56549c199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 0x56549c199de0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3424017be0 tx=0x7f3424017d70 comp rx=0 tx=0).stop 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 shutdown_connections 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f33140342b0 0x7f3314036770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/566107153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19b940 0x56549c199de0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 >> 172.21.15.129:0/566107153 conn(0x56549c298850 msgr2=0x56549c299360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 shutdown_connections 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/566107153 wait complete. 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c290df0 msgr2=0x56549c2931e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c290df0 0x56549c2931e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3324034300 msgr2=0x7f33240367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3324034300 0x7f33240367c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f34240ac000 tx=0x7f34240a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 msgr2=0x56549c28c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c28c180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3434001ee0 tx=0x7f3434000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 shutdown_connections 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56549c290df0 0x56549c2931e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3324034300 0x7f33240367c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 --2- 172.21.15.129:0/547599716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56549c19f520 0x56549c28c180 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:22.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 >> 172.21.15.129:0/547599716 conn(0x56549c1958e0 msgr2=0x56549c27f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:22.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 shutdown_connections 2024-02-18T16:21:22.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:22.934+0000 7f343f468980 1 -- 172.21.15.129:0/547599716 wait complete. 2024-02-18T16:21:22.947 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:22.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:22.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:22.948 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697d201980 1 Processor -- start 2024-02-18T16:21:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697d201980 1 -- start start 2024-02-18T16:21:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697d201980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55c1216ad850 0x55c1216afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697d201980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c1215f34c0 con 0x55c1216a9350 2024-02-18T16:21:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697d201980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c1215ba180 con 0x55c1216ad850 2024-02-18T16:21:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697a51b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55c1216ad850 0x55c1216afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697ad1c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55c1216a9350 0x55c1216a9730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42732/0 (socket says 172.21.15.129:42732) 2024-02-18T16:21:23.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697ad1c640 1 -- 172.21.15.129:0/2666562094 learned_addr learned my addr 172.21.15.129:0/2666562094 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:23.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697a51b640 1 -- 172.21.15.129:0/2666562094 >> v1:172.21.15.80:6789/0 conn(0x55c1216a9350 legacy=0x55c1216a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.018+0000 7f697a51b640 1 -- 172.21.15.129:0/2666562094 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1216b1190 con 0x55c1216ad850 2024-02-18T16:21:23.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697a51b640 1 --2- 172.21.15.129:0/2666562094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216ad850 0x55c1216afc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f697000a480 tx=0x7f697001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e2a935901e11b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f6979d1a640 1 -- 172.21.15.129:0/2666562094 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700ab540 con 0x55c1216ad850 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f6979d1a640 1 -- 172.21.15.129:0/2666562094 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700ab6a0 con 0x55c1216ad850 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f6979d1a640 1 -- 172.21.15.129:0/2666562094 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700ab960 con 0x55c1216ad850 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 -- 172.21.15.129:0/2666562094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216ad850 msgr2=0x55c1216afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 --2- 172.21.15.129:0/2666562094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216ad850 0x55c1216afc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f697000a480 tx=0x7f697001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 -- 172.21.15.129:0/2666562094 shutdown_connections 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 --2- 172.21.15.129:0/2666562094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216ad850 0x55c1216afc40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 -- 172.21.15.129:0/2666562094 >> 172.21.15.129:0/2666562094 conn(0x55c12161ca40 msgr2=0x55c12161ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 -- 172.21.15.129:0/2666562094 shutdown_connections 2024-02-18T16:21:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.022+0000 7f697d201980 1 -- 172.21.15.129:0/2666562094 wait complete. 2024-02-18T16:21:23.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697d201980 1 Processor -- start 2024-02-18T16:21:23.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697d201980 1 -- start start 2024-02-18T16:21:23.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697d201980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c1217932a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697d201980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1215b76b0 con 0x55c1216a9350 2024-02-18T16:21:23.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697ad1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c1217932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697ad1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c1217932a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48108/0 (socket says 172.21.15.129:48108) 2024-02-18T16:21:23.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.034+0000 7f697ad1c640 1 -- 172.21.15.129:0/1457544053 learned_addr learned my addr 172.21.15.129:0/1457544053 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 -- 172.21.15.129:0/1457544053 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970005d30 con 0x55c1216a9350 2024-02-18T16:21:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 --2- 172.21.15.129:0/1457544053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c1217932a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f696c001c90 tx=0x7f696c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0d2a93c49a7458 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f6868e09640 1 -- 172.21.15.129:0/1457544053 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f696c00e690 con 0x55c1216a9350 2024-02-18T16:21:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f6868e09640 1 -- 172.21.15.129:0/1457544053 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00e7f0 con 0x55c1216a9350 2024-02-18T16:21:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f6868e09640 1 -- 172.21.15.129:0/1457544053 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f696c00eaf0 con 0x55c1216a9350 2024-02-18T16:21:23.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- 172.21.15.129:0/1457544053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 msgr2=0x55c1217932a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 --2- 172.21.15.129:0/1457544053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c1217932a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f696c001c90 tx=0x7f696c00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- 172.21.15.129:0/1457544053 shutdown_connections 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 --2- 172.21.15.129:0/1457544053 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c1217932a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- 172.21.15.129:0/1457544053 >> 172.21.15.129:0/1457544053 conn(0x55c12161ca40 msgr2=0x55c12178ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- 172.21.15.129:0/1457544053 shutdown_connections 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- 172.21.15.129:0/1457544053 wait complete. 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 Processor -- start 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- start start 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c12179a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1215b2e90 con 0x55c1216a9350 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c12179a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c12179a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48112/0 (socket says 172.21.15.129:48112) 2024-02-18T16:21:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 -- 172.21.15.129:0/4204022219 learned_addr learned my addr 172.21.15.129:0/4204022219 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1215f34c0 con 0x55c1216a9350 2024-02-18T16:21:23.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697ad1c640 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c12179a0f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f696c001ee0 tx=0x7f696c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f6867606640 1 -- 172.21.15.129:0/4204022219 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f696c01f070 con 0x55c1216a9350 2024-02-18T16:21:23.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f6867606640 1 -- 172.21.15.129:0/4204022219 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c01a4d0 con 0x55c1216a9350 2024-02-18T16:21:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f6867606640 1 -- 172.21.15.129:0/4204022219 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f696c01a770 con 0x55c1216a9350 2024-02-18T16:21:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.038+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c12179a630 con 0x55c1216a9350 2024-02-18T16:21:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c12179aa80 con 0x55c1216a9350 2024-02-18T16:21:23.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f6867606640 1 -- 172.21.15.129:0/4204022219 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f696c00a040 con 0x55c1216a9350 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f6867606640 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68600342b0 0x7f6860036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f6867606640 1 -- 172.21.15.129:0/4204022219 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f696c049660 con 0x55c1216a9350 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697a51b640 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68600342b0 0x7f6860036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1216ad850 0x55c1217a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217a12b0 con 0x55c1216ad850 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1216ad850 0x55c1217a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697a51b640 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68600342b0 0x7f6860036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69700ad000 tx=0x7f69700a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1216ad850 0x55c1217a0d70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 -- 172.21.15.129:0/4204022219 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f697400a4d0 con 0x55c1216ad850 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217a1650 con 0x55c1216ad850 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 -- 172.21.15.129:0/4204022219 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f697400a4d0 con 0x55c1216ad850 2024-02-18T16:21:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217a2ed0 con 0x55c1216ad850 2024-02-18T16:21:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 -- 172.21.15.129:0/4204022219 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f697400a4d0 con 0x55c1216ad850 2024-02-18T16:21:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217a20d0 con 0x55c1216ad850 2024-02-18T16:21:23.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 -- 172.21.15.129:0/4204022219 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f697400a4d0 con 0x55c1216ad850 2024-02-18T16:21:23.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217a24e0 con 0x55c1216ad850 2024-02-18T16:21:23.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697b51d640 1 -- 172.21.15.129:0/4204022219 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f697400a4d0 con 0x55c1216ad850 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.042+0000 7f697d201980 1 Processor -- start 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 -- start start 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 0x55c1217b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12154bf20 con 0x55c1217b15d0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697a51b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 0x55c1217b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697a51b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 0x55c1217b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48116/0 (socket says 172.21.15.129:48116) 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697a51b640 1 -- 172.21.15.129:0/76788815 learned_addr learned my addr 172.21.15.129:0/76788815 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697a51b640 1 -- 172.21.15.129:0/76788815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1217b1f30 con 0x55c1217b15d0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697a51b640 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 0x55c1217b19f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f69700ab670 tx=0x7f6970018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f6864e01640 1 -- 172.21.15.129:0/76788815 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700be7c0 con 0x55c1217b15d0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1217b2120 con 0x55c1217b15d0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1217b2c70 con 0x55c1217b15d0 2024-02-18T16:21:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f6864e01640 1 -- 172.21.15.129:0/76788815 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700be920 con 0x55c1217b15d0 2024-02-18T16:21:23.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f6864e01640 1 -- 172.21.15.129:0/76788815 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700bebc0 con 0x55c1217b15d0 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f6864e01640 1 -- 172.21.15.129:0/76788815 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f69700bed20 con 0x55c1217b15d0 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f6864e01640 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68540342b0 0x7f6854036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f6864e01640 1 -- 172.21.15.129:0/76788815 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f69700e6710 con 0x55c1217b15d0 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697b51d640 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68540342b0 0x7f6854036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 Processor -- start 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 -- start start 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697b51d640 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68540342b0 0x7f6854036770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55c1217a1b10 tx=0x7f6974005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.046+0000 7f697d201980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12153f790 con 0x55c1217be650 2024-02-18T16:21:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217bea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48122/0 (socket says 172.21.15.129:48122) 2024-02-18T16:21:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 -- 172.21.15.129:0/1547423660 learned_addr learned my addr 172.21.15.129:0/1547423660 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 -- 172.21.15.129:0/1547423660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1217bf020 con 0x55c1217be650 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 --2- 172.21.15.129:0/1547423660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217bea50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69700e4b00 tx=0x7f69700aa830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e20b99f34a8609 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f685e7fc640 1 -- 172.21.15.129:0/1547423660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700aab00 con 0x55c1217be650 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f685e7fc640 1 -- 172.21.15.129:0/1547423660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700aaca0 con 0x55c1217be650 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f685e7fc640 1 -- 172.21.15.129:0/1547423660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700aa3b0 con 0x55c1217be650 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/1547423660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 msgr2=0x55c1217bea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 --2- 172.21.15.129:0/1547423660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217bea50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69700e4b00 tx=0x7f69700aa830 comp rx=0 tx=0).stop 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/1547423660 shutdown_connections 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 --2- 172.21.15.129:0/1547423660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217bea50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/1547423660 >> 172.21.15.129:0/1547423660 conn(0x55c1217ba990 msgr2=0x55c1217b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/1547423660 shutdown_connections 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/1547423660 wait complete. 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 Processor -- start 2024-02-18T16:21:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- start start 2024-02-18T16:21:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1217c5a90 con 0x55c1217be650 2024-02-18T16:21:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48126/0 (socket says 172.21.15.129:48126) 2024-02-18T16:21:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 learned_addr learned my addr 172.21.15.129:0/829078275 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1217b2c70 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697a51b640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217c5550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69700b4d90 tx=0x7f69700d4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f685cff9640 1 -- 172.21.15.129:0/829078275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700e0040 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1217c5c90 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1217c60c0 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f685cff9640 1 -- 172.21.15.129:0/829078275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700aae10 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.050+0000 7f685cff9640 1 -- 172.21.15.129:0/829078275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69700e6db0 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f685cff9640 1 -- 172.21.15.129:0/829078275 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f69700bda60 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f685cff9640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68440342b0 0x7f6844036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f685cff9640 1 -- 172.21.15.129:0/829078275 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f69700dd0b0 con 0x55c1217be650 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697b51d640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68440342b0 0x7f6844036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1217d0ab0 0x55c1217d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d36a0 con 0x55c1217d0ab0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1217d0ab0 0x55c1217d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697b51d640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68440342b0 0x7f6844036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6974011010 tx=0x7f6974020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1217d0ab0 0x55c1217d2f50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 realm 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d3a70 con 0x55c1217d0ab0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d42c0 con 0x55c1217d0ab0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d4620 con 0x55c1217d0ab0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d3f60 con 0x55c1217d0ab0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 20 searching for the correct realm 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c1217d6870 0x55c1217d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697a51b640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c1217d6870 0x55c1217d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697a51b640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c1217d6870 0x55c1217d8cc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f69700bdd60 con 0x55c1217d6870 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697a51b640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f69700ef070 0x7f69700d3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.054+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69700ef070 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f69700ef070 0x7f69700d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f69700ef070 0x7f69700d3110 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f697400a4d0 con 0x7f69700ef070 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f69740141d0 0x7f6974015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f69740141d0 0x7f6974015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f69740141d0 0x7f6974015940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69700ef070 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f697400a4d0 con 0x7f69700ef070 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.058+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69700ef070 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.062+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69700ef070 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69700ef070 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d6870 2024-02-18T16:21:23.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.066+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69740141d0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x55c1217d0ab0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9390 con 0x7f69700ef070 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d54c0 con 0x55c1217d0ab0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d5140 con 0x55c1217d0ab0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d5e10 con 0x55c1217d0ab0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 zone default found 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 4 Realm: () 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 zonegroup default 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217d9c70 con 0x7f69740141d0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217db650 con 0x55c1217d6870 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217db9b0 con 0x55c1217d6870 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 started sync module instance, tier type = 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dac20 con 0x7f69700ef070 2024-02-18T16:21:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94287978934224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dac20 con 0x7f69700ef070 2024-02-18T16:21:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.070+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dc400 con 0x55c1217d0ab0 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94287978934224] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94287978938112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dac20 con 0x55c1217d0ab0 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dce00 con 0x55c1217d6870 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94287978940704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dd650 con 0x55c1217d6870 2024-02-18T16:21:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.074+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217de000 con 0x7f69700ef070 2024-02-18T16:21:23.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94287978938112] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94287978932096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217de3b0 con 0x7f69700ef070 2024-02-18T16:21:23.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217ded20 con 0x55c1217d0ab0 2024-02-18T16:21:23.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94287978940704] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94287978932096] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94287978945312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217de880 con 0x55c1217d0ab0 2024-02-18T16:21:23.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.078+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217df570 con 0x7f69740141d0 2024-02-18T16:21:23.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94287978945312] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94287978942896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217df2d0 con 0x7f69740141d0 2024-02-18T16:21:23.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dfad0 con 0x7f69740141d0 2024-02-18T16:21:23.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94287978942896] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94287978950672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217df9f0 con 0x7f69740141d0 2024-02-18T16:21:23.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.082+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217e0490 con 0x7f69740141d0 2024-02-18T16:21:23.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94287978950672] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94287978954608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217e0450 con 0x7f69740141d0 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=0 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=1 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=2 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=3 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=4 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=5 2024-02-18T16:21:23.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=6 2024-02-18T16:21:23.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94287978954608] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 20 add_watcher() i=7 2024-02-18T16:21:23.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:23.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217e38d0 con 0x55c1217d0ab0 2024-02-18T16:21:23.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.086+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94287978951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217e0db0 con 0x55c1217d0ab0 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94287978951792] v30'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f68317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 5 note: GC not initialized 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f67abfff640 20 reqs_thread_entry: start 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 Filter name: none 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f67a9ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c121805320 con 0x55c1217d0ab0 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 rados_obj.operate() r=0 bl.length=513 2024-02-18T16:21:23.096 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:23.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f68317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94287978951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c121804350 con 0x55c1217d0ab0 2024-02-18T16:21:23.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94287978951792] v30'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94287978934224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217df470 con 0x7f69700ef070 2024-02-18T16:21:23.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94287978934224] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 20 remove_watcher() i=0 2024-02-18T16:21:23.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 2 removed watcher, disabling cache 2024-02-18T16:21:23.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.090+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94287978938112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dafd0 con 0x55c1217d0ab0 2024-02-18T16:21:23.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.094+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94287978938112] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.094+0000 7f697d201980 20 remove_watcher() i=1 2024-02-18T16:21:23.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.094+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94287978940704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dafd0 con 0x55c1217d6870 2024-02-18T16:21:23.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.094+0000 7f697a51b640 1 -- 172.21.15.129:0/829078275 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94287978940704] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6970103040 con 0x55c1217d6870 2024-02-18T16:21:23.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.094+0000 7f697d201980 20 remove_watcher() i=2 2024-02-18T16:21:23.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.094+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94287978932096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dbf00 con 0x7f69700ef070 2024-02-18T16:21:23.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.098+0000 7f697b51d640 1 -- 172.21.15.129:0/829078275 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94287978932096] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f697403a040 con 0x7f69700ef070 2024-02-18T16:21:23.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.098+0000 7f697d201980 20 remove_watcher() i=3 2024-02-18T16:21:23.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.098+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94287978945312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dbf00 con 0x55c1217d0ab0 2024-02-18T16:21:23.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.098+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94287978945312] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x55c1217d0ab0 2024-02-18T16:21:23.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.098+0000 7f697d201980 20 remove_watcher() i=4 2024-02-18T16:21:23.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.098+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94287978942896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217ddb20 con 0x7f69740141d0 2024-02-18T16:21:23.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.102+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94287978942896] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.102+0000 7f697d201980 20 remove_watcher() i=5 2024-02-18T16:21:23.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.102+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94287978950672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217dbf00 con 0x7f69740141d0 2024-02-18T16:21:23.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.102+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94287978950672] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.102+0000 7f697d201980 20 remove_watcher() i=6 2024-02-18T16:21:23.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.102+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94287978954608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c1217ddb20 con 0x7f69740141d0 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94287978954608] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f696c014070 con 0x7f69740141d0 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 20 remove_watcher() i=7 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f69740141d0 msgr2=0x7f6974015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f69740141d0 0x7f6974015940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1217d0ab0 msgr2=0x55c1217d2f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1217d0ab0 0x55c1217d2f50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f69700ef070 msgr2=0x7f69700d3110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f69700ef070 0x7f69700d3110 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c1217d6870 msgr2=0x55c1217d8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c1217d6870 0x55c1217d8cc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68440342b0 msgr2=0x7f6844036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68440342b0 0x7f6844036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6974011010 tx=0x7f6974020000 comp rx=0 tx=0).stop 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 msgr2=0x55c1217c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/829078275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217be650 0x55c1217c5550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69700b4d90 tx=0x7f69700d4040 comp rx=0 tx=0).stop 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 reap_dead start 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697ad1c640 1 -- 172.21.15.129:0/829078275 reap_dead start 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 shutdown_connections 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 >> 172.21.15.129:0/829078275 conn(0x55c1217ba990 msgr2=0x55c1217b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 shutdown_connections 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/829078275 wait complete. 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68540342b0 msgr2=0x7f6854036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68540342b0 0x7f6854036770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55c1217a1b10 tx=0x7f6974005850 comp rx=0 tx=0).stop 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 msgr2=0x55c1217b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 0x55c1217b19f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f69700ab670 tx=0x7f6970018020 comp rx=0 tx=0).stop 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 shutdown_connections 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68540342b0 0x7f6854036770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/76788815 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1217b15d0 0x55c1217b19f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 >> 172.21.15.129:0/76788815 conn(0x55c1217a63e0 msgr2=0x55c1217a6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 shutdown_connections 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/76788815 wait complete. 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1216ad850 msgr2=0x55c1217a0d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1216ad850 0x55c1217a0d70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68600342b0 msgr2=0x7f6860036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68600342b0 0x7f6860036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69700ad000 tx=0x7f69700a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 msgr2=0x55c12179a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c12179a0f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f696c001ee0 tx=0x7f696c000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 shutdown_connections 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c1216ad850 0x55c1217a0d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f68600342b0 0x7f6860036770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 --2- 172.21.15.129:0/4204022219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c1216a9350 0x55c12179a0f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 >> 172.21.15.129:0/4204022219 conn(0x55c12161ca40 msgr2=0x55c12178d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 shutdown_connections 2024-02-18T16:21:23.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.106+0000 7f697d201980 1 -- 172.21.15.129:0/4204022219 wait complete. 2024-02-18T16:21:23.120 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:23.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-18T16:21:23.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-18T16:21:23.120 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-02-18T16:21:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1be078f980 1 Processor -- start 2024-02-18T16:21:23.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1be078f980 1 -- start start 2024-02-18T16:21:23.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1be078f980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560ff24ee800 0x560ff24eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1be078f980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560ff2437460 con 0x560ff24ed2c0 2024-02-18T16:21:23.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1be078f980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x560ff23fe180 con 0x560ff24ee800 2024-02-18T16:21:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1bde2aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560ff24ee800 0x560ff24eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1bddaa9640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x560ff24ed2c0 0x560ff24ed6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42738/0 (socket says 172.21.15.129:42738) 2024-02-18T16:21:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1bde2aa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560ff24ee800 0x560ff24eebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48142/0 (socket says 172.21.15.129:48142) 2024-02-18T16:21:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1038284021 learned_addr learned my addr 172.21.15.129:0/1038284021 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1038284021 >> v1:172.21.15.80:6789/0 conn(0x560ff24ed2c0 legacy=0x560ff24ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.198+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1038284021 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff24ef360 con 0x560ff24ee800 2024-02-18T16:21:23.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/1038284021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ee800 0x560ff24eebe0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000a420 tx=0x7f1bd001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbb57e16a233141 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1bdd2a8640 1 -- 172.21.15.129:0/1038284021 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00aa530 con 0x560ff24ee800 2024-02-18T16:21:23.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1bdd2a8640 1 -- 172.21.15.129:0/1038284021 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00a6050 con 0x560ff24ee800 2024-02-18T16:21:23.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1bdd2a8640 1 -- 172.21.15.129:0/1038284021 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00aa800 con 0x560ff24ee800 2024-02-18T16:21:23.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 -- 172.21.15.129:0/1038284021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ee800 msgr2=0x560ff24eebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 --2- 172.21.15.129:0/1038284021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ee800 0x560ff24eebe0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000a420 tx=0x7f1bd001afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 -- 172.21.15.129:0/1038284021 shutdown_connections 2024-02-18T16:21:23.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 --2- 172.21.15.129:0/1038284021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ee800 0x560ff24eebe0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 -- 172.21.15.129:0/1038284021 >> 172.21.15.129:0/1038284021 conn(0x560ff24609e0 msgr2=0x560ff2460df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 -- 172.21.15.129:0/1038284021 shutdown_connections 2024-02-18T16:21:23.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.202+0000 7f1be078f980 1 -- 172.21.15.129:0/1038284021 wait complete. 2024-02-18T16:21:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1be078f980 1 Processor -- start 2024-02-18T16:21:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1be078f980 1 -- start start 2024-02-18T16:21:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1be078f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1be078f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff23fb6b0 con 0x560ff24ed2c0 2024-02-18T16:21:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1bde2aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1bde2aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48158/0 (socket says 172.21.15.129:48158) 2024-02-18T16:21:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1bde2aa640 1 -- 172.21.15.129:0/2554853400 learned_addr learned my addr 172.21.15.129:0/2554853400 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1bde2aa640 1 -- 172.21.15.129:0/2554853400 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd000a100 con 0x560ff24ed2c0 2024-02-18T16:21:23.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/2554853400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25d7760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ad040 tx=0x7f1bd00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2e65a3216d21ef server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1acc608640 1 -- 172.21.15.129:0/2554853400 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00aa6c0 con 0x560ff24ed2c0 2024-02-18T16:21:23.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1acc608640 1 -- 172.21.15.129:0/2554853400 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00aa820 con 0x560ff24ed2c0 2024-02-18T16:21:23.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.214+0000 7f1acc608640 1 -- 172.21.15.129:0/2554853400 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00aaac0 con 0x560ff24ed2c0 2024-02-18T16:21:23.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2554853400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 msgr2=0x560ff25d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 --2- 172.21.15.129:0/2554853400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25d7760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ad040 tx=0x7f1bd00033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2554853400 shutdown_connections 2024-02-18T16:21:23.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 --2- 172.21.15.129:0/2554853400 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25d7760 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2554853400 >> 172.21.15.129:0/2554853400 conn(0x560ff24609e0 msgr2=0x560ff25d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2554853400 shutdown_connections 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2554853400 wait complete. 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 Processor -- start 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- start start 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25de4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff23f6e90 con 0x560ff24ed2c0 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1bde2aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25de4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1bde2aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25de4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48164/0 (socket says 172.21.15.129:48164) 2024-02-18T16:21:23.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1bde2aa640 1 -- 172.21.15.129:0/2483387809 learned_addr learned my addr 172.21.15.129:0/2483387809 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1bde2aa640 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff24ef360 con 0x560ff24ed2c0 2024-02-18T16:21:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25de4a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0003430 tx=0x7f1bd0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1acae05640 1 -- 172.21.15.129:0/2483387809 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00b6950 con 0x560ff24ed2c0 2024-02-18T16:21:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ff25de9e0 con 0x560ff24ed2c0 2024-02-18T16:21:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1acae05640 1 -- 172.21.15.129:0/2483387809 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00b6ab0 con 0x560ff24ed2c0 2024-02-18T16:21:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff25dee70 con 0x560ff24ed2c0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1acae05640 1 -- 172.21.15.129:0/2483387809 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00b6d50 con 0x560ff24ed2c0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.218+0000 7f1acae05640 1 -- 172.21.15.129:0/2483387809 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1bd00c0450 con 0x560ff24ed2c0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1acae05640 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ac40342b0 0x7f1ac4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1acae05640 1 -- 172.21.15.129:0/2483387809 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1bd00e3f20 con 0x560ff24ed2c0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ac40342b0 0x7f1ac4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff24ee800 0x560ff25e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff25e5660 con 0x560ff24ee800 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff24ee800 0x560ff25e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ac40342b0 0x7f1ac4036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8001da0 tx=0x7f1bc8001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff24ee800 0x560ff25e5120 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 -- 172.21.15.129:0/2483387809 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1bd80083f0 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff25e59e0 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 -- 172.21.15.129:0/2483387809 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1bd80083f0 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff25e7290 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 -- 172.21.15.129:0/2483387809 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f1bd80083f0 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff25e6490 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 -- 172.21.15.129:0/2483387809 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1bd80083f0 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff25e68a0 con 0x560ff24ee800 2024-02-18T16:21:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bdeaab640 1 -- 172.21.15.129:0/2483387809 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1bd8012040 con 0x560ff24ee800 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 Processor -- start 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- start start 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 0x560ff25f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1be078f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff238ff20 con 0x560ff25f59a0 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bddaa9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 0x560ff25f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bddaa9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 0x560ff25f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48170/0 (socket says 172.21.15.129:48170) 2024-02-18T16:21:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bddaa9640 1 -- 172.21.15.129:0/521847321 learned_addr learned my addr 172.21.15.129:0/521847321 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.222+0000 7f1bddaa9640 1 -- 172.21.15.129:0/521847321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff25f6300 con 0x560ff25f59a0 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 0x560ff25f5dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800d660 tx=0x7f1bc800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac3fff640 1 -- 172.21.15.129:0/521847321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc8020070 con 0x560ff25f59a0 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ff25f6550 con 0x560ff25f59a0 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac3fff640 1 -- 172.21.15.129:0/521847321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800c770 con 0x560ff25f59a0 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac3fff640 1 -- 172.21.15.129:0/521847321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc8013040 con 0x560ff25f59a0 2024-02-18T16:21:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff25f70a0 con 0x560ff25f59a0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac3fff640 1 -- 172.21.15.129:0/521847321 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1bc800a040 con 0x560ff25f59a0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac3fff640 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ab80342b0 0x7f1ab8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac3fff640 1 -- 172.21.15.129:0/521847321 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1bc804b6a0 con 0x560ff25f59a0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ab80342b0 0x7f1ab8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1be078f980 1 Processor -- start 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1be078f980 1 -- start start 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ab80342b0 0x7f1ab8036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x560ff25e5ed0 tx=0x7f1bd8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1be078f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff24626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1be078f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff2383790 con 0x560ff24622d0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bddaa9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff24626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bddaa9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff24626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48176/0 (socket says 172.21.15.129:48176) 2024-02-18T16:21:23.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1260976621 learned_addr learned my addr 172.21.15.129:0/1260976621 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1260976621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff2462ca0 con 0x560ff24622d0 2024-02-18T16:21:23.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/1260976621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff24626d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8049bc0 tx=0x7f1bc8049cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b701953cb5d6238b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.226+0000 7f1ac1ffb640 1 -- 172.21.15.129:0/1260976621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc801ace0 con 0x560ff24622d0 2024-02-18T16:21:23.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1ac1ffb640 1 -- 172.21.15.129:0/1260976621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc801ae40 con 0x560ff24622d0 2024-02-18T16:21:23.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1ac1ffb640 1 -- 172.21.15.129:0/1260976621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc803a370 con 0x560ff24622d0 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1260976621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 msgr2=0x560ff24626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 --2- 172.21.15.129:0/1260976621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff24626d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8049bc0 tx=0x7f1bc8049cb0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1260976621 shutdown_connections 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 --2- 172.21.15.129:0/1260976621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff24626d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1260976621 >> 172.21.15.129:0/1260976621 conn(0x560ff25fed00 msgr2=0x560ff25fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1260976621 shutdown_connections 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1260976621 wait complete. 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 Processor -- start 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- start start 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff260dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff260e230 con 0x560ff24622d0 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1bddaa9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff260dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1bddaa9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff260dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48182/0 (socket says 172.21.15.129:48182) 2024-02-18T16:21:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 learned_addr learned my addr 172.21.15.129:0/1030574528 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff25f70a0 con 0x560ff24622d0 2024-02-18T16:21:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff260dcf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1bc801ac70 tx=0x7f1bc8049960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1aaffff640 1 -- 172.21.15.129:0/1030574528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc8048460 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ff260e430 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1aaffff640 1 -- 172.21.15.129:0/1030574528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8034070 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1aaffff640 1 -- 172.21.15.129:0/1030574528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc8019320 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff260e8c0 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.230+0000 7f1aaffff640 1 -- 172.21.15.129:0/1030574528 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1bc8019480 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1aaffff640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1aa80342b0 0x7f1aa8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1aaffff640 1 -- 172.21.15.129:0/1030574528 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1bc8040020 con 0x560ff24622d0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1aa80342b0 0x7f1aa8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff2619130 0x560ff261b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261bd20 con 0x560ff2619130 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff2619130 0x560ff261b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff2619130 0x560ff261b5d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1aa80342b0 0x7f1aa8036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8008fd0 tx=0x7f1bd801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 realm 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261c140 con 0x560ff2619130 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261c990 con 0x560ff2619130 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261ccf0 con 0x560ff2619130 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261d4f0 con 0x560ff2619130 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 20 searching for the correct realm 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560ff261f3b0 0x560ff2621830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2621eb0 con 0x560ff261f3b0 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560ff261f3b0 0x560ff2621830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560ff261f3b0 0x560ff2621830 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bddaa9640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1bc801a3c0 0x7f1bc804adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2621eb0 con 0x7f1bc801a3c0 2024-02-18T16:21:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1bc801a3c0 0x7f1bc804adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1bc801a3c0 0x7f1bc804adf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd802c040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1bd8027940 0x7f1bd80333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.234+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2621eb0 con 0x7f1bd8027940 2024-02-18T16:21:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1bd8027940 0x7f1bd80333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1bd8027940 0x7f1bd80333c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2621eb0 con 0x560ff2619130 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bc801a3c0 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd802c040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.238+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bc801a3c0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1bd802c040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.242+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bc801a3c0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd802c040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bc801a3c0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd802c040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff261f3b0 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bd8027940 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x560ff2619130 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.246+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1bd00e6080 con 0x7f1bc801a3c0 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1bd802c040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261e990 con 0x560ff2619130 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261e1e0 con 0x560ff2619130 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff261d970 con 0x560ff2619130 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 zone default found 2024-02-18T16:21:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 4 Realm: () 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 zonegroup default 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26222f0 con 0x7f1bd8027940 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2623d30 con 0x560ff261f3b0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26241c0 con 0x560ff261f3b0 2024-02-18T16:21:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1bc8022070 con 0x560ff261f3b0 2024-02-18T16:21:23.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 started sync module instance, tier type = 2024-02-18T16:21:23.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:23.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26235b0 con 0x7f1bc801a3c0 2024-02-18T16:21:23.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94626491019536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2623960 con 0x7f1bc801a3c0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.250+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2624f20 con 0x560ff2619130 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94626491019536] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94626491024864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2624ee0 con 0x560ff2619130 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26259a0 con 0x560ff261f3b0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bc806f040 con 0x560ff261f3b0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94626491028576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26261f0 con 0x560ff261f3b0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.254+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2626bc0 con 0x7f1bc801a3c0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94626491024864] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94626491033280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2626f70 con 0x7f1bc801a3c0 2024-02-18T16:21:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26278e0 con 0x560ff2619130 2024-02-18T16:21:23.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94626491033280] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94626491028576] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bc806f040 con 0x560ff261f3b0 2024-02-18T16:21:23.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94626491030864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2627440 con 0x560ff2619130 2024-02-18T16:21:23.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.258+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2628130 con 0x7f1bd8027940 2024-02-18T16:21:23.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94626491030864] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94626491025920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2627e90 con 0x7f1bd8027940 2024-02-18T16:21:23.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2628690 con 0x7f1bd8027940 2024-02-18T16:21:23.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94626491039648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2628a20 con 0x7f1bd8027940 2024-02-18T16:21:23.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26294f0 con 0x7f1bd8027940 2024-02-18T16:21:23.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.262+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94626491025920] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94626491039648] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94626491043792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2628480 con 0x7f1bd8027940 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=0 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=1 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=2 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=3 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=4 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=5 2024-02-18T16:21:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=6 2024-02-18T16:21:23.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94626491043792] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 20 add_watcher() i=7 2024-02-18T16:21:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff262c4e0 con 0x560ff2619130 2024-02-18T16:21:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94626491038192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2629950 con 0x560ff2619130 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.266+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94626491038192] v30'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 5 note: GC not initialized 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1a0f7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:23.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 Filter name: none 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1a0d7fa640 20 reqs_thread_entry: start 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff264e310 con 0x560ff2619130 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 rados_obj.operate() r=0 bl.length=513 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff264eb50 con 0x7f1bc801a3c0 2024-02-18T16:21:23.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-02-18T16:21:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-18T16:21:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-02-18T16:21:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff26543d0 con 0x560ff2619130 2024-02-18T16:21:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~621] v30'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94626491219536 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2652f60 con 0x560ff2619130 2024-02-18T16:21:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94626491030864 notify 128849018887 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x560ff25dee70 con 0x560ff2619130 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1ac1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94626491030864 notifier 4385 bl.length()=797 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1ac1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1ac1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(65 notify.4 [notify cookie 94626491219536 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1ac1ffb640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1aa4003ea0 con 0x560ff2619130 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94626491219536 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560ff25de9e0 con 0x560ff2619130 2024-02-18T16:21:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.270+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2653350 con 0x7f1bc801a3c0 2024-02-18T16:21:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1be078f980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-18T16:21:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1be078f980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-18T16:21:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1be078f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-18T16:21:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94626491219536 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2653350 con 0x7f1bc801a3c0 2024-02-18T16:21:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== watch-notify(notify (1) cookie 94626491019536 notify 128849018883 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x7f1bd801aa20 con 0x7f1bc801a3c0 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1ac1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94626491019536 notifier 4385 bl.length()=166 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1ac1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1ac1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(68 notify.0 [notify cookie 94626491219536 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1ac1ffb640 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1aa4003ea0 con 0x7f1bc801a3c0 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== watch-notify(notify_complete (2) cookie 94626491219536 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1bd801ac80 con 0x7f1bc801a3c0 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.281 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:23.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94626491038192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2653350 con 0x560ff2619130 2024-02-18T16:21:23.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94626491038192] v30'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.274+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94626491019536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2653350 con 0x7f1bc801a3c0 2024-02-18T16:21:23.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94626491019536] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1be078f980 20 remove_watcher() i=0 2024-02-18T16:21:23.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1be078f980 2 removed watcher, disabling cache 2024-02-18T16:21:23.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94626491024864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2653350 con 0x560ff2619130 2024-02-18T16:21:23.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94626491024864] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1be078f980 20 remove_watcher() i=1 2024-02-18T16:21:23.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.278+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94626491028576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2653350 con 0x560ff261f3b0 2024-02-18T16:21:23.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1bddaa9640 1 -- 172.21.15.129:0/1030574528 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94626491028576] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bc806f040 con 0x560ff261f3b0 2024-02-18T16:21:23.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1be078f980 20 remove_watcher() i=2 2024-02-18T16:21:23.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94626491033280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2652f60 con 0x7f1bc801a3c0 2024-02-18T16:21:23.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1bdeaab640 1 -- 172.21.15.129:0/1030574528 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94626491033280] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd803f040 con 0x7f1bc801a3c0 2024-02-18T16:21:23.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1be078f980 20 remove_watcher() i=3 2024-02-18T16:21:23.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94626491030864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2652f60 con 0x560ff2619130 2024-02-18T16:21:23.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94626491030864] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x560ff2619130 2024-02-18T16:21:23.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1be078f980 20 remove_watcher() i=4 2024-02-18T16:21:23.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.282+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94626491025920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2652f60 con 0x7f1bd8027940 2024-02-18T16:21:23.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.286+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94626491025920] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.286+0000 7f1be078f980 20 remove_watcher() i=5 2024-02-18T16:21:23.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.286+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94626491039648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2652f60 con 0x7f1bd8027940 2024-02-18T16:21:23.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94626491039648] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 20 remove_watcher() i=6 2024-02-18T16:21:23.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94626491043792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560ff2652f60 con 0x7f1bd8027940 2024-02-18T16:21:23.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94626491043792] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1bd00c6070 con 0x7f1bd8027940 2024-02-18T16:21:23.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 20 remove_watcher() i=7 2024-02-18T16:21:23.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1bd8027940 msgr2=0x7f1bd80333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1bd8027940 0x7f1bd80333c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff2619130 msgr2=0x560ff261b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff2619130 0x560ff261b5d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1bc801a3c0 msgr2=0x7f1bc804adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1bc801a3c0 0x7f1bc804adf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560ff261f3b0 msgr2=0x560ff2621830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560ff261f3b0 0x560ff2621830 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1aa80342b0 msgr2=0x7f1aa8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1aa80342b0 0x7f1aa8036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8008fd0 tx=0x7f1bd801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 msgr2=0x560ff260dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1bde2aa640 1 -- 172.21.15.129:0/1030574528 reap_dead start 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff260dcf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1bc801ac70 tx=0x7f1bc8049960 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 shutdown_connections 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/1030574528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24622d0 0x560ff260dcf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 >> 172.21.15.129:0/1030574528 conn(0x560ff25fed00 msgr2=0x560ff25fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 shutdown_connections 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/1030574528 wait complete. 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ab80342b0 msgr2=0x7f1ab8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ab80342b0 0x7f1ab8036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x560ff25e5ed0 tx=0x7f1bd8003070 comp rx=0 tx=0).stop 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 msgr2=0x560ff25f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 0x560ff25f5dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800d660 tx=0x7f1bc800da60 comp rx=0 tx=0).stop 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 shutdown_connections 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ab80342b0 0x7f1ab8036770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/521847321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff25f59a0 0x560ff25f5dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 >> 172.21.15.129:0/521847321 conn(0x560ff25ea7b0 msgr2=0x560ff25eb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 shutdown_connections 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/521847321 wait complete. 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff24ee800 msgr2=0x560ff25e5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.290+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff24ee800 0x560ff25e5120 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ac40342b0 msgr2=0x7f1ac4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ac40342b0 0x7f1ac4036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8001da0 tx=0x7f1bc8001300 comp rx=0 tx=0).stop 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 msgr2=0x560ff25de4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25de4a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0003430 tx=0x7f1bd0019810 comp rx=0 tx=0).stop 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 shutdown_connections 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560ff24ee800 0x560ff25e5120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1ac40342b0 0x7f1ac4036770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 --2- 172.21.15.129:0/2483387809 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560ff24ed2c0 0x560ff25de4a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 >> 172.21.15.129:0/2483387809 conn(0x560ff24609e0 msgr2=0x560ff25d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 shutdown_connections 2024-02-18T16:21:23.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.294+0000 7f1be078f980 1 -- 172.21.15.129:0/2483387809 wait complete. 2024-02-18T16:21:23.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:23.307 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:21:23.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:21:23.307 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:21:23.375 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:23.376 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:23.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f2782673980 1 Processor -- start 2024-02-18T16:21:23.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f2782673980 1 -- start start 2024-02-18T16:21:23.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f2782673980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56090ee64570 0x56090ee66960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f2782673980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56090edad4c0 con 0x56090ee60010 2024-02-18T16:21:23.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f2782673980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x56090ed74180 con 0x56090ee64570 2024-02-18T16:21:23.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f277f98d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56090ee64570 0x56090ee66960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f278018e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x56090ee60010 0x56090ee603f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42754/0 (socket says 172.21.15.129:42754) 2024-02-18T16:21:23.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f278018e640 1 -- 172.21.15.129:0/2090722846 learned_addr learned my addr 172.21.15.129:0/2090722846 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:23.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f277f98d640 1 -- 172.21.15.129:0/2090722846 >> v1:172.21.15.80:6789/0 conn(0x56090ee60010 legacy=0x56090ee603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.370+0000 7f277f98d640 1 -- 172.21.15.129:0/2090722846 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56090ee67eb0 con 0x56090ee64570 2024-02-18T16:21:23.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f277f98d640 1 --2- 172.21.15.129:0/2090722846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee64570 0x56090ee66960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f277400a480 tx=0x7f277401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a71808fb99a3cff server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f277f18c640 1 -- 172.21.15.129:0/2090722846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740ab540 con 0x56090ee64570 2024-02-18T16:21:23.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f277f18c640 1 -- 172.21.15.129:0/2090722846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27740ab6a0 con 0x56090ee64570 2024-02-18T16:21:23.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f277f18c640 1 -- 172.21.15.129:0/2090722846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740ab960 con 0x56090ee64570 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 -- 172.21.15.129:0/2090722846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee64570 msgr2=0x56090ee66960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 --2- 172.21.15.129:0/2090722846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee64570 0x56090ee66960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f277400a480 tx=0x7f277401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 -- 172.21.15.129:0/2090722846 shutdown_connections 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 --2- 172.21.15.129:0/2090722846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee64570 0x56090ee66960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 -- 172.21.15.129:0/2090722846 >> 172.21.15.129:0/2090722846 conn(0x56090ee5b8e0 msgr2=0x56090ee5dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 -- 172.21.15.129:0/2090722846 shutdown_connections 2024-02-18T16:21:23.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.374+0000 7f2782673980 1 -- 172.21.15.129:0/2090722846 wait complete. 2024-02-18T16:21:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.386+0000 7f2782673980 1 Processor -- start 2024-02-18T16:21:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.386+0000 7f2782673980 1 -- start start 2024-02-18T16:21:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.386+0000 7f2782673980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef49f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.386+0000 7f2782673980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56090ed716b0 con 0x56090ee60010 2024-02-18T16:21:23.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.386+0000 7f278018e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef49f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef49f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48202/0 (socket says 172.21.15.129:48202) 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 -- 172.21.15.129:0/774572217 learned_addr learned my addr 172.21.15.129:0/774572217 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 -- 172.21.15.129:0/774572217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2774005d30 con 0x56090ee60010 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 --2- 172.21.15.129:0/774572217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef49f80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f277800d3d0 tx=0x7f277800d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aababbd3e81a8399 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f266e60c640 1 -- 172.21.15.129:0/774572217 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2778006410 con 0x56090ee60010 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f266e60c640 1 -- 172.21.15.129:0/774572217 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778004030 con 0x56090ee60010 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f266e60c640 1 -- 172.21.15.129:0/774572217 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2778004330 con 0x56090ee60010 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- 172.21.15.129:0/774572217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 msgr2=0x56090ef49f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 --2- 172.21.15.129:0/774572217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef49f80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f277800d3d0 tx=0x7f277800d890 comp rx=0 tx=0).stop 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- 172.21.15.129:0/774572217 shutdown_connections 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 --2- 172.21.15.129:0/774572217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef49f80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- 172.21.15.129:0/774572217 >> 172.21.15.129:0/774572217 conn(0x56090ee5b8e0 msgr2=0x56090ef45b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- 172.21.15.129:0/774572217 shutdown_connections 2024-02-18T16:21:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- 172.21.15.129:0/774572217 wait complete. 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 Processor -- start 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- start start 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef4fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56090ed6ce90 con 0x56090ee60010 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef4fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef4fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48218/0 (socket says 172.21.15.129:48218) 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 -- 172.21.15.129:0/1694704541 learned_addr learned my addr 172.21.15.129:0/1694704541 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56090edad4c0 con 0x56090ee60010 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f278018e640 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef4fd50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x56090ef4ae10 tx=0x7f2778000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f266ce09640 1 -- 172.21.15.129:0/1694704541 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2778021070 con 0x56090ee60010 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.390+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56090ef50290 con 0x56090ee60010 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56090ef50740 con 0x56090ee60010 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f266ce09640 1 -- 172.21.15.129:0/1694704541 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277801b5b0 con 0x56090ee60010 2024-02-18T16:21:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f266ce09640 1 -- 172.21.15.129:0/1694704541 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f277801b890 con 0x56090ee60010 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f266ce09640 1 -- 172.21.15.129:0/1694704541 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f277801b9f0 con 0x56090ee60010 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f266ce09640 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26680342b0 0x7f2668036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f266ce09640 1 -- 172.21.15.129:0/1694704541 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f277804baa0 con 0x56090ee60010 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f277f98d640 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26680342b0 0x7f2668036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ee64570 0x56090ef56a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef56f40 con 0x56090ee64570 2024-02-18T16:21:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ee64570 0x56090ef56a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f277f98d640 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26680342b0 0x7f2668036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27740ad000 tx=0x7f27740a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ee64570 0x56090ef56a00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 -- 172.21.15.129:0/1694704541 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f27700083f0 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef54100 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 -- 172.21.15.129:0/1694704541 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f27700083f0 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef58c40 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 -- 172.21.15.129:0/1694704541 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f27700083f0 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef57e40 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 -- 172.21.15.129:0/1694704541 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f27700083f0 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef58250 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f278098f640 1 -- 172.21.15.129:0/1694704541 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2770012040 con 0x56090ee64570 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 Processor -- start 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.394+0000 7f2782673980 1 -- start start 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 0x56090ef677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56090ed05f20 con 0x56090ef673b0 2024-02-18T16:21:23.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 0x56090ef677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 0x56090ef677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48232/0 (socket says 172.21.15.129:48232) 2024-02-18T16:21:23.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 -- 172.21.15.129:0/3040906339 learned_addr learned my addr 172.21.15.129:0/3040906339 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 -- 172.21.15.129:0/3040906339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56090ef67d10 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 0x56090ef677d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2774096e80 tx=0x7f2774018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2665ffb640 1 -- 172.21.15.129:0/3040906339 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740bd8a0 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56090ef67f00 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2665ffb640 1 -- 172.21.15.129:0/3040906339 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27740bda00 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2665ffb640 1 -- 172.21.15.129:0/3040906339 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740bdca0 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56090ef68a50 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2665ffb640 1 -- 172.21.15.129:0/3040906339 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f27740be480 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2665ffb640 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26580342b0 0x7f2658036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2665ffb640 1 -- 172.21.15.129:0/3040906339 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f27740e66e0 con 0x56090ef673b0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f278098f640 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26580342b0 0x7f2658036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 Processor -- start 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 -- start start 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f278098f640 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26580342b0 0x7f2658036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x56090ef577c0 tx=0x7f2770003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef747d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f2782673980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56090ecf9790 con 0x56090ef743f0 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef747d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48234/0 (socket says 172.21.15.129:48234) 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.398+0000 7f277f98d640 1 -- 172.21.15.129:0/4101133677 learned_addr learned my addr 172.21.15.129:0/4101133677 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 -- 172.21.15.129:0/4101133677 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56090ef74da0 con 0x56090ef743f0 2024-02-18T16:21:23.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 --2- 172.21.15.129:0/4101133677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef747d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27740e4ad0 tx=0x7f27740b4430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16558b76bb188df6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f265f7fe640 1 -- 172.21.15.129:0/4101133677 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740d6070 con 0x56090ef743f0 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f265f7fe640 1 -- 172.21.15.129:0/4101133677 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27740c7b00 con 0x56090ef743f0 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f265f7fe640 1 -- 172.21.15.129:0/4101133677 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740c7da0 con 0x56090ef743f0 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/4101133677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 msgr2=0x56090ef747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 --2- 172.21.15.129:0/4101133677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef747d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27740e4ad0 tx=0x7f27740b4430 comp rx=0 tx=0).stop 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/4101133677 shutdown_connections 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 --2- 172.21.15.129:0/4101133677 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef747d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/4101133677 >> 172.21.15.129:0/4101133677 conn(0x56090ef70730 msgr2=0x56090ef6e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/4101133677 shutdown_connections 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/4101133677 wait complete. 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 Processor -- start 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- start start 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef7b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56090ef7b810 con 0x56090ef743f0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef7b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef7b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48244/0 (socket says 172.21.15.129:48244) 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 learned_addr learned my addr 172.21.15.129:0/707904573 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56090ef68a50 con 0x56090ef743f0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f277f98d640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef7b2d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f27740b5f10 tx=0x7f27740e4a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f265dffb640 1 -- 172.21.15.129:0/707904573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740e0070 con 0x56090ef743f0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56090ef7ba10 con 0x56090ef743f0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f265dffb640 1 -- 172.21.15.129:0/707904573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27740c9ca0 con 0x56090ef743f0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56090ef7be40 con 0x56090ef743f0 2024-02-18T16:21:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.402+0000 7f265dffb640 1 -- 172.21.15.129:0/707904573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27740e6a40 con 0x56090ef743f0 2024-02-18T16:21:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f265dffb640 1 -- 172.21.15.129:0/707904573 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f27740e6ba0 con 0x56090ef743f0 2024-02-18T16:21:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f265dffb640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2650034260 0x7f2650036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f265dffb640 1 -- 172.21.15.129:0/707904573 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f27740f0c60 con 0x56090ef743f0 2024-02-18T16:21:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278098f640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2650034260 0x7f2650036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ef867a0 0x56090ef88c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef89390 con 0x56090ef867a0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ef867a0 0x56090ef88c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278098f640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2650034260 0x7f2650036720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2770008fd0 tx=0x7f277001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ef867a0 0x56090ef88c40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2778029d70 con 0x56090ef867a0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 realm 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef89760 con 0x56090ef867a0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2778029d70 con 0x56090ef867a0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef89fb0 con 0x56090ef867a0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2778029d70 con 0x56090ef867a0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8a310 con 0x56090ef867a0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2778029d70 con 0x56090ef867a0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef89c50 con 0x56090ef867a0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2778029d70 con 0x56090ef867a0 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 20 searching for the correct realm 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56090ef8c560 0x56090ef8e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f277f98d640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56090ef8c560 0x56090ef8e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f277f98d640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56090ef8c560 0x56090ef8e990 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f277f98d640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f27740ef020 0x7f27740d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f27740ef020 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.406+0000 7f278098f640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f27740ef020 0x7f27740d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278098f640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f27740ef020 0x7f27740d2070 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277002c040 con 0x7f27740ef020 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278098f640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2770027940 0x7f27700333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2770027940 0x7f27700333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2770027940 0x7f27700333c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2778029d70 con 0x7f2770027940 2024-02-18T16:21:23.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2778029d70 con 0x56090ef867a0 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f27740ef020 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277002c040 con 0x7f27740ef020 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.410+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f27740ef020 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f277002c040 con 0x7f27740ef020 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.414+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f27740ef020 2024-02-18T16:21:23.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277002c040 con 0x7f27740ef020 2024-02-18T16:21:23.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f27740ef020 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277002c040 con 0x7f27740ef020 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef8c560 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f2770027940 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x56090ef867a0 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.418+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f060 con 0x7f27740ef020 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f277002c040 con 0x7f27740ef020 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8b1b0 con 0x56090ef867a0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8ae00 con 0x56090ef867a0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8ae10 con 0x56090ef867a0 2024-02-18T16:21:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 zone default found 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 4 Realm: () 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 zonegroup default 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef8f4a0 con 0x7f2770027940 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef90e80 con 0x56090ef8c560 2024-02-18T16:21:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef912a0 con 0x56090ef8c560 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 started sync module instance, tier type = 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef90760 con 0x7f27740ef020 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277003f040 con 0x7f27740ef020 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596905894592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef90b10 con 0x7f27740ef020 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.422+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef92000 con 0x56090ef867a0 2024-02-18T16:21:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596905894592] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277003f040 con 0x7f27740ef020 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596905899712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef91fe0 con 0x56090ef867a0 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef92aa0 con 0x56090ef8c560 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596905899712] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596905903456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef92e50 con 0x56090ef8c560 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.426+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef937c0 con 0x7f27740ef020 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277003f040 con 0x7f27740ef020 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596905907280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94010 con 0x7f27740ef020 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94a30 con 0x56090ef867a0 2024-02-18T16:21:23.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596905903456] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596905907280] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277003f040 con 0x7f27740ef020 2024-02-18T16:21:23.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596905911568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef93b70 con 0x56090ef867a0 2024-02-18T16:21:23.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.430+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef95280 con 0x7f2770027940 2024-02-18T16:21:23.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596905911568] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596905900768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef93b70 con 0x7f2770027940 2024-02-18T16:21:23.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef95770 con 0x7f2770027940 2024-02-18T16:21:23.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596905914960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef95bd0 con 0x7f2770027940 2024-02-18T16:21:23.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef965c0 con 0x7f2770027940 2024-02-18T16:21:23.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.434+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596905900768] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596905914960] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596905918624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef95730 con 0x7f2770027940 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=0 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=1 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=2 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=3 2024-02-18T16:21:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=4 2024-02-18T16:21:23.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=5 2024-02-18T16:21:23.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=6 2024-02-18T16:21:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596905918624] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 20 add_watcher() i=7 2024-02-18T16:21:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef996c0 con 0x56090ef867a0 2024-02-18T16:21:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.438+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596905913280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef96b30 con 0x56090ef867a0 2024-02-18T16:21:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596905913280] v30'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f26367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 5 note: GC not initialized 2024-02-18T16:21:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f26357e2640 20 reqs_thread_entry: start 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 20 Filter name: none 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f25a6ffd640 20 reqs_thread_entry: start 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090efbaf80 con 0x56090ef867a0 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 20 rados_obj.operate() r=0 bl.length=621 2024-02-18T16:21:23.449 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:23.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f26367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596905913280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090efba100 con 0x56090ef867a0 2024-02-18T16:21:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94596905913280] v30'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.442+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596905894592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94bc0 con 0x7f27740ef020 2024-02-18T16:21:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94596905894592] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277003f040 con 0x7f27740ef020 2024-02-18T16:21:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f2782673980 20 remove_watcher() i=0 2024-02-18T16:21:23.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f2782673980 2 removed watcher, disabling cache 2024-02-18T16:21:23.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596905899712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94bc0 con 0x56090ef867a0 2024-02-18T16:21:23.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94596905899712] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f2782673980 20 remove_watcher() i=1 2024-02-18T16:21:23.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.446+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596905903456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef916c0 con 0x56090ef8c560 2024-02-18T16:21:23.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f277f98d640 1 -- 172.21.15.129:0/707904573 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94596905903456] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27740ec070 con 0x56090ef8c560 2024-02-18T16:21:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f2782673980 20 remove_watcher() i=2 2024-02-18T16:21:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596905907280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94bc0 con 0x7f27740ef020 2024-02-18T16:21:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f278098f640 1 -- 172.21.15.129:0/707904573 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94596905907280] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277003f040 con 0x7f27740ef020 2024-02-18T16:21:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f2782673980 20 remove_watcher() i=3 2024-02-18T16:21:23.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596905911568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94bc0 con 0x56090ef867a0 2024-02-18T16:21:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94596905911568] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x56090ef867a0 2024-02-18T16:21:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f2782673980 20 remove_watcher() i=4 2024-02-18T16:21:23.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.450+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596905900768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94510 con 0x7f2770027940 2024-02-18T16:21:23.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.454+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94596905900768] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.454+0000 7f2782673980 20 remove_watcher() i=5 2024-02-18T16:21:23.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.454+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596905914960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94510 con 0x7f2770027940 2024-02-18T16:21:23.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.454+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94596905914960] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.454+0000 7f2782673980 20 remove_watcher() i=6 2024-02-18T16:21:23.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.454+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596905918624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56090ef94510 con 0x7f2770027940 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94596905918624] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f277803c040 con 0x7f2770027940 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 20 remove_watcher() i=7 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2770027940 msgr2=0x7f27700333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2770027940 0x7f27700333c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ef867a0 msgr2=0x56090ef88c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ef867a0 0x56090ef88c40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f27740ef020 msgr2=0x7f27740d2070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f27740ef020 0x7f27740d2070 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56090ef8c560 msgr2=0x56090ef8e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56090ef8c560 0x56090ef8e990 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2650034260 msgr2=0x7f2650036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2650034260 0x7f2650036720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2770008fd0 tx=0x7f277001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f278018e640 1 -- 172.21.15.129:0/707904573 reap_dead start 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 msgr2=0x56090ef7b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef7b2d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f27740b5f10 tx=0x7f27740e4a60 comp rx=0 tx=0).stop 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 shutdown_connections 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/707904573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef743f0 0x56090ef7b2d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 >> 172.21.15.129:0/707904573 conn(0x56090ef70730 msgr2=0x56090ef6e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 shutdown_connections 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/707904573 wait complete. 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26580342b0 msgr2=0x7f2658036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26580342b0 0x7f2658036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x56090ef577c0 tx=0x7f2770003070 comp rx=0 tx=0).stop 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 msgr2=0x56090ef677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 0x56090ef677d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2774096e80 tx=0x7f2774018020 comp rx=0 tx=0).stop 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 shutdown_connections 2024-02-18T16:21:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26580342b0 0x7f2658036770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/3040906339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ef673b0 0x56090ef677d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 >> 172.21.15.129:0/3040906339 conn(0x56090ef5c1c0 msgr2=0x56090ef5ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 shutdown_connections 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/3040906339 wait complete. 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ee64570 msgr2=0x56090ef56a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ee64570 0x56090ef56a00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26680342b0 msgr2=0x7f2668036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26680342b0 0x7f2668036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27740ad000 tx=0x7f27740a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 msgr2=0x56090ef4fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef4fd50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x56090ef4ae10 tx=0x7f2778000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 shutdown_connections 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56090ee64570 0x56090ef56a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f26680342b0 0x7f2668036770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 --2- 172.21.15.129:0/1694704541 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56090ee60010 0x56090ef4fd50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 >> 172.21.15.129:0/1694704541 conn(0x56090ee5b8e0 msgr2=0x56090ef44620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 shutdown_connections 2024-02-18T16:21:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.458+0000 7f2782673980 1 -- 172.21.15.129:0/1694704541 wait complete. 2024-02-18T16:21:23.473 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:23.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-18T16:21:23.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-18T16:21:23.474 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-02-18T16:21:23.553 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:23.553 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6be0961980 1 Processor -- start 2024-02-18T16:21:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6be0961980 1 -- start start 2024-02-18T16:21:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6be0961980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56270e540650 0x56270e542a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6be0961980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56270e4884d0 con 0x56270e53c140 2024-02-18T16:21:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6be0961980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x56270e44f180 con 0x56270e540650 2024-02-18T16:21:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6bddc7b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56270e540650 0x56270e542a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6bde47c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x56270e53c140 0x56270e53c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42770/0 (socket says 172.21.15.129:42770) 2024-02-18T16:21:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6bde47c640 1 -- 172.21.15.129:0/4089524551 learned_addr learned my addr 172.21.15.129:0/4089524551 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6bddc7b640 1 -- 172.21.15.129:0/4089524551 >> v1:172.21.15.80:6789/0 conn(0x56270e53c140 legacy=0x56270e53c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6bddc7b640 1 -- 172.21.15.129:0/4089524551 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56270e543f90 con 0x56270e540650 2024-02-18T16:21:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.550+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/4089524551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e542a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800a480 tx=0x7f6bc801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2841fb3ee6a489ce server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6bdd47a640 1 -- 172.21.15.129:0/4089524551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80ab540 con 0x56270e540650 2024-02-18T16:21:23.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6bdd47a640 1 -- 172.21.15.129:0/4089524551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80ab6a0 con 0x56270e540650 2024-02-18T16:21:23.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6bdd47a640 1 -- 172.21.15.129:0/4089524551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80ab960 con 0x56270e540650 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 -- 172.21.15.129:0/4089524551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 msgr2=0x56270e542a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 --2- 172.21.15.129:0/4089524551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e542a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800a480 tx=0x7f6bc801b280 comp rx=0 tx=0).stop 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 -- 172.21.15.129:0/4089524551 shutdown_connections 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 --2- 172.21.15.129:0/4089524551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e542a40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 -- 172.21.15.129:0/4089524551 >> 172.21.15.129:0/4089524551 conn(0x56270e537a10 msgr2=0x56270e539e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 -- 172.21.15.129:0/4089524551 shutdown_connections 2024-02-18T16:21:23.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.554+0000 7f6be0961980 1 -- 172.21.15.129:0/4089524551 wait complete. 2024-02-18T16:21:23.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6be0961980 1 Processor -- start 2024-02-18T16:21:23.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6be0961980 1 -- start start 2024-02-18T16:21:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6be0961980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 0x56270e626080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6be0961980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56270e44c6b0 con 0x56270e53c140 2024-02-18T16:21:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6bde47c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 0x56270e626080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6bde47c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 0x56270e626080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48262/0 (socket says 172.21.15.129:48262) 2024-02-18T16:21:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6bde47c640 1 -- 172.21.15.129:0/4161846975 learned_addr learned my addr 172.21.15.129:0/4161846975 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6bde47c640 1 -- 172.21.15.129:0/4161846975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8005d30 con 0x56270e53c140 2024-02-18T16:21:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.566+0000 7f6bde47c640 1 --2- 172.21.15.129:0/4161846975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 0x56270e626080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0001590 tx=0x7f6bd0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414907f0be2da695 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6acc608640 1 -- 172.21.15.129:0/4161846975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bd0004530 con 0x56270e53c140 2024-02-18T16:21:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6acc608640 1 -- 172.21.15.129:0/4161846975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0004690 con 0x56270e53c140 2024-02-18T16:21:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6acc608640 1 -- 172.21.15.129:0/4161846975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bd0004950 con 0x56270e53c140 2024-02-18T16:21:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/4161846975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 msgr2=0x56270e626080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 --2- 172.21.15.129:0/4161846975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 0x56270e626080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0001590 tx=0x7f6bd0001a50 comp rx=0 tx=0).stop 2024-02-18T16:21:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/4161846975 shutdown_connections 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 --2- 172.21.15.129:0/4161846975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e53c140 0x56270e626080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/4161846975 >> 172.21.15.129:0/4161846975 conn(0x56270e537a10 msgr2=0x56270e621c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/4161846975 shutdown_connections 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/4161846975 wait complete. 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 Processor -- start 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- start start 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e4b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56270e447e90 con 0x56270e540650 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6bde47c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e4b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6bde47c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e4b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48264/0 (socket says 172.21.15.129:48264) 2024-02-18T16:21:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6bde47c640 1 -- 172.21.15.129:0/3015143348 learned_addr learned my addr 172.21.15.129:0/3015143348 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6bde47c640 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56270e4884d0 con 0x56270e540650 2024-02-18T16:21:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6bde47c640 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e4b2880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0001a90 tx=0x7f6bd0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6acae05640 1 -- 172.21.15.129:0/3015143348 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bd0013630 con 0x56270e540650 2024-02-18T16:21:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56270e4b2dc0 con 0x56270e540650 2024-02-18T16:21:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56270e4b1200 con 0x56270e540650 2024-02-18T16:21:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6acae05640 1 -- 172.21.15.129:0/3015143348 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0013790 con 0x56270e540650 2024-02-18T16:21:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.570+0000 7f6acae05640 1 -- 172.21.15.129:0/3015143348 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bd0013ab0 con 0x56270e540650 2024-02-18T16:21:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6acae05640 1 -- 172.21.15.129:0/3015143348 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6bd0013c10 con 0x56270e540650 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6acae05640 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ac40342b0 0x7f6ac4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6acae05640 1 -- 172.21.15.129:0/3015143348 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6bd00493b0 con 0x56270e540650 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ac40342b0 0x7f6ac4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e634010 0x56270e636400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e636940 con 0x56270e634010 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e634010 0x56270e636400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ac40342b0 0x7f6ac4036770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80ad000 tx=0x7f6bc80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e634010 0x56270e636400 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 -- 172.21.15.129:0/3015143348 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6bd80083f0 con 0x56270e634010 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e636ca0 con 0x56270e634010 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 -- 172.21.15.129:0/3015143348 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6bd80083f0 con 0x56270e634010 2024-02-18T16:21:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e638550 con 0x56270e634010 2024-02-18T16:21:23.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 -- 172.21.15.129:0/3015143348 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f6bd80083f0 con 0x56270e634010 2024-02-18T16:21:23.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e637750 con 0x56270e634010 2024-02-18T16:21:23.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 -- 172.21.15.129:0/3015143348 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6bd80083f0 con 0x56270e634010 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e637b60 con 0x56270e634010 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bdec7d640 1 -- 172.21.15.129:0/3015143348 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6bd8012040 con 0x56270e634010 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 Processor -- start 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- start start 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 0x56270e647050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6be0961980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56270e3e0f20 con 0x56270e646c30 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bddc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 0x56270e647050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bddc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 0x56270e647050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48272/0 (socket says 172.21.15.129:48272) 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.574+0000 7f6bddc7b640 1 -- 172.21.15.129:0/1375493222 learned_addr learned my addr 172.21.15.129:0/1375493222 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bddc7b640 1 -- 172.21.15.129:0/1375493222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56270e647590 con 0x56270e646c30 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 0x56270e647050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80ab670 tx=0x7f6bc8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6ac3fff640 1 -- 172.21.15.129:0/1375493222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80be7c0 con 0x56270e646c30 2024-02-18T16:21:23.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6ac3fff640 1 -- 172.21.15.129:0/1375493222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80be920 con 0x56270e646c30 2024-02-18T16:21:23.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56270e647780 con 0x56270e646c30 2024-02-18T16:21:23.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6ac3fff640 1 -- 172.21.15.129:0/1375493222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80bebc0 con 0x56270e646c30 2024-02-18T16:21:23.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56270e6482d0 con 0x56270e646c30 2024-02-18T16:21:23.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6ac3fff640 1 -- 172.21.15.129:0/1375493222 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6bc80bd3e0 con 0x56270e646c30 2024-02-18T16:21:23.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6ac3fff640 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ab80342b0 0x7f6ab8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6ac3fff640 1 -- 172.21.15.129:0/1375493222 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6bc80e63c0 con 0x56270e646c30 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ab80342b0 0x7f6ab8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6be0961980 1 Processor -- start 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6be0961980 1 -- start start 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ab80342b0 0x7f6ab8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x56270e637190 tx=0x7f6bd8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6be0961980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e654000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6be0961980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56270e3d4790 con 0x56270e653be0 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bddc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e654000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bddc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e654000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48276/0 (socket says 172.21.15.129:48276) 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bddc7b640 1 -- 172.21.15.129:0/3452981606 learned_addr learned my addr 172.21.15.129:0/3452981606 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.578+0000 7f6bddc7b640 1 -- 172.21.15.129:0/3452981606 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56270e6545d0 con 0x56270e653be0 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/3452981606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e654000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80e4720 tx=0x7f6bc80c5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7e52a9fed3b4c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6ac1ffb640 1 -- 172.21.15.129:0/3452981606 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80b49a0 con 0x56270e653be0 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6ac1ffb640 1 -- 172.21.15.129:0/3452981606 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80e60d0 con 0x56270e653be0 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6ac1ffb640 1 -- 172.21.15.129:0/3452981606 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80bce40 con 0x56270e653be0 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/3452981606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 msgr2=0x56270e654000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 --2- 172.21.15.129:0/3452981606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e654000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80e4720 tx=0x7f6bc80c5f50 comp rx=0 tx=0).stop 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/3452981606 shutdown_connections 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 --2- 172.21.15.129:0/3452981606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e654000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/3452981606 >> 172.21.15.129:0/3452981606 conn(0x56270e64ff70 msgr2=0x56270e64dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/3452981606 shutdown_connections 2024-02-18T16:21:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/3452981606 wait complete. 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 Processor -- start 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- start start 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e65ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56270e65b080 con 0x56270e653be0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6bddc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e65ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6bddc7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e65ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48290/0 (socket says 172.21.15.129:48290) 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 learned_addr learned my addr 172.21.15.129:0/436402501 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56270e6482d0 con 0x56270e653be0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e65ab40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80c55c0 tx=0x7f6bc80e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6aaffff640 1 -- 172.21.15.129:0/436402501 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80d5040 con 0x56270e653be0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56270e65b280 con 0x56270e653be0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56270e65b6b0 con 0x56270e653be0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6aaffff640 1 -- 172.21.15.129:0/436402501 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80bce00 con 0x56270e653be0 2024-02-18T16:21:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.582+0000 7f6aaffff640 1 -- 172.21.15.129:0/436402501 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bc80bd7c0 con 0x56270e653be0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6aaffff640 1 -- 172.21.15.129:0/436402501 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6bc80bc360 con 0x56270e653be0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6aaffff640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6aa8034260 0x7f6aa8036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6aaffff640 1 -- 172.21.15.129:0/436402501 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6bc80f1ca0 con 0x56270e653be0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6aa8034260 0x7f6aa8036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e6660d0 0x56270e668590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e668ce0 con 0x56270e6660d0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e6660d0 0x56270e668590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6aa8034260 0x7f6aa8036720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8008fd0 tx=0x7f6bd801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e6660d0 0x56270e668590 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 realm 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6690b0 con 0x56270e6660d0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e669930 con 0x56270e6660d0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e669c90 con 0x56270e6660d0 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66a490 con 0x56270e6660d0 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 20 searching for the correct realm 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56270e66c320 0x56270e66e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56270e66c320 0x56270e66e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56270e66c320 0x56270e66e7b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bddc7b640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6bc80f0060 0x7f6bc80b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bc80f0060 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6bc80f0060 0x7f6bc80b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.586+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6bc80f0060 0x7f6bc80b08b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c040 con 0x7f6bc80f0060 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bdec7d640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6bd8027940 0x7f6bd80333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6bd8027940 0x7f6bd80333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6bd8027940 0x7f6bd80333c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bc80f0060 2024-02-18T16:21:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c040 con 0x7f6bc80f0060 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.590+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bc80f0060 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6bd802c040 con 0x7f6bc80f0060 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.594+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bc80f0060 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c040 con 0x7f6bc80f0060 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bc80f0060 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c040 con 0x7f6bc80f0060 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e66c320 2024-02-18T16:21:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bd8027940 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x56270e6660d0 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ee80 con 0x7f6bc80f0060 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c040 con 0x7f6bc80f0060 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.598+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66ad90 con 0x56270e6660d0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66b5e0 con 0x56270e6660d0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66f2c0 con 0x56270e6660d0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 zone default found 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 4 Realm: () 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 zonegroup default 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66f330 con 0x7f6bd8027940 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e671110 con 0x56270e66c320 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e671520 con 0x56270e66c320 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 started sync module instance, tier type = 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6709f0 con 0x7f6bc80f0060 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725745345872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e670da0 con 0x7f6bc80f0060 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e672280 con 0x56270e6660d0 2024-02-18T16:21:23.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.602+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725745345872] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725745350976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e672200 con 0x56270e6660d0 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e672c70 con 0x56270e66c320 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725745350976] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725745352032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e672180 con 0x56270e66c320 2024-02-18T16:21:23.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.606+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e673990 con 0x7f6bc80f0060 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725745358368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6741e0 con 0x7f6bc80f0060 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e674c00 con 0x56270e6660d0 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725745352032] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725745358368] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725745362656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e673d40 con 0x56270e6660d0 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.610+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e675450 con 0x7f6bd8027940 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725745362656] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725745356880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e673d40 con 0x7f6bd8027940 2024-02-18T16:21:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e675940 con 0x7f6bd8027940 2024-02-18T16:21:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725745356880] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725745366080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e675900 con 0x7f6bd8027940 2024-02-18T16:21:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.614+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e676270 con 0x7f6bd8027940 2024-02-18T16:21:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725745366080] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725745364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e676270 con 0x7f6bd8027940 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=0 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=1 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=2 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=3 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=4 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=5 2024-02-18T16:21:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=6 2024-02-18T16:21:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725745364400] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 20 add_watcher() i=7 2024-02-18T16:21:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e679660 con 0x56270e6660d0 2024-02-18T16:21:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.618+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725745368992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e676b70 con 0x56270e6660d0 2024-02-18T16:21:23.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725745368992] v30'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:23.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 5 note: GC not initialized 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6a0f7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 20 Filter name: none 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6a0d7fa640 20 reqs_thread_entry: start 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e69b5f0 con 0x56270e6660d0 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 20 rados_obj.operate() r=0 bl.length=621 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6a17b0 con 0x56270e6660d0 2024-02-18T16:21:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~539] v30'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94725745545840 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6a0380 con 0x56270e6660d0 2024-02-18T16:21:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94725745362656 notify 128849018888 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x56270e4b1200 con 0x56270e6660d0 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6ac1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94725745362656 notifier 4399 bl.length()=715 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 94725745545840 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6ac1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6ac1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6ac1ffb640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6aa4003ea0 con 0x56270e6660d0 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94725745545840 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6bd002d070 con 0x56270e6660d0 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94725745545840 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e69fee0 con 0x7f6bc80f0060 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== watch-notify(notify (1) cookie 94725745345872 notify 128849018884 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f6bd801a990 con 0x7f6bc80f0060 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6ac1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94725745345872 notifier 4399 bl.length()=159 2024-02-18T16:21:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(66 notify.0 [notify cookie 94725745545840 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.622+0000 7f6ac1ffb640 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6aa4004200 con 0x7f6bc80f0060 2024-02-18T16:21:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== watch-notify(notify_complete (2) cookie 94725745545840 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6bd801ab20 con 0x7f6bc80f0060 2024-02-18T16:21:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6a1270 con 0x56270e6660d0 2024-02-18T16:21:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(68 foo:foo1 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.632 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:23.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725745368992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e6a0770 con 0x56270e6660d0 2024-02-18T16:21:23.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94725745368992] v30'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.626+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725745345872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e663960 con 0x7f6bc80f0060 2024-02-18T16:21:23.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94725745345872] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6be0961980 20 remove_watcher() i=0 2024-02-18T16:21:23.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6be0961980 2 removed watcher, disabling cache 2024-02-18T16:21:23.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725745350976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66b5e0 con 0x56270e6660d0 2024-02-18T16:21:23.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94725745350976] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6be0961980 20 remove_watcher() i=1 2024-02-18T16:21:23.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.630+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725745352032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e66b5a0 con 0x56270e66c320 2024-02-18T16:21:23.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6bddc7b640 1 -- 172.21.15.129:0/436402501 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94725745352032] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bc80e4b00 con 0x56270e66c320 2024-02-18T16:21:23.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6be0961980 20 remove_watcher() i=2 2024-02-18T16:21:23.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725745358368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e670550 con 0x7f6bc80f0060 2024-02-18T16:21:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6bdec7d640 1 -- 172.21.15.129:0/436402501 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94725745358368] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd803f040 con 0x7f6bc80f0060 2024-02-18T16:21:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6be0961980 20 remove_watcher() i=3 2024-02-18T16:21:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725745362656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e670550 con 0x56270e6660d0 2024-02-18T16:21:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94725745362656] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x56270e6660d0 2024-02-18T16:21:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6be0961980 20 remove_watcher() i=4 2024-02-18T16:21:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.634+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725745356880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e670550 con 0x7f6bd8027940 2024-02-18T16:21:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.638+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94725745356880] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.638+0000 7f6be0961980 20 remove_watcher() i=5 2024-02-18T16:21:23.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.638+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725745366080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e670550 con 0x7f6bd8027940 2024-02-18T16:21:23.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.638+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94725745366080] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.638+0000 7f6be0961980 20 remove_watcher() i=6 2024-02-18T16:21:23.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.638+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725745364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56270e675440 con 0x7f6bd8027940 2024-02-18T16:21:23.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94725745364400] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6bd0024020 con 0x7f6bd8027940 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 20 remove_watcher() i=7 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6bd8027940 msgr2=0x7f6bd80333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6bd8027940 0x7f6bd80333c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e6660d0 msgr2=0x56270e668590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e6660d0 0x56270e668590 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6bc80f0060 msgr2=0x7f6bc80b08b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6bc80f0060 0x7f6bc80b08b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56270e66c320 msgr2=0x56270e66e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56270e66c320 0x56270e66e7b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6aa8034260 msgr2=0x7f6aa8036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6aa8034260 0x7f6aa8036720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8008fd0 tx=0x7f6bd801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6bde47c640 1 -- 172.21.15.129:0/436402501 reap_dead start 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 msgr2=0x56270e65ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e65ab40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80c55c0 tx=0x7f6bc80e4680 comp rx=0 tx=0).stop 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 shutdown_connections 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/436402501 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e653be0 0x56270e65ab40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 >> 172.21.15.129:0/436402501 conn(0x56270e64ff70 msgr2=0x56270e64d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 shutdown_connections 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/436402501 wait complete. 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ab80342b0 msgr2=0x7f6ab8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ab80342b0 0x7f6ab8036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x56270e637190 tx=0x7f6bd8003070 comp rx=0 tx=0).stop 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 msgr2=0x56270e647050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 0x56270e647050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80ab670 tx=0x7f6bc8018020 comp rx=0 tx=0).stop 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 shutdown_connections 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ab80342b0 0x7f6ab8036770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/1375493222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e646c30 0x56270e647050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 >> 172.21.15.129:0/1375493222 conn(0x56270e63ba40 msgr2=0x56270e63c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 shutdown_connections 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/1375493222 wait complete. 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e634010 msgr2=0x56270e636400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e634010 0x56270e636400 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ac40342b0 msgr2=0x7f6ac4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ac40342b0 0x7f6ac4036770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80ad000 tx=0x7f6bc80a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 msgr2=0x56270e4b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e4b2880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0001a90 tx=0x7f6bd0001260 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 shutdown_connections 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56270e634010 0x56270e636400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6ac40342b0 0x7f6ac4036770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 --2- 172.21.15.129:0/3015143348 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56270e540650 0x56270e4b2880 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 >> 172.21.15.129:0/3015143348 conn(0x56270e537a10 msgr2=0x56270e620720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 shutdown_connections 2024-02-18T16:21:23.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.642+0000 7f6be0961980 1 -- 172.21.15.129:0/3015143348 wait complete. 2024-02-18T16:21:23.657 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:23.657 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-18T16:21:23.657 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-18T16:21:23.657 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-02-18T16:21:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7ce263980 1 Processor -- start 2024-02-18T16:21:23.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7ce263980 1 -- start start 2024-02-18T16:21:23.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7ce263980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x565106c1d520 0x565106c1f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7ce263980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x565106b654c0 con 0x565106b8d080 2024-02-18T16:21:23.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7ce263980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x565106b2c180 con 0x565106c1d520 2024-02-18T16:21:23.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7cb57d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x565106c1d520 0x565106c1f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7cbd7e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x565106b8d080 0x565106c1be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42780/0 (socket says 172.21.15.129:42780) 2024-02-18T16:21:23.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/1033864001 learned_addr learned my addr 172.21.15.129:0/1033864001 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:23.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7cb57d640 1 -- 172.21.15.129:0/1033864001 >> v1:172.21.15.80:6789/0 conn(0x565106b8d080 legacy=0x565106c1be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.722+0000 7fb7cb57d640 1 -- 172.21.15.129:0/1033864001 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565106c20ef0 con 0x565106c1d520 2024-02-18T16:21:23.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/1033864001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106c1d520 0x565106c1f910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a480 tx=0x7fb7c001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a04e675e75a52a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7cad7c640 1 -- 172.21.15.129:0/1033864001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00ab540 con 0x565106c1d520 2024-02-18T16:21:23.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7cad7c640 1 -- 172.21.15.129:0/1033864001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c00ab6a0 con 0x565106c1d520 2024-02-18T16:21:23.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7cad7c640 1 -- 172.21.15.129:0/1033864001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00ab960 con 0x565106c1d520 2024-02-18T16:21:23.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 -- 172.21.15.129:0/1033864001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106c1d520 msgr2=0x565106c1f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 --2- 172.21.15.129:0/1033864001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106c1d520 0x565106c1f910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a480 tx=0x7fb7c001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:23.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 -- 172.21.15.129:0/1033864001 shutdown_connections 2024-02-18T16:21:23.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 --2- 172.21.15.129:0/1033864001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106c1d520 0x565106c1f910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 -- 172.21.15.129:0/1033864001 >> 172.21.15.129:0/1033864001 conn(0x565106c138e0 msgr2=0x565106c15d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 -- 172.21.15.129:0/1033864001 shutdown_connections 2024-02-18T16:21:23.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.726+0000 7fb7ce263980 1 -- 172.21.15.129:0/1033864001 wait complete. 2024-02-18T16:21:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7ce263980 1 Processor -- start 2024-02-18T16:21:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7ce263980 1 -- start start 2024-02-18T16:21:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7ce263980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d030b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7ce263980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x565106b296b0 con 0x565106b8d080 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7cbd7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7cbd7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48310/0 (socket says 172.21.15.129:48310) 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/531225881 learned_addr learned my addr 172.21.15.129:0/531225881 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/531225881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0005d30 con 0x565106b8d080 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb7cbd7e640 1 --2- 172.21.15.129:0/531225881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d030b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc001c00 tx=0x7fb7bc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30aa566f3baedbd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb6b9e0b640 1 -- 172.21.15.129:0/531225881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc00e690 con 0x565106b8d080 2024-02-18T16:21:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb6b9e0b640 1 -- 172.21.15.129:0/531225881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00e810 con 0x565106b8d080 2024-02-18T16:21:23.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.738+0000 7fb6b9e0b640 1 -- 172.21.15.129:0/531225881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc00eb30 con 0x565106b8d080 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/531225881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 msgr2=0x565106d030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 --2- 172.21.15.129:0/531225881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d030b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc001c00 tx=0x7fb7bc00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/531225881 shutdown_connections 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 --2- 172.21.15.129:0/531225881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d030b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/531225881 >> 172.21.15.129:0/531225881 conn(0x565106c138e0 msgr2=0x565106cfec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/531225881 shutdown_connections 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/531225881 wait complete. 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 Processor -- start 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- start start 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d09f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x565106b24e90 con 0x565106b8d080 2024-02-18T16:21:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7cbd7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7cbd7e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d09f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48322/0 (socket says 172.21.15.129:48322) 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/2440060416 learned_addr learned my addr 172.21.15.129:0/2440060416 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565106b654c0 con 0x565106b8d080 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7cbd7e640 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d09f00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00b710 tx=0x7fb7bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb6b3fff640 1 -- 172.21.15.129:0/2440060416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc01f070 con 0x565106b8d080 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565106d0a440 con 0x565106b8d080 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb6b3fff640 1 -- 172.21.15.129:0/2440060416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc01a910 con 0x565106b8d080 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565106d0a870 con 0x565106b8d080 2024-02-18T16:21:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb6b3fff640 1 -- 172.21.15.129:0/2440060416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc01abf0 con 0x565106b8d080 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb6b3fff640 1 -- 172.21.15.129:0/2440060416 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb7bc00a040 con 0x565106b8d080 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb6b3fff640 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6b40342b0 0x7fb6b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.742+0000 7fb6b3fff640 1 -- 172.21.15.129:0/2440060416 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb7bc049fe0 con 0x565106b8d080 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6b40342b0 0x7fb6b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106c1d520 0x565106d10b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d110c0 con 0x565106c1d520 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106c1d520 0x565106d10b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6b40342b0 0x7fb6b4036770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00ad000 tx=0x7fb7c00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106c1d520 0x565106d10b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 -- 172.21.15.129:0/2440060416 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb7c400a4d0 con 0x565106c1d520 2024-02-18T16:21:23.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d114d0 con 0x565106c1d520 2024-02-18T16:21:23.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 -- 172.21.15.129:0/2440060416 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb7c400a4d0 con 0x565106c1d520 2024-02-18T16:21:23.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d12d80 con 0x565106c1d520 2024-02-18T16:21:23.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 -- 172.21.15.129:0/2440060416 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb7c400a4d0 con 0x565106c1d520 2024-02-18T16:21:23.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d11f80 con 0x565106c1d520 2024-02-18T16:21:23.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 -- 172.21.15.129:0/2440060416 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb7c400a4d0 con 0x565106c1d520 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d12390 con 0x565106c1d520 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cc57f640 1 -- 172.21.15.129:0/2440060416 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb7c400a4d0 con 0x565106c1d520 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 Processor -- start 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- start start 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 0x565106d21880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x565106abdf20 con 0x565106d21460 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 0x565106d21880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 0x565106d21880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48330/0 (socket says 172.21.15.129:48330) 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 -- 172.21.15.129:0/1015645912 learned_addr learned my addr 172.21.15.129:0/1015645912 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 -- 172.21.15.129:0/1015645912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565106d21dc0 con 0x565106d21460 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 0x565106d21880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0096e80 tx=0x7fb7c0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb6b17fa640 1 -- 172.21.15.129:0/1015645912 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00bd8a0 con 0x565106d21460 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565106d21fb0 con 0x565106d21460 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565106d22b00 con 0x565106d21460 2024-02-18T16:21:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb6b17fa640 1 -- 172.21.15.129:0/1015645912 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c00bda00 con 0x565106d21460 2024-02-18T16:21:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.746+0000 7fb6b17fa640 1 -- 172.21.15.129:0/1015645912 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00bdca0 con 0x565106d21460 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb6b17fa640 1 -- 172.21.15.129:0/1015645912 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb7c00be480 con 0x565106d21460 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb6b17fa640 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6a40342b0 0x7fb6a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb6b17fa640 1 -- 172.21.15.129:0/1015645912 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb7c00e66e0 con 0x565106d21460 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6a40342b0 0x7fb6a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 Processor -- start 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- start start 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6a40342b0 0x7fb6a4036770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x565106d119c0 tx=0x7fb7c4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d2e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x565106ab1790 con 0x565106d2e430 2024-02-18T16:21:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cb57d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cb57d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d2e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48338/0 (socket says 172.21.15.129:48338) 2024-02-18T16:21:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cb57d640 1 -- 172.21.15.129:0/4282842289 learned_addr learned my addr 172.21.15.129:0/4282842289 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cb57d640 1 -- 172.21.15.129:0/4282842289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565106d2ee20 con 0x565106d2e430 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/4282842289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d2e850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00e4ad0 tx=0x7fb7c00b4430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fc5abd656505d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb6aaffd640 1 -- 172.21.15.129:0/4282842289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00d6070 con 0x565106d2e430 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb6aaffd640 1 -- 172.21.15.129:0/4282842289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c00c7b00 con 0x565106d2e430 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb6aaffd640 1 -- 172.21.15.129:0/4282842289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00c7da0 con 0x565106d2e430 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- 172.21.15.129:0/4282842289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 msgr2=0x565106d2e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 --2- 172.21.15.129:0/4282842289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d2e850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00e4ad0 tx=0x7fb7c00b4430 comp rx=0 tx=0).stop 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- 172.21.15.129:0/4282842289 shutdown_connections 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 --2- 172.21.15.129:0/4282842289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d2e850 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- 172.21.15.129:0/4282842289 >> 172.21.15.129:0/4282842289 conn(0x565106d2a7c0 msgr2=0x565106d28820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- 172.21.15.129:0/4282842289 shutdown_connections 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.750+0000 7fb7ce263980 1 -- 172.21.15.129:0/4282842289 wait complete. 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 Processor -- start 2024-02-18T16:21:23.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 -- start start 2024-02-18T16:21:23.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d35350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x565106d35890 con 0x565106d2e430 2024-02-18T16:21:23.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cb57d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d35350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cb57d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d35350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48354/0 (socket says 172.21.15.129:48354) 2024-02-18T16:21:23.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 learned_addr learned my addr 172.21.15.129:0/3057034557 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565106d22b00 con 0x565106d2e430 2024-02-18T16:21:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d35350 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00b5f10 tx=0x7fb7c00e4a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb6a97fa640 1 -- 172.21.15.129:0/3057034557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00e0070 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565106d35a90 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb6a97fa640 1 -- 172.21.15.129:0/3057034557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c00c9ca0 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb6a97fa640 1 -- 172.21.15.129:0/3057034557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c00e6a40 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565106d35ec0 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb6a97fa640 1 -- 172.21.15.129:0/3057034557 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb7c00e6c30 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb6a97fa640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6940342b0 0x7fb694036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb6a97fa640 1 -- 172.21.15.129:0/3057034557 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb7c00f0c60 con 0x565106d2e430 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6940342b0 0x7fb694036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106d408d0 0x565106d42d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d434c0 con 0x565106d408d0 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cbd7e640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106d408d0 0x565106d42d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6940342b0 0x7fb694036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4011010 tx=0x7fb7c4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.754+0000 7fb7cbd7e640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106d408d0 0x565106d42d70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 realm 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d43890 con 0x565106d408d0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d440e0 con 0x565106d408d0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d44440 con 0x565106d408d0 2024-02-18T16:21:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d44c40 con 0x565106d408d0 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 20 searching for the correct realm 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x565106d46b00 0x565106d48f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x565106d46b00 0x565106d48f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x565106d46b00 0x565106d48f80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cb57d640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb7c00ef020 0x7fb7c00de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c00ef020 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb7c00ef020 0x7fb7c00de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb7c00ef020 0x7fb7c00de0c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c400a4d0 con 0x7fb7c00ef020 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cc57f640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb7c40141d0 0x7fb7c4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.758+0000 7fb7cbd7e640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb7c40141d0 0x7fb7c4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb7c40141d0 0x7fb7c4015940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c00ef020 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c400a4d0 con 0x7fb7c00ef020 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c00ef020 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.762+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c00ef020 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x565106d408d0 2024-02-18T16:21:23.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.766+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c00ef020 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d46b00 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c40141d0 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7bc017900 con 0x7fb7c40141d0 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x565106d408d0 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49600 con 0x7fb7c00ef020 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d46110 con 0x565106d408d0 2024-02-18T16:21:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d45930 con 0x565106d408d0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d49a40 con 0x565106d408d0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 zone default found 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 4 Realm: () 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 zonegroup default 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.770+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4a240 con 0x7fb7c40141d0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4bc20 con 0x565106d46b00 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4bf80 con 0x565106d46b00 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 started sync module instance, tier type = 2024-02-18T16:21:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4b1f0 con 0x7fb7c00ef020 2024-02-18T16:21:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94906006943136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4b1f0 con 0x7fb7c00ef020 2024-02-18T16:21:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4c9d0 con 0x565106d408d0 2024-02-18T16:21:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.774+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94906006943136] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94906006947056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4b1f0 con 0x565106d408d0 2024-02-18T16:21:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4d390 con 0x565106d46b00 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94906006949616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4dbe0 con 0x565106d46b00 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4e590 con 0x7fb7c00ef020 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94906006947056] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94906006941008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4e970 con 0x7fb7c00ef020 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4f2e0 con 0x565106d408d0 2024-02-18T16:21:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.778+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94906006949616] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94906006941008] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94906006954160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4ee40 con 0x565106d408d0 2024-02-18T16:21:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4fb30 con 0x7fb7c40141d0 2024-02-18T16:21:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94906006954160] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94906006951744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4f890 con 0x7fb7c40141d0 2024-02-18T16:21:23.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.782+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d50090 con 0x7fb7c40141d0 2024-02-18T16:21:23.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94906006951744] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94906006959360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4fe80 con 0x7fb7c40141d0 2024-02-18T16:21:23.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d50920 con 0x7fb7c40141d0 2024-02-18T16:21:23.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94906006959360] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94906006963200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d508e0 con 0x7fb7c40141d0 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=0 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=1 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=2 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=3 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=4 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=5 2024-02-18T16:21:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.786+0000 7fb7ce263980 20 add_watcher() i=6 2024-02-18T16:21:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94906006963200] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 add_watcher() i=7 2024-02-18T16:21:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d53d90 con 0x565106d408d0 2024-02-18T16:21:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94906006960416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d51270 con 0x565106d408d0 2024-02-18T16:21:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94906006960416] v30'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 5 note: GC not initialized 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb680fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 Filter name: none 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb5fa7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d75cb0 con 0x565106d408d0 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+662 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 20 rados_obj.operate() r=0 bl.length=539 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.790+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d7bbb0 con 0x565106d408d0 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v30'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7ce263980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7ce263980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7ce263980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94906007139888 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d775b0 con 0x565106d408d0 2024-02-18T16:21:23.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94906006954160 notify 128849018889 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x565106d0a870 con 0x565106d408d0 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb6aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94906006954160 notifier 4406 bl.length()=689 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 94906007139888 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb6aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb6aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb6aaffd640 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb690003ea0 con 0x565106d408d0 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94906007139888 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x565106d0a440 con 0x565106d408d0 2024-02-18T16:21:23.800 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94906006960416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d53d30 con 0x565106d408d0 2024-02-18T16:21:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94906006960416] v30'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94906006943136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d53d30 con 0x7fb7c00ef020 2024-02-18T16:21:23.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.794+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94906006943136] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.798+0000 7fb7ce263980 20 remove_watcher() i=0 2024-02-18T16:21:23.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.798+0000 7fb7ce263980 2 removed watcher, disabling cache 2024-02-18T16:21:23.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.798+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94906006947056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d53d30 con 0x565106d408d0 2024-02-18T16:21:23.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.798+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94906006947056] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.798+0000 7fb7ce263980 20 remove_watcher() i=1 2024-02-18T16:21:23.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.798+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94906006949616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d53d30 con 0x565106d46b00 2024-02-18T16:21:23.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7cb57d640 1 -- 172.21.15.129:0/3057034557 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94906006949616] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c00ec070 con 0x565106d46b00 2024-02-18T16:21:23.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7ce263980 20 remove_watcher() i=2 2024-02-18T16:21:23.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94906006941008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4b5a0 con 0x7fb7c00ef020 2024-02-18T16:21:23.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7cc57f640 1 -- 172.21.15.129:0/3057034557 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94906006941008] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7c403a040 con 0x7fb7c00ef020 2024-02-18T16:21:23.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7ce263980 20 remove_watcher() i=3 2024-02-18T16:21:23.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94906006954160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4c4f0 con 0x565106d408d0 2024-02-18T16:21:23.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94906006954160] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x565106d408d0 2024-02-18T16:21:23.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7ce263980 20 remove_watcher() i=4 2024-02-18T16:21:23.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.802+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94906006951744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4cef0 con 0x7fb7c40141d0 2024-02-18T16:21:23.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.806+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94906006951744] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.806+0000 7fb7ce263980 20 remove_watcher() i=5 2024-02-18T16:21:23.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.806+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94906006959360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4e0b0 con 0x7fb7c40141d0 2024-02-18T16:21:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.806+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94906006959360] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.806+0000 7fb7ce263980 20 remove_watcher() i=6 2024-02-18T16:21:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.806+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94906006963200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565106d4c4f0 con 0x7fb7c40141d0 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94906006963200] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7bc0550c0 con 0x7fb7c40141d0 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 20 remove_watcher() i=7 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb7c40141d0 msgr2=0x7fb7c4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fb7c40141d0 0x7fb7c4015940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106d408d0 msgr2=0x565106d42d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106d408d0 0x565106d42d70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb7c00ef020 msgr2=0x7fb7c00de0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fb7c00ef020 0x7fb7c00de0c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x565106d46b00 msgr2=0x565106d48f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x565106d46b00 0x565106d48f80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6940342b0 msgr2=0x7fb694036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6940342b0 0x7fb694036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4011010 tx=0x7fb7c4020000 comp rx=0 tx=0).stop 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 msgr2=0x565106d35350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d35350 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00b5f10 tx=0x7fb7c00e4a60 comp rx=0 tx=0).stop 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7cbd7e640 1 -- 172.21.15.129:0/3057034557 reap_dead start 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 shutdown_connections 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/3057034557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d2e430 0x565106d35350 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 >> 172.21.15.129:0/3057034557 conn(0x565106d2a7c0 msgr2=0x565106d27e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 shutdown_connections 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/3057034557 wait complete. 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6a40342b0 msgr2=0x7fb6a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6a40342b0 0x7fb6a4036770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x565106d119c0 tx=0x7fb7c4005850 comp rx=0 tx=0).stop 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 msgr2=0x565106d21880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 0x565106d21880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0096e80 tx=0x7fb7c0018020 comp rx=0 tx=0).stop 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 shutdown_connections 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6a40342b0 0x7fb6a4036770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/1015645912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106d21460 0x565106d21880 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 >> 172.21.15.129:0/1015645912 conn(0x565106d16270 msgr2=0x565106d16d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 shutdown_connections 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/1015645912 wait complete. 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106c1d520 msgr2=0x565106d10b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106c1d520 0x565106d10b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6b40342b0 msgr2=0x7fb6b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6b40342b0 0x7fb6b4036770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00ad000 tx=0x7fb7c00a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 msgr2=0x565106d09f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d09f00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00b710 tx=0x7fb7bc000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 shutdown_connections 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x565106c1d520 0x565106d10b80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fb6b40342b0 0x7fb6b4036770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 --2- 172.21.15.129:0/2440060416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x565106b8d080 0x565106d09f00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 >> 172.21.15.129:0/2440060416 conn(0x565106c138e0 msgr2=0x565106cfd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 shutdown_connections 2024-02-18T16:21:23.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.810+0000 7fb7ce263980 1 -- 172.21.15.129:0/2440060416 wait complete. 2024-02-18T16:21:23.825 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:23.825 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-18T16:21:23.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-18T16:21:23.826 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-02-18T16:21:23.901 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:23.901 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.894+0000 7f1c8db1a980 1 Processor -- start 2024-02-18T16:21:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.894+0000 7f1c8db1a980 1 -- start start 2024-02-18T16:21:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c8db1a980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d555ae14f0 0x55d555ae38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c8db1a980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d555a29460 con 0x55d555a51860 2024-02-18T16:21:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c8db1a980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d5559f0180 con 0x55d555ae14f0 2024-02-18T16:21:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c83fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d555ae14f0 0x55d555ae38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c83fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d555ae14f0 0x55d555ae38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48370/0 (socket says 172.21.15.129:48370) 2024-02-18T16:21:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c83fff640 1 -- 172.21.15.129:0/107389167 learned_addr learned my addr 172.21.15.129:0/107389167 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c83fff640 1 -- 172.21.15.129:0/107389167 >> v1:172.21.15.80:6789/0 conn(0x55d555a51860 legacy=0x55d555adfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c83fff640 1 -- 172.21.15.129:0/107389167 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d555ae4e60 con 0x55d555ae14f0 2024-02-18T16:21:23.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.898+0000 7f1c83fff640 1 --2- 172.21.15.129:0/107389167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555ae14f0 0x55d555ae38e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400a5c0 tx=0x7f1c7401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e33a1c546b544a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8ae34640 1 -- 172.21.15.129:0/107389167 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740aa470 con 0x55d555ae14f0 2024-02-18T16:21:23.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8ae34640 1 -- 172.21.15.129:0/107389167 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740aa5d0 con 0x55d555ae14f0 2024-02-18T16:21:23.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8ae34640 1 -- 172.21.15.129:0/107389167 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740aa890 con 0x55d555ae14f0 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 -- 172.21.15.129:0/107389167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555ae14f0 msgr2=0x55d555ae38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/107389167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555ae14f0 0x55d555ae38e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400a5c0 tx=0x7f1c7401b340 comp rx=0 tx=0).stop 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 -- 172.21.15.129:0/107389167 shutdown_connections 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/107389167 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555ae14f0 0x55d555ae38e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 -- 172.21.15.129:0/107389167 >> 172.21.15.129:0/107389167 conn(0x55d555ad78b0 msgr2=0x55d555ad9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 -- 172.21.15.129:0/107389167 shutdown_connections 2024-02-18T16:21:23.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.902+0000 7f1c8db1a980 1 -- 172.21.15.129:0/107389167 wait complete. 2024-02-18T16:21:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8db1a980 1 Processor -- start 2024-02-18T16:21:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8db1a980 1 -- start start 2024-02-18T16:21:23.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8db1a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bc7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8db1a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5559ed6b0 con 0x55d555a51860 2024-02-18T16:21:23.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8b635640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bc7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8b635640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bc7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48380/0 (socket says 172.21.15.129:48380) 2024-02-18T16:21:23.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8b635640 1 -- 172.21.15.129:0/1235314222 learned_addr learned my addr 172.21.15.129:0/1235314222 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8b635640 1 -- 172.21.15.129:0/1235314222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74005df0 con 0x55d555a51860 2024-02-18T16:21:23.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.914+0000 7f1c8b635640 1 --2- 172.21.15.129:0/1235314222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bc7010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c001d10 tx=0x7f1c7c00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225396a7b241e96d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1b7960a640 1 -- 172.21.15.129:0/1235314222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c7c014070 con 0x55d555a51860 2024-02-18T16:21:23.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1b7960a640 1 -- 172.21.15.129:0/1235314222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c00f560 con 0x55d555a51860 2024-02-18T16:21:23.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1b7960a640 1 -- 172.21.15.129:0/1235314222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c7c00f840 con 0x55d555a51860 2024-02-18T16:21:23.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/1235314222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 msgr2=0x55d555bc7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/1235314222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bc7010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c001d10 tx=0x7f1c7c00b5c0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/1235314222 shutdown_connections 2024-02-18T16:21:23.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/1235314222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bc7010 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/1235314222 >> 172.21.15.129:0/1235314222 conn(0x55d555ad78b0 msgr2=0x55d555bc2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/1235314222 shutdown_connections 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/1235314222 wait complete. 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 Processor -- start 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- start start 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bcdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5559e8e90 con 0x55d555a51860 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8b635640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bcdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8b635640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bcdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48390/0 (socket says 172.21.15.129:48390) 2024-02-18T16:21:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8b635640 1 -- 172.21.15.129:0/3086319588 learned_addr learned my addr 172.21.15.129:0/3086319588 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8b635640 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d555a29460 con 0x55d555a51860 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8b635640 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bcdfa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55d555bc7ea0 tx=0x7f1c7c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1b77e07640 1 -- 172.21.15.129:0/3086319588 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c7c014050 con 0x55d555a51860 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d555bce4e0 con 0x55d555a51860 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d555bce990 con 0x55d555a51860 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1b77e07640 1 -- 172.21.15.129:0/3086319588 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c001520 con 0x55d555a51860 2024-02-18T16:21:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.918+0000 7f1b77e07640 1 -- 172.21.15.129:0/3086319588 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c7c01bab0 con 0x55d555a51860 2024-02-18T16:21:23.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1b77e07640 1 -- 172.21.15.129:0/3086319588 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1c7c022020 con 0x55d555a51860 2024-02-18T16:21:23.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1b77e07640 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b700342b0 0x7f1b70036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1b77e07640 1 -- 172.21.15.129:0/3086319588 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1c7c049060 con 0x55d555a51860 2024-02-18T16:21:23.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c83fff640 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b700342b0 0x7f1b70036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555ae14f0 0x55d555bd4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555bd50a0 con 0x55d555ae14f0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555ae14f0 0x55d555bd4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c83fff640 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b700342b0 0x7f1b70036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ae000 tx=0x7f1c740a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555ae14f0 0x55d555bd4b60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 -- 172.21.15.129:0/3086319588 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c8400a4d0 con 0x55d555ae14f0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555bd2280 con 0x55d555ae14f0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 -- 172.21.15.129:0/3086319588 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c8400a4d0 con 0x55d555ae14f0 2024-02-18T16:21:23.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555bd6dd0 con 0x55d555ae14f0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 -- 172.21.15.129:0/3086319588 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f1c8400a4d0 con 0x55d555ae14f0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555bd5f10 con 0x55d555ae14f0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 -- 172.21.15.129:0/3086319588 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c8400a4d0 con 0x55d555ae14f0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555bd6320 con 0x55d555ae14f0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8be36640 1 -- 172.21.15.129:0/3086319588 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1c8400a4d0 con 0x55d555ae14f0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 Processor -- start 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- start start 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 0x55d555be5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c8db1a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d555981f20 con 0x55d555be5470 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 0x55d555be5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 0x55d555be5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48396/0 (socket says 172.21.15.129:48396) 2024-02-18T16:21:23.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.922+0000 7f1c83fff640 1 -- 172.21.15.129:0/2954773578 learned_addr learned my addr 172.21.15.129:0/2954773578 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 -- 172.21.15.129:0/2954773578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d555be5dd0 con 0x55d555be5470 2024-02-18T16:21:23.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 0x55d555be5890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ac040 tx=0x7f1c740180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b75602640 1 -- 172.21.15.129:0/2954773578 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740b3cd0 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b75602640 1 -- 172.21.15.129:0/2954773578 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740c3070 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b75602640 1 -- 172.21.15.129:0/2954773578 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740c8430 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d555be5fc0 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d555be6ab0 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b75602640 1 -- 172.21.15.129:0/2954773578 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1c740c5030 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b75602640 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b640342b0 0x7f1b64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b75602640 1 -- 172.21.15.129:0/2954773578 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1c740e6890 con 0x55d555be5470 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8be36640 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b640342b0 0x7f1b64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8db1a980 1 Processor -- start 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8db1a980 1 -- start start 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8be36640 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b640342b0 0x7f1b64036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d555bd5950 tx=0x7f1c84005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8db1a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bf4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c8db1a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d555975790 con 0x55d555bf4300 2024-02-18T16:21:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bf4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bf4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48412/0 (socket says 172.21.15.129:48412) 2024-02-18T16:21:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 -- 172.21.15.129:0/705182074 learned_addr learned my addr 172.21.15.129:0/705182074 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 -- 172.21.15.129:0/705182074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d555bf4cf0 con 0x55d555bf4300 2024-02-18T16:21:23.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1c83fff640 1 --2- 172.21.15.129:0/705182074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bf4720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1c740befd0 tx=0x7f1c740bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b289705ff46f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b6effd640 1 -- 172.21.15.129:0/705182074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740d6040 con 0x55d555bf4300 2024-02-18T16:21:23.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b6effd640 1 -- 172.21.15.129:0/705182074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740c7b20 con 0x55d555bf4300 2024-02-18T16:21:23.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.926+0000 7f1b6effd640 1 -- 172.21.15.129:0/705182074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740c7dc0 con 0x55d555bf4300 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/705182074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 msgr2=0x55d555bf4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/705182074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bf4720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1c740befd0 tx=0x7f1c740bd450 comp rx=0 tx=0).stop 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/705182074 shutdown_connections 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/705182074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bf4720 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/705182074 >> 172.21.15.129:0/705182074 conn(0x55d555adbdf0 msgr2=0x55d555adc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/705182074 shutdown_connections 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/705182074 wait complete. 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 Processor -- start 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- start start 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bfb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d555bfba00 con 0x55d555bf4300 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bfb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c83fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bfb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48422/0 (socket says 172.21.15.129:48422) 2024-02-18T16:21:23.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 learned_addr learned my addr 172.21.15.129:0/4121607865 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d555be6ab0 con 0x55d555bf4300 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c83fff640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bfb4c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1c740bd960 tx=0x7f1c740e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1b6d7fa640 1 -- 172.21.15.129:0/4121607865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740d6040 con 0x55d555bf4300 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d555bfbc00 con 0x55d555bf4300 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1b6d7fa640 1 -- 172.21.15.129:0/4121607865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740e6b70 con 0x55d555bf4300 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d555bfc030 con 0x55d555bf4300 2024-02-18T16:21:23.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1b6d7fa640 1 -- 172.21.15.129:0/4121607865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c740bdb00 con 0x55d555bf4300 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1b6d7fa640 1 -- 172.21.15.129:0/4121607865 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1c740e3350 con 0x55d555bf4300 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1b6d7fa640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b540342b0 0x7f1b54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1b6d7fa640 1 -- 172.21.15.129:0/4121607865 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1c740de580 con 0x55d555bf4300 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8be36640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b540342b0 0x7f1b54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555c067e0 0x55d555c08c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.930+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c093d0 con 0x55d555c067e0 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555c067e0 0x55d555c08c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555c067e0 0x55d555c08c80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8be36640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b540342b0 0x7f1b54036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c84011010 tx=0x7f1c84020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 realm 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c097a0 con 0x55d555c067e0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c09ff0 con 0x55d555c067e0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0a350 con 0x55d555c067e0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 20 searching for the correct realm 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d555c0caa0 0x55d555c0eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0f550 con 0x55d555c0caa0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c83fff640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d555c0caa0 0x55d555c0eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c83fff640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d555c0caa0 0x55d555c0eed0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c83fff640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1c74009040 0x7f1c74006a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0f550 con 0x7f1c74009040 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8be36640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1c74009040 0x7f1c74006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8be36640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1c74009040 0x7f1c74006a80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c8400a4d0 con 0x7f1c74009040 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8be36640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1c840141d0 0x7f1c84015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0f550 con 0x7f1c840141d0 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.934+0000 7f1c8b635640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1c840141d0 0x7f1c84015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1c840141d0 0x7f1c84015940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x7f1c840141d0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x7f1c840141d0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x7f1c840141d0 2024-02-18T16:21:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c74009040 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c8400a4d0 con 0x7f1c74009040 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x7f1c840141d0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.938+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c74009040 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x7f1c840141d0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c016070 con 0x55d555c067e0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c74009040 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.942+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c74009040 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c0caa0 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c840141d0 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x55d555c067e0 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0ab50 con 0x7f1c74009040 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0b410 con 0x55d555c067e0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0b7c0 con 0x55d555c067e0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.946+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0bba0 con 0x55d555c067e0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 zone default found 2024-02-18T16:21:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 4 Realm: () 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 zonegroup default 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c0bf90 con 0x7f1c840141d0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c11370 con 0x55d555c0caa0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c116d0 con 0x55d555c0caa0 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 started sync module instance, tier type = 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10800 con 0x7f1c74009040 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94374755107680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10df0 con 0x7f1c74009040 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c11f50 con 0x55d555c067e0 2024-02-18T16:21:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.950+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94374755107680] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94374755113520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c11f10 con 0x55d555c067e0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c12910 con 0x55d555c0caa0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94374755113520] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94374755116144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c12cc0 con 0x55d555c0caa0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c13630 con 0x7f1c74009040 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94374755119776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c13d60 con 0x7f1c74009040 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.954+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c14830 con 0x55d555c067e0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.958+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94374755116144] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.958+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94374755119776] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.958+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.958+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94374755123984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c147f0 con 0x55d555c067e0 2024-02-18T16:21:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.958+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c13930 con 0x7f1c840141d0 2024-02-18T16:21:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.958+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94374755123984] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94374755125232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c150b0 con 0x7f1c840141d0 2024-02-18T16:21:23.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c158b0 con 0x7f1c840141d0 2024-02-18T16:21:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94374755125232] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94374755126560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c15700 con 0x7f1c840141d0 2024-02-18T16:21:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.962+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c161d0 con 0x7f1c840141d0 2024-02-18T16:21:23.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94374755130544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c16630 con 0x7f1c840141d0 2024-02-18T16:21:23.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=0 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=1 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=2 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=3 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=4 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=5 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94374755126560] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=6 2024-02-18T16:21:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94374755130544] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 20 add_watcher() i=7 2024-02-18T16:21:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c16630 con 0x55d555c067e0 2024-02-18T16:21:23.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94374755131792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c165b0 con 0x55d555c067e0 2024-02-18T16:21:23.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94374755131792] v30'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.966+0000 7f1b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 5 note: GC not initialized 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b40fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 20 Filter name: none 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1aba7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c3b550 con 0x55d555c067e0 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 20 rados_obj.operate() r=0 bl.length=513 2024-02-18T16:21:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c412b0 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94374755306832 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c3cda0 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94374755123984 notify 128849018890 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55d555bce990 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 94374755306832 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94374755123984 notifier 4412 bl.length()=533 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b6e7fc640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1ac0003430 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== watch-notify(notify_complete (2) cookie 94374755306832 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d555bce4e0 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94374755306832 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c3cda0 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== watch-notify(notify (1) cookie 94374755107680 notify 128849018885 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f1c84026bc0 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94374755107680 notifier 4412 bl.length()=159 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(66 notify.0 [notify cookie 94374755306832 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1b6e7fc640 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1ac0003430 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== watch-notify(notify_complete (2) cookie 94374755306832 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1c84026d50 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.970+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c40d50 con 0x7f1c74009040 2024-02-18T16:21:23.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.974+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 foo:foo2 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.980 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:23.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.974+0000 7f1b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:23.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.974+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94374755131792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c3a660 con 0x55d555c067e0 2024-02-18T16:21:23.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.974+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94374755131792] v30'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.974+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94374755107680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c16190 con 0x7f1c74009040 2024-02-18T16:21:23.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94374755107680] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8db1a980 20 remove_watcher() i=0 2024-02-18T16:21:23.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8db1a980 2 removed watcher, disabling cache 2024-02-18T16:21:23.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94374755113520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c16190 con 0x55d555c067e0 2024-02-18T16:21:23.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94374755113520] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8db1a980 20 remove_watcher() i=1 2024-02-18T16:21:23.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.978+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94374755116144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c16190 con 0x55d555c0caa0 2024-02-18T16:21:23.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c83fff640 1 -- 172.21.15.129:0/4121607865 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94374755116144] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c740b0020 con 0x55d555c0caa0 2024-02-18T16:21:23.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8db1a980 20 remove_watcher() i=2 2024-02-18T16:21:23.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94374755119776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10360 con 0x7f1c74009040 2024-02-18T16:21:23.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8be36640 1 -- 172.21.15.129:0/4121607865 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94374755119776] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c8403a040 con 0x7f1c74009040 2024-02-18T16:21:23.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8db1a980 20 remove_watcher() i=3 2024-02-18T16:21:23.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94374755123984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10360 con 0x55d555c067e0 2024-02-18T16:21:23.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94374755123984] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x55d555c067e0 2024-02-18T16:21:23.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8db1a980 20 remove_watcher() i=4 2024-02-18T16:21:23.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.982+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94374755125232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10360 con 0x7f1c840141d0 2024-02-18T16:21:23.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.986+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94374755125232] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.986+0000 7f1c8db1a980 20 remove_watcher() i=5 2024-02-18T16:21:23.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.986+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94374755126560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10360 con 0x7f1c840141d0 2024-02-18T16:21:23.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.986+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94374755126560] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.986+0000 7f1c8db1a980 20 remove_watcher() i=6 2024-02-18T16:21:23.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.986+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94374755130544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d555c10360 con 0x7f1c840141d0 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94374755130544] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c7c052040 con 0x7f1c840141d0 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 20 remove_watcher() i=7 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1c840141d0 msgr2=0x7f1c84015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1c840141d0 0x7f1c84015940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555c067e0 msgr2=0x55d555c08c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555c067e0 0x55d555c08c80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1c74009040 msgr2=0x7f1c74006a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1c74009040 0x7f1c74006a80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d555c0caa0 msgr2=0x55d555c0eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d555c0caa0 0x55d555c0eed0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b540342b0 msgr2=0x7f1b54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b540342b0 0x7f1b54036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c84011010 tx=0x7f1c84020000 comp rx=0 tx=0).stop 2024-02-18T16:21:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8b635640 1 -- 172.21.15.129:0/4121607865 reap_dead start 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 msgr2=0x55d555bfb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bfb4c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1c740bd960 tx=0x7f1c740e4b90 comp rx=0 tx=0).stop 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 shutdown_connections 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/4121607865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555bf4300 0x55d555bfb4c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 >> 172.21.15.129:0/4121607865 conn(0x55d555adbdf0 msgr2=0x55d555bebe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 shutdown_connections 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/4121607865 wait complete. 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b640342b0 msgr2=0x7f1b64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b640342b0 0x7f1b64036770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d555bd5950 tx=0x7f1c84005850 comp rx=0 tx=0).stop 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 msgr2=0x55d555be5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 0x55d555be5890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ac040 tx=0x7f1c740180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 shutdown_connections 2024-02-18T16:21:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b640342b0 0x7f1b64036770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/2954773578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555be5470 0x55d555be5890 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 >> 172.21.15.129:0/2954773578 conn(0x55d555bda280 msgr2=0x55d555bdad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 shutdown_connections 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/2954773578 wait complete. 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555ae14f0 msgr2=0x55d555bd4b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555ae14f0 0x55d555bd4b60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b700342b0 msgr2=0x7f1b70036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b700342b0 0x7f1b70036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ae000 tx=0x7f1c740a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 msgr2=0x55d555bcdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bcdfa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55d555bc7ea0 tx=0x7f1c7c000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 shutdown_connections 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d555ae14f0 0x55d555bd4b60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1b700342b0 0x7f1b70036770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 --2- 172.21.15.129:0/3086319588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d555a51860 0x55d555bcdfa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 >> 172.21.15.129:0/3086319588 conn(0x55d555ad78b0 msgr2=0x55d555bc16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 shutdown_connections 2024-02-18T16:21:24.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:23.990+0000 7f1c8db1a980 1 -- 172.21.15.129:0/3086319588 wait complete. 2024-02-18T16:21:24.005 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:24.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-18T16:21:24.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-18T16:21:24.005 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-18T16:21:24.075 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:24.075 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:24.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f4517043980 1 Processor -- start 2024-02-18T16:21:24.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f4517043980 1 -- start start 2024-02-18T16:21:24.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f4517043980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x563ed7c16080 0x563ed7c16490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f4517043980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563ed7be94c0 con 0x563ed7c13b80 2024-02-18T16:21:24.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f4517043980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x563ed7bb0180 con 0x563ed7c16080 2024-02-18T16:21:24.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f451435d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x563ed7c16080 0x563ed7c16490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f451435d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x563ed7c16080 0x563ed7c16490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48428/0 (socket says 172.21.15.129:48428) 2024-02-18T16:21:24.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f451435d640 1 -- 172.21.15.129:0/2399176778 learned_addr learned my addr 172.21.15.129:0/2399176778 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f4514b5e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x563ed7c13b80 0x563ed7c13f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42804/0 (socket says 172.21.15.129:42804) 2024-02-18T16:21:24.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f451435d640 1 -- 172.21.15.129:0/2399176778 >> v1:172.21.15.80:6789/0 conn(0x563ed7c13b80 legacy=0x563ed7c13f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.070+0000 7f451435d640 1 -- 172.21.15.129:0/2399176778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed7c179e0 con 0x563ed7c16080 2024-02-18T16:21:24.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f451435d640 1 --2- 172.21.15.129:0/2399176778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c16080 0x563ed7c16490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f450800a4e0 tx=0x7f450801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f123e41113cf2e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4513b5c640 1 -- 172.21.15.129:0/2399176778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080aa540 con 0x563ed7c16080 2024-02-18T16:21:24.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4513b5c640 1 -- 172.21.15.129:0/2399176778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080a6070 con 0x563ed7c16080 2024-02-18T16:21:24.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4513b5c640 1 -- 172.21.15.129:0/2399176778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080aa850 con 0x563ed7c16080 2024-02-18T16:21:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 -- 172.21.15.129:0/2399176778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c16080 msgr2=0x563ed7c16490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 --2- 172.21.15.129:0/2399176778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c16080 0x563ed7c16490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f450800a4e0 tx=0x7f450801b090 comp rx=0 tx=0).stop 2024-02-18T16:21:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 -- 172.21.15.129:0/2399176778 shutdown_connections 2024-02-18T16:21:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 --2- 172.21.15.129:0/2399176778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c16080 0x563ed7c16490 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 -- 172.21.15.129:0/2399176778 >> 172.21.15.129:0/2399176778 conn(0x563ed7c12a40 msgr2=0x563ed7c12e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 -- 172.21.15.129:0/2399176778 shutdown_connections 2024-02-18T16:21:24.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.074+0000 7f4517043980 1 -- 172.21.15.129:0/2399176778 wait complete. 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4517043980 1 Processor -- start 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4517043980 1 -- start start 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4517043980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d8d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4517043980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed7bad6b0 con 0x563ed7c13b80 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4514b5e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d8d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4514b5e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d8d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48432/0 (socket says 172.21.15.129:48432) 2024-02-18T16:21:24.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4514b5e640 1 -- 172.21.15.129:0/2837063018 learned_addr learned my addr 172.21.15.129:0/2837063018 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.086+0000 7f4514b5e640 1 -- 172.21.15.129:0/2837063018 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450800a1c0 con 0x563ed7c13b80 2024-02-18T16:21:24.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4514b5e640 1 --2- 172.21.15.129:0/2837063018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d8d6d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4504001cc0 tx=0x7f450400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833f0ce3b3d4766e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4402e0d640 1 -- 172.21.15.129:0/2837063018 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4504014070 con 0x563ed7c13b80 2024-02-18T16:21:24.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4402e0d640 1 -- 172.21.15.129:0/2837063018 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400f590 con 0x563ed7c13b80 2024-02-18T16:21:24.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4402e0d640 1 -- 172.21.15.129:0/2837063018 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4504007040 con 0x563ed7c13b80 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/2837063018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 msgr2=0x563ed7d8d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 --2- 172.21.15.129:0/2837063018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d8d6d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4504001cc0 tx=0x7f450400b610 comp rx=0 tx=0).stop 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/2837063018 shutdown_connections 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 --2- 172.21.15.129:0/2837063018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d8d6d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/2837063018 >> 172.21.15.129:0/2837063018 conn(0x563ed7c12a40 msgr2=0x563ed7d89260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/2837063018 shutdown_connections 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/2837063018 wait complete. 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 Processor -- start 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- start start 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d94520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed7ba8e90 con 0x563ed7c13b80 2024-02-18T16:21:24.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4514b5e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d94520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4514b5e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d94520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48440/0 (socket says 172.21.15.129:48440) 2024-02-18T16:21:24.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4514b5e640 1 -- 172.21.15.129:0/855894320 learned_addr learned my addr 172.21.15.129:0/855894320 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4514b5e640 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed7be94c0 con 0x563ed7c13b80 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4514b5e640 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d94520 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x563ed7d8e560 tx=0x7f4504000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f440160a640 1 -- 172.21.15.129:0/855894320 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4504014030 con 0x563ed7c13b80 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ed7d94a60 con 0x563ed7c13b80 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f440160a640 1 -- 172.21.15.129:0/855894320 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450401c840 con 0x563ed7c13b80 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ed7d94e90 con 0x563ed7c13b80 2024-02-18T16:21:24.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.090+0000 7f440160a640 1 -- 172.21.15.129:0/855894320 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f450401cb20 con 0x563ed7c13b80 2024-02-18T16:21:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f440160a640 1 -- 172.21.15.129:0/855894320 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f450401cc80 con 0x563ed7c13b80 2024-02-18T16:21:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f440160a640 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43fc0342b0 0x7f43fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f440160a640 1 -- 172.21.15.129:0/855894320 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4504006070 con 0x563ed7c13b80 2024-02-18T16:21:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451435d640 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43fc0342b0 0x7f43fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7c16080 0x563ed7d9b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7d9b6e0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7c16080 0x563ed7d9b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451435d640 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43fc0342b0 0x7f43fc036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f45080ab000 tx=0x7f45080a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7c16080 0x563ed7d9b1a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 -- 172.21.15.129:0/855894320 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f450c0083f0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7d9ba40 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 -- 172.21.15.129:0/855894320 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f450c0083f0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7d9d2c0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 -- 172.21.15.129:0/855894320 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f450c0083f0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7d9c4c0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 -- 172.21.15.129:0/855894320 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f450c0083f0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7d9c8d0 con 0x563ed7c16080 2024-02-18T16:21:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451535f640 1 -- 172.21.15.129:0/855894320 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f450c012040 con 0x563ed7c16080 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 Processor -- start 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- start start 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 0x563ed7dabde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f4517043980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed7b41f20 con 0x563ed7dab9c0 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451435d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 0x563ed7dabde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451435d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 0x563ed7dabde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48456/0 (socket says 172.21.15.129:48456) 2024-02-18T16:21:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.094+0000 7f451435d640 1 -- 172.21.15.129:0/841080388 learned_addr learned my addr 172.21.15.129:0/841080388 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451435d640 1 -- 172.21.15.129:0/841080388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed7dac320 con 0x563ed7dab9c0 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451435d640 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 0x563ed7dabde0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f450800a190 tx=0x7f4508017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f43fa7fc640 1 -- 172.21.15.129:0/841080388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080b5be0 con 0x563ed7dab9c0 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f43fa7fc640 1 -- 172.21.15.129:0/841080388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080b5d40 con 0x563ed7dab9c0 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ed7dac510 con 0x563ed7dab9c0 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f43fa7fc640 1 -- 172.21.15.129:0/841080388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080be410 con 0x563ed7dab9c0 2024-02-18T16:21:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ed7dad000 con 0x563ed7dab9c0 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f43fa7fc640 1 -- 172.21.15.129:0/841080388 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f45080a8070 con 0x563ed7dab9c0 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f43fa7fc640 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43ec0342b0 0x7f43ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f43fa7fc640 1 -- 172.21.15.129:0/841080388 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f45080e5cf0 con 0x563ed7dab9c0 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451535f640 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43ec0342b0 0x7f43ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f4517043980 1 Processor -- start 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f4517043980 1 -- start start 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f4517043980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7db8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451535f640 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43ec0342b0 0x7f43ec036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x563ed7d9bf00 tx=0x7f450c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f4517043980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed7b35790 con 0x563ed7db8a70 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451435d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7db8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451435d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7db8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48464/0 (socket says 172.21.15.129:48464) 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451435d640 1 -- 172.21.15.129:0/70934876 learned_addr learned my addr 172.21.15.129:0/70934876 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.098+0000 7f451435d640 1 -- 172.21.15.129:0/70934876 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed7db9420 con 0x563ed7db8a70 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f451435d640 1 --2- 172.21.15.129:0/70934876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7db8e50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f45080e40e0 tx=0x7f45080c5910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df91b02e2d62154 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ebfff640 1 -- 172.21.15.129:0/70934876 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080d6070 con 0x563ed7db8a70 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ebfff640 1 -- 172.21.15.129:0/70934876 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080a99d0 con 0x563ed7db8a70 2024-02-18T16:21:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ebfff640 1 -- 172.21.15.129:0/70934876 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080be710 con 0x563ed7db8a70 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/70934876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 msgr2=0x563ed7db8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 --2- 172.21.15.129:0/70934876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7db8e50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f45080e40e0 tx=0x7f45080c5910 comp rx=0 tx=0).stop 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/70934876 shutdown_connections 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 --2- 172.21.15.129:0/70934876 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7db8e50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/70934876 >> 172.21.15.129:0/70934876 conn(0x563ed7db4db0 msgr2=0x563ed7db2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/70934876 shutdown_connections 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/70934876 wait complete. 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 Processor -- start 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- start start 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7dbf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ed7dbfe80 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f451435d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7dbf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f451435d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7dbf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48470/0 (socket says 172.21.15.129:48470) 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 learned_addr learned my addr 172.21.15.129:0/170165345 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ed7dad000 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f451435d640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7dbf940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45080b58f0 tx=0x7f45080e4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ea7fc640 1 -- 172.21.15.129:0/170165345 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080bebd0 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ed7dc0080 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ea7fc640 1 -- 172.21.15.129:0/170165345 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080d1480 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ea7fc640 1 -- 172.21.15.129:0/170165345 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080d1740 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ed7dc04b0 con 0x563ed7db8a70 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.102+0000 7f43ea7fc640 1 -- 172.21.15.129:0/170165345 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f45080d9070 con 0x563ed7db8a70 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f43ea7fc640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43e00342b0 0x7f43e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f43ea7fc640 1 -- 172.21.15.129:0/170165345 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f45080ac0d0 con 0x563ed7db8a70 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43e00342b0 0x7f43e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7dcaee0 0x563ed7dcd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dcdad0 con 0x563ed7dcaee0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7dcaee0 0x563ed7dcd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43e00342b0 0x7f43e0036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f450c008fd0 tx=0x7f450c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7dcaee0 0x563ed7dcd380 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4504016070 con 0x563ed7dcaee0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 realm 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dcdea0 con 0x563ed7dcaee0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4504016070 con 0x563ed7dcaee0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dce6f0 con 0x563ed7dcaee0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4504016070 con 0x563ed7dcaee0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dcea50 con 0x563ed7dcaee0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4504016070 con 0x563ed7dcaee0 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dce390 con 0x563ed7dcaee0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4504016070 con 0x563ed7dcaee0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 20 searching for the correct realm 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563ed7dd0ca0 0x563ed7dd3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451435d640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563ed7dd0ca0 0x563ed7dd3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451435d640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563ed7dd0ca0 0x563ed7dd3090 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451435d640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f45080c7070 0x7f45080e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f45080c7070 2024-02-18T16:21:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f45080c7070 0x7f45080e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f45080c7070 0x7f45080e7a10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450c02c040 con 0x7f45080c7070 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f450c027940 0x7f450c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.106+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f450c027940 0x7f450c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f450c027940 0x7f450c0333c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4504016070 con 0x7f450c027940 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f45080c7070 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450c02c040 con 0x7f45080c7070 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.110+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f45080c7070 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f450c02c040 con 0x7f45080c7070 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f45080c7070 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450c02c040 con 0x7f45080c7070 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.114+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f45080c7070 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450c02c040 con 0x7f45080c7070 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dd0ca0 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f450c027940 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x563ed7dcaee0 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd3740 con 0x7f45080c7070 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f450c02c040 con 0x7f45080c7070 2024-02-18T16:21:24.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dcf8f0 con 0x563ed7dcaee0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dcf570 con 0x563ed7dcaee0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.118+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd0240 con 0x563ed7dcaee0 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 zone default found 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 4 Realm: () 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 zonegroup default 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4020 con 0x7f450c027940 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd5a00 con 0x563ed7dd0ca0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd5d60 con 0x563ed7dd0ca0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 started sync module instance, tier type = 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4fd0 con 0x7f45080c7070 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94827909567360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4fd0 con 0x7f45080c7070 2024-02-18T16:21:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd6780 con 0x563ed7dcaee0 2024-02-18T16:21:24.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.122+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94827909567360] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94827909571200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4fd0 con 0x563ed7dcaee0 2024-02-18T16:21:24.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd7140 con 0x563ed7dd0ca0 2024-02-18T16:21:24.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94827909571200] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94827909565232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4f50 con 0x563ed7dd0ca0 2024-02-18T16:21:24.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd7e90 con 0x7f45080c7070 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94827909577104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd86e0 con 0x7f45080c7070 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.126+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd9100 con 0x563ed7dcaee0 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94827909577104] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94827909565232] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94827909581792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd8240 con 0x563ed7dcaee0 2024-02-18T16:21:24.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd9950 con 0x7f450c027940 2024-02-18T16:21:24.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94827909581792] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94827909575920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd8240 con 0x7f450c027940 2024-02-18T16:21:24.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.130+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd9e00 con 0x7f450c027940 2024-02-18T16:21:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94827909575920] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94827909583504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd9dc0 con 0x7f450c027940 2024-02-18T16:21:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dda7c0 con 0x7f450c027940 2024-02-18T16:21:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94827909583504] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94827909587648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd9dc0 con 0x7f450c027940 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=0 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=1 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=2 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=3 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=4 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=5 2024-02-18T16:21:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.134+0000 7f4517043980 20 add_watcher() i=6 2024-02-18T16:21:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94827909587648] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 20 add_watcher() i=7 2024-02-18T16:21:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dddc00 con 0x563ed7dcaee0 2024-02-18T16:21:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94827909585648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7ddb0d0 con 0x563ed7dcaee0 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94827909585648] v30'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f43cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 5 note: GC not initialized 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f43c9fe3640 20 reqs_thread_entry: start 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.138+0000 7f4517043980 20 Filter name: none 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f433b7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dff720 con 0x563ed7dcaee0 2024-02-18T16:21:24.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:24.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dff720 con 0x7f45080c7070 2024-02-18T16:21:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f43cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94827909585648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dff6e0 con 0x563ed7dcaee0 2024-02-18T16:21:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94827909585648] v30'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94827909567360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dff6e0 con 0x7f45080c7070 2024-02-18T16:21:24.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94827909567360] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 20 remove_watcher() i=0 2024-02-18T16:21:24.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 2 removed watcher, disabling cache 2024-02-18T16:21:24.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.142+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94827909571200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd5380 con 0x563ed7dcaee0 2024-02-18T16:21:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.146+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94827909571200] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.146+0000 7f4517043980 20 remove_watcher() i=1 2024-02-18T16:21:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.146+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94827909565232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd5380 con 0x563ed7dd0ca0 2024-02-18T16:21:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.146+0000 7f451435d640 1 -- 172.21.15.129:0/170165345 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94827909565232] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f45080d8030 con 0x563ed7dd0ca0 2024-02-18T16:21:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.146+0000 7f4517043980 20 remove_watcher() i=2 2024-02-18T16:21:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.146+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94827909577104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4b30 con 0x7f45080c7070 2024-02-18T16:21:24.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.150+0000 7f451535f640 1 -- 172.21.15.129:0/170165345 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94827909577104] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450c03f040 con 0x7f45080c7070 2024-02-18T16:21:24.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.150+0000 7f4517043980 20 remove_watcher() i=3 2024-02-18T16:21:24.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.150+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94827909581792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4b30 con 0x563ed7dcaee0 2024-02-18T16:21:24.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.150+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94827909581792] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x563ed7dcaee0 2024-02-18T16:21:24.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.150+0000 7f4517043980 20 remove_watcher() i=4 2024-02-18T16:21:24.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.150+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94827909575920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd8be0 con 0x7f450c027940 2024-02-18T16:21:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94827909575920] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4517043980 20 remove_watcher() i=5 2024-02-18T16:21:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94827909583504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd4b30 con 0x7f450c027940 2024-02-18T16:21:24.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94827909583504] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4517043980 20 remove_watcher() i=6 2024-02-18T16:21:24.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94827909587648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563ed7dd8be0 con 0x7f450c027940 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94827909587648] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f450403a080 con 0x7f450c027940 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.154+0000 7f4517043980 20 remove_watcher() i=7 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f450c027940 msgr2=0x7f450c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f450c027940 0x7f450c0333c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7dcaee0 msgr2=0x563ed7dcd380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7dcaee0 0x563ed7dcd380 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f45080c7070 msgr2=0x7f45080e7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f45080c7070 0x7f45080e7a10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563ed7dd0ca0 msgr2=0x563ed7dd3090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x563ed7dd0ca0 0x563ed7dd3090 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43e00342b0 msgr2=0x7f43e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43e00342b0 0x7f43e0036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f450c008fd0 tx=0x7f450c01c070 comp rx=0 tx=0).stop 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 msgr2=0x563ed7dbf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4514b5e640 1 -- 172.21.15.129:0/170165345 reap_dead start 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7dbf940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45080b58f0 tx=0x7f45080e4070 comp rx=0 tx=0).stop 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 shutdown_connections 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/170165345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7db8a70 0x563ed7dbf940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 >> 172.21.15.129:0/170165345 conn(0x563ed7db4db0 msgr2=0x563ed7db2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 shutdown_connections 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/170165345 wait complete. 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43ec0342b0 msgr2=0x7f43ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43ec0342b0 0x7f43ec036770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x563ed7d9bf00 tx=0x7f450c003070 comp rx=0 tx=0).stop 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 msgr2=0x563ed7dabde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 0x563ed7dabde0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f450800a190 tx=0x7f4508017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 shutdown_connections 2024-02-18T16:21:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43ec0342b0 0x7f43ec036770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/841080388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7dab9c0 0x563ed7dabde0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 >> 172.21.15.129:0/841080388 conn(0x563ed7da07d0 msgr2=0x563ed7da12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 shutdown_connections 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/841080388 wait complete. 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7c16080 msgr2=0x563ed7d9b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7c16080 0x563ed7d9b1a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43fc0342b0 msgr2=0x7f43fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43fc0342b0 0x7f43fc036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f45080ab000 tx=0x7f45080a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 msgr2=0x563ed7d94520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d94520 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x563ed7d8e560 tx=0x7f4504000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 shutdown_connections 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x563ed7c16080 0x563ed7d9b1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f43fc0342b0 0x7f43fc036770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 --2- 172.21.15.129:0/855894320 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x563ed7c13b80 0x563ed7d94520 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 >> 172.21.15.129:0/855894320 conn(0x563ed7c12a40 msgr2=0x563ed7d87d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 shutdown_connections 2024-02-18T16:21:24.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.158+0000 7f4517043980 1 -- 172.21.15.129:0/855894320 wait complete. 2024-02-18T16:21:24.172 INFO:teuthology.orchestra.run.smithi129.stdout:[] 2024-02-18T16:21:24.172 DEBUG:tasks.util.rgw: json result: [] 2024-02-18T16:21:24.172 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-18T16:21:24.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-18T16:21:24.173 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-18T16:21:24.249 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:24.249 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:24.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.242+0000 7f4371ba0980 1 Processor -- start 2024-02-18T16:21:24.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f4371ba0980 1 -- start start 2024-02-18T16:21:24.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f4371ba0980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d40767a640 0x55d40767ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f4371ba0980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d4075c24c0 con 0x55d407676130 2024-02-18T16:21:24.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f4371ba0980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d407589180 con 0x55d40767a640 2024-02-18T16:21:24.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436eeba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d40767a640 0x55d40767ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436eeba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d40767a640 0x55d40767ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48472/0 (socket says 172.21.15.129:48472) 2024-02-18T16:21:24.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436f6bb640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55d407676130 0x55d407676510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42814/0 (socket says 172.21.15.129:42814) 2024-02-18T16:21:24.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436eeba640 1 -- 172.21.15.129:0/3294920788 learned_addr learned my addr 172.21.15.129:0/3294920788 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436eeba640 1 -- 172.21.15.129:0/3294920788 >> v1:172.21.15.80:6789/0 conn(0x55d407676130 legacy=0x55d407676510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436eeba640 1 -- 172.21.15.129:0/3294920788 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d40767df80 con 0x55d40767a640 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436eeba640 1 --2- 172.21.15.129:0/3294920788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40767a640 0x55d40767ca30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f436400a5c0 tx=0x7f436401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cbfef2446f2a41 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436e6b9640 1 -- 172.21.15.129:0/3294920788 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640aa470 con 0x55d40767a640 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436e6b9640 1 -- 172.21.15.129:0/3294920788 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640aa5d0 con 0x55d40767a640 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.246+0000 7f436e6b9640 1 -- 172.21.15.129:0/3294920788 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640aa890 con 0x55d40767a640 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 -- 172.21.15.129:0/3294920788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40767a640 msgr2=0x55d40767ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 --2- 172.21.15.129:0/3294920788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40767a640 0x55d40767ca30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f436400a5c0 tx=0x7f436401b340 comp rx=0 tx=0).stop 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 -- 172.21.15.129:0/3294920788 shutdown_connections 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 --2- 172.21.15.129:0/3294920788 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40767a640 0x55d40767ca30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 -- 172.21.15.129:0/3294920788 >> 172.21.15.129:0/3294920788 conn(0x55d407671a00 msgr2=0x55d407673e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 -- 172.21.15.129:0/3294920788 shutdown_connections 2024-02-18T16:21:24.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.250+0000 7f4371ba0980 1 -- 172.21.15.129:0/3294920788 wait complete. 2024-02-18T16:21:24.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f4371ba0980 1 Processor -- start 2024-02-18T16:21:24.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f4371ba0980 1 -- start start 2024-02-18T16:21:24.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f4371ba0980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d407760030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f4371ba0980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4075866b0 con 0x55d407676130 2024-02-18T16:21:24.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f436f6bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d407760030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f436f6bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d407760030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48486/0 (socket says 172.21.15.129:48486) 2024-02-18T16:21:24.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f436f6bb640 1 -- 172.21.15.129:0/766730708 learned_addr learned my addr 172.21.15.129:0/766730708 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f436f6bb640 1 -- 172.21.15.129:0/766730708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364005df0 con 0x55d407676130 2024-02-18T16:21:24.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f436f6bb640 1 --2- 172.21.15.129:0/766730708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d407760030 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4360001cc0 tx=0x7f436000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bb852abb5bf80d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f425d60a640 1 -- 172.21.15.129:0/766730708 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4360014070 con 0x55d407676130 2024-02-18T16:21:24.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f425d60a640 1 -- 172.21.15.129:0/766730708 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000f590 con 0x55d407676130 2024-02-18T16:21:24.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.262+0000 7f425d60a640 1 -- 172.21.15.129:0/766730708 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4360007040 con 0x55d407676130 2024-02-18T16:21:24.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/766730708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 msgr2=0x55d407760030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 --2- 172.21.15.129:0/766730708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d407760030 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4360001cc0 tx=0x7f436000b610 comp rx=0 tx=0).stop 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/766730708 shutdown_connections 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 --2- 172.21.15.129:0/766730708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d407760030 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/766730708 >> 172.21.15.129:0/766730708 conn(0x55d407671a00 msgr2=0x55d40775bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/766730708 shutdown_connections 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/766730708 wait complete. 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 Processor -- start 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- start start 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d4077690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d407581e90 con 0x55d407676130 2024-02-18T16:21:24.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f436f6bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d4077690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f436f6bb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d4077690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48494/0 (socket says 172.21.15.129:48494) 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f436f6bb640 1 -- 172.21.15.129:0/917566228 learned_addr learned my addr 172.21.15.129:0/917566228 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f436f6bb640 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4075c24c0 con 0x55d407676130 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f436f6bb640 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d4077690a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55d407760ec0 tx=0x7f4360000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f425be07640 1 -- 172.21.15.129:0/917566228 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4360014030 con 0x55d407676130 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4077695e0 con 0x55d407676130 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d407769a90 con 0x55d407676130 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f425be07640 1 -- 172.21.15.129:0/917566228 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436001c840 con 0x55d407676130 2024-02-18T16:21:24.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f425be07640 1 -- 172.21.15.129:0/917566228 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f436001cb20 con 0x55d407676130 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f425be07640 1 -- 172.21.15.129:0/917566228 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f436001cc80 con 0x55d407676130 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f425be07640 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42540342b0 0x7f4254036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f425be07640 1 -- 172.21.15.129:0/917566228 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4360006070 con 0x55d407676130 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.266+0000 7f436eeba640 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42540342b0 0x7f4254036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40767a640 0x55d40776fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077702c0 con 0x55d40767a640 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40767a640 0x55d40776fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436eeba640 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42540342b0 0x7f4254036770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43640ae000 tx=0x7f43640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40767a640 0x55d40776fd80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 -- 172.21.15.129:0/917566228 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f436800a4d0 con 0x55d40767a640 2024-02-18T16:21:24.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077706b0 con 0x55d40767a640 2024-02-18T16:21:24.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 -- 172.21.15.129:0/917566228 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f436800a4d0 con 0x55d40767a640 2024-02-18T16:21:24.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d407771f60 con 0x55d40767a640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 -- 172.21.15.129:0/917566228 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f436800a4d0 con 0x55d40767a640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d407771160 con 0x55d40767a640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 -- 172.21.15.129:0/917566228 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f436800a4d0 con 0x55d40767a640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d407771570 con 0x55d40767a640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436febc640 1 -- 172.21.15.129:0/917566228 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f436800a4d0 con 0x55d40767a640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 Processor -- start 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- start start 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 0x55d407780a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f4371ba0980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40751af20 con 0x55d407780640 2024-02-18T16:21:24.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436eeba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 0x55d407780a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436eeba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 0x55d407780a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48508/0 (socket says 172.21.15.129:48508) 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436eeba640 1 -- 172.21.15.129:0/1117447704 learned_addr learned my addr 172.21.15.129:0/1117447704 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436eeba640 1 -- 172.21.15.129:0/1117447704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d407780fa0 con 0x55d407780640 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.270+0000 7f436eeba640 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 0x55d407780a60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43640ac040 tx=0x7f43640180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4259602640 1 -- 172.21.15.129:0/1117447704 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640b3cd0 con 0x55d407780640 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4259602640 1 -- 172.21.15.129:0/1117447704 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640c3070 con 0x55d407780640 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d407781190 con 0x55d407780640 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4259602640 1 -- 172.21.15.129:0/1117447704 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640c8430 con 0x55d407780640 2024-02-18T16:21:24.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d407781c80 con 0x55d407780640 2024-02-18T16:21:24.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4259602640 1 -- 172.21.15.129:0/1117447704 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f43640c5030 con 0x55d407780640 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4259602640 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42480342b0 0x7f4248036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4259602640 1 -- 172.21.15.129:0/1117447704 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f43640e6890 con 0x55d407780640 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436febc640 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42480342b0 0x7f4248036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 Processor -- start 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436febc640 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42480342b0 0x7f4248036770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55d407770ba0 tx=0x7f4368005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- start start 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d40778da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40750e790 con 0x55d40778d620 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436eeba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d40778da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436eeba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d40778da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48524/0 (socket says 172.21.15.129:48524) 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436eeba640 1 -- 172.21.15.129:0/1800762986 learned_addr learned my addr 172.21.15.129:0/1800762986 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436eeba640 1 -- 172.21.15.129:0/1800762986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d40778e010 con 0x55d40778d620 2024-02-18T16:21:24.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f436eeba640 1 --2- 172.21.15.129:0/1800762986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d40778da40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f43640befd0 tx=0x7f43640bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7af2479784e2559 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4252ffd640 1 -- 172.21.15.129:0/1800762986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640d6040 con 0x55d40778d620 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4252ffd640 1 -- 172.21.15.129:0/1800762986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640c7b20 con 0x55d40778d620 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4252ffd640 1 -- 172.21.15.129:0/1800762986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640c7dc0 con 0x55d40778d620 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1800762986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 msgr2=0x55d40778da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 --2- 172.21.15.129:0/1800762986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d40778da40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f43640befd0 tx=0x7f43640bd450 comp rx=0 tx=0).stop 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1800762986 shutdown_connections 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 --2- 172.21.15.129:0/1800762986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d40778da40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1800762986 >> 172.21.15.129:0/1800762986 conn(0x55d4077899b0 msgr2=0x55d407787a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1800762986 shutdown_connections 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.274+0000 7f4371ba0980 1 -- 172.21.15.129:0/1800762986 wait complete. 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 Processor -- start 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 -- start start 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d407794550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d407794a90 con 0x55d40778d620 2024-02-18T16:21:24.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436eeba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d407794550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436eeba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d407794550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48534/0 (socket says 172.21.15.129:48534) 2024-02-18T16:21:24.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 learned_addr learned my addr 172.21.15.129:0/2075766599 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d407781c80 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436eeba640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d407794550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f43640bd960 tx=0x7f43640e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f42517fa640 1 -- 172.21.15.129:0/2075766599 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640d6040 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d407794c90 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f42517fa640 1 -- 172.21.15.129:0/2075766599 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640e6b70 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f42517fa640 1 -- 172.21.15.129:0/2075766599 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43640e6e10 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4077950c0 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f42517fa640 1 -- 172.21.15.129:0/2075766599 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f43640bd9d0 con 0x55d40778d620 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f42517fa640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4238034210 0x7f42380366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f42517fa640 1 -- 172.21.15.129:0/2075766599 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f43640f1c50 con 0x55d40778d620 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436febc640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4238034210 0x7f42380366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40779f7d0 0x55d4077a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a23e0 con 0x55d40779f7d0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436f6bb640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40779f7d0 0x55d4077a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436febc640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4238034210 0x7f42380366d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4368011010 tx=0x7f4368020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.278+0000 7f436f6bb640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40779f7d0 0x55d4077a1c90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 realm 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a27b0 con 0x55d40779f7d0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a3000 con 0x55d40779f7d0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a3360 con 0x55d40779f7d0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a2ca0 con 0x55d40779f7d0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 20 searching for the correct realm 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d4077a55b0 0x55d4077a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436eeba640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d4077a55b0 0x55d4077a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436eeba640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d4077a55b0 0x55d4077a79a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436eeba640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4364009040 0x7f43640e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f4364009040 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436febc640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4364009040 0x7f43640e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436febc640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4364009040 0x7f43640e3350 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f436800a4d0 con 0x7f4364009040 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436febc640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43680141d0 0x7f4368015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43680141d0 0x7f4368015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.282+0000 7f436f6bb640 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43680141d0 0x7f4368015940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f4364009040 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f436800a4d0 con 0x7f4364009040 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.286+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f4364009040 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f4364009040 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.290+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f4364009040 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d4077a55b0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f43680141d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x55d40779f7d0 2024-02-18T16:21:24.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8050 con 0x7f4364009040 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a4200 con 0x55d40779f7d0 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a3e80 con 0x55d40779f7d0 2024-02-18T16:21:24.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a4b50 con 0x55d40779f7d0 2024-02-18T16:21:24.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.294+0000 7f4371ba0980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 zone default found 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 4 Realm: () 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 zonegroup default 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a8930 con 0x7f43680141d0 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077aa310 con 0x55d4077a55b0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077aa670 con 0x55d4077a55b0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 started sync module instance, tier type = 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a98e0 con 0x7f4364009040 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94369146903696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a98e0 con 0x7f4364009040 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077ab0c0 con 0x55d40779f7d0 2024-02-18T16:21:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.298+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94369146903696] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94369146907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a98e0 con 0x55d40779f7d0 2024-02-18T16:21:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077aba80 con 0x55d4077a55b0 2024-02-18T16:21:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94369146907584] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94369146901568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077a9860 con 0x55d4077a55b0 2024-02-18T16:21:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077ac770 con 0x7f4364009040 2024-02-18T16:21:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94369146913760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077acec0 con 0x7f4364009040 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.302+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077ad990 con 0x55d40779f7d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94369146901568] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94369146913760] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94369146918000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077ad950 con 0x55d40779f7d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077aca90 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94369146918000] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94369146919248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077ae210 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.306+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077aea50 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.310+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.310+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94369146919248] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.310+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94369146920304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077aec30 con 0x7f43680141d0 2024-02-18T16:21:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.310+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077af430 con 0x7f43680141d0 2024-02-18T16:21:24.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94369146920304] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94369146924080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077af4f0 con 0x7f43680141d0 2024-02-18T16:21:24.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=0 2024-02-18T16:21:24.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=1 2024-02-18T16:21:24.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=2 2024-02-18T16:21:24.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=3 2024-02-18T16:21:24.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=4 2024-02-18T16:21:24.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=5 2024-02-18T16:21:24.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=6 2024-02-18T16:21:24.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94369146924080] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 add_watcher() i=7 2024-02-18T16:21:24.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:24.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077b2820 con 0x55d40779f7d0 2024-02-18T16:21:24.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94369146937888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077af660 con 0x55d40779f7d0 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94369146937888] v30'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.314+0000 7f4371ba0980 5 note: GC not initialized 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4224fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 20 Filter name: none 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f419e7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077d4330 con 0x55d40779f7d0 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:24.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077d4330 con 0x7f4364009040 2024-02-18T16:21:24.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94369146937888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077d42f0 con 0x55d40779f7d0 2024-02-18T16:21:24.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94369146937888] v30'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.318+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94369146903696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077d42f0 con 0x7f4364009040 2024-02-18T16:21:24.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94369146903696] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 20 remove_watcher() i=0 2024-02-18T16:21:24.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 2 removed watcher, disabling cache 2024-02-18T16:21:24.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94369146907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077d42f0 con 0x55d40779f7d0 2024-02-18T16:21:24.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94369146907584] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 20 remove_watcher() i=1 2024-02-18T16:21:24.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94369146901568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077d42f0 con 0x55d4077a55b0 2024-02-18T16:21:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f436eeba640 1 -- 172.21.15.129:0/2075766599 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94369146901568] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43640b0020 con 0x55d4077a55b0 2024-02-18T16:21:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 20 remove_watcher() i=2 2024-02-18T16:21:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.322+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94369146913760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077b1c70 con 0x7f4364009040 2024-02-18T16:21:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.326+0000 7f436febc640 1 -- 172.21.15.129:0/2075766599 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94369146913760] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f436803a040 con 0x7f4364009040 2024-02-18T16:21:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.326+0000 7f4371ba0980 20 remove_watcher() i=3 2024-02-18T16:21:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.326+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94369146918000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077b1c70 con 0x55d40779f7d0 2024-02-18T16:21:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.326+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94369146918000] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x55d40779f7d0 2024-02-18T16:21:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.326+0000 7f4371ba0980 20 remove_watcher() i=4 2024-02-18T16:21:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.326+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94369146919248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077b1c70 con 0x7f43680141d0 2024-02-18T16:21:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.330+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94369146919248] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.330+0000 7f4371ba0980 20 remove_watcher() i=5 2024-02-18T16:21:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.330+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94369146920304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077b1c70 con 0x7f43680141d0 2024-02-18T16:21:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.330+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94369146920304] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.330+0000 7f4371ba0980 20 remove_watcher() i=6 2024-02-18T16:21:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.330+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94369146924080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d4077b1c70 con 0x7f43680141d0 2024-02-18T16:21:24.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94369146924080] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4360016070 con 0x7f43680141d0 2024-02-18T16:21:24.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 20 remove_watcher() i=7 2024-02-18T16:21:24.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43680141d0 msgr2=0x7f4368015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43680141d0 0x7f4368015940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40779f7d0 msgr2=0x55d4077a1c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40779f7d0 0x55d4077a1c90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4364009040 msgr2=0x7f43640e3350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4364009040 0x7f43640e3350 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d4077a55b0 msgr2=0x55d4077a79a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d4077a55b0 0x55d4077a79a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4238034210 msgr2=0x7f42380366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4238034210 0x7f42380366d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4368011010 tx=0x7f4368020000 comp rx=0 tx=0).stop 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 msgr2=0x55d407794550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f436f6bb640 1 -- 172.21.15.129:0/2075766599 reap_dead start 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d407794550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f43640bd960 tx=0x7f43640e4b90 comp rx=0 tx=0).stop 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 shutdown_connections 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/2075766599 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d40778d620 0x55d407794550 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 >> 172.21.15.129:0/2075766599 conn(0x55d4077899b0 msgr2=0x55d407787010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 shutdown_connections 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/2075766599 wait complete. 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42480342b0 msgr2=0x7f4248036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42480342b0 0x7f4248036770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55d407770ba0 tx=0x7f4368005850 comp rx=0 tx=0).stop 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 msgr2=0x55d407780a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 0x55d407780a60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43640ac040 tx=0x7f43640180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 shutdown_connections 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42480342b0 0x7f4248036770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/1117447704 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407780640 0x55d407780a60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 >> 172.21.15.129:0/1117447704 conn(0x55d407775450 msgr2=0x55d407775f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 shutdown_connections 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/1117447704 wait complete. 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40767a640 msgr2=0x55d40776fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40767a640 0x55d40776fd80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42540342b0 msgr2=0x7f4254036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42540342b0 0x7f4254036770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43640ae000 tx=0x7f43640a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 msgr2=0x55d4077690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d4077690a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55d407760ec0 tx=0x7f4360000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 shutdown_connections 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d40767a640 0x55d40776fd80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42540342b0 0x7f4254036770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 --2- 172.21.15.129:0/917566228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d407676130 0x55d4077690a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 >> 172.21.15.129:0/917566228 conn(0x55d407671a00 msgr2=0x55d40775a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 shutdown_connections 2024-02-18T16:21:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.334+0000 7f4371ba0980 1 -- 172.21.15.129:0/917566228 wait complete. 2024-02-18T16:21:24.349 INFO:teuthology.orchestra.run.smithi129.stdout:[] 2024-02-18T16:21:24.349 DEBUG:tasks.util.rgw: json result: [] 2024-02-18T16:21:24.475 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:24.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-18T16:21:24.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-18T16:21:24.476 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-18T16:21:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.506+0000 7fa3c5d61980 1 Processor -- start 2024-02-18T16:21:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.506+0000 7fa3c5d61980 1 -- start start 2024-02-18T16:21:24.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.506+0000 7fa3c5d61980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55bae5273850 0x55bae5275c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.506+0000 7fa3c5d61980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bae51b94c0 con 0x55bae526f350 2024-02-18T16:21:24.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.506+0000 7fa3c5d61980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bae5180180 con 0x55bae5273850 2024-02-18T16:21:24.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c307b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55bae5273850 0x55bae5275c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c307b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55bae5273850 0x55bae5275c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48546/0 (socket says 172.21.15.129:48546) 2024-02-18T16:21:24.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c307b640 1 -- 172.21.15.129:0/2745178263 learned_addr learned my addr 172.21.15.129:0/2745178263 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c307b640 1 -- 172.21.15.129:0/2745178263 >> v1:172.21.15.80:6789/0 conn(0x55bae526f350 legacy=0x55bae526f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c307b640 1 -- 172.21.15.129:0/2745178263 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bae5277190 con 0x55bae5273850 2024-02-18T16:21:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c307b640 1 --2- 172.21.15.129:0/2745178263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae5275c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800a5c0 tx=0x7fa3b801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71aff45e66eabbad server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c287a640 1 -- 172.21.15.129:0/2745178263 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80aa470 con 0x55bae5273850 2024-02-18T16:21:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c287a640 1 -- 172.21.15.129:0/2745178263 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b80aa5d0 con 0x55bae5273850 2024-02-18T16:21:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.510+0000 7fa3c287a640 1 -- 172.21.15.129:0/2745178263 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80aa890 con 0x55bae5273850 2024-02-18T16:21:24.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 -- 172.21.15.129:0/2745178263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 msgr2=0x55bae5275c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/2745178263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae5275c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800a5c0 tx=0x7fa3b801b340 comp rx=0 tx=0).stop 2024-02-18T16:21:24.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 -- 172.21.15.129:0/2745178263 shutdown_connections 2024-02-18T16:21:24.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/2745178263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae5275c40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 -- 172.21.15.129:0/2745178263 >> 172.21.15.129:0/2745178263 conn(0x55bae51e2a40 msgr2=0x55bae51e2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 -- 172.21.15.129:0/2745178263 shutdown_connections 2024-02-18T16:21:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.514+0000 7fa3c5d61980 1 -- 172.21.15.129:0/2745178263 wait complete. 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c5d61980 1 Processor -- start 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c5d61980 1 -- start start 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c5d61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 0x55bae5359250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c5d61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bae517d6b0 con 0x55bae526f350 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c387c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 0x55bae5359250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c387c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 0x55bae5359250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48548/0 (socket says 172.21.15.129:48548) 2024-02-18T16:21:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c387c640 1 -- 172.21.15.129:0/683849318 learned_addr learned my addr 172.21.15.129:0/683849318 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.526+0000 7fa3c387c640 1 -- 172.21.15.129:0/683849318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8005df0 con 0x55bae526f350 2024-02-18T16:21:24.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c387c640 1 --2- 172.21.15.129:0/683849318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 0x55bae5359250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc006fb0 tx=0x7fa3bc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c4d430637d4139 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa2b1e0b640 1 -- 172.21.15.129:0/683849318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc00f640 con 0x55bae526f350 2024-02-18T16:21:24.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa2b1e0b640 1 -- 172.21.15.129:0/683849318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00f7c0 con 0x55bae526f350 2024-02-18T16:21:24.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa2b1e0b640 1 -- 172.21.15.129:0/683849318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc00fae0 con 0x55bae526f350 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/683849318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 msgr2=0x55bae5359250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/683849318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 0x55bae5359250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc006fb0 tx=0x7fa3bc001940 comp rx=0 tx=0).stop 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/683849318 shutdown_connections 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/683849318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae526f350 0x55bae5359250 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc006fb0 tx=0x7fa3bc001940 comp rx=0 tx=0).stop 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/683849318 >> 172.21.15.129:0/683849318 conn(0x55bae51e2a40 msgr2=0x55bae5354de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/683849318 shutdown_connections 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/683849318 wait complete. 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 Processor -- start 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- start start 2024-02-18T16:21:24.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae53603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bae5178e90 con 0x55bae5273850 2024-02-18T16:21:24.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c387c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae53603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c387c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae53603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48562/0 (socket says 172.21.15.129:48562) 2024-02-18T16:21:24.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c387c640 1 -- 172.21.15.129:0/1560386969 learned_addr learned my addr 172.21.15.129:0/1560386969 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c387c640 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bae51b94c0 con 0x55bae5273850 2024-02-18T16:21:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c387c640 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae53603d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc003000 tx=0x7fa3bc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa2abfff640 1 -- 172.21.15.129:0/1560386969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc005450 con 0x55bae5273850 2024-02-18T16:21:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bae5360910 con 0x55bae5273850 2024-02-18T16:21:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bae5360d60 con 0x55bae5273850 2024-02-18T16:21:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa2abfff640 1 -- 172.21.15.129:0/1560386969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0055b0 con 0x55bae5273850 2024-02-18T16:21:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.530+0000 7fa2abfff640 1 -- 172.21.15.129:0/1560386969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc005890 con 0x55bae5273850 2024-02-18T16:21:24.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa2abfff640 1 -- 172.21.15.129:0/1560386969 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa3bc0059f0 con 0x55bae5273850 2024-02-18T16:21:24.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa2abfff640 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa2ac034300 0x7fa2ac0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa2abfff640 1 -- 172.21.15.129:0/1560386969 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa3bc048d00 con 0x55bae5273850 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa2ac034300 0x7fa2ac0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5364fb0 0x55bae53673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53678e0 con 0x55bae5364fb0 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5364fb0 0x55bae53673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa2ac034300 0x7fa2ac0367c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80ae000 tx=0x7fa3b80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5364fb0 0x55bae53673a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 -- 172.21.15.129:0/1560386969 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3b40083f0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae5367cc0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 -- 172.21.15.129:0/1560386969 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa3b40083f0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae5369570 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 -- 172.21.15.129:0/1560386969 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa3b40083f0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53686b0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 -- 172.21.15.129:0/1560386969 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa3b40083f0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae5368ac0 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c407d640 1 -- 172.21.15.129:0/1560386969 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa3b4012040 con 0x55bae5364fb0 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.534+0000 7fa3c5d61980 1 Processor -- start 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 -- start start 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 0x55bae5377ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bae5111f20 con 0x55bae5377bd0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c307b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 0x55bae5377ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c307b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 0x55bae5377ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48566/0 (socket says 172.21.15.129:48566) 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c307b640 1 -- 172.21.15.129:0/1989738939 learned_addr learned my addr 172.21.15.129:0/1989738939 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c307b640 1 -- 172.21.15.129:0/1989738939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bae5378530 con 0x55bae5377bd0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 0x55bae5377ff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80ac040 tx=0x7fa3b80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa2a97fa640 1 -- 172.21.15.129:0/1989738939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80b3cd0 con 0x55bae5377bd0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa2a97fa640 1 -- 172.21.15.129:0/1989738939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b80c3070 con 0x55bae5377bd0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bae5378720 con 0x55bae5377bd0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa2a97fa640 1 -- 172.21.15.129:0/1989738939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80c8430 con 0x55bae5377bd0 2024-02-18T16:21:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bae5379210 con 0x55bae5377bd0 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa2a97fa640 1 -- 172.21.15.129:0/1989738939 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa3b80c5030 con 0x55bae5377bd0 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa2a97fa640 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa29c0342b0 0x7fa29c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa2a97fa640 1 -- 172.21.15.129:0/1989738939 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa3b80e67d0 con 0x55bae5377bd0 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa29c0342b0 0x7fa29c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 Processor -- start 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 -- start start 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa29c0342b0 0x7fa29c036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55bae5368a10 tx=0x7fa3b4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae5384fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.538+0000 7fa3c5d61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bae5105790 con 0x55bae5384b90 2024-02-18T16:21:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae5384fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae5384fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48578/0 (socket says 172.21.15.129:48578) 2024-02-18T16:21:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 -- 172.21.15.129:0/1808205029 learned_addr learned my addr 172.21.15.129:0/1808205029 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 -- 172.21.15.129:0/1808205029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bae5385580 con 0x55bae5384b90 2024-02-18T16:21:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1808205029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae5384fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80befd0 tx=0x7fa3b80bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36821ee9d76f68da server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa2a2ffd640 1 -- 172.21.15.129:0/1808205029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80d6040 con 0x55bae5384b90 2024-02-18T16:21:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa2a2ffd640 1 -- 172.21.15.129:0/1808205029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b80c7c50 con 0x55bae5384b90 2024-02-18T16:21:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa2a2ffd640 1 -- 172.21.15.129:0/1808205029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80c7590 con 0x55bae5384b90 2024-02-18T16:21:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1808205029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 msgr2=0x55bae5384fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1808205029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae5384fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80befd0 tx=0x7fa3b80bd450 comp rx=0 tx=0).stop 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1808205029 shutdown_connections 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1808205029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae5384fb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1808205029 >> 172.21.15.129:0/1808205029 conn(0x55bae5380f20 msgr2=0x55bae537ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1808205029 shutdown_connections 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1808205029 wait complete. 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 Processor -- start 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- start start 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae538ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bae538bfc0 con 0x55bae5384b90 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae538ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae538ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48592/0 (socket says 172.21.15.129:48592) 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 learned_addr learned my addr 172.21.15.129:0/1821278981 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bae5379210 con 0x55bae5384b90 2024-02-18T16:21:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae538ba80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80de040 tx=0x7fa3b80e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa2a17fa640 1 -- 172.21.15.129:0/1821278981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80e6e70 con 0x55bae5384b90 2024-02-18T16:21:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bae538c1c0 con 0x55bae5384b90 2024-02-18T16:21:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa2a17fa640 1 -- 172.21.15.129:0/1821278981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b80ea070 con 0x55bae5384b90 2024-02-18T16:21:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa2a17fa640 1 -- 172.21.15.129:0/1821278981 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3b80bdb20 con 0x55bae5384b90 2024-02-18T16:21:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.542+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bae538c650 con 0x55bae5384b90 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa2a17fa640 1 -- 172.21.15.129:0/1821278981 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa3b80e2050 con 0x55bae5384b90 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa2a17fa640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa28c0342b0 0x7fa28c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa2a17fa640 1 -- 172.21.15.129:0/1821278981 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa3b80ec070 con 0x55bae5384b90 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa28c0342b0 0x7fa28c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5396d70 0x55bae5399210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae5399960 con 0x55bae5396d70 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5396d70 0x55bae5399210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa28c0342b0 0x7fa28c036770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4008fd0 tx=0x7fa3b401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5396d70 0x55bae5399210 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 realm 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae5399d30 con 0x55bae5396d70 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539a580 con 0x55bae5396d70 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539a8e0 con 0x55bae5396d70 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539a220 con 0x55bae5396d70 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 20 searching for the correct realm 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bae539cb30 0x55bae539ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bae539cb30 0x55bae539ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bae539cb30 0x55bae539ef20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c307b640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa3b80db070 0x7fa3b80e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.546+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b80db070 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa3b80db070 0x7fa3b80e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa3b80db070 0x7fa3b80e01e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b402c040 con 0x7fa3b80db070 2024-02-18T16:21:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c407d640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa3b4027940 0x7fa3b40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa3b4027940 0x7fa3b40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa3b4027940 0x7fa3b40333c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.550+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b80db070 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b402c040 con 0x7fa3b80db070 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b80db070 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa3b402c040 con 0x7fa3b80db070 2024-02-18T16:21:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.554+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b80db070 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b402c040 con 0x7fa3b80db070 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x55bae5396d70 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc023070 con 0x7fa3b4027940 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b80db070 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b402c040 con 0x7fa3b80db070 2024-02-18T16:21:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae539cb30 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.558+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b4027940 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x55bae5396d70 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539f5f0 con 0x7fa3b80db070 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3b402c040 con 0x7fa3b80db070 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539b750 con 0x55bae5396d70 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539b3d0 con 0x55bae5396d70 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539c020 con 0x55bae5396d70 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 zone default found 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 4 Realm: () 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 zonegroup default 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae539fa30 con 0x7fa3b4027940 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a1440 con 0x55bae539cb30 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a18a0 con 0x55bae539cb30 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 started sync module instance, tier type = 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a0cf0 con 0x7fa3b80db070 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94261198063696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a10a0 con 0x7fa3b80db070 2024-02-18T16:21:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.562+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a2600 con 0x55bae5396d70 2024-02-18T16:21:24.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.566+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94261198063696] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.566+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.566+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94261198068928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a25c0 con 0x55bae5396d70 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.566+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a3060 con 0x55bae539cb30 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.566+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94261198068928] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94261198072640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a3410 con 0x55bae539cb30 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a3d80 con 0x7fa3b80db070 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94261198076400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a44d0 con 0x7fa3b80db070 2024-02-18T16:21:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a4fa0 con 0x55bae5396d70 2024-02-18T16:21:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94261198076400] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94261198072640] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94261198069984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a4f60 con 0x55bae5396d70 2024-02-18T16:21:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.570+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a40a0 con 0x7fa3b4027940 2024-02-18T16:21:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.574+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94261198069984] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.574+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.574+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94261198081888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a5820 con 0x7fa3b4027940 2024-02-18T16:21:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.574+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a6060 con 0x7fa3b4027940 2024-02-18T16:21:24.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.574+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94261198081888] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.574+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94261198082944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a6240 con 0x7fa3b4027940 2024-02-18T16:21:24.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a6a40 con 0x7fa3b4027940 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94261198087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a6e80 con 0x7fa3b4027940 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=0 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=1 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=2 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=3 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=4 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=5 2024-02-18T16:21:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94261198082944] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.578+0000 7fa3c5d61980 20 add_watcher() i=6 2024-02-18T16:21:24.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94261198087200] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 add_watcher() i=7 2024-02-18T16:21:24.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:24.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a5840 con 0x55bae5396d70 2024-02-18T16:21:24.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94261198088480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a5800 con 0x55bae5396d70 2024-02-18T16:21:24.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94261198088480] v30'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa279fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 5 note: GC not initialized 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa278fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 Filter name: none 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa1f27fc640 20 reqs_thread_entry: start 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53cb970 con 0x55bae5396d70 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53cb970 con 0x7fa3b80db070 2024-02-18T16:21:24.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa279fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.582+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94261198088480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53ac040 con 0x55bae5396d70 2024-02-18T16:21:24.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94261198088480] v30'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94261198063696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a68e0 con 0x7fa3b80db070 2024-02-18T16:21:24.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94261198063696] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c5d61980 20 remove_watcher() i=0 2024-02-18T16:21:24.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c5d61980 2 removed watcher, disabling cache 2024-02-18T16:21:24.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94261198068928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a0850 con 0x55bae5396d70 2024-02-18T16:21:24.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94261198068928] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c5d61980 20 remove_watcher() i=1 2024-02-18T16:21:24.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.586+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94261198072640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a0850 con 0x55bae539cb30 2024-02-18T16:21:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.590+0000 7fa3c307b640 1 -- 172.21.15.129:0/1821278981 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94261198072640] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b8103040 con 0x55bae539cb30 2024-02-18T16:21:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.590+0000 7fa3c5d61980 20 remove_watcher() i=2 2024-02-18T16:21:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.590+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94261198076400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a2b40 con 0x7fa3b80db070 2024-02-18T16:21:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.590+0000 7fa3c407d640 1 -- 172.21.15.129:0/1821278981 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94261198076400] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3b403f040 con 0x7fa3b80db070 2024-02-18T16:21:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.590+0000 7fa3c5d61980 20 remove_watcher() i=3 2024-02-18T16:21:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.590+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94261198069984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a39f0 con 0x55bae5396d70 2024-02-18T16:21:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.594+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94261198069984] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x55bae5396d70 2024-02-18T16:21:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.594+0000 7fa3c5d61980 20 remove_watcher() i=4 2024-02-18T16:21:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.594+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94261198081888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a39f0 con 0x7fa3b4027940 2024-02-18T16:21:24.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.594+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94261198081888] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.594+0000 7fa3c5d61980 20 remove_watcher() i=5 2024-02-18T16:21:24.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.594+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94261198082944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a4f60 con 0x7fa3b4027940 2024-02-18T16:21:24.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94261198082944] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 20 remove_watcher() i=6 2024-02-18T16:21:24.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94261198087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bae53a39f0 con 0x7fa3b4027940 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94261198087200] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3bc058040 con 0x7fa3b4027940 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 20 remove_watcher() i=7 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa3b4027940 msgr2=0x7fa3b40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa3b4027940 0x7fa3b40333c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5396d70 msgr2=0x55bae5399210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5396d70 0x55bae5399210 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa3b80db070 msgr2=0x7fa3b80e01e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa3b80db070 0x7fa3b80e01e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bae539cb30 msgr2=0x55bae539ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bae539cb30 0x55bae539ef20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa28c0342b0 msgr2=0x7fa28c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa28c0342b0 0x7fa28c036770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4008fd0 tx=0x7fa3b401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:24.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c387c640 1 -- 172.21.15.129:0/1821278981 reap_dead start 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 msgr2=0x55bae538ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae538ba80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80de040 tx=0x7fa3b80e4b90 comp rx=0 tx=0).stop 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 shutdown_connections 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1821278981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5384b90 0x55bae538ba80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 >> 172.21.15.129:0/1821278981 conn(0x55bae5380f20 msgr2=0x55bae537e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 shutdown_connections 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1821278981 wait complete. 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa29c0342b0 msgr2=0x7fa29c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa29c0342b0 0x7fa29c036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55bae5368a10 tx=0x7fa3b4003070 comp rx=0 tx=0).stop 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 msgr2=0x55bae5377ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 0x55bae5377ff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80ac040 tx=0x7fa3b80180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 shutdown_connections 2024-02-18T16:21:24.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa29c0342b0 0x7fa29c036770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1989738939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5377bd0 0x55bae5377ff0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 >> 172.21.15.129:0/1989738939 conn(0x55bae536c9e0 msgr2=0x55bae536d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 shutdown_connections 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.598+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1989738939 wait complete. 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5364fb0 msgr2=0x55bae53673a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5364fb0 0x55bae53673a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa2ac034300 msgr2=0x7fa2ac0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa2ac034300 0x7fa2ac0367c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80ae000 tx=0x7fa3b80a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 msgr2=0x55bae53603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae53603d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc003000 tx=0x7fa3bc000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:24.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 shutdown_connections 2024-02-18T16:21:24.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bae5364fb0 0x55bae53673a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa2ac034300 0x7fa2ac0367c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 --2- 172.21.15.129:0/1560386969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bae5273850 0x55bae53603d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 >> 172.21.15.129:0/1560386969 conn(0x55bae51e2a40 msgr2=0x55bae53538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 shutdown_connections 2024-02-18T16:21:24.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.602+0000 7fa3c5d61980 1 -- 172.21.15.129:0/1560386969 wait complete. 2024-02-18T16:21:24.615 INFO:teuthology.orchestra.run.smithi129.stdout:["myfoo"] 2024-02-18T16:21:24.615 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-18T16:21:24.706 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:24.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-18T16:21:24.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-18T16:21:24.707 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-18T16:21:24.740 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:24.741 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:24.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.734+0000 7f33c73a9980 1 Processor -- start 2024-02-18T16:21:24.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.734+0000 7f33c73a9980 1 -- start start 2024-02-18T16:21:24.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.734+0000 7f33c73a9980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55805da92340 0x55805da92720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.734+0000 7f33c73a9980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55805d9dc4b0 con 0x55805da92c60 2024-02-18T16:21:24.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.734+0000 7f33c73a9980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55805d9a3180 con 0x55805da92340 2024-02-18T16:21:24.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c4ec4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55805da92340 0x55805da92720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c46c3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55805da92c60 0x55805da93610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42826/0 (socket says 172.21.15.129:42826) 2024-02-18T16:21:24.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c4ec4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55805da92340 0x55805da92720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48598/0 (socket says 172.21.15.129:48598) 2024-02-18T16:21:24.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c46c3640 1 -- 172.21.15.129:0/1682191452 learned_addr learned my addr 172.21.15.129:0/1682191452 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:24.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1682191452 >> v1:172.21.15.80:6789/0 conn(0x55805da92c60 legacy=0x55805da93610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1682191452 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805da93e40 con 0x55805da92340 2024-02-18T16:21:24.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/1682191452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805da92720 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f33b400a480 tx=0x7f33b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0837fecf0b1ee6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c3ec2640 1 -- 172.21.15.129:0/1682191452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40ab540 con 0x55805da92340 2024-02-18T16:21:24.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c3ec2640 1 -- 172.21.15.129:0/1682191452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40ab6a0 con 0x55805da92340 2024-02-18T16:21:24.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.738+0000 7f33c3ec2640 1 -- 172.21.15.129:0/1682191452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40ab960 con 0x55805da92340 2024-02-18T16:21:24.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 -- 172.21.15.129:0/1682191452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 msgr2=0x55805da92720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1682191452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805da92720 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f33b400a480 tx=0x7f33b401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:24.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 -- 172.21.15.129:0/1682191452 shutdown_connections 2024-02-18T16:21:24.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1682191452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805da92720 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 -- 172.21.15.129:0/1682191452 >> 172.21.15.129:0/1682191452 conn(0x55805da05a30 msgr2=0x55805da05e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 -- 172.21.15.129:0/1682191452 shutdown_connections 2024-02-18T16:21:24.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.742+0000 7f33c73a9980 1 -- 172.21.15.129:0/1682191452 wait complete. 2024-02-18T16:21:24.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c73a9980 1 Processor -- start 2024-02-18T16:21:24.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c73a9980 1 -- start start 2024-02-18T16:21:24.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c73a9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db7c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c73a9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805d9a06b0 con 0x55805da92340 2024-02-18T16:21:24.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c4ec4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db7c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c4ec4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db7c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48610/0 (socket says 172.21.15.129:48610) 2024-02-18T16:21:24.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c4ec4640 1 -- 172.21.15.129:0/176316906 learned_addr learned my addr 172.21.15.129:0/176316906 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c4ec4640 1 -- 172.21.15.129:0/176316906 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4005d30 con 0x55805da92340 2024-02-18T16:21:24.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.754+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/176316906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db7c820 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ae040 tx=0x7f33b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9664bfd5074bd861 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f32b2e0d640 1 -- 172.21.15.129:0/176316906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40ab810 con 0x55805da92340 2024-02-18T16:21:24.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f32b2e0d640 1 -- 172.21.15.129:0/176316906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40ab970 con 0x55805da92340 2024-02-18T16:21:24.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f32b2e0d640 1 -- 172.21.15.129:0/176316906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40abc10 con 0x55805da92340 2024-02-18T16:21:24.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/176316906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 msgr2=0x55805db7c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 --2- 172.21.15.129:0/176316906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db7c820 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ae040 tx=0x7f33b4003030 comp rx=0 tx=0).stop 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/176316906 shutdown_connections 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 --2- 172.21.15.129:0/176316906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db7c820 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/176316906 >> 172.21.15.129:0/176316906 conn(0x55805da05a30 msgr2=0x55805db783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/176316906 shutdown_connections 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/176316906 wait complete. 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 Processor -- start 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- start start 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db834d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805d99be90 con 0x55805da92340 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c4ec4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c4ec4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db834d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48612/0 (socket says 172.21.15.129:48612) 2024-02-18T16:21:24.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1597066845 learned_addr learned my addr 172.21.15.129:0/1597066845 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805da93e40 con 0x55805da92340 2024-02-18T16:21:24.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db834d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33b401bb20 tx=0x7f33b4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f32b160a640 1 -- 172.21.15.129:0/1597066845 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40c2070 con 0x55805da92340 2024-02-18T16:21:24.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55805db83a10 con 0x55805da92340 2024-02-18T16:21:24.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f32b160a640 1 -- 172.21.15.129:0/1597066845 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40b59d0 con 0x55805da92340 2024-02-18T16:21:24.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55805db83ea0 con 0x55805da92340 2024-02-18T16:21:24.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.758+0000 7f32b160a640 1 -- 172.21.15.129:0/1597066845 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b40b5c70 con 0x55805da92340 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f32b160a640 1 -- 172.21.15.129:0/1597066845 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f33b40b2070 con 0x55805da92340 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f32b160a640 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f32ac0342b0 0x7f32ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f32b160a640 1 -- 172.21.15.129:0/1597066845 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f33b40e3450 con 0x55805da92340 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805da92c60 0x55805db8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f32ac0342b0 0x7f32ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805db8a640 con 0x55805da92c60 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805da92c60 0x55805db8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805da92c60 0x55805db8a100 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f32ac0342b0 0x7f32ac036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f33b8000f70 tx=0x7f33b80012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 -- 172.21.15.129:0/1597066845 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f33bc00a4d0 con 0x55805da92c60 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805db877e0 con 0x55805da92c60 2024-02-18T16:21:24.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 -- 172.21.15.129:0/1597066845 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f33bc00a4d0 con 0x55805da92c60 2024-02-18T16:21:24.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805db8c020 con 0x55805da92c60 2024-02-18T16:21:24.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 -- 172.21.15.129:0/1597066845 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f33bc00a4d0 con 0x55805da92c60 2024-02-18T16:21:24.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805db8ae80 con 0x55805da92c60 2024-02-18T16:21:24.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 -- 172.21.15.129:0/1597066845 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f33bc00a4d0 con 0x55805da92c60 2024-02-18T16:21:24.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805db8b290 con 0x55805da92c60 2024-02-18T16:21:24.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c56c5640 1 -- 172.21.15.129:0/1597066845 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f33bc00a4d0 con 0x55805da92c60 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 Processor -- start 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- start start 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 0x55805db9ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c73a9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805d934f20 con 0x55805db9a960 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c46c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 0x55805db9ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c46c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 0x55805db9ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48628/0 (socket says 172.21.15.129:48628) 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.762+0000 7f33c46c3640 1 -- 172.21.15.129:0/917355561 learned_addr learned my addr 172.21.15.129:0/917355561 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c46c3640 1 -- 172.21.15.129:0/917355561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805db9b2c0 con 0x55805db9a960 2024-02-18T16:21:24.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c46c3640 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 0x55805db9ad80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f33b8001ee0 tx=0x7f33b800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f32aa7fc640 1 -- 172.21.15.129:0/917355561 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b8020070 con 0x55805db9a960 2024-02-18T16:21:24.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f32aa7fc640 1 -- 172.21.15.129:0/917355561 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800c770 con 0x55805db9a960 2024-02-18T16:21:24.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55805db9b510 con 0x55805db9a960 2024-02-18T16:21:24.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f32aa7fc640 1 -- 172.21.15.129:0/917355561 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b8013040 con 0x55805db9a960 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55805db9c060 con 0x55805db9a960 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f32aa7fc640 1 -- 172.21.15.129:0/917355561 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f33b800a040 con 0x55805db9a960 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f32aa7fc640 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f329c034300 0x7f329c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f32aa7fc640 1 -- 172.21.15.129:0/917355561 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f33b804b770 con 0x55805db9a960 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c56c5640 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f329c034300 0x7f329c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c73a9980 1 Processor -- start 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c56c5640 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f329c034300 0x7f329c0367c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55805db8ba30 tx=0x7f33bc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c73a9980 1 -- start start 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c73a9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dba7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c73a9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805d928790 con 0x55805dba7930 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c46c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dba7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c46c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dba7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48634/0 (socket says 172.21.15.129:48634) 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c46c3640 1 -- 172.21.15.129:0/1510064388 learned_addr learned my addr 172.21.15.129:0/1510064388 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.766+0000 7f33c46c3640 1 -- 172.21.15.129:0/1510064388 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805dba8320 con 0x55805dba7930 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1510064388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dba7d50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f33b8049ad0 tx=0x7f33b8019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630b5b2070eb6516 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f329bfff640 1 -- 172.21.15.129:0/1510064388 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b8048070 con 0x55805dba7930 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f329bfff640 1 -- 172.21.15.129:0/1510064388 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b803a2e0 con 0x55805dba7930 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f329bfff640 1 -- 172.21.15.129:0/1510064388 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b801b7a0 con 0x55805dba7930 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1510064388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 msgr2=0x55805dba7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1510064388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dba7d50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f33b8049ad0 tx=0x7f33b8019a70 comp rx=0 tx=0).stop 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1510064388 shutdown_connections 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1510064388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dba7d50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1510064388 >> 172.21.15.129:0/1510064388 conn(0x55805dba3cc0 msgr2=0x55805dba1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1510064388 shutdown_connections 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1510064388 wait complete. 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 Processor -- start 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- start start 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dbae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805dbaede0 con 0x55805dba7930 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c46c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dbae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c46c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dbae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48642/0 (socket says 172.21.15.129:48642) 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 learned_addr learned my addr 172.21.15.129:0/1924904996 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55805db9c060 con 0x55805dba7930 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dbae8a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f33b8049e40 tx=0x7f33b8049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f329a7fc640 1 -- 172.21.15.129:0/1924904996 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b800ca50 con 0x55805dba7930 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55805dbaefe0 con 0x55805dba7930 2024-02-18T16:21:24.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f329a7fc640 1 -- 172.21.15.129:0/1924904996 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800cbb0 con 0x55805dba7930 2024-02-18T16:21:24.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55805dbaf410 con 0x55805dba7930 2024-02-18T16:21:24.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.770+0000 7f329a7fc640 1 -- 172.21.15.129:0/1924904996 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33b800ce50 con 0x55805dba7930 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f329a7fc640 1 -- 172.21.15.129:0/1924904996 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f33b8042050 con 0x55805dba7930 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f329a7fc640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3290034260 0x7f3290036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f329a7fc640 1 -- 172.21.15.129:0/1924904996 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f33b8038c60 con 0x55805dba7930 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3290034260 0x7f3290036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805dbb9d90 0x55805dbbc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbc980 con 0x55805dbb9d90 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805dbb9d90 0x55805dbbc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3290034260 0x7f3290036720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33bc011010 tx=0x7f33bc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805dbb9d90 0x55805dbbc230 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 realm 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbcd50 con 0x55805dbb9d90 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbd5a0 con 0x55805dbb9d90 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbd900 con 0x55805dbb9d90 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbd200 con 0x55805dbb9d90 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 20 searching for the correct realm 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55805dbbfc80 0x55805dbc2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55805dbbfc80 0x55805dbc2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55805dbbfc80 0x55805dbc2070 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c46c3640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f33b8037020 0x7f33b801d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f33b8037020 0x7f33b801d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.774+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f33b8037020 0x7f33b801d0d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc00a4d0 con 0x7f33b8037020 2024-02-18T16:21:24.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c56c5640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f33bc0141d0 0x7f33bc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:24.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f33bc0141d0 0x7f33bc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:24.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f33bc0141d0 0x7f33bc015940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:24.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x7f33bc0141d0 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x7f33bc0141d0 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x7f33bc0141d0 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc00a4d0 con 0x7f33b8037020 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.778+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x7f33bc0141d0 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x7f33bc0141d0 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f33b40bd4a0 con 0x55805dbb9d90 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.782+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.786+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:24.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbe760 con 0x55805dbb9d90 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbe3e0 con 0x55805dbb9d90 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbf0b0 con 0x55805dbb9d90 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 zone default found 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 4 Realm: () 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 zonegroup default 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2ee0 con 0x7f33bc0141d0 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc48c0 con 0x55805dbbfc80 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc4c20 con 0x55805dbbfc80 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 started sync module instance, tier type = 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.790+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc3e90 con 0x7f33b8037020 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009816793664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc3e90 con 0x7f33b8037020 2024-02-18T16:21:24.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc56b0 con 0x55805dbb9d90 2024-02-18T16:21:24.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009816793664] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009816797616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc3e90 con 0x55805dbb9d90 2024-02-18T16:21:24.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.794+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc60a0 con 0x55805dbbfc80 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009816797616] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009816791536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc3e10 con 0x55805dbbfc80 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc6d90 con 0x7f33b8037020 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009816803840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc75e0 con 0x7f33b8037020 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc7fe0 con 0x55805dbb9d90 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009816791536] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009816803840] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009816808160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc7140 con 0x55805dbb9d90 2024-02-18T16:21:24.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.798+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc8830 con 0x7f33bc0141d0 2024-02-18T16:21:24.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009816808160] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009816802384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc7140 con 0x7f33bc0141d0 2024-02-18T16:21:24.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc8d20 con 0x7f33bc0141d0 2024-02-18T16:21:24.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009816811520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc8ce0 con 0x7f33bc0141d0 2024-02-18T16:21:24.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.802+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc9ca0 con 0x7f33bc0141d0 2024-02-18T16:21:24.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009816802384] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009816815552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc9ca0 con 0x7f33bc0141d0 2024-02-18T16:21:24.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=0 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=1 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=2 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=3 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=4 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=5 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009816811520] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=6 2024-02-18T16:21:24.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009816815552] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 20 add_watcher() i=7 2024-02-18T16:21:24.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:24.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc90d0 con 0x55805dbb9d90 2024-02-18T16:21:24.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.806+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009816809920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc90d0 con 0x55805dbb9d90 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009816809920] v30'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f327afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c73a9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c73a9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c73a9980 5 note: GC not initialized 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f3279fe3640 20 reqs_thread_entry: start 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c73a9980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c73a9980 20 Filter name: none 2024-02-18T16:21:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f31eb7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbee280 con 0x55805dbbfc80 2024-02-18T16:21:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbee280 con 0x55805dbbfc80 2024-02-18T16:21:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbee280 con 0x55805dbb9d90 2024-02-18T16:21:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbe3e0 con 0x55805dbb9d90 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbe3e0 con 0x7f33b8037020 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.810+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.814+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.818+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33bc0141d0 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbb9d90 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x55805dbbfc80 2024-02-18T16:21:24.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc2600 con 0x7f33b8037020 2024-02-18T16:21:24.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c73a9980 20 RGWRados::pool_iterate: got myfoo 2024-02-18T16:21:24.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c73a9980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:24.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f327afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:24.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009816809920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbbe3e0 con 0x55805dbb9d90 2024-02-18T16:21:24.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94009816809920] v30'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.822+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009816793664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc81c0 con 0x7f33b8037020 2024-02-18T16:21:24.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94009816793664] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c73a9980 20 remove_watcher() i=0 2024-02-18T16:21:24.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c73a9980 2 removed watcher, disabling cache 2024-02-18T16:21:24.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009816797616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc4240 con 0x55805dbb9d90 2024-02-18T16:21:24.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94009816797616] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c73a9980 20 remove_watcher() i=1 2024-02-18T16:21:24.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.826+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009816791536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc4240 con 0x55805dbbfc80 2024-02-18T16:21:24.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c46c3640 1 -- 172.21.15.129:0/1924904996 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94009816791536] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b8034070 con 0x55805dbbfc80 2024-02-18T16:21:24.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c73a9980 20 remove_watcher() i=2 2024-02-18T16:21:24.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009816803840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc39f0 con 0x7f33b8037020 2024-02-18T16:21:24.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c56c5640 1 -- 172.21.15.129:0/1924904996 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94009816803840] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33bc03a040 con 0x7f33b8037020 2024-02-18T16:21:24.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c73a9980 20 remove_watcher() i=3 2024-02-18T16:21:24.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009816808160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc39f0 con 0x55805dbb9d90 2024-02-18T16:21:24.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94009816808160] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x55805dbb9d90 2024-02-18T16:21:24.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c73a9980 20 remove_watcher() i=4 2024-02-18T16:21:24.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.830+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009816802384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc7ae0 con 0x7f33bc0141d0 2024-02-18T16:21:24.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.834+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94009816802384] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.834+0000 7f33c73a9980 20 remove_watcher() i=5 2024-02-18T16:21:24.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.834+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009816811520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc39f0 con 0x7f33bc0141d0 2024-02-18T16:21:24.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.834+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94009816811520] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.834+0000 7f33c73a9980 20 remove_watcher() i=6 2024-02-18T16:21:24.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.834+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009816815552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55805dbc39f0 con 0x7f33bc0141d0 2024-02-18T16:21:24.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94009816815552] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f33b40f3040 con 0x7f33bc0141d0 2024-02-18T16:21:24.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 20 remove_watcher() i=7 2024-02-18T16:21:24.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f33bc0141d0 msgr2=0x7f33bc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f33bc0141d0 0x7f33bc015940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805dbb9d90 msgr2=0x55805dbbc230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805dbb9d90 0x55805dbbc230 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f33b8037020 msgr2=0x7f33b801d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f33b8037020 0x7f33b801d0d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55805dbbfc80 msgr2=0x55805dbc2070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55805dbbfc80 0x55805dbc2070 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3290034260 msgr2=0x7f3290036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3290034260 0x7f3290036720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33bc011010 tx=0x7f33bc020000 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 msgr2=0x55805dbae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c4ec4640 1 -- 172.21.15.129:0/1924904996 reap_dead start 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dbae8a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f33b8049e40 tx=0x7f33b8049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 shutdown_connections 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1924904996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805dba7930 0x55805dbae8a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 >> 172.21.15.129:0/1924904996 conn(0x55805dba3cc0 msgr2=0x55805dba1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 shutdown_connections 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1924904996 wait complete. 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f329c034300 msgr2=0x7f329c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f329c034300 0x7f329c0367c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55805db8ba30 tx=0x7f33bc005850 comp rx=0 tx=0).stop 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 msgr2=0x55805db9ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 0x55805db9ad80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f33b8001ee0 tx=0x7f33b800da30 comp rx=0 tx=0).stop 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 shutdown_connections 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f329c034300 0x7f329c0367c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/917355561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805db9a960 0x55805db9ad80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 >> 172.21.15.129:0/917355561 conn(0x55805db8f770 msgr2=0x55805db90280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 shutdown_connections 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/917355561 wait complete. 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805da92c60 msgr2=0x55805db8a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805da92c60 0x55805db8a100 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f32ac0342b0 msgr2=0x7f32ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f32ac0342b0 0x7f32ac036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f33b8000f70 tx=0x7f33b80012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 msgr2=0x55805db834d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db834d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33b401bb20 tx=0x7f33b4018020 comp rx=0 tx=0).stop 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 shutdown_connections 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55805da92c60 0x55805db8a100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f32ac0342b0 0x7f32ac036770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 --2- 172.21.15.129:0/1597066845 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55805da92340 0x55805db834d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 >> 172.21.15.129:0/1597066845 conn(0x55805da05a30 msgr2=0x55805db76ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 shutdown_connections 2024-02-18T16:21:24.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:24.838+0000 7f33c73a9980 1 -- 172.21.15.129:0/1597066845 wait complete. 2024-02-18T16:21:24.853 INFO:teuthology.orchestra.run.smithi129.stdout:["myfoo"] 2024-02-18T16:21:24.853 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-18T16:21:24.865 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:24.880 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:24.894 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:24.936 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-02-18T16:21:25.007 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:25.081 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:25.158 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:25.158 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-18T16:21:25.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-18T16:21:25.158 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-18T16:21:25.197 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:25.197 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:25.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.190+0000 7f62e12ab980 1 Processor -- start 2024-02-18T16:21:25.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.190+0000 7f62e12ab980 1 -- start start 2024-02-18T16:21:25.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62e12ab980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d5e2651040 0x55d5e2651420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62e12ab980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d5e259e4c0 con 0x55d5e2651960 2024-02-18T16:21:25.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62e12ab980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d5e2565180 con 0x55d5e2651040 2024-02-18T16:21:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dedc6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d5e2651040 0x55d5e2651420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dedc6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d5e2651040 0x55d5e2651420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48654/0 (socket says 172.21.15.129:48654) 2024-02-18T16:21:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62de5c5640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55d5e2651960 0x55d5e2652320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42836/0 (socket says 172.21.15.129:42836) 2024-02-18T16:21:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dedc6640 1 -- 172.21.15.129:0/586397584 learned_addr learned my addr 172.21.15.129:0/586397584 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dedc6640 1 -- 172.21.15.129:0/586397584 >> v1:172.21.15.80:6789/0 conn(0x55d5e2651960 legacy=0x55d5e2652320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dedc6640 1 -- 172.21.15.129:0/586397584 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5e2652b50 con 0x55d5e2651040 2024-02-18T16:21:25.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dedc6640 1 --2- 172.21.15.129:0/586397584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2651420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f62d800a4e0 tx=0x7f62d801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3643e8ca6febf50 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dddc4640 1 -- 172.21.15.129:0/586397584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d80aa540 con 0x55d5e2651040 2024-02-18T16:21:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dddc4640 1 -- 172.21.15.129:0/586397584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80a6070 con 0x55d5e2651040 2024-02-18T16:21:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.194+0000 7f62dddc4640 1 -- 172.21.15.129:0/586397584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d80aa850 con 0x55d5e2651040 2024-02-18T16:21:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 -- 172.21.15.129:0/586397584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 msgr2=0x55d5e2651420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 --2- 172.21.15.129:0/586397584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2651420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f62d800a4e0 tx=0x7f62d801b090 comp rx=0 tx=0).stop 2024-02-18T16:21:25.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 -- 172.21.15.129:0/586397584 shutdown_connections 2024-02-18T16:21:25.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 --2- 172.21.15.129:0/586397584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2651420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 -- 172.21.15.129:0/586397584 >> 172.21.15.129:0/586397584 conn(0x55d5e264c910 msgr2=0x55d5e264ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 -- 172.21.15.129:0/586397584 shutdown_connections 2024-02-18T16:21:25.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.198+0000 7f62e12ab980 1 -- 172.21.15.129:0/586397584 wait complete. 2024-02-18T16:21:25.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.210+0000 7f62e12ab980 1 Processor -- start 2024-02-18T16:21:25.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.210+0000 7f62e12ab980 1 -- start start 2024-02-18T16:21:25.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e273c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e25626b0 con 0x55d5e2651040 2024-02-18T16:21:25.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e273c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e273c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48664/0 (socket says 172.21.15.129:48664) 2024-02-18T16:21:25.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 -- 172.21.15.129:0/3838231818 learned_addr learned my addr 172.21.15.129:0/3838231818 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 -- 172.21.15.129:0/3838231818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d800a1c0 con 0x55d5e2651040 2024-02-18T16:21:25.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 --2- 172.21.15.129:0/3838231818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e273c660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f62d8017ca0 tx=0x7f62d80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb4013c06ad22d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f61cce09640 1 -- 172.21.15.129:0/3838231818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d80aa780 con 0x55d5e2651040 2024-02-18T16:21:25.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f61cce09640 1 -- 172.21.15.129:0/3838231818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80aa8e0 con 0x55d5e2651040 2024-02-18T16:21:25.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f61cce09640 1 -- 172.21.15.129:0/3838231818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d80aab80 con 0x55d5e2651040 2024-02-18T16:21:25.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- 172.21.15.129:0/3838231818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 msgr2=0x55d5e273c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3838231818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e273c660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f62d8017ca0 tx=0x7f62d80033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- 172.21.15.129:0/3838231818 shutdown_connections 2024-02-18T16:21:25.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3838231818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e273c660 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- 172.21.15.129:0/3838231818 >> 172.21.15.129:0/3838231818 conn(0x55d5e264c910 msgr2=0x55d5e27381f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- 172.21.15.129:0/3838231818 shutdown_connections 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- 172.21.15.129:0/3838231818 wait complete. 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 Processor -- start 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- start start 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2743340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62e12ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e255de90 con 0x55d5e2651040 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2743340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2743340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48672/0 (socket says 172.21.15.129:48672) 2024-02-18T16:21:25.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.214+0000 7f62dedc6640 1 -- 172.21.15.129:0/198167513 learned_addr learned my addr 172.21.15.129:0/198167513 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62dedc6640 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5e2652b50 con 0x55d5e2651040 2024-02-18T16:21:25.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62dedc6640 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2743340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f62d801aec0 tx=0x7f62d8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f61cb606640 1 -- 172.21.15.129:0/198167513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d80c4070 con 0x55d5e2651040 2024-02-18T16:21:25.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5e2743880 con 0x55d5e2651040 2024-02-18T16:21:25.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f61cb606640 1 -- 172.21.15.129:0/198167513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80b5650 con 0x55d5e2651040 2024-02-18T16:21:25.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f61cb606640 1 -- 172.21.15.129:0/198167513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d80b5910 con 0x55d5e2651040 2024-02-18T16:21:25.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5e2743cb0 con 0x55d5e2651040 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f61cb606640 1 -- 172.21.15.129:0/198167513 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62d80a8070 con 0x55d5e2651040 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f61cb606640 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61c40342b0 0x7f61c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f61cb606640 1 -- 172.21.15.129:0/198167513 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f62d80e37a0 con 0x55d5e2651040 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62de5c5640 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61c40342b0 0x7f61c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2651960 0x55d5e2749fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e274a500 con 0x55d5e2651960 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62df5c7640 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2651960 0x55d5e2749fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62de5c5640 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61c40342b0 0x7f61c4036770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62d4000f70 tx=0x7f62d4001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62df5c7640 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2651960 0x55d5e2749fc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62df5c7640 1 -- 172.21.15.129:0/198167513 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62d00083f0 con 0x55d5e2651960 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.218+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e274a8c0 con 0x55d5e2651960 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62df5c7640 1 -- 172.21.15.129:0/198167513 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62d00083f0 con 0x55d5e2651960 2024-02-18T16:21:25.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e274c170 con 0x55d5e2651960 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62df5c7640 1 -- 172.21.15.129:0/198167513 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f62d00083f0 con 0x55d5e2651960 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e274b370 con 0x55d5e2651960 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62df5c7640 1 -- 172.21.15.129:0/198167513 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62d00083f0 con 0x55d5e2651960 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e274b780 con 0x55d5e2651960 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62df5c7640 1 -- 172.21.15.129:0/198167513 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f62d0012040 con 0x55d5e2651960 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 Processor -- start 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- start start 2024-02-18T16:21:25.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 0x55d5e275ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e24f6f20 con 0x55d5e275a830 2024-02-18T16:21:25.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62de5c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 0x55d5e275ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62de5c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 0x55d5e275ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48678/0 (socket says 172.21.15.129:48678) 2024-02-18T16:21:25.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62de5c5640 1 -- 172.21.15.129:0/3620838352 learned_addr learned my addr 172.21.15.129:0/3620838352 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62de5c5640 1 -- 172.21.15.129:0/3620838352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5e275b190 con 0x55d5e275a830 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62de5c5640 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 0x55d5e275ac50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62d4001ee0 tx=0x7f62d400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f61c8e01640 1 -- 172.21.15.129:0/3620838352 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d4007040 con 0x55d5e275a830 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f61c8e01640 1 -- 172.21.15.129:0/3620838352 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400d660 con 0x55d5e275a830 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5e275b3e0 con 0x55d5e275a830 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f61c8e01640 1 -- 172.21.15.129:0/3620838352 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d400d900 con 0x55d5e275a830 2024-02-18T16:21:25.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.222+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5e275bf30 con 0x55d5e275a830 2024-02-18T16:21:25.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f61c8e01640 1 -- 172.21.15.129:0/3620838352 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62d401a070 con 0x55d5e275a830 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f61c8e01640 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61b80342b0 0x7f61b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f61c8e01640 1 -- 172.21.15.129:0/3620838352 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f62d4017050 con 0x55d5e275a830 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62df5c7640 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61b80342b0 0x7f61b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 Processor -- start 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- start start 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e2767b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62df5c7640 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61b80342b0 0x7f61b8036770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55d5e274adb0 tx=0x7f62d0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e24ea790 con 0x55d5e27677b0 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62de5c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e2767b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62de5c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e2767b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48694/0 (socket says 172.21.15.129:48694) 2024-02-18T16:21:25.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62de5c5640 1 -- 172.21.15.129:0/3342927335 learned_addr learned my addr 172.21.15.129:0/3342927335 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62de5c5640 1 -- 172.21.15.129:0/3342927335 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5e2768160 con 0x55d5e27677b0 2024-02-18T16:21:25.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62de5c5640 1 --2- 172.21.15.129:0/3342927335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e2767b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62d4027030 tx=0x7f62d400df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51db272cce9d956 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f61c27fc640 1 -- 172.21.15.129:0/3342927335 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d4025520 con 0x55d5e27677b0 2024-02-18T16:21:25.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f61c27fc640 1 -- 172.21.15.129:0/3342927335 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4039440 con 0x55d5e27677b0 2024-02-18T16:21:25.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f61c27fc640 1 -- 172.21.15.129:0/3342927335 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d403ab10 con 0x55d5e27677b0 2024-02-18T16:21:25.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- 172.21.15.129:0/3342927335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 msgr2=0x55d5e2767b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3342927335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e2767b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62d4027030 tx=0x7f62d400df20 comp rx=0 tx=0).stop 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- 172.21.15.129:0/3342927335 shutdown_connections 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3342927335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e2767b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- 172.21.15.129:0/3342927335 >> 172.21.15.129:0/3342927335 conn(0x55d5e2763af0 msgr2=0x55d5e2761b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- 172.21.15.129:0/3342927335 shutdown_connections 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- 172.21.15.129:0/3342927335 wait complete. 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 Processor -- start 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.226+0000 7f62e12ab980 1 -- start start 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e276e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e276ebd0 con 0x55d5e27677b0 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62de5c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e276e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62de5c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e276e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48706/0 (socket says 172.21.15.129:48706) 2024-02-18T16:21:25.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 learned_addr learned my addr 172.21.15.129:0/2020721406 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5e275bf30 con 0x55d5e27677b0 2024-02-18T16:21:25.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62de5c5640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e276e690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62d400df60 tx=0x7f62d4048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f61c0ff9640 1 -- 172.21.15.129:0/2020721406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d401a610 con 0x55d5e27677b0 2024-02-18T16:21:25.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f61c0ff9640 1 -- 172.21.15.129:0/2020721406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d401a770 con 0x55d5e27677b0 2024-02-18T16:21:25.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5e276edd0 con 0x55d5e27677b0 2024-02-18T16:21:25.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f61c0ff9640 1 -- 172.21.15.129:0/2020721406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62d4024900 con 0x55d5e27677b0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5e276f200 con 0x55d5e27677b0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f61c0ff9640 1 -- 172.21.15.129:0/2020721406 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f62d4024c70 con 0x55d5e27677b0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f61c0ff9640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61a80342b0 0x7f61a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f61c0ff9640 1 -- 172.21.15.129:0/2020721406 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f62d402c2f0 con 0x55d5e27677b0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62df5c7640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61a80342b0 0x7f61a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2779ba0 0x55d5e277c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277c790 con 0x55d5e2779ba0 2024-02-18T16:21:25.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62dedc6640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2779ba0 0x55d5e277c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62df5c7640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61a80342b0 0x7f61a8036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62d0008fd0 tx=0x7f62d001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.230+0000 7f62dedc6640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2779ba0 0x55d5e277c040 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 realm 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277cb60 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277d3b0 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277d710 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277d050 con 0x55d5e2779ba0 2024-02-18T16:21:25.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 20 searching for the correct realm 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d5e277f960 0x55d5e2781d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62de5c5640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d5e277f960 0x55d5e2781d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62de5c5640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d5e277f960 0x55d5e2781d90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62de5c5640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f62d4027060 0x7f62d4013a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d4027060 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62df5c7640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f62d4027060 0x7f62d4013a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62df5c7640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f62d4027060 0x7f62d4013a70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d002c040 con 0x7f62d4027060 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62df5c7640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f62d0027940 0x7f62d00333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.234+0000 7f62dedc6640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f62d0027940 0x7f62d00333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f62d0027940 0x7f62d00333c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d4027060 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d002c040 con 0x7f62d4027060 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.238+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d4027060 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f62d002c040 con 0x7f62d4027060 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.242+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d4027060 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d002c040 con 0x7f62d4027060 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d4027060 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d002c040 con 0x7f62d4027060 2024-02-18T16:21:25.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e277f960 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.246+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d0027940 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x55d5e2779ba0 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2782460 con 0x7f62d4027060 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62d002c040 con 0x7f62d4027060 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:25.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277e580 con 0x55d5e2779ba0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277e200 con 0x55d5e2779ba0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e277ee50 con 0x55d5e2779ba0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 zone default found 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 4 Realm: () 2024-02-18T16:21:25.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:25.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:25.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:25.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 zonegroup default 2024-02-18T16:21:25.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27828a0 con 0x7f62d0027940 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2784280 con 0x55d5e277f960 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2784660 con 0x55d5e277f960 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 started sync module instance, tier type = 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.250+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2783b60 con 0x7f62d4027060 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94377115924160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2783f10 con 0x7f62d4027060 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27853c0 con 0x55d5e2779ba0 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94377115924160] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94377115929216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27853e0 con 0x55d5e2779ba0 2024-02-18T16:21:25.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.254+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2785e80 con 0x55d5e277f960 2024-02-18T16:21:25.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94377115929216] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94377115933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2786230 con 0x55d5e277f960 2024-02-18T16:21:25.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2786ba0 con 0x7f62d4027060 2024-02-18T16:21:25.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94377115936784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27872d0 con 0x7f62d4027060 2024-02-18T16:21:25.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2787da0 con 0x55d5e2779ba0 2024-02-18T16:21:25.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94377115933024] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.258+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94377115936784] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94377115940992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2787d60 con 0x55d5e2779ba0 2024-02-18T16:21:25.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2786ea0 con 0x7f62d0027940 2024-02-18T16:21:25.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94377115940992] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94377115930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27885a0 con 0x7f62d0027940 2024-02-18T16:21:25.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.262+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2788f10 con 0x7f62d0027940 2024-02-18T16:21:25.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94377115945584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2789330 con 0x7f62d0027940 2024-02-18T16:21:25.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2789d40 con 0x7f62d0027940 2024-02-18T16:21:25.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94377115930272] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94377115945584] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94377115943168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e2789a40 con 0x7f62d0027940 2024-02-18T16:21:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=0 2024-02-18T16:21:25.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=1 2024-02-18T16:21:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=2 2024-02-18T16:21:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=3 2024-02-18T16:21:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=4 2024-02-18T16:21:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=5 2024-02-18T16:21:25.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.266+0000 7f62e12ab980 20 add_watcher() i=6 2024-02-18T16:21:25.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94377115943168] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62e12ab980 20 add_watcher() i=7 2024-02-18T16:21:25.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62e12ab980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:25.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e278ce00 con 0x55d5e2779ba0 2024-02-18T16:21:25.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94377115949360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e278a1f0 con 0x55d5e2779ba0 2024-02-18T16:21:25.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.270+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94377115949360] v30'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f61957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 5 note: GC not initialized 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f610ffff640 20 reqs_thread_entry: start 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 Filter name: none 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f610dffb640 20 reqs_thread_entry: start 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27aec30 con 0x7f62d4027060 2024-02-18T16:21:25.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:25.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27af210 con 0x55d5e2779ba0 2024-02-18T16:21:25.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(63 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27ae270 con 0x7f62d4027060 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27b07b0 con 0x55d5e2779ba0 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 4.22 4:469ecc78:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27afdf0 con 0x55d5e2779ba0 2024-02-18T16:21:25.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 4.38 4:1dfd4e12:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27b52d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 4.28 4:176c8e0f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27b7af0 con 0x55d5e2779ba0 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 4.30 4:0cc5cfbd:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27ba350 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 4.27 4:e50fab02:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27bcb70 con 0x55d5e2779ba0 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 4.19 4:99dba4f1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27bf7e0 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27c23d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 4.14 4:2b33d095:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27c4f50 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:74 4.3b 4:df59ffdb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27c79b0 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 4.38 4:1d3e2d48:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27ca6c0 con 0x55d5e2779ba0 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:76 4.3b 4:dcfc03a1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27cd080 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.274+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(71 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(73 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(74 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(67 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(70 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(66 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(72 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(75 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(76 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62e12ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.10 6:0b01f3f3:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27b07f0 con 0x7f62d0027940 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(77 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62e12ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f61957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94377115949360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x55d5e2779ba0 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94377115949360] v30'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.278+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94377115924160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x7f62d4027060 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94377115924160] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62e12ab980 20 remove_watcher() i=0 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62e12ab980 2 removed watcher, disabling cache 2024-02-18T16:21:25.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94377115929216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x55d5e2779ba0 2024-02-18T16:21:25.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94377115929216] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62e12ab980 20 remove_watcher() i=1 2024-02-18T16:21:25.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.282+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94377115933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x55d5e277f960 2024-02-18T16:21:25.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.286+0000 7f62de5c5640 1 -- 172.21.15.129:0/2020721406 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94377115933024] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d4042900 con 0x55d5e277f960 2024-02-18T16:21:25.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.286+0000 7f62e12ab980 20 remove_watcher() i=2 2024-02-18T16:21:25.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.286+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94377115936784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x7f62d4027060 2024-02-18T16:21:25.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.286+0000 7f62df5c7640 1 -- 172.21.15.129:0/2020721406 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94377115936784] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d003f040 con 0x7f62d4027060 2024-02-18T16:21:25.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.286+0000 7f62e12ab980 20 remove_watcher() i=3 2024-02-18T16:21:25.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.286+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94377115940992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x55d5e2779ba0 2024-02-18T16:21:25.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.290+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94377115940992] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x55d5e2779ba0 2024-02-18T16:21:25.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.290+0000 7f62e12ab980 20 remove_watcher() i=4 2024-02-18T16:21:25.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.290+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94377115930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x7f62d0027940 2024-02-18T16:21:25.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.290+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94377115930272] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.290+0000 7f62e12ab980 20 remove_watcher() i=5 2024-02-18T16:21:25.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.290+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94377115945584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x7f62d0027940 2024-02-18T16:21:25.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94377115945584] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 20 remove_watcher() i=6 2024-02-18T16:21:25.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94377115943168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d5e27a0940 con 0x7f62d0027940 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94377115943168] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62d80b49d0 con 0x7f62d0027940 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 20 remove_watcher() i=7 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f62d0027940 msgr2=0x7f62d00333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f62d0027940 0x7f62d00333c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2779ba0 msgr2=0x55d5e277c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2779ba0 0x55d5e277c040 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f62d4027060 msgr2=0x7f62d4013a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f62d4027060 0x7f62d4013a70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d5e277f960 msgr2=0x55d5e2781d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d5e277f960 0x55d5e2781d90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61a80342b0 msgr2=0x7f61a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61a80342b0 0x7f61a8036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62d0008fd0 tx=0x7f62d001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 msgr2=0x55d5e276e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62dedc6640 1 -- 172.21.15.129:0/2020721406 reap_dead start 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e276e690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62d400df60 tx=0x7f62d4048b70 comp rx=0 tx=0).stop 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 shutdown_connections 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/2020721406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e27677b0 0x55d5e276e690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 >> 172.21.15.129:0/2020721406 conn(0x55d5e2763af0 msgr2=0x55d5e2761b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 shutdown_connections 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/2020721406 wait complete. 2024-02-18T16:21:25.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61b80342b0 msgr2=0x7f61b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61b80342b0 0x7f61b8036770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55d5e274adb0 tx=0x7f62d0003070 comp rx=0 tx=0).stop 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 msgr2=0x55d5e275ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 0x55d5e275ac50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62d4001ee0 tx=0x7f62d400ea10 comp rx=0 tx=0).stop 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 shutdown_connections 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61b80342b0 0x7f61b8036770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 --2- 172.21.15.129:0/3620838352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e275a830 0x55d5e275ac50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.294+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 >> 172.21.15.129:0/3620838352 conn(0x55d5e274f640 msgr2=0x55d5e2750150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 shutdown_connections 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/3620838352 wait complete. 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2651960 msgr2=0x55d5e2749fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2651960 0x55d5e2749fc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61c40342b0 msgr2=0x7f61c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61c40342b0 0x7f61c4036770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62d4000f70 tx=0x7f62d4001380 comp rx=0 tx=0).stop 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 msgr2=0x55d5e2743340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2743340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f62d801aec0 tx=0x7f62d8017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 shutdown_connections 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5e2651960 0x55d5e2749fc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61c40342b0 0x7f61c4036770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 --2- 172.21.15.129:0/198167513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d5e2651040 0x55d5e2743340 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 >> 172.21.15.129:0/198167513 conn(0x55d5e264c910 msgr2=0x55d5e2736d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 shutdown_connections 2024-02-18T16:21:25.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.298+0000 7f62e12ab980 1 -- 172.21.15.129:0/198167513 wait complete. 2024-02-18T16:21:25.313 INFO:teuthology.orchestra.run.smithi129.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"5cf777d6-7609-4766-9b82-6394139fd65a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","marker":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-18T16:21:24.458220Z","creation_time":"2024-02-18T16:21:24.450254Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-18T16:21:25.314 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '5cf777d6-7609-4766-9b82-6394139fd65a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'marker': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-18T16:21:24.458220Z', 'creation_time': '2024-02-18T16:21:24.450254Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-18T16:21:25.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-18T16:21:25.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-18T16:21:25.314 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-18T16:21:25.392 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:25.392 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:25.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a8459e980 1 Processor -- start 2024-02-18T16:21:25.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a8459e980 1 -- start start 2024-02-18T16:21:25.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a8459e980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e0d5daf350 0x55e0d5daf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a8459e980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e0d5cf94c0 con 0x55e0d5dafc70 2024-02-18T16:21:25.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a8459e980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e0d5cc0180 con 0x55e0d5daf350 2024-02-18T16:21:25.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a820b9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e0d5daf350 0x55e0d5daf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a820b9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e0d5daf350 0x55e0d5daf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48722/0 (socket says 172.21.15.129:48722) 2024-02-18T16:21:25.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a820b9640 1 -- 172.21.15.129:0/1717351494 learned_addr learned my addr 172.21.15.129:0/1717351494 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.386+0000 7f6a818b8640 1 --1- 172.21.15.129:0/1717351494 >> v1:172.21.15.80:6789/0 conn(0x55e0d5dafc70 0x55e0d5db0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42848/0 (socket says 172.21.15.129:42848) 2024-02-18T16:21:25.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a820b9640 1 -- 172.21.15.129:0/1717351494 >> v1:172.21.15.80:6789/0 conn(0x55e0d5dafc70 legacy=0x55e0d5db0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a820b9640 1 -- 172.21.15.129:0/1717351494 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d5db0e50 con 0x55e0d5daf350 2024-02-18T16:21:25.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a820b9640 1 --2- 172.21.15.129:0/1717351494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5daf730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400a5c0 tx=0x7f6a7401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b14934edb545f44 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a810b7640 1 -- 172.21.15.129:0/1717351494 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a740aa470 con 0x55e0d5daf350 2024-02-18T16:21:25.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a810b7640 1 -- 172.21.15.129:0/1717351494 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740aa5d0 con 0x55e0d5daf350 2024-02-18T16:21:25.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a810b7640 1 -- 172.21.15.129:0/1717351494 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a740aa890 con 0x55e0d5daf350 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a8459e980 1 -- 172.21.15.129:0/1717351494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 msgr2=0x55e0d5daf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.390+0000 7f6a8459e980 1 --2- 172.21.15.129:0/1717351494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5daf730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400a5c0 tx=0x7f6a7401b340 comp rx=0 tx=0).stop 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.394+0000 7f6a8459e980 1 -- 172.21.15.129:0/1717351494 shutdown_connections 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.394+0000 7f6a8459e980 1 --2- 172.21.15.129:0/1717351494 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5daf730 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.394+0000 7f6a8459e980 1 -- 172.21.15.129:0/1717351494 >> 172.21.15.129:0/1717351494 conn(0x55e0d5d22a40 msgr2=0x55e0d5d22e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.394+0000 7f6a8459e980 1 -- 172.21.15.129:0/1717351494 shutdown_connections 2024-02-18T16:21:25.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.394+0000 7f6a8459e980 1 -- 172.21.15.129:0/1717351494 wait complete. 2024-02-18T16:21:25.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a8459e980 1 Processor -- start 2024-02-18T16:21:25.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a8459e980 1 -- start start 2024-02-18T16:21:25.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a8459e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5e99830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a8459e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d5cbd6b0 con 0x55e0d5daf350 2024-02-18T16:21:25.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a820b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5e99830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a820b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5e99830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48728/0 (socket says 172.21.15.129:48728) 2024-02-18T16:21:25.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.406+0000 7f6a820b9640 1 -- 172.21.15.129:0/3606002374 learned_addr learned my addr 172.21.15.129:0/3606002374 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a820b9640 1 -- 172.21.15.129:0/3606002374 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74005df0 con 0x55e0d5daf350 2024-02-18T16:21:25.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a820b9640 1 --2- 172.21.15.129:0/3606002374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5e99830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ac040 tx=0x7f6a74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594fbc929e8d1db4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6970608640 1 -- 172.21.15.129:0/3606002374 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a740aa9b0 con 0x55e0d5daf350 2024-02-18T16:21:25.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6970608640 1 -- 172.21.15.129:0/3606002374 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740aab30 con 0x55e0d5daf350 2024-02-18T16:21:25.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6970608640 1 -- 172.21.15.129:0/3606002374 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a740aae10 con 0x55e0d5daf350 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- 172.21.15.129:0/3606002374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 msgr2=0x55e0d5e99830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3606002374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5e99830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ac040 tx=0x7f6a74003030 comp rx=0 tx=0).stop 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- 172.21.15.129:0/3606002374 shutdown_connections 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3606002374 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5e99830 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- 172.21.15.129:0/3606002374 >> 172.21.15.129:0/3606002374 conn(0x55e0d5d22a40 msgr2=0x55e0d5e953c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- 172.21.15.129:0/3606002374 shutdown_connections 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- 172.21.15.129:0/3606002374 wait complete. 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 Processor -- start 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- start start 2024-02-18T16:21:25.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5ea0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a8459e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d5cb8e90 con 0x55e0d5daf350 2024-02-18T16:21:25.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a820b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5ea0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a820b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5ea0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48732/0 (socket says 172.21.15.129:48732) 2024-02-18T16:21:25.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a820b9640 1 -- 172.21.15.129:0/233415967 learned_addr learned my addr 172.21.15.129:0/233415967 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.410+0000 7f6a820b9640 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d5db0e50 con 0x55e0d5daf350 2024-02-18T16:21:25.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a820b9640 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5ea0520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6a74005940 tx=0x7f6a740180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f696ee05640 1 -- 172.21.15.129:0/233415967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a740c6690 con 0x55e0d5daf350 2024-02-18T16:21:25.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f696ee05640 1 -- 172.21.15.129:0/233415967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740c67f0 con 0x55e0d5daf350 2024-02-18T16:21:25.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f696ee05640 1 -- 172.21.15.129:0/233415967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a740c6ab0 con 0x55e0d5daf350 2024-02-18T16:21:25.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0d5ea0a60 con 0x55e0d5daf350 2024-02-18T16:21:25.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0d5ea0e90 con 0x55e0d5daf350 2024-02-18T16:21:25.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f696ee05640 1 -- 172.21.15.129:0/233415967 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6a740c6c10 con 0x55e0d5daf350 2024-02-18T16:21:25.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f696ee05640 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f69680342b0 0x7f6968036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f696ee05640 1 -- 172.21.15.129:0/233415967 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6a740e4180 con 0x55e0d5daf350 2024-02-18T16:21:25.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a818b8640 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f69680342b0 0x7f6968036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5dafc70 0x55e0d5ea7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ea7690 con 0x55e0d5dafc70 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a828ba640 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5dafc70 0x55e0d5ea7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a818b8640 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f69680342b0 0x7f6968036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6a78001e50 tx=0x7f6a780013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a828ba640 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5dafc70 0x55e0d5ea7150 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a828ba640 1 -- 172.21.15.129:0/233415967 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x55e0d5dafc70 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ea7a10 con 0x55e0d5dafc70 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a828ba640 1 -- 172.21.15.129:0/233415967 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x55e0d5dafc70 2024-02-18T16:21:25.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.414+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ea92c0 con 0x55e0d5dafc70 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a828ba640 1 -- 172.21.15.129:0/233415967 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x55e0d5dafc70 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ea84c0 con 0x55e0d5dafc70 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a828ba640 1 -- 172.21.15.129:0/233415967 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x55e0d5dafc70 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ea88d0 con 0x55e0d5dafc70 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a828ba640 1 -- 172.21.15.129:0/233415967 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x55e0d5dafc70 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 Processor -- start 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 -- start start 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 0x55e0d5eb7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d5c51f20 con 0x55e0d5eb79d0 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a818b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 0x55e0d5eb7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a818b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 0x55e0d5eb7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48746/0 (socket says 172.21.15.129:48746) 2024-02-18T16:21:25.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a818b8640 1 -- 172.21.15.129:0/847068538 learned_addr learned my addr 172.21.15.129:0/847068538 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a818b8640 1 -- 172.21.15.129:0/847068538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d5eb8330 con 0x55e0d5eb79d0 2024-02-18T16:21:25.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a818b8640 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 0x55e0d5eb7df0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800e640 tx=0x7f6a7800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6967fff640 1 -- 172.21.15.129:0/847068538 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a78007040 con 0x55e0d5eb79d0 2024-02-18T16:21:25.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0d5eb8580 con 0x55e0d5eb79d0 2024-02-18T16:21:25.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6967fff640 1 -- 172.21.15.129:0/847068538 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7800d660 con 0x55e0d5eb79d0 2024-02-18T16:21:25.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6967fff640 1 -- 172.21.15.129:0/847068538 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a7800d920 con 0x55e0d5eb79d0 2024-02-18T16:21:25.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.418+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0d5eb90d0 con 0x55e0d5eb79d0 2024-02-18T16:21:25.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6967fff640 1 -- 172.21.15.129:0/847068538 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6a7801a070 con 0x55e0d5eb79d0 2024-02-18T16:21:25.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6967fff640 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f695c0342b0 0x7f695c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6967fff640 1 -- 172.21.15.129:0/847068538 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6a78017050 con 0x55e0d5eb79d0 2024-02-18T16:21:25.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a828ba640 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f695c0342b0 0x7f695c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 Processor -- start 2024-02-18T16:21:25.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- start start 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ec4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d5c45790 con 0x55e0d5ec4980 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a828ba640 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f695c0342b0 0x7f695c036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55e0d5ea7f00 tx=0x7f6a7c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ec4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ec4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48756/0 (socket says 172.21.15.129:48756) 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 -- 172.21.15.129:0/44479810 learned_addr learned my addr 172.21.15.129:0/44479810 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 -- 172.21.15.129:0/44479810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d5ec5370 con 0x55e0d5ec4980 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 --2- 172.21.15.129:0/44479810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ec4da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800ff70 tx=0x7f6a7801ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57cfd4dcbc297d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6965ffb640 1 -- 172.21.15.129:0/44479810 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a78025360 con 0x55e0d5ec4980 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6965ffb640 1 -- 172.21.15.129:0/44479810 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7800de00 con 0x55e0d5ec4980 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6965ffb640 1 -- 172.21.15.129:0/44479810 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a7803ad00 con 0x55e0d5ec4980 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- 172.21.15.129:0/44479810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 msgr2=0x55e0d5ec4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 --2- 172.21.15.129:0/44479810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ec4da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800ff70 tx=0x7f6a7801ae40 comp rx=0 tx=0).stop 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- 172.21.15.129:0/44479810 shutdown_connections 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 --2- 172.21.15.129:0/44479810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ec4da0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- 172.21.15.129:0/44479810 >> 172.21.15.129:0/44479810 conn(0x55e0d5ec0cc0 msgr2=0x55e0d5ebed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- 172.21.15.129:0/44479810 shutdown_connections 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- 172.21.15.129:0/44479810 wait complete. 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 Processor -- start 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- start start 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ecb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a8459e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d5ecbda0 con 0x55e0d5ec4980 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ecb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ecb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48766/0 (socket says 172.21.15.129:48766) 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.422+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 learned_addr learned my addr 172.21.15.129:0/3554113821 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d5eb90d0 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a818b8640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ecb860 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800eed0 tx=0x7f6a78048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6953fff640 1 -- 172.21.15.129:0/3554113821 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a78025360 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0d5ecbfa0 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6953fff640 1 -- 172.21.15.129:0/3554113821 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a780246d0 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6953fff640 1 -- 172.21.15.129:0/3554113821 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a78024e70 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0d5ecc430 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6953fff640 1 -- 172.21.15.129:0/3554113821 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6a7804aa30 con 0x55e0d5ec4980 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6953fff640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f694c034260 0x7f694c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6953fff640 1 -- 172.21.15.129:0/3554113821 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6a78047c70 con 0x55e0d5ec4980 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a828ba640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f694c034260 0x7f694c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5ed6de0 0x55e0d5ed9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ed99c0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a820b9640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5ed6de0 0x55e0d5ed9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a828ba640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f694c034260 0x7f694c036720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c011010 tx=0x7f6a7c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a820b9640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5ed6de0 0x55e0d5ed9270 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 20 realm 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ed9d90 con 0x55e0d5ed6de0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.426+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5eda5e0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5eda940 con 0x55e0d5ed6de0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5eda280 con 0x55e0d5ed6de0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:25.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 20 searching for the correct realm 2024-02-18T16:21:25.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e0d5edcb90 0x55e0d5edefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a818b8640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e0d5edcb90 0x55e0d5edefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a818b8640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e0d5edcb90 0x55e0d5edefa0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a818b8640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6a78027060 0x7f6a780308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a78027060 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a828ba640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6a78027060 0x7f6a780308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a828ba640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6a78027060 0x7f6a780308b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x7f6a78027060 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a828ba640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6a7c0141d0 0x7f6a7c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a820b9640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6a7c0141d0 0x7f6a7c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.430+0000 7f6a820b9640 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6a7c0141d0 0x7f6a7c015940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a78027060 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7c00a4d0 con 0x7f6a78027060 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.434+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a78027060 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.438+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a78027060 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a78027060 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5edcb90 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.442+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a7c0141d0 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x55e0d5ed6de0 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edf670 con 0x7f6a78027060 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:25.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edb7b0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edb430 con 0x55e0d5ed6de0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edc080 con 0x55e0d5ed6de0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 zone default found 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 4 Realm: () 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 zonegroup default 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5edfab0 con 0x7f6a7c0141d0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee1490 con 0x55e0d5edcb90 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee1870 con 0x55e0d5edcb90 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 started sync module instance, tier type = 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:25.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.446+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee0d70 con 0x7f6a78027060 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94424150182096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee1120 con 0x7f6a78027060 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee25d0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94424150182096] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94424150187152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee2610 con 0x55e0d5ed6de0 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.450+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee30c0 con 0x55e0d5edcb90 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94424150191040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee38c0 con 0x55e0d5edcb90 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee42e0 con 0x7f6a78027060 2024-02-18T16:21:25.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94424150187152] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94424150195648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee4690 con 0x7f6a78027060 2024-02-18T16:21:25.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee5040 con 0x55e0d5ed6de0 2024-02-18T16:21:25.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94424150191040] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.454+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94424150195648] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94424150188208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee4b60 con 0x55e0d5ed6de0 2024-02-18T16:21:25.463 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee5890 con 0x7f6a7c0141d0 2024-02-18T16:21:25.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94424150188208] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94424150193184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee55b0 con 0x7f6a7c0141d0 2024-02-18T16:21:25.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.458+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee5db0 con 0x7f6a7c0141d0 2024-02-18T16:21:25.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94424150202256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee6210 con 0x7f6a7c0141d0 2024-02-18T16:21:25.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee6ce0 con 0x7f6a7c0141d0 2024-02-18T16:21:25.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94424150193184] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94424150202256] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94424150206400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee6ca0 con 0x7f6a7c0141d0 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=0 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=1 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=2 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=3 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=4 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=5 2024-02-18T16:21:25.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.462+0000 7f6a8459e980 20 add_watcher() i=6 2024-02-18T16:21:25.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94424150206400] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 add_watcher() i=7 2024-02-18T16:21:25.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:25.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee5d00 con 0x55e0d5ed6de0 2024-02-18T16:21:25.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94424150203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5ee7560 con 0x55e0d5ed6de0 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94424150203536] v30'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6938fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 5 note: GC not initialized 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f68b37fe640 20 reqs_thread_entry: start 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:25.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 Filter name: none 2024-02-18T16:21:25.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f68b17fa640 20 reqs_thread_entry: start 2024-02-18T16:21:25.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f0b710 con 0x55e0d5ed6de0 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.466+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f0cac0 con 0x7f6a78027060 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f0a610 con 0x7f6a78027060 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f0aab0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:25.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 4.22 4:469ecc78:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f0df30 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 4.38 4:1dfd4e12:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f10a80 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 4.28 4:176c8e0f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f135f0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 4.30 4:0cc5cfbd:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f16350 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 4.27 4:e50fab02:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f18d80 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 4.19 4:99dba4f1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f1b6d0 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f1dfb0 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 4.14 4:2b33d095:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f20570 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:74 4.3b 4:df59ffdb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f22fb0 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 4.38 4:1d3e2d48:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f25970 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:76 4.3b 4:dcfc03a1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f287a0 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(71 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(73 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(67 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(74 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(68 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(70 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(72 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(75 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(76 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.10 6:0b01f3f3:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x7f6a7c0141d0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(77 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.470+0000 7f6a8459e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6938fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94424150203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x55e0d5ed6de0 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94424150203536] v30'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94424150182096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x7f6a78027060 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94424150182096] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a8459e980 20 remove_watcher() i=0 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a8459e980 2 removed watcher, disabling cache 2024-02-18T16:21:25.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.474+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94424150187152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x55e0d5ed6de0 2024-02-18T16:21:25.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94424150187152] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a8459e980 20 remove_watcher() i=1 2024-02-18T16:21:25.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94424150191040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x55e0d5edcb90 2024-02-18T16:21:25.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a818b8640 1 -- 172.21.15.129:0/3554113821 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94424150191040] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7802d040 con 0x55e0d5edcb90 2024-02-18T16:21:25.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a8459e980 20 remove_watcher() i=2 2024-02-18T16:21:25.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94424150195648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x7f6a78027060 2024-02-18T16:21:25.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.478+0000 7f6a828ba640 1 -- 172.21.15.129:0/3554113821 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94424150195648] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a7c03a040 con 0x7f6a78027060 2024-02-18T16:21:25.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.482+0000 7f6a8459e980 20 remove_watcher() i=3 2024-02-18T16:21:25.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.482+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94424150188208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x55e0d5ed6de0 2024-02-18T16:21:25.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.482+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94424150188208] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x55e0d5ed6de0 2024-02-18T16:21:25.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.482+0000 7f6a8459e980 20 remove_watcher() i=4 2024-02-18T16:21:25.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.482+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94424150193184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x7f6a7c0141d0 2024-02-18T16:21:25.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.486+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94424150193184] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.486+0000 7f6a8459e980 20 remove_watcher() i=5 2024-02-18T16:21:25.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.486+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94424150202256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x7f6a7c0141d0 2024-02-18T16:21:25.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.486+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94424150202256] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.486+0000 7f6a8459e980 20 remove_watcher() i=6 2024-02-18T16:21:25.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.486+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94424150206400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e0d5f23010 con 0x7f6a7c0141d0 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94424150206400] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6a740b0020 con 0x7f6a7c0141d0 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 20 remove_watcher() i=7 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6a7c0141d0 msgr2=0x7f6a7c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6a7c0141d0 0x7f6a7c015940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5ed6de0 msgr2=0x55e0d5ed9270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5ed6de0 0x55e0d5ed9270 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6a78027060 msgr2=0x7f6a780308b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f6a78027060 0x7f6a780308b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e0d5edcb90 msgr2=0x55e0d5edefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e0d5edcb90 0x55e0d5edefa0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f694c034260 msgr2=0x7f694c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f694c034260 0x7f694c036720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c011010 tx=0x7f6a7c020000 comp rx=0 tx=0).stop 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a820b9640 1 -- 172.21.15.129:0/3554113821 reap_dead start 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 msgr2=0x55e0d5ecb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ecb860 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800eed0 tx=0x7f6a78048c10 comp rx=0 tx=0).stop 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 shutdown_connections 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/3554113821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5ec4980 0x55e0d5ecb860 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 >> 172.21.15.129:0/3554113821 conn(0x55e0d5ec0cc0 msgr2=0x55e0d5ebe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 shutdown_connections 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/3554113821 wait complete. 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f695c0342b0 msgr2=0x7f695c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f695c0342b0 0x7f695c036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55e0d5ea7f00 tx=0x7f6a7c005850 comp rx=0 tx=0).stop 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 msgr2=0x55e0d5eb7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 0x55e0d5eb7df0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800e640 tx=0x7f6a7800ea40 comp rx=0 tx=0).stop 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 shutdown_connections 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f695c0342b0 0x7f695c036770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/847068538 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5eb79d0 0x55e0d5eb7df0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 >> 172.21.15.129:0/847068538 conn(0x55e0d5eac7e0 msgr2=0x55e0d5ead2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 shutdown_connections 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/847068538 wait complete. 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5dafc70 msgr2=0x55e0d5ea7150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5dafc70 0x55e0d5ea7150 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f69680342b0 msgr2=0x7f6968036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f69680342b0 0x7f6968036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6a78001e50 tx=0x7f6a780013b0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 msgr2=0x55e0d5ea0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5ea0520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6a74005940 tx=0x7f6a740180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 shutdown_connections 2024-02-18T16:21:25.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e0d5dafc70 0x55e0d5ea7150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f69680342b0 0x7f6968036770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 --2- 172.21.15.129:0/233415967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e0d5daf350 0x55e0d5ea0520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 >> 172.21.15.129:0/233415967 conn(0x55e0d5d22a40 msgr2=0x55e0d5e93ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 shutdown_connections 2024-02-18T16:21:25.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.490+0000 7f6a8459e980 1 -- 172.21.15.129:0/233415967 wait complete. 2024-02-18T16:21:25.507 INFO:teuthology.orchestra.run.smithi129.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"5cf777d6-7609-4766-9b82-6394139fd65a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","marker":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-18T16:21:24.458220Z","creation_time":"2024-02-18T16:21:24.450254Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-02-18T16:21:25.508 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '5cf777d6-7609-4766-9b82-6394139fd65a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'marker': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-18T16:21:24.458220Z', 'creation_time': '2024-02-18T16:21:24.450254Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-02-18T16:21:25.517 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-18T16:21:25.517 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-18T16:21:25.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-18T16:21:25.518 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-18T16:21:25.582 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:25.582 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:25.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54ab538980 1 Processor -- start 2024-02-18T16:21:25.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54ab538980 1 -- start start 2024-02-18T16:21:25.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54ab538980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5560d2f3c0c0 0x5560d2fcadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54ab538980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5560d2f144c0 con 0x5560d2fcb300 2024-02-18T16:21:25.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54ab538980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5560d2edb180 con 0x5560d2f3c0c0 2024-02-18T16:21:25.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54a9053640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5560d2f3c0c0 0x5560d2fcadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54a8852640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5560d2fcb300 0x5560d2fcd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42850/0 (socket says 172.21.15.129:42850) 2024-02-18T16:21:25.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54a8852640 1 -- 172.21.15.129:0/951716782 learned_addr learned my addr 172.21.15.129:0/951716782 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:25.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54a9053640 1 -- 172.21.15.129:0/951716782 >> v1:172.21.15.80:6789/0 conn(0x5560d2fcb300 legacy=0x5560d2fcd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.578+0000 7f54a9053640 1 -- 172.21.15.129:0/951716782 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d2fcfee0 con 0x5560d2f3c0c0 2024-02-18T16:21:25.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54a9053640 1 --2- 172.21.15.129:0/951716782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d2fcadc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f549c00a480 tx=0x7f549c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e92e551e1d9d24 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f549bfff640 1 -- 172.21.15.129:0/951716782 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549c0ab540 con 0x5560d2f3c0c0 2024-02-18T16:21:25.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f549bfff640 1 -- 172.21.15.129:0/951716782 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0ab6a0 con 0x5560d2f3c0c0 2024-02-18T16:21:25.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f549bfff640 1 -- 172.21.15.129:0/951716782 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549c0ab960 con 0x5560d2f3c0c0 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 -- 172.21.15.129:0/951716782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 msgr2=0x5560d2fcadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 --2- 172.21.15.129:0/951716782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d2fcadc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f549c00a480 tx=0x7f549c01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 -- 172.21.15.129:0/951716782 shutdown_connections 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 --2- 172.21.15.129:0/951716782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d2fcadc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 -- 172.21.15.129:0/951716782 >> 172.21.15.129:0/951716782 conn(0x5560d2fc28e0 msgr2=0x5560d2fc4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 -- 172.21.15.129:0/951716782 shutdown_connections 2024-02-18T16:21:25.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.582+0000 7f54ab538980 1 -- 172.21.15.129:0/951716782 wait complete. 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54ab538980 1 Processor -- start 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54ab538980 1 -- start start 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54ab538980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54ab538980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d2ed86b0 con 0x5560d2f3c0c0 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54a9053640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54a9053640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48788/0 (socket says 172.21.15.129:48788) 2024-02-18T16:21:25.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54a9053640 1 -- 172.21.15.129:0/2031358208 learned_addr learned my addr 172.21.15.129:0/2031358208 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54a9053640 1 -- 172.21.15.129:0/2031358208 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c005d30 con 0x5560d2f3c0c0 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.598+0000 7f54a9053640 1 --2- 172.21.15.129:0/2031358208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b2080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f549c0ae040 tx=0x7f549c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13b46ab904ef30f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f5397606640 1 -- 172.21.15.129:0/2031358208 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549c0ab810 con 0x5560d2f3c0c0 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f5397606640 1 -- 172.21.15.129:0/2031358208 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0ab970 con 0x5560d2f3c0c0 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f5397606640 1 -- 172.21.15.129:0/2031358208 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549c0abc10 con 0x5560d2f3c0c0 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2031358208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 msgr2=0x5560d30b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 --2- 172.21.15.129:0/2031358208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b2080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f549c0ae040 tx=0x7f549c003030 comp rx=0 tx=0).stop 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2031358208 shutdown_connections 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 --2- 172.21.15.129:0/2031358208 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b2080 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2031358208 >> 172.21.15.129:0/2031358208 conn(0x5560d2fc28e0 msgr2=0x5560d30adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2031358208 shutdown_connections 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2031358208 wait complete. 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 Processor -- start 2024-02-18T16:21:25.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- start start 2024-02-18T16:21:25.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d2ed3e90 con 0x5560d2f3c0c0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54a9053640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54a9053640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48800/0 (socket says 172.21.15.129:48800) 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54a9053640 1 -- 172.21.15.129:0/2302946258 learned_addr learned my addr 172.21.15.129:0/2302946258 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54a9053640 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d2fcfee0 con 0x5560d2f3c0c0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54a9053640 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b8d30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f549c01bb20 tx=0x7f549c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f5395e03640 1 -- 172.21.15.129:0/2302946258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549c0c2070 con 0x5560d2f3c0c0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560d30b9270 con 0x5560d2f3c0c0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f5395e03640 1 -- 172.21.15.129:0/2302946258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0b5d50 con 0x5560d2f3c0c0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f5395e03640 1 -- 172.21.15.129:0/2302946258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549c0c6410 con 0x5560d2f3c0c0 2024-02-18T16:21:25.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.602+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560d30b9720 con 0x5560d2f3c0c0 2024-02-18T16:21:25.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f5395e03640 1 -- 172.21.15.129:0/2302946258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f549c0b2070 con 0x5560d2f3c0c0 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f5395e03640 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53900342b0 0x7f5390036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f5395e03640 1 -- 172.21.15.129:0/2302946258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f549c0e37a0 con 0x5560d2f3c0c0 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a8852640 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53900342b0 0x7f5390036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d2fcb300 0x5560d30bf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30bfea0 con 0x5560d2fcb300 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d2fcb300 0x5560d30bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a8852640 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53900342b0 0x7f5390036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000f70 tx=0x7f54a00012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d2fcb300 0x5560d30bf960 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 -- 172.21.15.129:0/2302946258 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54a400a4d0 con 0x5560d2fcb300 2024-02-18T16:21:25.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30bd070 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 -- 172.21.15.129:0/2302946258 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f54a400a4d0 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30c1bd0 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 -- 172.21.15.129:0/2302946258 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f54a400a4d0 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30c0dd0 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 -- 172.21.15.129:0/2302946258 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f54a400a4d0 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30c11e0 con 0x5560d2fcb300 2024-02-18T16:21:25.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54a9854640 1 -- 172.21.15.129:0/2302946258 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f54a400a4d0 con 0x5560d2fcb300 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 Processor -- start 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.606+0000 7f54ab538980 1 -- start start 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54ab538980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 0x5560d30d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54ab538980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d2e6cf20 con 0x5560d30d0270 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54a8852640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 0x5560d30d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54a8852640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 0x5560d30d0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48802/0 (socket says 172.21.15.129:48802) 2024-02-18T16:21:25.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54a8852640 1 -- 172.21.15.129:0/3640976076 learned_addr learned my addr 172.21.15.129:0/3640976076 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54a8852640 1 -- 172.21.15.129:0/3640976076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d30d0bd0 con 0x5560d30d0270 2024-02-18T16:21:25.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54a8852640 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 0x5560d30d0690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f54a0001ee0 tx=0x7f54a000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f538effd640 1 -- 172.21.15.129:0/3640976076 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0020070 con 0x5560d30d0270 2024-02-18T16:21:25.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f538effd640 1 -- 172.21.15.129:0/3640976076 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000c770 con 0x5560d30d0270 2024-02-18T16:21:25.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560d30d0e20 con 0x5560d30d0270 2024-02-18T16:21:25.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f538effd640 1 -- 172.21.15.129:0/3640976076 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0013040 con 0x5560d30d0270 2024-02-18T16:21:25.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560d30d1970 con 0x5560d30d0270 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f538effd640 1 -- 172.21.15.129:0/3640976076 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f54a000a040 con 0x5560d30d0270 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f538effd640 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f5380034300 0x7f53800367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f538effd640 1 -- 172.21.15.129:0/3640976076 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f54a004b770 con 0x5560d30d0270 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54a9854640 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f5380034300 0x7f53800367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.610+0000 7f54ab538980 1 Processor -- start 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- start start 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30dd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d2e60790 con 0x5560d30dd2b0 2024-02-18T16:21:25.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a9854640 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f5380034300 0x7f53800367c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5560d30c0810 tx=0x7f54a4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30dd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30dd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48814/0 (socket says 172.21.15.129:48814) 2024-02-18T16:21:25.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 -- 172.21.15.129:0/1924185231 learned_addr learned my addr 172.21.15.129:0/1924185231 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 -- 172.21.15.129:0/1924185231 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d30ddc60 con 0x5560d30dd2b0 2024-02-18T16:21:25.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 --2- 172.21.15.129:0/1924185231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30dd690 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f54a0049ad0 tx=0x7f54a0019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4207fd1cacd60a11 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f538cff9640 1 -- 172.21.15.129:0/1924185231 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0048070 con 0x5560d30dd2b0 2024-02-18T16:21:25.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f538cff9640 1 -- 172.21.15.129:0/1924185231 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a003a2e0 con 0x5560d30dd2b0 2024-02-18T16:21:25.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f538cff9640 1 -- 172.21.15.129:0/1924185231 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a001b7a0 con 0x5560d30dd2b0 2024-02-18T16:21:25.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- 172.21.15.129:0/1924185231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 msgr2=0x5560d30dd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 --2- 172.21.15.129:0/1924185231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30dd690 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f54a0049ad0 tx=0x7f54a0019a70 comp rx=0 tx=0).stop 2024-02-18T16:21:25.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- 172.21.15.129:0/1924185231 shutdown_connections 2024-02-18T16:21:25.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 --2- 172.21.15.129:0/1924185231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30dd690 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- 172.21.15.129:0/1924185231 >> 172.21.15.129:0/1924185231 conn(0x5560d30d95f0 msgr2=0x5560d30d7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- 172.21.15.129:0/1924185231 shutdown_connections 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- 172.21.15.129:0/1924185231 wait complete. 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 Processor -- start 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- start start 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54ab538980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d30e4660 con 0x5560d30dd2b0 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48830/0 (socket says 172.21.15.129:48830) 2024-02-18T16:21:25.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 learned_addr learned my addr 172.21.15.129:0/1978839170 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.614+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d30d1970 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a8852640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30e4120 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54a0049e40 tx=0x7f54a0049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f537effd640 1 -- 172.21.15.129:0/1978839170 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0024e80 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f537effd640 1 -- 172.21.15.129:0/1978839170 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000ca50 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f537effd640 1 -- 172.21.15.129:0/1978839170 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a000ccf0 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560d30e4860 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560d30e4c90 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f537effd640 1 -- 172.21.15.129:0/1978839170 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f54a0042050 con 0x5560d30dd2b0 2024-02-18T16:21:25.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f537effd640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53740342b0 0x7f5374036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f537effd640 1 -- 172.21.15.129:0/1978839170 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f54a0038c60 con 0x5560d30dd2b0 2024-02-18T16:21:25.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9854640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53740342b0 0x7f5374036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d30ef6a0 0x5560d30f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f2290 con 0x5560d30ef6a0 2024-02-18T16:21:25.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9053640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d30ef6a0 0x5560d30f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9854640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53740342b0 0x7f5374036770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54a4011010 tx=0x7f54a4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9053640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d30ef6a0 0x5560d30f1b40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f549c0aac40 con 0x5560d30ef6a0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 realm 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f2660 con 0x5560d30ef6a0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f549c0aac40 con 0x5560d30ef6a0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f2eb0 con 0x5560d30ef6a0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f3210 con 0x5560d30ef6a0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.618+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f2b10 con 0x5560d30ef6a0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54ab538980 20 searching for the correct realm 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5560d30f5590 0x5560d30f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a8852640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5560d30f5590 0x5560d30f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a8852640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5560d30f5590 0x5560d30f7980 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a8852640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f54a003fc20 0x7f54a003b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a003fc20 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9854640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f54a003fc20 0x7f54a003b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9854640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f54a003fc20 0x7f54a003b050 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a400a4d0 con 0x7f54a003fc20 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9854640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f54a40141d0 0x7f54a4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9053640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f54a40141d0 0x7f54a4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.622+0000 7f54a9053640 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f54a40141d0 0x7f54a4015940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x7f54a40141d0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x7f54a40141d0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x7f54a40141d0 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a003fc20 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a400a4d0 con 0x7f54a003fc20 2024-02-18T16:21:25.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x7f54a40141d0 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a003fc20 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.626+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x7f54a40141d0 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f549c0d9040 con 0x5560d30ef6a0 2024-02-18T16:21:25.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a003fc20 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.630+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a003fc20 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30f5590 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a40141d0 2024-02-18T16:21:25.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x5560d30ef6a0 2024-02-18T16:21:25.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f7f60 con 0x7f54a003fc20 2024-02-18T16:21:25.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:25.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f4040 con 0x5560d30ef6a0 2024-02-18T16:21:25.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f3cc0 con 0x5560d30ef6a0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.634+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f4990 con 0x5560d30ef6a0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 zone default found 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 4 Realm: () 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:25.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 zonegroup default 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f8820 con 0x7f54a40141d0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fa200 con 0x5560d30f5590 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fa560 con 0x5560d30f5590 2024-02-18T16:21:25.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 started sync module instance, tier type = 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f97d0 con 0x7f54a003fc20 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874346236800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f97d0 con 0x7f54a003fc20 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.638+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30faff0 con 0x5560d30ef6a0 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874346236800] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874346240688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f97d0 con 0x5560d30ef6a0 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fb9b0 con 0x5560d30f5590 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874346243344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fc200 con 0x5560d30f5590 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874346240688] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.642+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fcc20 con 0x7f54a003fc20 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874346247936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fcfd0 con 0x7f54a003fc20 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fd980 con 0x5560d30ef6a0 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874346243344] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874346247936] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874346234672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fd4a0 con 0x5560d30ef6a0 2024-02-18T16:21:25.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.646+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fe1d0 con 0x7f54a40141d0 2024-02-18T16:21:25.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874346234672] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874346245472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fdec0 con 0x7f54a40141d0 2024-02-18T16:21:25.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fe6c0 con 0x7f54a40141d0 2024-02-18T16:21:25.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874346245472] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874346253104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30fe590 con 0x7f54a40141d0 2024-02-18T16:21:25.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.650+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30ff060 con 0x7f54a40141d0 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874346253104] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874346257216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30ff020 con 0x7f54a40141d0 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=0 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=1 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=2 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=3 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=4 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=5 2024-02-18T16:21:25.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=6 2024-02-18T16:21:25.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874346257216] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 20 add_watcher() i=7 2024-02-18T16:21:25.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:25.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.654+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d31024d0 con 0x5560d30ef6a0 2024-02-18T16:21:25.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874346254320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30ff9b0 con 0x5560d30ef6a0 2024-02-18T16:21:25.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874346254320] v30'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f535ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 5 note: GC not initialized 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f535efe5640 20 reqs_thread_entry: start 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 Filter name: none 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f535cfe1640 20 reqs_thread_entry: start 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3124450 con 0x7f54a003fc20 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3124a40 con 0x5560d30ef6a0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(63 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3123ad0 con 0x7f54a003fc20 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.658+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3124440 con 0x5560d30ef6a0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 4.22 4:469ecc78:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3125aa0 con 0x5560d30ef6a0 2024-02-18T16:21:25.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 4.38 4:1dfd4e12:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d312ab30 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 4.28 4:176c8e0f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d312ab30 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 4.30 4:0cc5cfbd:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d312f850 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 4.27 4:e50fab02:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3132300 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 4.19 4:99dba4f1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3134fd0 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3137a50 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 4.14 4:2b33d095:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d313a870 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:74 4.3b 4:df59ffdb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d313d6b0 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 4.38 4:1d3e2d48:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d31403e0 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:76 4.3b 4:dcfc03a1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3142e10 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(73 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(67 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(74 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(70 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(68 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(71 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(76 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(72 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(75 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.10 6:0b01f3f3:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3132360 con 0x7f54a40141d0 2024-02-18T16:21:25.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(77 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f535ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.662+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874346254320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3102160 con 0x5560d30ef6a0 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.666+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93874346254320] v30'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.666+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874346236800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d3102160 con 0x7f54a003fc20 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.666+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93874346236800] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.666+0000 7f54ab538980 20 remove_watcher() i=0 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.666+0000 7f54ab538980 2 removed watcher, disabling cache 2024-02-18T16:21:25.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.666+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874346240688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x5560d30ef6a0 2024-02-18T16:21:25.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93874346240688] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54ab538980 20 remove_watcher() i=1 2024-02-18T16:21:25.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874346243344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x5560d30f5590 2024-02-18T16:21:25.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54a8852640 1 -- 172.21.15.129:0/1978839170 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93874346243344] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a0034070 con 0x5560d30f5590 2024-02-18T16:21:25.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54ab538980 20 remove_watcher() i=2 2024-02-18T16:21:25.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874346247936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x7f54a003fc20 2024-02-18T16:21:25.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54a9854640 1 -- 172.21.15.129:0/1978839170 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93874346247936] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54a403a040 con 0x7f54a003fc20 2024-02-18T16:21:25.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54ab538980 20 remove_watcher() i=3 2024-02-18T16:21:25.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.670+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874346234672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x5560d30ef6a0 2024-02-18T16:21:25.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.674+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93874346234672] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x5560d30ef6a0 2024-02-18T16:21:25.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.674+0000 7f54ab538980 20 remove_watcher() i=4 2024-02-18T16:21:25.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.674+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874346245472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x7f54a40141d0 2024-02-18T16:21:25.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.678+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93874346245472] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.678+0000 7f54ab538980 20 remove_watcher() i=5 2024-02-18T16:21:25.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.678+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874346253104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x7f54a40141d0 2024-02-18T16:21:25.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.678+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93874346253104] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.678+0000 7f54ab538980 20 remove_watcher() i=6 2024-02-18T16:21:25.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.678+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874346257216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560d30f9b80 con 0x7f54a40141d0 2024-02-18T16:21:25.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93874346257216] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f549c0f3040 con 0x7f54a40141d0 2024-02-18T16:21:25.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 20 remove_watcher() i=7 2024-02-18T16:21:25.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f54a40141d0 msgr2=0x7f54a4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f54a40141d0 0x7f54a4015940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d30ef6a0 msgr2=0x5560d30f1b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d30ef6a0 0x5560d30f1b40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f54a003fc20 msgr2=0x7f54a003b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f54a003fc20 0x7f54a003b050 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5560d30f5590 msgr2=0x5560d30f7980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5560d30f5590 0x5560d30f7980 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53740342b0 msgr2=0x7f5374036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53740342b0 0x7f5374036770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54a4011010 tx=0x7f54a4020000 comp rx=0 tx=0).stop 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 msgr2=0x5560d30e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54a9053640 1 -- 172.21.15.129:0/1978839170 reap_dead start 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30e4120 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54a0049e40 tx=0x7f54a0049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 shutdown_connections 2024-02-18T16:21:25.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/1978839170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30dd2b0 0x5560d30e4120 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 >> 172.21.15.129:0/1978839170 conn(0x5560d30d95f0 msgr2=0x5560d30d7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 shutdown_connections 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/1978839170 wait complete. 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f5380034300 msgr2=0x7f53800367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f5380034300 0x7f53800367c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5560d30c0810 tx=0x7f54a4005850 comp rx=0 tx=0).stop 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 msgr2=0x5560d30d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 0x5560d30d0690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f54a0001ee0 tx=0x7f54a000da30 comp rx=0 tx=0).stop 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 shutdown_connections 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f5380034300 0x7f53800367c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/3640976076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d30d0270 0x5560d30d0690 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 >> 172.21.15.129:0/3640976076 conn(0x5560d30c5080 msgr2=0x5560d30c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 shutdown_connections 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/3640976076 wait complete. 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d2fcb300 msgr2=0x5560d30bf960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d2fcb300 0x5560d30bf960 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53900342b0 msgr2=0x7f5390036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53900342b0 0x7f5390036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000f70 tx=0x7f54a00012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 msgr2=0x5560d30b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b8d30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f549c01bb20 tx=0x7f549c018020 comp rx=0 tx=0).stop 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 shutdown_connections 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5560d2fcb300 0x5560d30bf960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f53900342b0 0x7f5390036770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 --2- 172.21.15.129:0/2302946258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5560d2f3c0c0 0x5560d30b8d30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 >> 172.21.15.129:0/2302946258 conn(0x5560d2fc28e0 msgr2=0x5560d30ac720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 shutdown_connections 2024-02-18T16:21:25.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.682+0000 7f54ab538980 1 -- 172.21.15.129:0/2302946258 wait complete. 2024-02-18T16:21:25.699 INFO:teuthology.orchestra.run.smithi129.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"5cf777d6-7609-4766-9b82-6394139fd65a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","marker":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-18T16:21:24.458220Z","creation_time":"2024-02-18T16:21:24.450254Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-18T16:21:25.699 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '5cf777d6-7609-4766-9b82-6394139fd65a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'marker': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-18T16:21:24.458220Z', 'creation_time': '2024-02-18T16:21:24.450254Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-18T16:21:25.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-18T16:21:25.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-18T16:21:25.700 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-02-18T16:21:25.774 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:25.774 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:25.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43bbec4980 1 Processor -- start 2024-02-18T16:21:25.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43bbec4980 1 -- start start 2024-02-18T16:21:25.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43bbec4980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5642e928e8d0 0x5642e931f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43bbec4980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5642e92664d0 con 0x5642e931f780 2024-02-18T16:21:25.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43bbec4980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5642e922d180 con 0x5642e928e8d0 2024-02-18T16:21:25.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43b99df640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5642e928e8d0 0x5642e931f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43b99df640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5642e928e8d0 0x5642e931f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48840/0 (socket says 172.21.15.129:48840) 2024-02-18T16:21:25.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43b99df640 1 -- 172.21.15.129:0/2258266820 learned_addr learned my addr 172.21.15.129:0/2258266820 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43b91de640 1 --1- 172.21.15.129:0/2258266820 >> v1:172.21.15.80:6789/0 conn(0x5642e931f780 0x5642e9321b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42854/0 (socket says 172.21.15.129:42854) 2024-02-18T16:21:25.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43b99df640 1 -- 172.21.15.129:0/2258266820 >> v1:172.21.15.80:6789/0 conn(0x5642e931f780 legacy=0x5642e9321b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.770+0000 7f43b99df640 1 -- 172.21.15.129:0/2258266820 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642e931ac60 con 0x5642e928e8d0 2024-02-18T16:21:25.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43b99df640 1 --2- 172.21.15.129:0/2258266820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e931f240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00a5c0 tx=0x7f43ac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0a7fdbd076f765 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43b89dd640 1 -- 172.21.15.129:0/2258266820 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43ac0aa470 con 0x5642e928e8d0 2024-02-18T16:21:25.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43b89dd640 1 -- 172.21.15.129:0/2258266820 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0aa5d0 con 0x5642e928e8d0 2024-02-18T16:21:25.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43b89dd640 1 -- 172.21.15.129:0/2258266820 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43ac0aa890 con 0x5642e928e8d0 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 -- 172.21.15.129:0/2258266820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 msgr2=0x5642e931f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2258266820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e931f240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00a5c0 tx=0x7f43ac01b340 comp rx=0 tx=0).stop 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 -- 172.21.15.129:0/2258266820 shutdown_connections 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2258266820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e931f240 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 -- 172.21.15.129:0/2258266820 >> 172.21.15.129:0/2258266820 conn(0x5642e9314920 msgr2=0x5642e9316d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 -- 172.21.15.129:0/2258266820 shutdown_connections 2024-02-18T16:21:25.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.774+0000 7f43bbec4980 1 -- 172.21.15.129:0/2258266820 wait complete. 2024-02-18T16:21:25.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43bbec4980 1 Processor -- start 2024-02-18T16:21:25.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43bbec4980 1 -- start start 2024-02-18T16:21:25.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43bbec4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e9406260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43bbec4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642e922a6b0 con 0x5642e928e8d0 2024-02-18T16:21:25.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43b99df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e9406260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43b99df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e9406260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48852/0 (socket says 172.21.15.129:48852) 2024-02-18T16:21:25.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43b99df640 1 -- 172.21.15.129:0/3949685969 learned_addr learned my addr 172.21.15.129:0/3949685969 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43b99df640 1 -- 172.21.15.129:0/3949685969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac005df0 con 0x5642e928e8d0 2024-02-18T16:21:25.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f43b99df640 1 --2- 172.21.15.129:0/3949685969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e9406260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f43ac018f70 tx=0x7f43ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63602f517205ce97 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f42a7e07640 1 -- 172.21.15.129:0/3949685969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43ac0aa9c0 con 0x5642e928e8d0 2024-02-18T16:21:25.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f42a7e07640 1 -- 172.21.15.129:0/3949685969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0aab20 con 0x5642e928e8d0 2024-02-18T16:21:25.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.790+0000 7f42a7e07640 1 -- 172.21.15.129:0/3949685969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43ac0aadc0 con 0x5642e928e8d0 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/3949685969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 msgr2=0x5642e9406260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 --2- 172.21.15.129:0/3949685969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e9406260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f43ac018f70 tx=0x7f43ac003030 comp rx=0 tx=0).stop 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/3949685969 shutdown_connections 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 --2- 172.21.15.129:0/3949685969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e9406260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/3949685969 >> 172.21.15.129:0/3949685969 conn(0x5642e9314920 msgr2=0x5642e9401df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/3949685969 shutdown_connections 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/3949685969 wait complete. 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 Processor -- start 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- start start 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e940cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642e9225e90 con 0x5642e928e8d0 2024-02-18T16:21:25.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43b99df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e940cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43b99df640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e940cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48864/0 (socket says 172.21.15.129:48864) 2024-02-18T16:21:25.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43b99df640 1 -- 172.21.15.129:0/1903120985 learned_addr learned my addr 172.21.15.129:0/1903120985 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43b99df640 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642e931ac60 con 0x5642e928e8d0 2024-02-18T16:21:25.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43b99df640 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e940cf40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f43ac018f70 tx=0x7f43ac0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f42a6604640 1 -- 172.21.15.129:0/1903120985 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43ac0cb070 con 0x5642e928e8d0 2024-02-18T16:21:25.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5642e940d480 con 0x5642e928e8d0 2024-02-18T16:21:25.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f42a6604640 1 -- 172.21.15.129:0/1903120985 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0bd810 con 0x5642e928e8d0 2024-02-18T16:21:25.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f42a6604640 1 -- 172.21.15.129:0/1903120985 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43ac0bdab0 con 0x5642e928e8d0 2024-02-18T16:21:25.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642e940d850 con 0x5642e928e8d0 2024-02-18T16:21:25.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f42a6604640 1 -- 172.21.15.129:0/1903120985 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f43ac0bdc10 con 0x5642e928e8d0 2024-02-18T16:21:25.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f42a6604640 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42a00342b0 0x7f42a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.794+0000 7f42a6604640 1 -- 172.21.15.129:0/1903120985 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f43ac0e4a30 con 0x5642e928e8d0 2024-02-18T16:21:25.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43b91de640 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42a00342b0 0x7f42a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e931f780 0x5642e9413bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9414100 con 0x5642e931f780 2024-02-18T16:21:25.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e931f780 0x5642e9413bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43b91de640 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42a00342b0 0x7f42a0036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43b0001e50 tx=0x7f43b00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e931f780 0x5642e9413bc0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 -- 172.21.15.129:0/1903120985 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f43b400a4d0 con 0x5642e931f780 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9414460 con 0x5642e931f780 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 -- 172.21.15.129:0/1903120985 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f43b400a4d0 con 0x5642e931f780 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9415cf0 con 0x5642e931f780 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 -- 172.21.15.129:0/1903120985 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f43b400a4d0 con 0x5642e931f780 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9414ef0 con 0x5642e931f780 2024-02-18T16:21:25.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 -- 172.21.15.129:0/1903120985 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f43b400a4d0 con 0x5642e931f780 2024-02-18T16:21:25.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9415300 con 0x5642e931f780 2024-02-18T16:21:25.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43ba1e0640 1 -- 172.21.15.129:0/1903120985 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f43b400a4d0 con 0x5642e931f780 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 Processor -- start 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- start start 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 0x5642e94247d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43bbec4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642e91bef20 con 0x5642e94243b0 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43b91de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 0x5642e94247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43b91de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 0x5642e94247d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48866/0 (socket says 172.21.15.129:48866) 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.798+0000 7f43b91de640 1 -- 172.21.15.129:0/3201899797 learned_addr learned my addr 172.21.15.129:0/3201899797 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43b91de640 1 -- 172.21.15.129:0/3201899797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642e9424d10 con 0x5642e94243b0 2024-02-18T16:21:25.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43b91de640 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 0x5642e94247d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f43b000e640 tx=0x7f43b000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f429f7fe640 1 -- 172.21.15.129:0/3201899797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43b0007040 con 0x5642e94243b0 2024-02-18T16:21:25.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f429f7fe640 1 -- 172.21.15.129:0/3201899797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000d660 con 0x5642e94243b0 2024-02-18T16:21:25.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5642e9424f60 con 0x5642e94243b0 2024-02-18T16:21:25.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f429f7fe640 1 -- 172.21.15.129:0/3201899797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43b000d920 con 0x5642e94243b0 2024-02-18T16:21:25.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642e9425ab0 con 0x5642e94243b0 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f429f7fe640 1 -- 172.21.15.129:0/3201899797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f43b001a070 con 0x5642e94243b0 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f429f7fe640 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42940342b0 0x7f4294036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f429f7fe640 1 -- 172.21.15.129:0/3201899797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f43b0017050 con 0x5642e94243b0 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42940342b0 0x7f4294036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43bbec4980 1 Processor -- start 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43bbec4980 1 -- start start 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42940342b0 0x7f4294036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5642e9414930 tx=0x7f43b4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43bbec4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e9431750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43bbec4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642e91b2790 con 0x5642e9431330 2024-02-18T16:21:25.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43b91de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e9431750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43b91de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e9431750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48876/0 (socket says 172.21.15.129:48876) 2024-02-18T16:21:25.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43b91de640 1 -- 172.21.15.129:0/364904669 learned_addr learned my addr 172.21.15.129:0/364904669 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.802+0000 7f43b91de640 1 -- 172.21.15.129:0/364904669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642e9431d20 con 0x5642e9431330 2024-02-18T16:21:25.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43b91de640 1 --2- 172.21.15.129:0/364904669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e9431750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f43b000ff70 tx=0x7f43b001ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d849ecea60232 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f429d7fa640 1 -- 172.21.15.129:0/364904669 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43b0025360 con 0x5642e9431330 2024-02-18T16:21:25.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f429d7fa640 1 -- 172.21.15.129:0/364904669 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000de00 con 0x5642e9431330 2024-02-18T16:21:25.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f429d7fa640 1 -- 172.21.15.129:0/364904669 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43b003abb0 con 0x5642e9431330 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/364904669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 msgr2=0x5642e9431750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 --2- 172.21.15.129:0/364904669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e9431750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f43b000ff70 tx=0x7f43b001ae40 comp rx=0 tx=0).stop 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/364904669 shutdown_connections 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 --2- 172.21.15.129:0/364904669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e9431750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/364904669 >> 172.21.15.129:0/364904669 conn(0x5642e942d6c0 msgr2=0x5642e942b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/364904669 shutdown_connections 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/364904669 wait complete. 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 Processor -- start 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- start start 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e94382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642e94387f0 con 0x5642e9431330 2024-02-18T16:21:25.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43b91de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e94382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43b91de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e94382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48886/0 (socket says 172.21.15.129:48886) 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 learned_addr learned my addr 172.21.15.129:0/2555009592 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642e9425ab0 con 0x5642e9431330 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43b91de640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e94382b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f43b000ff70 tx=0x7f43b0048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f428b7fe640 1 -- 172.21.15.129:0/2555009592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43b0034070 con 0x5642e9431330 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5642e94389f0 con 0x5642e9431330 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f428b7fe640 1 -- 172.21.15.129:0/2555009592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b0025360 con 0x5642e9431330 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f428b7fe640 1 -- 172.21.15.129:0/2555009592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43b0024900 con 0x5642e9431330 2024-02-18T16:21:25.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.806+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642e9438e20 con 0x5642e9431330 2024-02-18T16:21:25.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f428b7fe640 1 -- 172.21.15.129:0/2555009592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f43b0041070 con 0x5642e9431330 2024-02-18T16:21:25.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f428b7fe640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4284034300 0x7f42840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f428b7fe640 1 -- 172.21.15.129:0/2555009592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f43b0031cd0 con 0x5642e9431330 2024-02-18T16:21:25.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4284034300 0x7f42840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e9443850 0x5642e9445d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9446460 con 0x5642e9443850 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e9443850 0x5642e9445d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4284034300 0x7f42840367c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f43b4011010 tx=0x7f43b4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e9443850 0x5642e9445d10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 realm 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9446830 con 0x5642e9443850 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9447080 con 0x5642e9443850 2024-02-18T16:21:25.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94473e0 con 0x5642e9443850 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9446d20 con 0x5642e9443850 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 20 searching for the correct realm 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5642e9449630 0x5642e944ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944c150 con 0x5642e9449630 2024-02-18T16:21:25.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b91de640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5642e9449630 0x5642e944ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.810+0000 7f43b91de640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5642e9449630 0x5642e944ba80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b91de640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f43b0027060 0x7f43b00435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944c150 con 0x7f43b0027060 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f43b0027060 0x7f43b00435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f43b0027060 0x7f43b00435a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b400a4d0 con 0x7f43b0027060 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43ba1e0640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43b40141d0 0x7f43b4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944c150 con 0x7f43b40141d0 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43b40141d0 0x7f43b4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43b40141d0 0x7f43b4015940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944c150 con 0x5642e9443850 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944c150 con 0x5642e9443850 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.814+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b0027060 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b400a4d0 con 0x7f43b0027060 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9443850 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9443850 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b0027060 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.818+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9443850 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9443850 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b0027060 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9443850 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x5642e9443850 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.822+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac0cd070 con 0x7f43b40141d0 2024-02-18T16:21:25.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b0027060 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9449630 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b40141d0 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x5642e9443850 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f43ac0f1040 con 0x7f43b0027060 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:25.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9448110 con 0x5642e9443850 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94484c0 con 0x5642e9443850 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94484c0 con 0x5642e9443850 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 zone default found 2024-02-18T16:21:25.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 4 Realm: () 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 zonegroup default 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9448d90 con 0x7f43b40141d0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.826+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9448d90 con 0x5642e9449630 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944e0b0 con 0x5642e9449630 2024-02-18T16:21:25.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:25.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 20 started sync module instance, tier type = 2024-02-18T16:21:25.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:25.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944d850 con 0x7f43b0027060 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94845381432240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944dc00 con 0x7f43b0027060 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944ee10 con 0x5642e9443850 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.830+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94845381432240] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94845381436624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944edf0 con 0x5642e9443850 2024-02-18T16:21:25.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944f8b0 con 0x5642e9449630 2024-02-18T16:21:25.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94845381440368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9450100 con 0x5642e9449630 2024-02-18T16:21:25.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9450ad0 con 0x7f43b0027060 2024-02-18T16:21:25.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94845381436624] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94845381445072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9450e80 con 0x7f43b0027060 2024-02-18T16:21:25.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.834+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94517f0 con 0x5642e9443850 2024-02-18T16:21:25.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.838+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94845381440368] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.838+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94845381445072] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.838+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.838+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94845381437680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9451350 con 0x5642e9443850 2024-02-18T16:21:25.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.838+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9451bb0 con 0x7f43b40141d0 2024-02-18T16:21:25.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.838+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94845381437680] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94845381442656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94517f0 con 0x7f43b40141d0 2024-02-18T16:21:25.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9452570 con 0x7f43b40141d0 2024-02-18T16:21:25.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94845381451984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9452990 con 0x7f43b40141d0 2024-02-18T16:21:25.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9453430 con 0x7f43b40141d0 2024-02-18T16:21:25.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.842+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94845381442656] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94845381451984] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94845381455632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94524f0 con 0x7f43b40141d0 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=0 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=1 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=2 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=3 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=4 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=5 2024-02-18T16:21:25.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=6 2024-02-18T16:21:25.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94845381455632] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 20 add_watcher() i=7 2024-02-18T16:21:25.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:25.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9456530 con 0x5642e9443850 2024-02-18T16:21:25.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.846+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94845381448528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94539a0 con 0x5642e9443850 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94845381448528] v30'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f426b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 5 note: GC not initialized 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f426a7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 Filter name: none 2024-02-18T16:21:25.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f41dbfff640 20 reqs_thread_entry: start 2024-02-18T16:21:25.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9477e50 con 0x5642e9443850 2024-02-18T16:21:25.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:25.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9479200 con 0x7f43b0027060 2024-02-18T16:21:25.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94771f0 con 0x5642e9443850 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 4.22 4:469ecc78:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e947a6b0 con 0x5642e9443850 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 4.38 4:1dfd4e12:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e947d180 con 0x5642e9443850 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 4.28 4:176c8e0f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e947fca0 con 0x5642e9443850 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 4.30 4:0cc5cfbd:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e94824c0 con 0x5642e9449630 2024-02-18T16:21:25.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 4.27 4:e50fab02:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9484ce0 con 0x5642e9443850 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 4.19 4:99dba4f1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9487550 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e948a120 con 0x5642e9443850 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:72 4.14 4:2b33d095:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e948ce30 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 4.3b 4:df59ffdb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e948f6d0 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 4.38 4:1d3e2d48:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9492230 con 0x5642e9443850 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 4.3b 4:dcfc03a1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9494a50 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(68 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.850+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(66 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(67 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(73 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(72 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(70 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(69 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(75 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(74 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(71 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9476da0 con 0x7f43b0027060 2024-02-18T16:21:25.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.854+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9476da0 con 0x7f43b0027060 2024-02-18T16:21:25.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43bbec4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:25.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9476da0 con 0x5642e9443850 2024-02-18T16:21:25.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(78 foo [stat out=16b,read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+373 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43bbec4980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:25.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9476da0 con 0x7f43b0027060 2024-02-18T16:21:25.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f426b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:25.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.858+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94845381448528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e946a010 con 0x5642e9443850 2024-02-18T16:21:25.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94845381448528] v30'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94845381432240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9451350 con 0x7f43b0027060 2024-02-18T16:21:25.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94845381432240] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43bbec4980 20 remove_watcher() i=0 2024-02-18T16:21:25.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43bbec4980 2 removed watcher, disabling cache 2024-02-18T16:21:25.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94845381436624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9451350 con 0x5642e9443850 2024-02-18T16:21:25.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94845381436624] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43bbec4980 20 remove_watcher() i=1 2024-02-18T16:21:25.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.862+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94845381440368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944e4d0 con 0x5642e9449630 2024-02-18T16:21:25.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.866+0000 7f43b91de640 1 -- 172.21.15.129:0/2555009592 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94845381440368] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b0036070 con 0x5642e9449630 2024-02-18T16:21:25.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.866+0000 7f43bbec4980 20 remove_watcher() i=2 2024-02-18T16:21:25.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.866+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94845381445072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9451350 con 0x7f43b0027060 2024-02-18T16:21:25.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.866+0000 7f43ba1e0640 1 -- 172.21.15.129:0/2555009592 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94845381445072] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43b403a040 con 0x7f43b0027060 2024-02-18T16:21:25.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.866+0000 7f43bbec4980 20 remove_watcher() i=3 2024-02-18T16:21:25.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.866+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94845381437680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944f370 con 0x5642e9443850 2024-02-18T16:21:25.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.870+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94845381437680] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x5642e9443850 2024-02-18T16:21:25.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.870+0000 7f43bbec4980 20 remove_watcher() i=4 2024-02-18T16:21:25.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.870+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94845381442656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e9451350 con 0x7f43b40141d0 2024-02-18T16:21:25.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.870+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94845381442656] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.870+0000 7f43bbec4980 20 remove_watcher() i=5 2024-02-18T16:21:25.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.870+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94845381451984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944f370 con 0x7f43b40141d0 2024-02-18T16:21:25.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94845381451984] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 20 remove_watcher() i=6 2024-02-18T16:21:25.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94845381455632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642e944fc60 con 0x7f43b40141d0 2024-02-18T16:21:25.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94845381455632] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f43ac102040 con 0x7f43b40141d0 2024-02-18T16:21:25.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 20 remove_watcher() i=7 2024-02-18T16:21:25.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43b40141d0 msgr2=0x7f43b4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f43b40141d0 0x7f43b4015940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e9443850 msgr2=0x5642e9445d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e9443850 0x5642e9445d10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f43b0027060 msgr2=0x7f43b00435a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f43b0027060 0x7f43b00435a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5642e9449630 msgr2=0x5642e944ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5642e9449630 0x5642e944ba80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4284034300 msgr2=0x7f42840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4284034300 0x7f42840367c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f43b4011010 tx=0x7f43b4020000 comp rx=0 tx=0).stop 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 msgr2=0x5642e94382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43b99df640 1 -- 172.21.15.129:0/2555009592 reap_dead start 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e94382b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f43b000ff70 tx=0x7f43b0048c10 comp rx=0 tx=0).stop 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 shutdown_connections 2024-02-18T16:21:25.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 --2- 172.21.15.129:0/2555009592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e9431330 0x5642e94382b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 >> 172.21.15.129:0/2555009592 conn(0x5642e942d6c0 msgr2=0x5642e942ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 shutdown_connections 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.874+0000 7f43bbec4980 1 -- 172.21.15.129:0/2555009592 wait complete. 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42940342b0 msgr2=0x7f4294036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42940342b0 0x7f4294036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5642e9414930 tx=0x7f43b4005850 comp rx=0 tx=0).stop 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 msgr2=0x5642e94247d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 0x5642e94247d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f43b000e640 tx=0x7f43b000ea40 comp rx=0 tx=0).stop 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 shutdown_connections 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42940342b0 0x7f4294036770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/3201899797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e94243b0 0x5642e94247d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 >> 172.21.15.129:0/3201899797 conn(0x5642e94191c0 msgr2=0x5642e9419cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 shutdown_connections 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/3201899797 wait complete. 2024-02-18T16:21:25.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e931f780 msgr2=0x5642e9413bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e931f780 0x5642e9413bc0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42a00342b0 msgr2=0x7f42a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42a00342b0 0x7f42a0036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43b0001e50 tx=0x7f43b00013b0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 msgr2=0x5642e940cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e940cf40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f43ac018f70 tx=0x7f43ac0180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 shutdown_connections 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5642e931f780 0x5642e9413bc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f42a00342b0 0x7f42a0036770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 --2- 172.21.15.129:0/1903120985 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5642e928e8d0 0x5642e940cf40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 >> 172.21.15.129:0/1903120985 conn(0x5642e9314920 msgr2=0x5642e9400900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 shutdown_connections 2024-02-18T16:21:25.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.878+0000 7f43bbec4980 1 -- 172.21.15.129:0/1903120985 wait complete. 2024-02-18T16:21:25.895 INFO:teuthology.orchestra.run.smithi129.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-02-18T16:21:25.857150Z","last_stats_update":"2024-02-18T16:21:25.854707Z"} 2024-02-18T16:21:25.895 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-02-18T16:21:25.857150Z', 'last_stats_update': '2024-02-18T16:21:25.854707Z'} 2024-02-18T16:21:25.902 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:25.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-18T16:21:25.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-18T16:21:25.903 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-02-18T16:21:25.971 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:25.971 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880ee52980 1 Processor -- start 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880ee52980 1 -- start start 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880ee52980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x564c980ff140 0x564c980ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880ee52980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564c9804b4d0 con 0x564c980ffa60 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880ee52980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x564c98012180 con 0x564c980ff140 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880c96d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x564c980ff140 0x564c980ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880c96d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x564c980ff140 0x564c980ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48894/0 (socket says 172.21.15.129:48894) 2024-02-18T16:21:25.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880c16c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x564c980ffa60 0x564c98100420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42856/0 (socket says 172.21.15.129:42856) 2024-02-18T16:21:25.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880c96d640 1 -- 172.21.15.129:0/1446847744 learned_addr learned my addr 172.21.15.129:0/1446847744 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880c96d640 1 -- 172.21.15.129:0/1446847744 >> v1:172.21.15.80:6789/0 conn(0x564c980ffa60 legacy=0x564c98100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.966+0000 7f880c96d640 1 -- 172.21.15.129:0/1446847744 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c98100c50 con 0x564c980ff140 2024-02-18T16:21:25.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880c96d640 1 --2- 172.21.15.129:0/1446847744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c980ff520 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f880400a4e0 tx=0x7f880401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5aaedbf7b147f64 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880b96b640 1 -- 172.21.15.129:0/1446847744 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040aa540 con 0x564c980ff140 2024-02-18T16:21:25.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880b96b640 1 -- 172.21.15.129:0/1446847744 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040a6070 con 0x564c980ff140 2024-02-18T16:21:25.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880b96b640 1 -- 172.21.15.129:0/1446847744 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040aa850 con 0x564c980ff140 2024-02-18T16:21:25.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 -- 172.21.15.129:0/1446847744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 msgr2=0x564c980ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 --2- 172.21.15.129:0/1446847744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c980ff520 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f880400a4e0 tx=0x7f880401b090 comp rx=0 tx=0).stop 2024-02-18T16:21:25.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 -- 172.21.15.129:0/1446847744 shutdown_connections 2024-02-18T16:21:25.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 --2- 172.21.15.129:0/1446847744 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c980ff520 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 -- 172.21.15.129:0/1446847744 >> 172.21.15.129:0/1446847744 conn(0x564c980faa10 msgr2=0x564c980fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 -- 172.21.15.129:0/1446847744 shutdown_connections 2024-02-18T16:21:25.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.970+0000 7f880ee52980 1 -- 172.21.15.129:0/1446847744 wait complete. 2024-02-18T16:21:25.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880ee52980 1 Processor -- start 2024-02-18T16:21:25.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880ee52980 1 -- start start 2024-02-18T16:21:25.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880ee52980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c981e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880ee52980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c9800f6b0 con 0x564c980ff140 2024-02-18T16:21:25.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880c96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c981e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880c96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c981e95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48902/0 (socket says 172.21.15.129:48902) 2024-02-18T16:21:25.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.986+0000 7f880c96d640 1 -- 172.21.15.129:0/464336928 learned_addr learned my addr 172.21.15.129:0/464336928 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 -- 172.21.15.129:0/464336928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880400a1c0 con 0x564c980ff140 2024-02-18T16:21:25.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 --2- 172.21.15.129:0/464336928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c981e95e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8804017ca0 tx=0x7f88040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185e5a4453777ff3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f86fae0d640 1 -- 172.21.15.129:0/464336928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040aa780 con 0x564c980ff140 2024-02-18T16:21:25.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f86fae0d640 1 -- 172.21.15.129:0/464336928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040aa8e0 con 0x564c980ff140 2024-02-18T16:21:25.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f86fae0d640 1 -- 172.21.15.129:0/464336928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040aab80 con 0x564c980ff140 2024-02-18T16:21:25.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- 172.21.15.129:0/464336928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 msgr2=0x564c981e95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:25.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 --2- 172.21.15.129:0/464336928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c981e95e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8804017ca0 tx=0x7f88040033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- 172.21.15.129:0/464336928 shutdown_connections 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 --2- 172.21.15.129:0/464336928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ff140 0x564c981e95e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- 172.21.15.129:0/464336928 >> 172.21.15.129:0/464336928 conn(0x564c980faa10 msgr2=0x564c981e5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- 172.21.15.129:0/464336928 shutdown_connections 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- 172.21.15.129:0/464336928 wait complete. 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 Processor -- start 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- start start 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 0x564c981f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c9800ae90 con 0x564c980ffa60 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 0x564c981f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:25.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 0x564c981f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48916/0 (socket says 172.21.15.129:48916) 2024-02-18T16:21:25.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 -- 172.21.15.129:0/3387185816 learned_addr learned my addr 172.21.15.129:0/3387185816 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:25.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c98100c50 con 0x564c980ffa60 2024-02-18T16:21:25.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880c96d640 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 0x564c981f0510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f880401aec0 tx=0x7f8804017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:25.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f86f960a640 1 -- 172.21.15.129:0/3387185816 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040c3070 con 0x564c980ffa60 2024-02-18T16:21:25.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.990+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c981f0a50 con 0x564c980ffa60 2024-02-18T16:21:25.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f86f960a640 1 -- 172.21.15.129:0/3387185816 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040b5570 con 0x564c980ffa60 2024-02-18T16:21:25.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c981f0ea0 con 0x564c980ffa60 2024-02-18T16:21:25.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f86f960a640 1 -- 172.21.15.129:0/3387185816 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88040b5810 con 0x564c980ffa60 2024-02-18T16:21:26.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f86f960a640 1 -- 172.21.15.129:0/3387185816 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f88040a8070 con 0x564c980ffa60 2024-02-18T16:21:26.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f86f960a640 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86f4034300 0x7f86f40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f86f960a640 1 -- 172.21.15.129:0/3387185816 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f88040e3550 con 0x564c980ffa60 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880c16c640 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86f4034300 0x7f86f40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c981f5160 0x564c981f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c981f7a90 con 0x564c981f5160 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880d16e640 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c981f5160 0x564c981f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880c16c640 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86f4034300 0x7f86f40367c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8800001e50 tx=0x7f88000013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880d16e640 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c981f5160 0x564c981f7550 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880d16e640 1 -- 172.21.15.129:0/3387185816 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87fc0083f0 con 0x564c981f5160 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c981f7e50 con 0x564c981f5160 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880d16e640 1 -- 172.21.15.129:0/3387185816 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87fc0083f0 con 0x564c981f5160 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c981f9700 con 0x564c981f5160 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880d16e640 1 -- 172.21.15.129:0/3387185816 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f87fc0083f0 con 0x564c981f5160 2024-02-18T16:21:26.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c981f8900 con 0x564c981f5160 2024-02-18T16:21:26.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880d16e640 1 -- 172.21.15.129:0/3387185816 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87fc0083f0 con 0x564c981f5160 2024-02-18T16:21:26.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.994+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c981f8d10 con 0x564c981f5160 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880d16e640 1 -- 172.21.15.129:0/3387185816 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f87fc012040 con 0x564c981f5160 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880ee52980 1 Processor -- start 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880ee52980 1 -- start start 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880ee52980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 0x564c982081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880ee52980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c97fa3f20 con 0x564c98207da0 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880c16c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 0x564c982081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880c16c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 0x564c982081c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48930/0 (socket says 172.21.15.129:48930) 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880c16c640 1 -- 172.21.15.129:0/3219178277 learned_addr learned my addr 172.21.15.129:0/3219178277 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880c16c640 1 -- 172.21.15.129:0/3219178277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c98208700 con 0x564c98207da0 2024-02-18T16:21:26.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880c16c640 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 0x564c982081c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f880000e640 tx=0x7f880000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f86f27fc640 1 -- 172.21.15.129:0/3219178277 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8800007040 con 0x564c98207da0 2024-02-18T16:21:26.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f86f27fc640 1 -- 172.21.15.129:0/3219178277 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000d660 con 0x564c98207da0 2024-02-18T16:21:26.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f86f27fc640 1 -- 172.21.15.129:0/3219178277 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f880000d920 con 0x564c98207da0 2024-02-18T16:21:26.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c98208950 con 0x564c98207da0 2024-02-18T16:21:26.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c982094a0 con 0x564c98207da0 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f86f27fc640 1 -- 172.21.15.129:0/3219178277 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f880001a070 con 0x564c98207da0 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f86f27fc640 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e40342b0 0x7f86e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f86f27fc640 1 -- 172.21.15.129:0/3219178277 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8800017050 con 0x564c98207da0 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:25.998+0000 7f880d16e640 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e40342b0 0x7f86e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 Processor -- start 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- start start 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880d16e640 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e40342b0 0x7f86e4036770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x564c981f8340 tx=0x7f87fc003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c980759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c97f97790 con 0x564c980755d0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c980759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c980759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48942/0 (socket says 172.21.15.129:48942) 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 -- 172.21.15.129:0/1995057316 learned_addr learned my addr 172.21.15.129:0/1995057316 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 -- 172.21.15.129:0/1995057316 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c98073e20 con 0x564c980755d0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 --2- 172.21.15.129:0/1995057316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c980759f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f880000ff70 tx=0x7f880001ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e583e830d80d44c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f86e3fff640 1 -- 172.21.15.129:0/1995057316 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8800025360 con 0x564c980755d0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f86e3fff640 1 -- 172.21.15.129:0/1995057316 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000de00 con 0x564c980755d0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f86e3fff640 1 -- 172.21.15.129:0/1995057316 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f880003abb0 con 0x564c980755d0 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- 172.21.15.129:0/1995057316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 msgr2=0x564c980759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 --2- 172.21.15.129:0/1995057316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c980759f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f880000ff70 tx=0x7f880001ae40 comp rx=0 tx=0).stop 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- 172.21.15.129:0/1995057316 shutdown_connections 2024-02-18T16:21:26.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 --2- 172.21.15.129:0/1995057316 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c980759f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- 172.21.15.129:0/1995057316 >> 172.21.15.129:0/1995057316 conn(0x564c982110c0 msgr2=0x564c9820f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- 172.21.15.129:0/1995057316 shutdown_connections 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- 172.21.15.129:0/1995057316 wait complete. 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 Processor -- start 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- start start 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c9821de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880ee52980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c9821e3c0 con 0x564c980755d0 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c9821de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c9821de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48950/0 (socket says 172.21.15.129:48950) 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.002+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 learned_addr learned my addr 172.21.15.129:0/3280611318 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c982094a0 con 0x564c980755d0 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880c16c640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c9821de80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f880000ff70 tx=0x7f8800048c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f86e27fc640 1 -- 172.21.15.129:0/3280611318 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8800034070 con 0x564c980755d0 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c9821e5c0 con 0x564c980755d0 2024-02-18T16:21:26.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f86e27fc640 1 -- 172.21.15.129:0/3280611318 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8800025360 con 0x564c980755d0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f86e27fc640 1 -- 172.21.15.129:0/3280611318 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8800024900 con 0x564c980755d0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c9821e9f0 con 0x564c980755d0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f86e27fc640 1 -- 172.21.15.129:0/3280611318 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8800041070 con 0x564c980755d0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f86e27fc640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86d80342b0 0x7f86d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f86e27fc640 1 -- 172.21.15.129:0/3280611318 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8800031cd0 con 0x564c980755d0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880d16e640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86d80342b0 0x7f86d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c98229450 0x564c9822b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822c060 con 0x564c98229450 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880c96d640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c98229450 0x564c9822b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880d16e640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86d80342b0 0x7f86d8036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f87fc008fd0 tx=0x7f87fc01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880c96d640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c98229450 0x564c9822b910 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 20 realm 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822c430 con 0x564c98229450 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.006+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822ccb0 con 0x564c98229450 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822d010 con 0x564c98229450 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822d810 con 0x564c98229450 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:26.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 20 searching for the correct realm 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c9822f6a0 0x564c98231b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c16c640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c9822f6a0 0x564c98231b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c16c640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c9822f6a0 0x564c98231b10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8800036070 con 0x564c9822f6a0 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c16c640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f8800027060 0x7f88000435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f8800027060 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880d16e640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f8800027060 0x7f88000435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880d16e640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f8800027060 0x7f88000435a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87fc02c040 con 0x7f8800027060 2024-02-18T16:21:26.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880d16e640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f87fc027940 0x7f87fc0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.010+0000 7f880c96d640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f87fc027940 0x7f87fc0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f87fc027940 0x7f87fc0333c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f8800027060 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87fc02c040 con 0x7f8800027060 2024-02-18T16:21:26.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8800036070 con 0x564c9822f6a0 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.014+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f8800027060 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f87fc02c040 con 0x7f8800027060 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8800036070 con 0x564c9822f6a0 2024-02-18T16:21:26.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.018+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f8800027060 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87fc02c040 con 0x7f8800027060 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x564c98229450 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f8800027060 2024-02-18T16:21:26.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87fc02c040 con 0x7f8800027060 2024-02-18T16:21:26.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c9822f6a0 2024-02-18T16:21:26.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f87fc027940 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f88040a9d10 con 0x7f87fc027940 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x564c98229450 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.022+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982321e0 con 0x7f8800027060 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87fc02c040 con 0x7f8800027060 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:26.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822e110 con 0x564c98229450 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822e960 con 0x564c98229450 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9822e960 con 0x564c98229450 2024-02-18T16:21:26.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 zone default found 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 4 Realm: () 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 zonegroup default 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98232620 con 0x7f87fc027940 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98234030 con 0x564c9822f6a0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98234490 con 0x564c9822f6a0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 started sync module instance, tier type = 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982338e0 con 0x7f8800027060 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.026+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94886969947200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98233c90 con 0x7f8800027060 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.030+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982351f0 con 0x564c98229450 2024-02-18T16:21:26.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.030+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94886969947200] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.030+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.030+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94886969952432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98233c90 con 0x564c98229450 2024-02-18T16:21:26.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.030+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982358c0 con 0x564c9822f6a0 2024-02-18T16:21:26.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94886969955264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98236110 con 0x564c9822f6a0 2024-02-18T16:21:26.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98236b00 con 0x7f8800027060 2024-02-18T16:21:26.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94886969952432] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94886969959904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98236eb0 con 0x7f8800027060 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98237820 con 0x564c98229450 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94886969955264] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94886969959904] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94886969953488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98237380 con 0x564c98229450 2024-02-18T16:21:26.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.034+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98238070 con 0x7f87fc027940 2024-02-18T16:21:26.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.038+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94886969953488] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.038+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.038+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94886969957488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98237da0 con 0x7f87fc027940 2024-02-18T16:21:26.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.038+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982385a0 con 0x7f87fc027940 2024-02-18T16:21:26.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94886969957488] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94886969964800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98238360 con 0x7f87fc027940 2024-02-18T16:21:26.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98238e00 con 0x7f87fc027940 2024-02-18T16:21:26.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94886969964800] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94886969968864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98238dc0 con 0x7f87fc027940 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=0 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=1 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=2 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=3 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=4 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=5 2024-02-18T16:21:26.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.042+0000 7f880ee52980 20 add_watcher() i=6 2024-02-18T16:21:26.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94886969968864] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 20 add_watcher() i=7 2024-02-18T16:21:26.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:26.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9823c300 con 0x564c98229450 2024-02-18T16:21:26.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94886969966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982396b0 con 0x564c98229450 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94886969966016] v30'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f86c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 5 note: GC not initialized 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f86c1fe3640 20 reqs_thread_entry: start 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 20 Filter name: none 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f86337fe640 20 reqs_thread_entry: start 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:26.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9825e190 con 0x564c98229450 2024-02-18T16:21:26.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.046+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:26.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:26.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c9825fb90 con 0x7f8800027060 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98261260 con 0x564c98229450 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-18T16:21:26.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98264750 con 0x7f8800027060 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98263760 con 0x7f8800027060 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:26.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.050+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982683f0 con 0x7f8800027060 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880ee52980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880ee52980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880ee52980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94886970163024 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982650d0 con 0x7f87fc027940 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== watch-notify(notify (1) cookie 94886969964800 notify 128849018881 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7f88040e7040 con 0x7f87fc027940 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f86e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94886969964800 notifier 4475 bl.length()=338 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f86e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f86e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(68 notify.6 [notify cookie 94886970163024 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.054+0000 7f86e3fff640 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86d0003ea0 con 0x7f87fc027940 2024-02-18T16:21:26.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== watch-notify(notify_complete (2) cookie 94886970163024 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564c981f0ea0 con 0x7f87fc027940 2024-02-18T16:21:26.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f86c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94886969966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98267f50 con 0x564c98229450 2024-02-18T16:21:26.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94886969966016] v30'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94886969947200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98267f50 con 0x7f8800027060 2024-02-18T16:21:26.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.058+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94886969947200] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87fc03f040 con 0x7f8800027060 2024-02-18T16:21:26.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.062+0000 7f880ee52980 20 remove_watcher() i=0 2024-02-18T16:21:26.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.062+0000 7f880ee52980 2 removed watcher, disabling cache 2024-02-18T16:21:26.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.062+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94886969952432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98233440 con 0x564c98229450 2024-02-18T16:21:26.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.062+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94886969952432] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.062+0000 7f880ee52980 20 remove_watcher() i=1 2024-02-18T16:21:26.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.062+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94886969955264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98267f50 con 0x564c9822f6a0 2024-02-18T16:21:26.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880c16c640 1 -- 172.21.15.129:0/3280611318 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94886969955264] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f880005d040 con 0x564c9822f6a0 2024-02-18T16:21:26.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880ee52980 20 remove_watcher() i=2 2024-02-18T16:21:26.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94886969959904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982348b0 con 0x7f8800027060 2024-02-18T16:21:26.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880d16e640 1 -- 172.21.15.129:0/3280611318 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94886969959904] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87fc048040 con 0x7f8800027060 2024-02-18T16:21:26.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880ee52980 20 remove_watcher() i=3 2024-02-18T16:21:26.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94886969953488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98233440 con 0x564c98229450 2024-02-18T16:21:26.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94886969953488] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x564c98229450 2024-02-18T16:21:26.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880ee52980 20 remove_watcher() i=4 2024-02-18T16:21:26.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.066+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94886969957488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982353c0 con 0x7f87fc027940 2024-02-18T16:21:26.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.070+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94886969957488] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.070+0000 7f880ee52980 20 remove_watcher() i=5 2024-02-18T16:21:26.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.070+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94886969964800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c98233440 con 0x7f87fc027940 2024-02-18T16:21:26.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.070+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94886969964800] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.070+0000 7f880ee52980 20 remove_watcher() i=6 2024-02-18T16:21:26.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.070+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94886969968864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c982353c0 con 0x7f87fc027940 2024-02-18T16:21:26.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94886969968864] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f88040f20c0 con 0x7f87fc027940 2024-02-18T16:21:26.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 20 remove_watcher() i=7 2024-02-18T16:21:26.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f87fc027940 msgr2=0x7f87fc0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f87fc027940 0x7f87fc0333c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c98229450 msgr2=0x564c9822b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c98229450 0x564c9822b910 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f8800027060 msgr2=0x7f88000435a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f8800027060 0x7f88000435a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c9822f6a0 msgr2=0x564c98231b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c9822f6a0 0x564c98231b10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86d80342b0 msgr2=0x7f86d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86d80342b0 0x7f86d8036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f87fc008fd0 tx=0x7f87fc01c070 comp rx=0 tx=0).stop 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880c96d640 1 -- 172.21.15.129:0/3280611318 reap_dead start 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 msgr2=0x564c9821de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c9821de80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f880000ff70 tx=0x7f8800048c10 comp rx=0 tx=0).stop 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 shutdown_connections 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3280611318 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980755d0 0x564c9821de80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 >> 172.21.15.129:0/3280611318 conn(0x564c982110c0 msgr2=0x564c9820e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 shutdown_connections 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3280611318 wait complete. 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e40342b0 msgr2=0x7f86e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e40342b0 0x7f86e4036770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x564c981f8340 tx=0x7f87fc003070 comp rx=0 tx=0).stop 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 msgr2=0x564c982081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 0x564c982081c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f880000e640 tx=0x7f880000ea40 comp rx=0 tx=0).stop 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 shutdown_connections 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86e40342b0 0x7f86e4036770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3219178277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c98207da0 0x564c982081c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 >> 172.21.15.129:0/3219178277 conn(0x564c981fcbb0 msgr2=0x564c981fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 shutdown_connections 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3219178277 wait complete. 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c981f5160 msgr2=0x564c981f7550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c981f5160 0x564c981f7550 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86f4034300 msgr2=0x7f86f40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86f4034300 0x7f86f40367c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8800001e50 tx=0x7f88000013b0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 msgr2=0x564c981f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 0x564c981f0510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f880401aec0 tx=0x7f8804017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 shutdown_connections 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c981f5160 0x564c981f7550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f86f4034300 0x7f86f40367c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 --2- 172.21.15.129:0/3387185816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c980ffa60 0x564c981f0510 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 >> 172.21.15.129:0/3387185816 conn(0x564c980faa10 msgr2=0x564c981e3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 shutdown_connections 2024-02-18T16:21:26.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.074+0000 7f880ee52980 1 -- 172.21.15.129:0/3387185816 wait complete. 2024-02-18T16:21:26.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-18T16:21:26.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-18T16:21:26.093 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-18T16:21:26.175 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:26.175 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:26.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58d711980 1 Processor -- start 2024-02-18T16:21:26.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58d711980 1 -- start start 2024-02-18T16:21:26.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58d711980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e1f87bc590 0x55e1f87be980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58d711980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e1f8705460 con 0x55e1f87b8080 2024-02-18T16:21:26.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58d711980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e1f86cc180 con 0x55e1f87bc590 2024-02-18T16:21:26.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58aa2b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e1f87bc590 0x55e1f87be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58aa2b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e1f87bc590 0x55e1f87be980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48956/0 (socket says 172.21.15.129:48956) 2024-02-18T16:21:26.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58b22c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55e1f87b8080 0x55e1f87b8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42864/0 (socket says 172.21.15.129:42864) 2024-02-18T16:21:26.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58aa2b640 1 -- 172.21.15.129:0/2826903069 learned_addr learned my addr 172.21.15.129:0/2826903069 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58aa2b640 1 -- 172.21.15.129:0/2826903069 >> v1:172.21.15.80:6789/0 conn(0x55e1f87b8080 legacy=0x55e1f87b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.170+0000 7fe58aa2b640 1 -- 172.21.15.129:0/2826903069 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f87bfed0 con 0x55e1f87bc590 2024-02-18T16:21:26.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/2826903069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87bc590 0x55e1f87be980 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe58000a5c0 tx=0x7fe58001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99c98cea97998f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58a22a640 1 -- 172.21.15.129:0/2826903069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800aa470 con 0x55e1f87bc590 2024-02-18T16:21:26.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58a22a640 1 -- 172.21.15.129:0/2826903069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800aa5d0 con 0x55e1f87bc590 2024-02-18T16:21:26.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58a22a640 1 -- 172.21.15.129:0/2826903069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800aa890 con 0x55e1f87bc590 2024-02-18T16:21:26.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 -- 172.21.15.129:0/2826903069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87bc590 msgr2=0x55e1f87be980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 --2- 172.21.15.129:0/2826903069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87bc590 0x55e1f87be980 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe58000a5c0 tx=0x7fe58001b340 comp rx=0 tx=0).stop 2024-02-18T16:21:26.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 -- 172.21.15.129:0/2826903069 shutdown_connections 2024-02-18T16:21:26.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 --2- 172.21.15.129:0/2826903069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87bc590 0x55e1f87be980 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 -- 172.21.15.129:0/2826903069 >> 172.21.15.129:0/2826903069 conn(0x55e1f87b3950 msgr2=0x55e1f87b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 -- 172.21.15.129:0/2826903069 shutdown_connections 2024-02-18T16:21:26.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.174+0000 7fe58d711980 1 -- 172.21.15.129:0/2826903069 wait complete. 2024-02-18T16:21:26.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58d711980 1 Processor -- start 2024-02-18T16:21:26.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58d711980 1 -- start start 2024-02-18T16:21:26.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58d711980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f872d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58d711980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f86c96b0 con 0x55e1f87b8080 2024-02-18T16:21:26.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58b22c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f872d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58b22c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f872d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48962/0 (socket says 172.21.15.129:48962) 2024-02-18T16:21:26.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58b22c640 1 -- 172.21.15.129:0/4196644132 learned_addr learned my addr 172.21.15.129:0/4196644132 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58b22c640 1 -- 172.21.15.129:0/4196644132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580005df0 con 0x55e1f87b8080 2024-02-18T16:21:26.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.190+0000 7fe58b22c640 1 --2- 172.21.15.129:0/4196644132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f872d060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe57c001cc0 tx=0x7fe57c00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82201d768c5e78c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe47960a640 1 -- 172.21.15.129:0/4196644132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe57c014070 con 0x55e1f87b8080 2024-02-18T16:21:26.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe47960a640 1 -- 172.21.15.129:0/4196644132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00f590 con 0x55e1f87b8080 2024-02-18T16:21:26.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe47960a640 1 -- 172.21.15.129:0/4196644132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe57c007040 con 0x55e1f87b8080 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/4196644132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 msgr2=0x55e1f872d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 --2- 172.21.15.129:0/4196644132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f872d060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe57c001cc0 tx=0x7fe57c00b610 comp rx=0 tx=0).stop 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/4196644132 shutdown_connections 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 --2- 172.21.15.129:0/4196644132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f872d060 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/4196644132 >> 172.21.15.129:0/4196644132 conn(0x55e1f87b3950 msgr2=0x55e1f889dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/4196644132 shutdown_connections 2024-02-18T16:21:26.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/4196644132 wait complete. 2024-02-18T16:21:26.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 Processor -- start 2024-02-18T16:21:26.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- start start 2024-02-18T16:21:26.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f88a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f86c4e90 con 0x55e1f87b8080 2024-02-18T16:21:26.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58b22c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f88a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58b22c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f88a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48970/0 (socket says 172.21.15.129:48970) 2024-02-18T16:21:26.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58b22c640 1 -- 172.21.15.129:0/179003566 learned_addr learned my addr 172.21.15.129:0/179003566 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58b22c640 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f8705460 con 0x55e1f87b8080 2024-02-18T16:21:26.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58b22c640 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f88a9fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55e1f88a4000 tx=0x7fe57c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe477e07640 1 -- 172.21.15.129:0/179003566 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe57c014030 con 0x55e1f87b8080 2024-02-18T16:21:26.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1f88aa500 con 0x55e1f87b8080 2024-02-18T16:21:26.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe477e07640 1 -- 172.21.15.129:0/179003566 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c01c840 con 0x55e1f87b8080 2024-02-18T16:21:26.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe477e07640 1 -- 172.21.15.129:0/179003566 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe57c01cb40 con 0x55e1f87b8080 2024-02-18T16:21:26.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.194+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1f88aa950 con 0x55e1f87b8080 2024-02-18T16:21:26.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe477e07640 1 -- 172.21.15.129:0/179003566 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe57c01cca0 con 0x55e1f87b8080 2024-02-18T16:21:26.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe477e07640 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe470034300 0x7fe4700367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe477e07640 1 -- 172.21.15.129:0/179003566 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe57c006070 con 0x55e1f87b8080 2024-02-18T16:21:26.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe470034300 0x7fe4700367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f87bc590 0x55e1f88b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88b1180 con 0x55e1f87bc590 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f87bc590 0x55e1f88b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe470034300 0x7fe4700367c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5800ae000 tx=0x7fe5800a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f87bc590 0x55e1f88b0c40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 -- 172.21.15.129:0/179003566 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe58400a4d0 con 0x55e1f87bc590 2024-02-18T16:21:26.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88b1570 con 0x55e1f87bc590 2024-02-18T16:21:26.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 -- 172.21.15.129:0/179003566 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe58400a4d0 con 0x55e1f87bc590 2024-02-18T16:21:26.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88b2e20 con 0x55e1f87bc590 2024-02-18T16:21:26.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 -- 172.21.15.129:0/179003566 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe58400a4d0 con 0x55e1f87bc590 2024-02-18T16:21:26.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88b2020 con 0x55e1f87bc590 2024-02-18T16:21:26.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 -- 172.21.15.129:0/179003566 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe58400a4d0 con 0x55e1f87bc590 2024-02-18T16:21:26.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88b2430 con 0x55e1f87bc590 2024-02-18T16:21:26.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.198+0000 7fe58ba2d640 1 -- 172.21.15.129:0/179003566 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe58400a4d0 con 0x55e1f87bc590 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 Processor -- start 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 -- start start 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 0x55e1f88c1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f865df20 con 0x55e1f88c1500 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58aa2b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 0x55e1f88c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58aa2b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 0x55e1f88c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48972/0 (socket says 172.21.15.129:48972) 2024-02-18T16:21:26.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58aa2b640 1 -- 172.21.15.129:0/1300165365 learned_addr learned my addr 172.21.15.129:0/1300165365 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58aa2b640 1 -- 172.21.15.129:0/1300165365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f88c1e60 con 0x55e1f88c1500 2024-02-18T16:21:26.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 0x55e1f88c1920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe5800ac040 tx=0x7fe5800180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe475602640 1 -- 172.21.15.129:0/1300165365 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800b3cd0 con 0x55e1f88c1500 2024-02-18T16:21:26.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1f88c2050 con 0x55e1f88c1500 2024-02-18T16:21:26.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe475602640 1 -- 172.21.15.129:0/1300165365 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800c3070 con 0x55e1f88c1500 2024-02-18T16:21:26.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe475602640 1 -- 172.21.15.129:0/1300165365 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800c8430 con 0x55e1f88c1500 2024-02-18T16:21:26.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1f88c2b40 con 0x55e1f88c1500 2024-02-18T16:21:26.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe475602640 1 -- 172.21.15.129:0/1300165365 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe5800c5030 con 0x55e1f88c1500 2024-02-18T16:21:26.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe475602640 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4640342b0 0x7fe464036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe475602640 1 -- 172.21.15.129:0/1300165365 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe5800e67d0 con 0x55e1f88c1500 2024-02-18T16:21:26.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4640342b0 0x7fe464036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.202+0000 7fe58d711980 1 Processor -- start 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- start start 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4640342b0 0x7fe464036770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55e1f88b1a60 tx=0x7fe584005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f8651790 con 0x55e1f88a3500 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88a38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48974/0 (socket says 172.21.15.129:48974) 2024-02-18T16:21:26.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 -- 172.21.15.129:0/4233967507 learned_addr learned my addr 172.21.15.129:0/4233967507 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 -- 172.21.15.129:0/4233967507 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f88a1d30 con 0x55e1f88a3500 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/4233967507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88a38e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe5800befd0 tx=0x7fe5800bd450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf7f7b4d9708dd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe46effd640 1 -- 172.21.15.129:0/4233967507 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800d6040 con 0x55e1f88a3500 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe46effd640 1 -- 172.21.15.129:0/4233967507 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800c7c50 con 0x55e1f88a3500 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe46effd640 1 -- 172.21.15.129:0/4233967507 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800c7590 con 0x55e1f88a3500 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- 172.21.15.129:0/4233967507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 msgr2=0x55e1f88a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 --2- 172.21.15.129:0/4233967507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88a38e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe5800befd0 tx=0x7fe5800bd450 comp rx=0 tx=0).stop 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- 172.21.15.129:0/4233967507 shutdown_connections 2024-02-18T16:21:26.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 --2- 172.21.15.129:0/4233967507 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88a38e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- 172.21.15.129:0/4233967507 >> 172.21.15.129:0/4233967507 conn(0x55e1f88ca870 msgr2=0x55e1f88c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- 172.21.15.129:0/4233967507 shutdown_connections 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- 172.21.15.129:0/4233967507 wait complete. 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 Processor -- start 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- start start 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88d7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58d711980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f88d7b70 con 0x55e1f88a3500 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88d7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48990/0 (socket says 172.21.15.129:48990) 2024-02-18T16:21:26.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.206+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 learned_addr learned my addr 172.21.15.129:0/3444719250 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f88c2b40 con 0x55e1f88a3500 2024-02-18T16:21:26.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88d7630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5800b3b20 tx=0x7fe5800e4b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe46d7fa640 1 -- 172.21.15.129:0/3444719250 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800e6cf0 con 0x55e1f88a3500 2024-02-18T16:21:26.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1f88d7d70 con 0x55e1f88a3500 2024-02-18T16:21:26.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe46d7fa640 1 -- 172.21.15.129:0/3444719250 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800ea070 con 0x55e1f88a3500 2024-02-18T16:21:26.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe46d7fa640 1 -- 172.21.15.129:0/3444719250 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800bd9d0 con 0x55e1f88a3500 2024-02-18T16:21:26.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1f88d7d70 con 0x55e1f88a3500 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe46d7fa640 1 -- 172.21.15.129:0/3444719250 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe5800e2050 con 0x55e1f88a3500 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe46d7fa640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4540342b0 0x7fe454036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe46d7fa640 1 -- 172.21.15.129:0/3444719250 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe5800ec070 con 0x55e1f88a3500 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4540342b0 0x7fe454036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f88e28e0 0x55e1f88e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e54f0 con 0x55e1f88e28e0 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58b22c640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f88e28e0 0x55e1f88e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4540342b0 0x7fe454036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe584011010 tx=0x7fe584020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58b22c640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f88e28e0 0x55e1f88e4da0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 realm 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e58c0 con 0x55e1f88e28e0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e6140 con 0x55e1f88e28e0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.210+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e64a0 con 0x55e1f88e28e0 2024-02-18T16:21:26.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e6ca0 con 0x55e1f88e28e0 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 20 searching for the correct realm 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e1f88e8b30 0x55e1f88eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e1f88e8b30 0x55e1f88eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e1f88e8b30 0x55e1f88eafa0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58aa2b640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe5800db070 0x7fe5800069b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5800db070 2024-02-18T16:21:26.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe5800db070 0x7fe5800069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe5800db070 0x7fe5800069b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe58400a4d0 con 0x7fe5800db070 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58ba2d640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe5840141d0 0x7fe584015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58b22c640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe5840141d0 0x7fe584015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.214+0000 7fe58b22c640 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe5840141d0 0x7fe584015940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5800db070 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe58400a4d0 con 0x7fe5800db070 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.218+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5800db070 2024-02-18T16:21:26.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.222+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5800db070 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5800db070 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e8b30 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5840141d0 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x55e1f88e28e0 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.226+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eb670 con 0x7fe5800db070 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:26.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e75d0 con 0x55e1f88e28e0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88e7e20 con 0x55e1f88e28e0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ebab0 con 0x55e1f88e28e0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 zone default found 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 4 Realm: () 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 zonegroup default 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ebb00 con 0x7fe5840141d0 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ed8e0 con 0x55e1f88e8b30 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88edcf0 con 0x55e1f88e8b30 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 started sync module instance, tier type = 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:26.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.230+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ed1c0 con 0x7fe5800db070 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94429026110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ed570 con 0x7fe5800db070 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88eea50 con 0x55e1f88e28e0 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94429026110752] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94429026115856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ee9d0 con 0x55e1f88e28e0 2024-02-18T16:21:26.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.234+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ef440 con 0x55e1f88e8b30 2024-02-18T16:21:26.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94429026119456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88efc90 con 0x55e1f88e8b30 2024-02-18T16:21:26.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f0680 con 0x7fe5800db070 2024-02-18T16:21:26.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94429026115856] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94429026124128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f0a30 con 0x7fe5800db070 2024-02-18T16:21:26.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f13e0 con 0x55e1f88e28e0 2024-02-18T16:21:26.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94429026119456] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.238+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94429026124128] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94429026116912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f0f00 con 0x55e1f88e28e0 2024-02-18T16:21:26.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f1c30 con 0x7fe5840141d0 2024-02-18T16:21:26.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94429026129072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f1d70 con 0x7fe5840141d0 2024-02-18T16:21:26.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f26e0 con 0x7fe5840141d0 2024-02-18T16:21:26.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94429026116912] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94429026129072] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.242+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94429026130128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f1cf0 con 0x7fe5840141d0 2024-02-18T16:21:26.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f2b80 con 0x7fe5840141d0 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94429026133728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f2fa0 con 0x7fe5840141d0 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=0 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=1 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=2 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=3 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=4 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=5 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94429026130128] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.246+0000 7fe58d711980 20 add_watcher() i=6 2024-02-18T16:21:26.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94429026133728] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 add_watcher() i=7 2024-02-18T16:21:26.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:26.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f2330 con 0x55e1f88e28e0 2024-02-18T16:21:26.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94429026134784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f3830 con 0x55e1f88e28e0 2024-02-18T16:21:26.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94429026134784] v30'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe441fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 5 note: GC not initialized 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe440fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 Filter name: none 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe3ba7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f8917ed0 con 0x7fe5840141d0 2024-02-18T16:21:26.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.250+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f89166a0 con 0x7fe5840141d0 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:21:26.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f8916a80 con 0x7fe5840141d0 2024-02-18T16:21:26.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-18T16:21:26.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:26.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-18T16:21:26.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94429026285872 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f89172c0 con 0x7fe5840141d0 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== watch-notify(notify (1) cookie 94429026129072 notify 128849018882 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55e1f88aa950 con 0x7fe5840141d0 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(65 notify.5 [notify cookie 94429026285872 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe46effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94429026129072 notifier 4482 bl.length()=522 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe46effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe46effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.254+0000 7fe46effd640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe450003ea0 con 0x7fe5840141d0 2024-02-18T16:21:26.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== watch-notify(notify_complete (2) cookie 94429026285872 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e1f88aa500 con 0x7fe5840141d0 2024-02-18T16:21:26.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f89172c0 con 0x7fe5840141d0 2024-02-18T16:21:26.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58d711980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:21:26.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58d711980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:26.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58d711980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:21:26.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94429026285872 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f89172c0 con 0x55e1f88e8b30 2024-02-18T16:21:26.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== watch-notify(notify (1) cookie 94429026119456 notify 128849018882 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55e1f88c2b40 con 0x55e1f88e8b30 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe46effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94429026119456 notifier 4482 bl.length()=177 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe46effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe46effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 notify.2 [notify cookie 94429026285872 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe46effd640 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe450003ea0 con 0x55e1f88e8b30 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.258+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== watch-notify(notify_complete (2) cookie 94429026285872 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e1f88a1d30 con 0x55e1f88e8b30 2024-02-18T16:21:26.266 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:26.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe441fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94429026134784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f8200 con 0x55e1f88e28e0 2024-02-18T16:21:26.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94429026134784] v30'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94429026110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f2b00 con 0x7fe5800db070 2024-02-18T16:21:26.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94429026110752] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58d711980 20 remove_watcher() i=0 2024-02-18T16:21:26.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58d711980 2 removed watcher, disabling cache 2024-02-18T16:21:26.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.262+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94429026115856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ecd20 con 0x55e1f88e28e0 2024-02-18T16:21:26.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.266+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94429026115856] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.266+0000 7fe58d711980 20 remove_watcher() i=1 2024-02-18T16:21:26.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.266+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94429026119456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ecd20 con 0x55e1f88e8b30 2024-02-18T16:21:26.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.266+0000 7fe58aa2b640 1 -- 172.21.15.129:0/3444719250 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94429026119456] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe580103040 con 0x55e1f88e8b30 2024-02-18T16:21:26.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.266+0000 7fe58d711980 20 remove_watcher() i=2 2024-02-18T16:21:26.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.266+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94429026124128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ecd20 con 0x7fe5800db070 2024-02-18T16:21:26.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.270+0000 7fe58ba2d640 1 -- 172.21.15.129:0/3444719250 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94429026124128] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe58403a040 con 0x7fe5800db070 2024-02-18T16:21:26.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.270+0000 7fe58d711980 20 remove_watcher() i=3 2024-02-18T16:21:26.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.270+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94429026116912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f0160 con 0x55e1f88e28e0 2024-02-18T16:21:26.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.270+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94429026116912] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x55e1f88e28e0 2024-02-18T16:21:26.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.270+0000 7fe58d711980 20 remove_watcher() i=4 2024-02-18T16:21:26.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.270+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94429026129072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f0160 con 0x7fe5840141d0 2024-02-18T16:21:26.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.274+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94429026129072] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.274+0000 7fe58d711980 20 remove_watcher() i=5 2024-02-18T16:21:26.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.274+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94429026130128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88f14b0 con 0x7fe5840141d0 2024-02-18T16:21:26.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.274+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94429026130128] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.274+0000 7fe58d711980 20 remove_watcher() i=6 2024-02-18T16:21:26.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.274+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94429026133728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1f88ecd20 con 0x7fe5840141d0 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94429026133728] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe57c016070 con 0x7fe5840141d0 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 20 remove_watcher() i=7 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe5840141d0 msgr2=0x7fe584015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe5840141d0 0x7fe584015940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f88e28e0 msgr2=0x55e1f88e4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f88e28e0 0x55e1f88e4da0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe5800db070 msgr2=0x7fe5800069b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fe5800db070 0x7fe5800069b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e1f88e8b30 msgr2=0x55e1f88eafa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e1f88e8b30 0x55e1f88eafa0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4540342b0 msgr2=0x7fe454036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4540342b0 0x7fe454036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe584011010 tx=0x7fe584020000 comp rx=0 tx=0).stop 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 msgr2=0x55e1f88d7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58b22c640 1 -- 172.21.15.129:0/3444719250 reap_dead start 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88d7630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5800b3b20 tx=0x7fe5800e4b90 comp rx=0 tx=0).stop 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 shutdown_connections 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/3444719250 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88a3500 0x55e1f88d7630 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5800b3b20 tx=0x7fe5800e4b90 comp rx=0 tx=0).stop 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 >> 172.21.15.129:0/3444719250 conn(0x55e1f88ca870 msgr2=0x55e1f88c7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 shutdown_connections 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/3444719250 wait complete. 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4640342b0 msgr2=0x7fe464036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4640342b0 0x7fe464036770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55e1f88b1a60 tx=0x7fe584005850 comp rx=0 tx=0).stop 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 msgr2=0x55e1f88c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 0x55e1f88c1920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe5800ac040 tx=0x7fe5800180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 shutdown_connections 2024-02-18T16:21:26.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe4640342b0 0x7fe464036770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/1300165365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f88c1500 0x55e1f88c1920 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 >> 172.21.15.129:0/1300165365 conn(0x55e1f88b6310 msgr2=0x55e1f88b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 shutdown_connections 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/1300165365 wait complete. 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f87bc590 msgr2=0x55e1f88b0c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f87bc590 0x55e1f88b0c40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe470034300 msgr2=0x7fe4700367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe470034300 0x7fe4700367c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5800ae000 tx=0x7fe5800a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 msgr2=0x55e1f88a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f88a9fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55e1f88a4000 tx=0x7fe57c000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 shutdown_connections 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e1f87bc590 0x55e1f88b0c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe470034300 0x7fe4700367c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 --2- 172.21.15.129:0/179003566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e1f87b8080 0x55e1f88a9fc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 >> 172.21.15.129:0/179003566 conn(0x55e1f87b3950 msgr2=0x55e1f889c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 shutdown_connections 2024-02-18T16:21:26.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.278+0000 7fe58d711980 1 -- 172.21.15.129:0/179003566 wait complete. 2024-02-18T16:21:26.295 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:26.303 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-18T16:21:26.309 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:26.309 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-02-18T16:21:26.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-02-18T16:21:26.309 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-02-18T16:21:26.372 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:26.372 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:26.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75ce6ab980 1 Processor -- start 2024-02-18T16:21:26.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75ce6ab980 1 -- start start 2024-02-18T16:21:26.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75ce6ab980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d323ca9680 0x55d323caba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75ce6ab980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d323bf14c0 con 0x55d323ca5170 2024-02-18T16:21:26.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75ce6ab980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d323bb8180 con 0x55d323ca9680 2024-02-18T16:21:26.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75cb9c5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d323ca9680 0x55d323caba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75cc1c6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55d323ca5170 0x55d323ca5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42872/0 (socket says 172.21.15.129:42872) 2024-02-18T16:21:26.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75cb9c5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d323ca9680 0x55d323caba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:48998/0 (socket says 172.21.15.129:48998) 2024-02-18T16:21:26.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.366+0000 7f75cc1c6640 1 -- 172.21.15.129:0/1284125387 learned_addr learned my addr 172.21.15.129:0/1284125387 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:26.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.370+0000 7f75cb9c5640 1 -- 172.21.15.129:0/1284125387 >> v1:172.21.15.80:6789/0 conn(0x55d323ca5170 legacy=0x55d323ca5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.370+0000 7f75cb9c5640 1 -- 172.21.15.129:0/1284125387 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d323cacfc0 con 0x55d323ca9680 2024-02-18T16:21:26.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/1284125387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca9680 0x55d323caba70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f75c000a480 tx=0x7f75c001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35130dc0178bf33d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75cb1c4640 1 -- 172.21.15.129:0/1284125387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00ab540 con 0x55d323ca9680 2024-02-18T16:21:26.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75cb1c4640 1 -- 172.21.15.129:0/1284125387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00ab6a0 con 0x55d323ca9680 2024-02-18T16:21:26.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75cb1c4640 1 -- 172.21.15.129:0/1284125387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00ab960 con 0x55d323ca9680 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1284125387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca9680 msgr2=0x55d323caba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1284125387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca9680 0x55d323caba70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f75c000a480 tx=0x7f75c001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1284125387 shutdown_connections 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1284125387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca9680 0x55d323caba70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1284125387 >> 172.21.15.129:0/1284125387 conn(0x55d323ca0a40 msgr2=0x55d323ca2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1284125387 shutdown_connections 2024-02-18T16:21:26.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.374+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1284125387 wait complete. 2024-02-18T16:21:26.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 Processor -- start 2024-02-18T16:21:26.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- start start 2024-02-18T16:21:26.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323c1af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d323bb56b0 con 0x55d323ca5170 2024-02-18T16:21:26.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75cc1c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323c1af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75cc1c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323c1af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49000/0 (socket says 172.21.15.129:49000) 2024-02-18T16:21:26.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75cc1c6640 1 -- 172.21.15.129:0/4257405306 learned_addr learned my addr 172.21.15.129:0/4257405306 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75cc1c6640 1 -- 172.21.15.129:0/4257405306 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c0005d30 con 0x55d323ca5170 2024-02-18T16:21:26.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75cc1c6640 1 --2- 172.21.15.129:0/4257405306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323c1af00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f75bc001c00 tx=0x7f75bc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e263344734712be0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f74ba60c640 1 -- 172.21.15.129:0/4257405306 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc00e690 con 0x55d323ca5170 2024-02-18T16:21:26.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f74ba60c640 1 -- 172.21.15.129:0/4257405306 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00e810 con 0x55d323ca5170 2024-02-18T16:21:26.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f74ba60c640 1 -- 172.21.15.129:0/4257405306 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc00eb30 con 0x55d323ca5170 2024-02-18T16:21:26.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- 172.21.15.129:0/4257405306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 msgr2=0x55d323c1af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/4257405306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323c1af00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f75bc001c00 tx=0x7f75bc00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- 172.21.15.129:0/4257405306 shutdown_connections 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/4257405306 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323c1af00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- 172.21.15.129:0/4257405306 >> 172.21.15.129:0/4257405306 conn(0x55d323ca0a40 msgr2=0x55d323d8abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- 172.21.15.129:0/4257405306 shutdown_connections 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- 172.21.15.129:0/4257405306 wait complete. 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 Processor -- start 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- start start 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323d98170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.390+0000 7f75ce6ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d323bb0e90 con 0x55d323ca5170 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc1c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323d98170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc1c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323d98170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49012/0 (socket says 172.21.15.129:49012) 2024-02-18T16:21:26.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc1c6640 1 -- 172.21.15.129:0/1954492409 learned_addr learned my addr 172.21.15.129:0/1954492409 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc1c6640 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d323bf14c0 con 0x55d323ca5170 2024-02-18T16:21:26.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc1c6640 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323d98170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00b710 tx=0x7f75bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f74b8e09640 1 -- 172.21.15.129:0/1954492409 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc01f070 con 0x55d323ca5170 2024-02-18T16:21:26.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d323d986b0 con 0x55d323ca5170 2024-02-18T16:21:26.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f74b8e09640 1 -- 172.21.15.129:0/1954492409 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc01a910 con 0x55d323ca5170 2024-02-18T16:21:26.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d323d98ae0 con 0x55d323ca5170 2024-02-18T16:21:26.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f74b8e09640 1 -- 172.21.15.129:0/1954492409 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc01abf0 con 0x55d323ca5170 2024-02-18T16:21:26.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f74b8e09640 1 -- 172.21.15.129:0/1954492409 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75bc00a040 con 0x55d323ca5170 2024-02-18T16:21:26.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f74b8e09640 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b4034300 0x7f74b40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f74b8e09640 1 -- 172.21.15.129:0/1954492409 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f75bc049e50 con 0x55d323ca5170 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b4034300 0x7f74b40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323ca9680 0x55d323d9edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323d9f330 con 0x55d323ca9680 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323ca9680 0x55d323d9edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b4034300 0x7f74b40367c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ad000 tx=0x7f75c00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323ca9680 0x55d323d9edf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75cc9c7640 1 -- 172.21.15.129:0/1954492409 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75c400a4d0 con 0x55d323ca9680 2024-02-18T16:21:26.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.394+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323d9f6f0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cc9c7640 1 -- 172.21.15.129:0/1954492409 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75c400a4d0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323da0fa0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cc9c7640 1 -- 172.21.15.129:0/1954492409 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f75c400a4d0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323da01a0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cc9c7640 1 -- 172.21.15.129:0/1954492409 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75c400a4d0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323da05b0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cc9c7640 1 -- 172.21.15.129:0/1954492409 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f75c400a4d0 con 0x55d323ca9680 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 Processor -- start 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- start start 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 0x55d323dafa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d323b49f20 con 0x55d323daf620 2024-02-18T16:21:26.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cb9c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 0x55d323dafa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cb9c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 0x55d323dafa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49026/0 (socket says 172.21.15.129:49026) 2024-02-18T16:21:26.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cb9c5640 1 -- 172.21.15.129:0/1973496713 learned_addr learned my addr 172.21.15.129:0/1973496713 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cb9c5640 1 -- 172.21.15.129:0/1973496713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d323daff80 con 0x55d323daf620 2024-02-18T16:21:26.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 0x55d323dafa40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75c0096e80 tx=0x7f75c0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f74b1ffb640 1 -- 172.21.15.129:0/1973496713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00bd8a0 con 0x55d323daf620 2024-02-18T16:21:26.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f74b1ffb640 1 -- 172.21.15.129:0/1973496713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00bda00 con 0x55d323daf620 2024-02-18T16:21:26.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d323db0170 con 0x55d323daf620 2024-02-18T16:21:26.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f74b1ffb640 1 -- 172.21.15.129:0/1973496713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00bdca0 con 0x55d323daf620 2024-02-18T16:21:26.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.398+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d323db0cc0 con 0x55d323daf620 2024-02-18T16:21:26.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f74b1ffb640 1 -- 172.21.15.129:0/1973496713 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75c00be480 con 0x55d323daf620 2024-02-18T16:21:26.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f74b1ffb640 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a40342b0 0x7f74a4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f74b1ffb640 1 -- 172.21.15.129:0/1973496713 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f75c00e6420 con 0x55d323daf620 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a40342b0 0x7f74a4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 Processor -- start 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- start start 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a40342b0 0x7f74a4036770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55d323d9fbe0 tx=0x7f75c4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dbca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d323b3d790 con 0x55d323dbc600 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cb9c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dbca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cb9c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dbca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49042/0 (socket says 172.21.15.129:49042) 2024-02-18T16:21:26.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cb9c5640 1 -- 172.21.15.129:0/2407653017 learned_addr learned my addr 172.21.15.129:0/2407653017 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cb9c5640 1 -- 172.21.15.129:0/2407653017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d323dbcff0 con 0x55d323dbc600 2024-02-18T16:21:26.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/2407653017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dbca20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f75c00e4780 tx=0x7f75c00aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc3ab80c7551205 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f74ab7fe640 1 -- 172.21.15.129:0/2407653017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c0006390 con 0x55d323dbc600 2024-02-18T16:21:26.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f74ab7fe640 1 -- 172.21.15.129:0/2407653017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00064f0 con 0x55d323dbc600 2024-02-18T16:21:26.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f74ab7fe640 1 -- 172.21.15.129:0/2407653017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00be860 con 0x55d323dbc600 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- 172.21.15.129:0/2407653017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 msgr2=0x55d323dbca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/2407653017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dbca20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f75c00e4780 tx=0x7f75c00aae30 comp rx=0 tx=0).stop 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- 172.21.15.129:0/2407653017 shutdown_connections 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/2407653017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dbca20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- 172.21.15.129:0/2407653017 >> 172.21.15.129:0/2407653017 conn(0x55d323db8990 msgr2=0x55d323db69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- 172.21.15.129:0/2407653017 shutdown_connections 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.402+0000 7f75ce6ab980 1 -- 172.21.15.129:0/2407653017 wait complete. 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 Processor -- start 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 -- start start 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dc3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d323dc3a70 con 0x55d323dbc600 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cb9c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dc3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cb9c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dc3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49048/0 (socket says 172.21.15.129:49048) 2024-02-18T16:21:26.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 learned_addr learned my addr 172.21.15.129:0/665825121 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d323db0cc0 con 0x55d323dbc600 2024-02-18T16:21:26.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dc3530 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ab5a0 tx=0x7f75c00e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f74a9ffb640 1 -- 172.21.15.129:0/665825121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00e33e0 con 0x55d323dbc600 2024-02-18T16:21:26.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d323dc3c70 con 0x55d323dbc600 2024-02-18T16:21:26.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f74a9ffb640 1 -- 172.21.15.129:0/665825121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00d7040 con 0x55d323dbc600 2024-02-18T16:21:26.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f74a9ffb640 1 -- 172.21.15.129:0/665825121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c00ade80 con 0x55d323dbc600 2024-02-18T16:21:26.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d323dc4040 con 0x55d323dbc600 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f74a9ffb640 1 -- 172.21.15.129:0/665825121 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75c00b4370 con 0x55d323dbc600 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f74a9ffb640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f749c034300 0x7f749c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f74a9ffb640 1 -- 172.21.15.129:0/665825121 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f75c00b6040 con 0x55d323dbc600 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f749c034300 0x7f749c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323dcea80 0x55d323dd0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd1670 con 0x55d323dcea80 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.406+0000 7f75cc1c6640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323dcea80 0x55d323dd0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f749c034300 0x7f749c0367c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75c4011010 tx=0x7f75c4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc1c6640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323dcea80 0x55d323dd0f20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 realm 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd1a40 con 0x55d323dcea80 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd2290 con 0x55d323dcea80 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd25f0 con 0x55d323dcea80 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd1f30 con 0x55d323dcea80 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 20 searching for the correct realm 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d323dd4840 0x55d323dd6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d323dd4840 0x55d323dd6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d323dd4840 0x55d323dd6c70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cb9c5640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75c00ef070 0x7f75c00db870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c00ef070 2024-02-18T16:21:26.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75c00ef070 0x7f75c00db870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75c00ef070 0x7f75c00db870 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c400a4d0 con 0x7f75c00ef070 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc9c7640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c40141d0 0x7f75c4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.410+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c40141d0 0x7f75c4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c40141d0 0x7f75c4015940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc02e8c0 con 0x7f75c40141d0 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc02e8c0 con 0x55d323dcea80 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc02e8c0 con 0x7f75c40141d0 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc02e8c0 con 0x7f75c40141d0 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c00ef070 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c400a4d0 con 0x7f75c00ef070 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.414+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x55d323dcea80 2024-02-18T16:21:26.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x7f75c40141d0 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x55d323dcea80 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c00ef070 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x7f75c40141d0 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x55d323dcea80 2024-02-18T16:21:26.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f75bc04c040 con 0x55d323dcea80 2024-02-18T16:21:26.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.418+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x7f75c40141d0 2024-02-18T16:21:26.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c00ef070 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x55d323dcea80 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x7f75c40141d0 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc04c040 con 0x7f75c40141d0 2024-02-18T16:21:26.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c00ef070 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dd4840 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.422+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c40141d0 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x55d323dcea80 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7340 con 0x7f75c00ef070 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:26.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd3490 con 0x55d323dcea80 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd3110 con 0x55d323dcea80 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd3d60 con 0x55d323dcea80 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:26.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 zone default found 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 4 Realm: () 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 zonegroup default 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd7780 con 0x7f75c40141d0 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd9190 con 0x55d323dd4840 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd9620 con 0x55d323dd4840 2024-02-18T16:21:26.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 started sync module instance, tier type = 2024-02-18T16:21:26.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:26.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.426+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd8a40 con 0x7f75c00ef070 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94365328180640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd8df0 con 0x7f75c00ef070 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dda380 con 0x55d323dcea80 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94365328180640] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94365328185920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dda300 con 0x55d323dcea80 2024-02-18T16:21:26.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.430+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddad90 con 0x55d323dd4840 2024-02-18T16:21:26.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94365328189616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddb610 con 0x55d323dd4840 2024-02-18T16:21:26.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94365328185920] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddc000 con 0x7f75c00ef070 2024-02-18T16:21:26.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94365328194272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddc3b0 con 0x7f75c00ef070 2024-02-18T16:21:26.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddcd20 con 0x55d323dcea80 2024-02-18T16:21:26.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.434+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94365328189616] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94365328194272] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94365328186976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddc880 con 0x55d323dcea80 2024-02-18T16:21:26.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddd570 con 0x7f75c40141d0 2024-02-18T16:21:26.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94365328186976] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94365328191856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddd2a0 con 0x7f75c40141d0 2024-02-18T16:21:26.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.438+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dddaa0 con 0x7f75c40141d0 2024-02-18T16:21:26.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.442+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94365328191856] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.442+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.442+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94365328199440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddd950 con 0x7f75c40141d0 2024-02-18T16:21:26.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.442+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dde420 con 0x7f75c40141d0 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94365328203520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dde8c0 con 0x7f75c40141d0 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=0 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=1 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=2 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=3 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=4 2024-02-18T16:21:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=5 2024-02-18T16:21:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94365328199440] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=6 2024-02-18T16:21:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94365328203520] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 20 add_watcher() i=7 2024-02-18T16:21:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddd3f0 con 0x55d323dcea80 2024-02-18T16:21:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94365328204768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddd3b0 con 0x55d323dcea80 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94365328204768] v30'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.446+0000 7f74827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 5 note: GC not initialized 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f74817e2640 20 reqs_thread_entry: start 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:26.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 20 Filter name: none 2024-02-18T16:21:26.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f73f2ffd640 20 reqs_thread_entry: start 2024-02-18T16:21:26.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323e03150 con 0x7f75c00ef070 2024-02-18T16:21:26.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:26.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f74827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94365328204768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323de3f10 con 0x55d323dcea80 2024-02-18T16:21:26.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94365328204768] v30'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.450+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94365328180640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dde3e0 con 0x7f75c00ef070 2024-02-18T16:21:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94365328180640] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75ce6ab980 20 remove_watcher() i=0 2024-02-18T16:21:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75ce6ab980 2 removed watcher, disabling cache 2024-02-18T16:21:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94365328185920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd85a0 con 0x55d323dcea80 2024-02-18T16:21:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94365328185920] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75ce6ab980 20 remove_watcher() i=1 2024-02-18T16:21:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.454+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94365328189616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd85a0 con 0x55d323dd4840 2024-02-18T16:21:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.458+0000 7f75cb9c5640 1 -- 172.21.15.129:0/665825121 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94365328189616] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c00ec070 con 0x55d323dd4840 2024-02-18T16:21:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.458+0000 7f75ce6ab980 20 remove_watcher() i=2 2024-02-18T16:21:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.458+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94365328194272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd9a40 con 0x7f75c00ef070 2024-02-18T16:21:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.458+0000 7f75cc9c7640 1 -- 172.21.15.129:0/665825121 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94365328194272] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c403a040 con 0x7f75c00ef070 2024-02-18T16:21:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.458+0000 7f75ce6ab980 20 remove_watcher() i=3 2024-02-18T16:21:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.458+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94365328186976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd9a40 con 0x55d323dcea80 2024-02-18T16:21:26.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.462+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94365328186976] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x55d323dcea80 2024-02-18T16:21:26.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.462+0000 7f75ce6ab980 20 remove_watcher() i=4 2024-02-18T16:21:26.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.462+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94365328191856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323dd9ee0 con 0x7f75c40141d0 2024-02-18T16:21:26.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.462+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94365328191856] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.462+0000 7f75ce6ab980 20 remove_watcher() i=5 2024-02-18T16:21:26.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.462+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94365328199440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddb170 con 0x7f75c40141d0 2024-02-18T16:21:26.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94365328199440] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 20 remove_watcher() i=6 2024-02-18T16:21:26.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94365328203520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d323ddb170 con 0x7f75c40141d0 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94365328203520] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75bc05c040 con 0x7f75c40141d0 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 20 remove_watcher() i=7 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c40141d0 msgr2=0x7f75c4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c40141d0 0x7f75c4015940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323dcea80 msgr2=0x55d323dd0f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323dcea80 0x55d323dd0f20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75c00ef070 msgr2=0x7f75c00db870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75c00ef070 0x7f75c00db870 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d323dd4840 msgr2=0x55d323dd6c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.466+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d323dd4840 0x55d323dd6c70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f749c034300 msgr2=0x7f749c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f749c034300 0x7f749c0367c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75c4011010 tx=0x7f75c4020000 comp rx=0 tx=0).stop 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 msgr2=0x55d323dc3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/665825121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323dbc600 0x55d323dc3530 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ab5a0 tx=0x7f75c00e46e0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 reap_dead start 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75cc1c6640 1 -- 172.21.15.129:0/665825121 reap_dead start 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 shutdown_connections 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 >> 172.21.15.129:0/665825121 conn(0x55d323db8990 msgr2=0x55d323db5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 shutdown_connections 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/665825121 wait complete. 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a40342b0 msgr2=0x7f74a4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a40342b0 0x7f74a4036770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55d323d9fbe0 tx=0x7f75c4005850 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 msgr2=0x55d323dafa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 0x55d323dafa40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75c0096e80 tx=0x7f75c0018020 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 shutdown_connections 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a40342b0 0x7f74a4036770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1973496713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323daf620 0x55d323dafa40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 >> 172.21.15.129:0/1973496713 conn(0x55d323da4430 msgr2=0x55d323da4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 shutdown_connections 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1973496713 wait complete. 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323ca9680 msgr2=0x55d323d9edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323ca9680 0x55d323d9edf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b4034300 msgr2=0x7f74b40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b4034300 0x7f74b40367c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ad000 tx=0x7f75c00a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 msgr2=0x55d323d98170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323d98170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00b710 tx=0x7f75bc000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 shutdown_connections 2024-02-18T16:21:26.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d323ca9680 0x55d323d9edf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b4034300 0x7f74b40367c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 --2- 172.21.15.129:0/1954492409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d323ca5170 0x55d323d98170 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 >> 172.21.15.129:0/1954492409 conn(0x55d323ca0a40 msgr2=0x55d323c19890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 shutdown_connections 2024-02-18T16:21:26.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.470+0000 7f75ce6ab980 1 -- 172.21.15.129:0/1954492409 wait complete. 2024-02-18T16:21:26.487 INFO:teuthology.orchestra.run.smithi129.stdout:{"key":"bucket:myfoo","ver":{"tag":"_NOPoyku84GSRlhfkWuKWQMq","ver":2},"mtime":"2024-02-18T16:21:26.054157Z","data":{"bucket":{"name":"myfoo","marker":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","bucket_id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-02-18T16:21:24.450254Z","linked":false,"has_bucket_info":false}} 2024-02-18T16:21:26.487 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_NOPoyku84GSRlhfkWuKWQMq', 'ver': 2}, 'mtime': '2024-02-18T16:21:26.054157Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'bucket_id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-02-18T16:21:24.450254Z', 'linked': False, 'has_bucket_info': False}} 2024-02-18T16:21:26.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1'] 2024-02-18T16:21:26.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1'] 2024-02-18T16:21:26.488 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:26.569 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:26.570 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:26.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f75c1980 1 Processor -- start 2024-02-18T16:21:26.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f75c1980 1 -- start start 2024-02-18T16:21:26.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f75c1980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ef43118fe0 0x55ef431193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f75c1980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ef43066460 con 0x55ef43119900 2024-02-18T16:21:26.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f75c1980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ef4302d180 con 0x55ef43118fe0 2024-02-18T16:21:26.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f50dc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ef43118fe0 0x55ef431193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f50dc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ef43118fe0 0x55ef431193c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49050/0 (socket says 172.21.15.129:49050) 2024-02-18T16:21:26.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f50dc640 1 -- 172.21.15.129:0/3606545950 learned_addr learned my addr 172.21.15.129:0/3606545950 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f50dc640 1 -- 172.21.15.129:0/3606545950 >> v1:172.21.15.80:6789/0 conn(0x55ef43119900 legacy=0x55ef4311a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.566+0000 7ff3f50dc640 1 -- 172.21.15.129:0/3606545950 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4311aaf0 con 0x55ef43118fe0 2024-02-18T16:21:26.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/3606545950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef431193c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800a5c0 tx=0x7ff3e801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d438777c3d7aa9aa server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3e7fff640 1 -- 172.21.15.129:0/3606545950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80aa470 con 0x55ef43118fe0 2024-02-18T16:21:26.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3e7fff640 1 -- 172.21.15.129:0/3606545950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80aa5d0 con 0x55ef43118fe0 2024-02-18T16:21:26.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3e7fff640 1 -- 172.21.15.129:0/3606545950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80aa890 con 0x55ef43118fe0 2024-02-18T16:21:26.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 -- 172.21.15.129:0/3606545950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 msgr2=0x55ef431193c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/3606545950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef431193c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800a5c0 tx=0x7ff3e801b340 comp rx=0 tx=0).stop 2024-02-18T16:21:26.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 -- 172.21.15.129:0/3606545950 shutdown_connections 2024-02-18T16:21:26.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/3606545950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef431193c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 -- 172.21.15.129:0/3606545950 >> 172.21.15.129:0/3606545950 conn(0x55ef431148b0 msgr2=0x55ef43116cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 -- 172.21.15.129:0/3606545950 shutdown_connections 2024-02-18T16:21:26.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.570+0000 7ff3f75c1980 1 -- 172.21.15.129:0/3606545950 wait complete. 2024-02-18T16:21:26.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f75c1980 1 Processor -- start 2024-02-18T16:21:26.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f75c1980 1 -- start start 2024-02-18T16:21:26.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f75c1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4308dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f75c1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4302a6b0 con 0x55ef43118fe0 2024-02-18T16:21:26.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f50dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4308dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f50dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4308dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49060/0 (socket says 172.21.15.129:49060) 2024-02-18T16:21:26.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f50dc640 1 -- 172.21.15.129:0/2946326147 learned_addr learned my addr 172.21.15.129:0/2946326147 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f50dc640 1 -- 172.21.15.129:0/2946326147 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8005df0 con 0x55ef43118fe0 2024-02-18T16:21:26.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.586+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/2946326147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4308dfc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8018f70 tx=0x7ff3e8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47625baf775a9f0d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff2e3606640 1 -- 172.21.15.129:0/2946326147 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80aa9c0 con 0x55ef43118fe0 2024-02-18T16:21:26.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff2e3606640 1 -- 172.21.15.129:0/2946326147 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80aab20 con 0x55ef43118fe0 2024-02-18T16:21:26.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff2e3606640 1 -- 172.21.15.129:0/2946326147 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80aadc0 con 0x55ef43118fe0 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2946326147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 msgr2=0x55ef4308dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/2946326147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4308dfc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8018f70 tx=0x7ff3e8003030 comp rx=0 tx=0).stop 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2946326147 shutdown_connections 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/2946326147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4308dfc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2946326147 >> 172.21.15.129:0/2946326147 conn(0x55ef431148b0 msgr2=0x55ef431ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2946326147 shutdown_connections 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2946326147 wait complete. 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 Processor -- start 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- start start 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4320b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef43025e90 con 0x55ef43118fe0 2024-02-18T16:21:26.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f50dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4320b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f50dc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4320b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49062/0 (socket says 172.21.15.129:49062) 2024-02-18T16:21:26.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f50dc640 1 -- 172.21.15.129:0/545738045 learned_addr learned my addr 172.21.15.129:0/545738045 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f50dc640 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4311aaf0 con 0x55ef43118fe0 2024-02-18T16:21:26.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4320b400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8018f70 tx=0x7ff3e80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff2e1e03640 1 -- 172.21.15.129:0/545738045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80cb070 con 0x55ef43118fe0 2024-02-18T16:21:26.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef4320b940 con 0x55ef43118fe0 2024-02-18T16:21:26.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef4320bd70 con 0x55ef43118fe0 2024-02-18T16:21:26.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff2e1e03640 1 -- 172.21.15.129:0/545738045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80c6690 con 0x55ef43118fe0 2024-02-18T16:21:26.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.590+0000 7ff2e1e03640 1 -- 172.21.15.129:0/545738045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80c6930 con 0x55ef43118fe0 2024-02-18T16:21:26.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff2e1e03640 1 -- 172.21.15.129:0/545738045 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3e80c6a90 con 0x55ef43118fe0 2024-02-18T16:21:26.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff2e1e03640 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2dc034300 0x7ff2dc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff2e1e03640 1 -- 172.21.15.129:0/545738045 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff3e80e4a60 con 0x55ef43118fe0 2024-02-18T16:21:26.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f48db640 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2dc034300 0x7ff2dc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43119900 0x55ef43212080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432125c0 con 0x55ef43119900 2024-02-18T16:21:26.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43119900 0x55ef43212080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f48db640 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2dc034300 0x7ff2dc0367c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001e20 tx=0x7ff3ec0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43119900 0x55ef43212080 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 -- 172.21.15.129:0/545738045 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3f000a4d0 con 0x55ef43119900 2024-02-18T16:21:26.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432129a0 con 0x55ef43119900 2024-02-18T16:21:26.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 -- 172.21.15.129:0/545738045 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3f000a4d0 con 0x55ef43119900 2024-02-18T16:21:26.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43214250 con 0x55ef43119900 2024-02-18T16:21:26.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 -- 172.21.15.129:0/545738045 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff3f000a4d0 con 0x55ef43119900 2024-02-18T16:21:26.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43213450 con 0x55ef43119900 2024-02-18T16:21:26.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 -- 172.21.15.129:0/545738045 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3f000a4d0 con 0x55ef43119900 2024-02-18T16:21:26.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43213860 con 0x55ef43119900 2024-02-18T16:21:26.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f58dd640 1 -- 172.21.15.129:0/545738045 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff3f000a4d0 con 0x55ef43119900 2024-02-18T16:21:26.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.594+0000 7ff3f75c1980 1 Processor -- start 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 -- start start 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 0x55ef43222d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef42fbef20 con 0x55ef43222910 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f48db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 0x55ef43222d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f48db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 0x55ef43222d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49068/0 (socket says 172.21.15.129:49068) 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f48db640 1 -- 172.21.15.129:0/1177435082 learned_addr learned my addr 172.21.15.129:0/1177435082 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f48db640 1 -- 172.21.15.129:0/1177435082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef43223270 con 0x55ef43222910 2024-02-18T16:21:26.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f48db640 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 0x55ef43222d30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001780 tx=0x7ff3ec00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff2daffd640 1 -- 172.21.15.129:0/1177435082 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec00e580 con 0x55ef43222910 2024-02-18T16:21:26.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff2daffd640 1 -- 172.21.15.129:0/1177435082 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00e6e0 con 0x55ef43222910 2024-02-18T16:21:26.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff2daffd640 1 -- 172.21.15.129:0/1177435082 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec00e980 con 0x55ef43222910 2024-02-18T16:21:26.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef432234c0 con 0x55ef43222910 2024-02-18T16:21:26.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef43224010 con 0x55ef43222910 2024-02-18T16:21:26.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff2daffd640 1 -- 172.21.15.129:0/1177435082 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3ec00eae0 con 0x55ef43222910 2024-02-18T16:21:26.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff2daffd640 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2cc034300 0x7ff2cc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff2daffd640 1 -- 172.21.15.129:0/1177435082 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff3ec018040 con 0x55ef43222910 2024-02-18T16:21:26.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2cc034300 0x7ff2cc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 Processor -- start 2024-02-18T16:21:26.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 -- start start 2024-02-18T16:21:26.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2cc034300 0x7ff2cc0367c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55ef43212e90 tx=0x7ff3f0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef4322fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.598+0000 7ff3f75c1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef42fb2790 con 0x55ef4322f8c0 2024-02-18T16:21:26.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef4322fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef4322fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49078/0 (socket says 172.21.15.129:49078) 2024-02-18T16:21:26.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 -- 172.21.15.129:0/2548390554 learned_addr learned my addr 172.21.15.129:0/2548390554 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 -- 172.21.15.129:0/2548390554 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef432302b0 con 0x55ef4322f8c0 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 --2- 172.21.15.129:0/2548390554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef4322fce0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec01bfd0 tx=0x7ff3ec01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfdc9c01f9ae712 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff2d8ff9640 1 -- 172.21.15.129:0/2548390554 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec048130 con 0x55ef4322f8c0 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff2d8ff9640 1 -- 172.21.15.129:0/2548390554 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec01bc30 con 0x55ef4322f8c0 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff2d8ff9640 1 -- 172.21.15.129:0/2548390554 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec03b0b0 con 0x55ef4322f8c0 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2548390554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 msgr2=0x55ef4322fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/2548390554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef4322fce0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec01bfd0 tx=0x7ff3ec01aa60 comp rx=0 tx=0).stop 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2548390554 shutdown_connections 2024-02-18T16:21:26.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/2548390554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef4322fce0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2548390554 >> 172.21.15.129:0/2548390554 conn(0x55ef4322bc50 msgr2=0x55ef43229cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2548390554 shutdown_connections 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- 172.21.15.129:0/2548390554 wait complete. 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 Processor -- start 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- start start 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef432367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f75c1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef43236d00 con 0x55ef4322f8c0 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef432367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef432367c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49088/0 (socket says 172.21.15.129:49088) 2024-02-18T16:21:26.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 learned_addr learned my addr 172.21.15.129:0/215429743 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.602+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef43224010 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f48db640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef432367c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec01bfd0 tx=0x7ff3ec049430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff2caffd640 1 -- 172.21.15.129:0/215429743 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec048130 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef43236f00 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff2caffd640 1 -- 172.21.15.129:0/215429743 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec01b7e0 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff2caffd640 1 -- 172.21.15.129:0/215429743 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec01a310 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef43237390 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff2caffd640 1 -- 172.21.15.129:0/215429743 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3ec024c60 con 0x55ef4322f8c0 2024-02-18T16:21:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff2caffd640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2c0034260 0x7ff2c0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff2caffd640 1 -- 172.21.15.129:0/215429743 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff3ec03ac70 con 0x55ef4322f8c0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2c0034260 0x7ff2c0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43241c00 0x55ef432440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43244810 con 0x55ef43241c00 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43241c00 0x55ef432440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2c0034260 0x7ff2c0036720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0011010 tx=0x7ff3f0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43241c00 0x55ef432440c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 realm 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43244be0 con 0x55ef43241c00 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43245460 con 0x55ef43241c00 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432457c0 con 0x55ef43241c00 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.606+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43245fc0 con 0x55ef43241c00 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f75c1980 20 searching for the correct realm 2024-02-18T16:21:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ef43247e70 0x55ef4324a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43247e70 2024-02-18T16:21:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f48db640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ef43247e70 0x55ef4324a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f48db640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ef43247e70 0x55ef4324a330 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f48db640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7ff3ec050070 0x7ff3ec02f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3ec050070 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7ff3ec050070 0x7ff3ec02f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7ff3ec050070 0x7ff3ec02f460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3f000a4d0 con 0x7ff3ec050070 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f58dd640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7ff3f00141d0 0x7ff3f0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3f00141d0 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7ff3f00141d0 0x7ff3f0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f50dc640 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7ff3f00141d0 0x7ff3f0015940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.610+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43241c00 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43241c00 2024-02-18T16:21:26.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3f00141d0 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3f00141d0 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3ec050070 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3f000a4d0 con 0x7ff3ec050070 2024-02-18T16:21:26.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43247e70 2024-02-18T16:21:26.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43241c00 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3f00141d0 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43241c00 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x7ff3ec050070 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.614+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324aa00 con 0x55ef43247e70 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43247e70 2024-02-18T16:21:26.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3f00141d0 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43247e70 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43247e70 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43241c00 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43241c00 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3f00141d0 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43247e70 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3ec050070 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.618+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43241c00 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x55ef43241c00 2024-02-18T16:21:26.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3f00141d0 2024-02-18T16:21:26.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43247e70 2024-02-18T16:21:26.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3f00141d0 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3ec050070 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43247e70 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3f00141d0 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3e80cd070 con 0x7ff3f00141d0 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x55ef43241c00 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3ec05e040 con 0x7ff3ec050070 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.622+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468c0 con 0x55ef43241c00 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43247110 con 0x55ef43241c00 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43246540 con 0x55ef43241c00 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 zone default found 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 4 Realm: () 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 zonegroup default 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43247130 con 0x7ff3f00141d0 2024-02-18T16:21:26.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324cd60 con 0x55ef43247e70 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324d0c0 con 0x55ef43247e70 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 started sync module instance, tier type = 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:26.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324c2e0 con 0x7ff3ec050070 2024-02-18T16:21:26.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94486112028352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324c2e0 con 0x7ff3ec050070 2024-02-18T16:21:26.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.626+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324da30 con 0x55ef43241c00 2024-02-18T16:21:26.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.630+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94486112028352] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.630+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.630+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94486112032416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324c2e0 con 0x55ef43241c00 2024-02-18T16:21:26.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.630+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324e3f0 con 0x55ef43247e70 2024-02-18T16:21:26.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94486112034640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324ebf0 con 0x55ef43247e70 2024-02-18T16:21:26.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324f560 con 0x7ff3ec050070 2024-02-18T16:21:26.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94486112032416] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94486112039104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4324f4e0 con 0x7ff3ec050070 2024-02-18T16:21:26.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432502e0 con 0x55ef43241c00 2024-02-18T16:21:26.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94486112034640] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.634+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94486112039104] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94486112036688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432502a0 con 0x55ef43241c00 2024-02-18T16:21:26.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43250b30 con 0x7ff3f00141d0 2024-02-18T16:21:26.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94486112044608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432502a0 con 0x7ff3f00141d0 2024-02-18T16:21:26.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43251550 con 0x7ff3f00141d0 2024-02-18T16:21:26.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94486112036688] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.638+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94486112044608] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94486112045664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43251070 con 0x7ff3f00141d0 2024-02-18T16:21:26.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432519e0 con 0x7ff3f00141d0 2024-02-18T16:21:26.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94486112045664] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94486112041280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432519e0 con 0x7ff3f00141d0 2024-02-18T16:21:26.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=0 2024-02-18T16:21:26.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=1 2024-02-18T16:21:26.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=2 2024-02-18T16:21:26.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=3 2024-02-18T16:21:26.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=4 2024-02-18T16:21:26.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=5 2024-02-18T16:21:26.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.642+0000 7ff3f75c1980 20 add_watcher() i=6 2024-02-18T16:21:26.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94486112041280] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 20 add_watcher() i=7 2024-02-18T16:21:26.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:26.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43254cf0 con 0x55ef43241c00 2024-02-18T16:21:26.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94486112061200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43251b50 con 0x55ef43241c00 2024-02-18T16:21:26.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94486112061200] v30'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff2ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:26.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:26.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 5 note: GC not initialized 2024-02-18T16:21:26.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff2aa7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:26.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:26.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 20 Filter name: none 2024-02-18T16:21:26.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff21bfff640 20 reqs_thread_entry: start 2024-02-18T16:21:26.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:26.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.646+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43276cd0 con 0x7ff3f00141d0 2024-02-18T16:21:26.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432786d0 con 0x7ff3ec050070 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:26.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43279e00 con 0x55ef43241c00 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(64 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-18T16:21:26.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4327e0f0 con 0x7ff3ec050070 2024-02-18T16:21:26.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.650+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43284130 con 0x55ef43241c00 2024-02-18T16:21:26.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(66 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94486112215728 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef43282e40 con 0x55ef43241c00 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 94486112032416 notify 128849018898 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55ef4320bd70 con 0x55ef43241c00 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff2d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94486112032416 notifier 4496 bl.length()=725 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff2d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff2d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff2d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(67 notify.1 [notify cookie 94486112215728 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff2d8ff9640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff2b8003ea0 con 0x55ef43241c00 2024-02-18T16:21:26.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 94486112215728 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ef4320b940 con 0x55ef43241c00 2024-02-18T16:21:26.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_sources= new_sources= 2024-02-18T16:21:26.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential sources added=[] removed=[] 2024-02-18T16:21:26.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_dests= new_dests= 2024-02-18T16:21:26.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential dests added=[] removed=[] 2024-02-18T16:21:26.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.654+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef4327a290 con 0x7ff3f00141d0 2024-02-18T16:21:26.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432829a0 con 0x7ff3ec050070 2024-02-18T16:21:26.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f75c1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-18T16:21:26.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f75c1980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f75c1980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:26.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.658+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94486112215696 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432829a0 con 0x7ff3f00141d0 2024-02-18T16:21:26.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== watch-notify(notify (1) cookie 94486112045664 notify 128849018883 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55ef4320b940 con 0x7ff3f00141d0 2024-02-18T16:21:26.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff2cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94486112045664 notifier 4496 bl.length()=314 2024-02-18T16:21:26.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff2cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-18T16:21:26.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff2cbfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:26.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(71 notify.6 [notify cookie 94486112215696 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff2cbfff640 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff228003400 con 0x7ff3f00141d0 2024-02-18T16:21:26.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== watch-notify(notify_complete (2) cookie 94486112215696 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ef4311aaf0 con 0x7ff3f00141d0 2024-02-18T16:21:26.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff2ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94486112061200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432829a0 con 0x55ef43241c00 2024-02-18T16:21:26.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94486112061200] v30'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.662+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94486112028352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432829a0 con 0x7ff3ec050070 2024-02-18T16:21:26.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94486112028352] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f75c1980 20 remove_watcher() i=0 2024-02-18T16:21:26.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f75c1980 2 removed watcher, disabling cache 2024-02-18T16:21:26.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94486112032416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468c0 con 0x55ef43241c00 2024-02-18T16:21:26.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94486112032416] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f75c1980 20 remove_watcher() i=1 2024-02-18T16:21:26.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.666+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94486112034640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432829a0 con 0x55ef43247e70 2024-02-18T16:21:26.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.670+0000 7ff3f48db640 1 -- 172.21.15.129:0/215429743 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94486112034640] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3ec03cd90 con 0x55ef43247e70 2024-02-18T16:21:26.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.670+0000 7ff3f75c1980 20 remove_watcher() i=2 2024-02-18T16:21:26.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.670+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94486112039104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468a0 con 0x7ff3ec050070 2024-02-18T16:21:26.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.670+0000 7ff3f58dd640 1 -- 172.21.15.129:0/215429743 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94486112039104] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3f003a040 con 0x7ff3ec050070 2024-02-18T16:21:26.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.670+0000 7ff3f75c1980 20 remove_watcher() i=3 2024-02-18T16:21:26.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.670+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94486112036688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468a0 con 0x55ef43241c00 2024-02-18T16:21:26.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.674+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94486112036688] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x55ef43241c00 2024-02-18T16:21:26.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.674+0000 7ff3f75c1980 20 remove_watcher() i=4 2024-02-18T16:21:26.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.674+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94486112044608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468a0 con 0x7ff3f00141d0 2024-02-18T16:21:26.681 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.674+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94486112044608] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.681 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.674+0000 7ff3f75c1980 20 remove_watcher() i=5 2024-02-18T16:21:26.681 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.674+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94486112045664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468a0 con 0x7ff3f00141d0 2024-02-18T16:21:26.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94486112045664] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 20 remove_watcher() i=6 2024-02-18T16:21:26.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94486112041280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef432468a0 con 0x7ff3f00141d0 2024-02-18T16:21:26.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94486112041280] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3e81000c0 con 0x7ff3f00141d0 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 20 remove_watcher() i=7 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7ff3f00141d0 msgr2=0x7ff3f0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7ff3f00141d0 0x7ff3f0015940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43241c00 msgr2=0x55ef432440c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43241c00 0x55ef432440c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7ff3ec050070 msgr2=0x7ff3ec02f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7ff3ec050070 0x7ff3ec02f460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ef43247e70 msgr2=0x55ef4324a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.689 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ef43247e70 0x55ef4324a330 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2c0034260 msgr2=0x7ff2c0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2c0034260 0x7ff2c0036720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0011010 tx=0x7ff3f0020000 comp rx=0 tx=0).stop 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 msgr2=0x55ef432367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/215429743 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef4322f8c0 0x55ef432367c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec01bfd0 tx=0x7ff3ec049430 comp rx=0 tx=0).stop 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 reap_dead start 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 shutdown_connections 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f50dc640 1 -- 172.21.15.129:0/215429743 reap_dead start 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 >> 172.21.15.129:0/215429743 conn(0x55ef4322bc50 msgr2=0x55ef432292b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 shutdown_connections 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.678+0000 7ff3f75c1980 1 -- 172.21.15.129:0/215429743 wait complete. 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2cc034300 msgr2=0x7ff2cc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2cc034300 0x7ff2cc0367c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55ef43212e90 tx=0x7ff3f0005850 comp rx=0 tx=0).stop 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 msgr2=0x55ef43222d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 0x55ef43222d30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001780 tx=0x7ff3ec00f7a0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 shutdown_connections 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2cc034300 0x7ff2cc0367c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/1177435082 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43222910 0x55ef43222d30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 >> 172.21.15.129:0/1177435082 conn(0x55ef43217720 msgr2=0x55ef43218230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 shutdown_connections 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/1177435082 wait complete. 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43119900 msgr2=0x55ef43212080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43119900 0x55ef43212080 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2dc034300 msgr2=0x7ff2dc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2dc034300 0x7ff2dc0367c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001e20 tx=0x7ff3ec0013a0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 msgr2=0x55ef4320b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4320b400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8018f70 tx=0x7ff3e80180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 shutdown_connections 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ef43119900 0x55ef43212080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ff2dc034300 0x7ff2dc0367c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 --2- 172.21.15.129:0/545738045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ef43118fe0 0x55ef4320b400 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 >> 172.21.15.129:0/545738045 conn(0x55ef431148b0 msgr2=0x55ef431fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 shutdown_connections 2024-02-18T16:21:26.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.682+0000 7ff3f75c1980 1 -- 172.21.15.129:0/545738045 wait complete. 2024-02-18T16:21:26.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-18T16:21:26.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-18T16:21:26.698 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-18T16:21:26.776 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:26.776 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:26.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.770+0000 7f2c01a33980 1 Processor -- start 2024-02-18T16:21:26.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.770+0000 7f2c01a33980 1 -- start start 2024-02-18T16:21:26.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.770+0000 7f2c01a33980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x564c7d154010 0x564c7d1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.770+0000 7f2c01a33980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564c7d0a14c0 con 0x564c7d154930 2024-02-18T16:21:26.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.770+0000 7f2c01a33980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x564c7d068180 con 0x564c7d154010 2024-02-18T16:21:26.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.770+0000 7f2bff54e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x564c7d154010 0x564c7d1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bff54e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x564c7d154010 0x564c7d1543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49104/0 (socket says 172.21.15.129:49104) 2024-02-18T16:21:26.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bff54e640 1 -- 172.21.15.129:0/736579644 learned_addr learned my addr 172.21.15.129:0/736579644 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bfed4d640 1 --1- 172.21.15.129:0/736579644 >> v1:172.21.15.80:6789/0 conn(0x564c7d154930 0x564c7d155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42884/0 (socket says 172.21.15.129:42884) 2024-02-18T16:21:26.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bff54e640 1 -- 172.21.15.129:0/736579644 >> v1:172.21.15.80:6789/0 conn(0x564c7d154930 legacy=0x564c7d155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bff54e640 1 -- 172.21.15.129:0/736579644 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d155b70 con 0x564c7d154010 2024-02-18T16:21:26.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bff54e640 1 --2- 172.21.15.129:0/736579644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d1543f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800a750 tx=0x7f2bf801d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5ad940af6f6e87 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bfe54c640 1 -- 172.21.15.129:0/736579644 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf800a200 con 0x564c7d154010 2024-02-18T16:21:26.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bfe54c640 1 -- 172.21.15.129:0/736579644 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80a8050 con 0x564c7d154010 2024-02-18T16:21:26.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2bfe54c640 1 -- 172.21.15.129:0/736579644 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf80085a0 con 0x564c7d154010 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2c01a33980 1 -- 172.21.15.129:0/736579644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 msgr2=0x564c7d1543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2c01a33980 1 --2- 172.21.15.129:0/736579644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d1543f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800a750 tx=0x7f2bf801d200 comp rx=0 tx=0).stop 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2c01a33980 1 -- 172.21.15.129:0/736579644 shutdown_connections 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2c01a33980 1 --2- 172.21.15.129:0/736579644 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d1543f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.774+0000 7f2c01a33980 1 -- 172.21.15.129:0/736579644 >> 172.21.15.129:0/736579644 conn(0x564c7d14f8e0 msgr2=0x564c7d151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.778+0000 7f2c01a33980 1 -- 172.21.15.129:0/736579644 shutdown_connections 2024-02-18T16:21:26.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.778+0000 7f2c01a33980 1 -- 172.21.15.129:0/736579644 wait complete. 2024-02-18T16:21:26.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.790+0000 7f2c01a33980 1 Processor -- start 2024-02-18T16:21:26.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.790+0000 7f2c01a33980 1 -- start start 2024-02-18T16:21:26.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.790+0000 7f2c01a33980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d23d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.790+0000 7f2c01a33980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d0656b0 con 0x564c7d154010 2024-02-18T16:21:26.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d23d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d23d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49108/0 (socket says 172.21.15.129:49108) 2024-02-18T16:21:26.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 -- 172.21.15.129:0/3540015904 learned_addr learned my addr 172.21.15.129:0/3540015904 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 -- 172.21.15.129:0/3540015904 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf8005df0 con 0x564c7d154010 2024-02-18T16:21:26.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 --2- 172.21.15.129:0/3540015904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d23d540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8019e10 tx=0x7f2bf8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9e232ecfba0a54 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2aed60a640 1 -- 172.21.15.129:0/3540015904 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf800a3b0 con 0x564c7d154010 2024-02-18T16:21:26.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2aed60a640 1 -- 172.21.15.129:0/3540015904 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80085a0 con 0x564c7d154010 2024-02-18T16:21:26.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2aed60a640 1 -- 172.21.15.129:0/3540015904 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8008860 con 0x564c7d154010 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- 172.21.15.129:0/3540015904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 msgr2=0x564c7d23d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3540015904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d23d540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8019e10 tx=0x7f2bf8003030 comp rx=0 tx=0).stop 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- 172.21.15.129:0/3540015904 shutdown_connections 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3540015904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d23d540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- 172.21.15.129:0/3540015904 >> 172.21.15.129:0/3540015904 conn(0x564c7d14f8e0 msgr2=0x564c7d2390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- 172.21.15.129:0/3540015904 shutdown_connections 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- 172.21.15.129:0/3540015904 wait complete. 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 Processor -- start 2024-02-18T16:21:26.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- start start 2024-02-18T16:21:26.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d244290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2c01a33980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d060e90 con 0x564c7d154010 2024-02-18T16:21:26.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d244290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d244290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49124/0 (socket says 172.21.15.129:49124) 2024-02-18T16:21:26.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 -- 172.21.15.129:0/3115238246 learned_addr learned my addr 172.21.15.129:0/3115238246 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.794+0000 7f2bff54e640 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d155b70 con 0x564c7d154010 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bff54e640 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d244290 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2bf801d030 tx=0x7f2bf8019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2aebe07640 1 -- 172.21.15.129:0/3115238246 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf80c7580 con 0x564c7d154010 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c7d2447d0 con 0x564c7d154010 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c7d244ce0 con 0x564c7d154010 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2aebe07640 1 -- 172.21.15.129:0/3115238246 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80c76e0 con 0x564c7d154010 2024-02-18T16:21:26.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2aebe07640 1 -- 172.21.15.129:0/3115238246 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bf80c7980 con 0x564c7d154010 2024-02-18T16:21:26.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2aebe07640 1 -- 172.21.15.129:0/3115238246 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2bf80c7ae0 con 0x564c7d154010 2024-02-18T16:21:26.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2aebe07640 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ae40342b0 0x7f2ae4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2aebe07640 1 -- 172.21.15.129:0/3115238246 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2bf80e5690 con 0x564c7d154010 2024-02-18T16:21:26.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ae40342b0 0x7f2ae4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d154930 0x564c7d24af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d24b460 con 0x564c7d154930 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d154930 0x564c7d24af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ae40342b0 0x7f2ae4036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2be8000f70 tx=0x7f2be8001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d154930 0x564c7d24af20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bffd4f640 1 -- 172.21.15.129:0/3115238246 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf000a4d0 con 0x564c7d154930 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d248620 con 0x564c7d154930 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bffd4f640 1 -- 172.21.15.129:0/3115238246 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2bf000a4d0 con 0x564c7d154930 2024-02-18T16:21:26.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d24d160 con 0x564c7d154930 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2bffd4f640 1 -- 172.21.15.129:0/3115238246 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2bf000a4d0 con 0x564c7d154930 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.798+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d24c360 con 0x564c7d154930 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bffd4f640 1 -- 172.21.15.129:0/3115238246 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bf000a4d0 con 0x564c7d154930 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d24c770 con 0x564c7d154930 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bffd4f640 1 -- 172.21.15.129:0/3115238246 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2bf000a4d0 con 0x564c7d154930 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 Processor -- start 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 -- start start 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 0x564c7d25ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7cff9f20 con 0x564c7d25fbb0 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bfed4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 0x564c7d25ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bfed4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 0x564c7d25ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49132/0 (socket says 172.21.15.129:49132) 2024-02-18T16:21:26.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bfed4d640 1 -- 172.21.15.129:0/2730443074 learned_addr learned my addr 172.21.15.129:0/2730443074 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bfed4d640 1 -- 172.21.15.129:0/2730443074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d260510 con 0x564c7d25fbb0 2024-02-18T16:21:26.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 0x564c7d25ffd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2be8001ee0 tx=0x7f2be800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2ae9602640 1 -- 172.21.15.129:0/2730443074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be8007040 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c7d260760 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2ae9602640 1 -- 172.21.15.129:0/2730443074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800d660 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2ae9602640 1 -- 172.21.15.129:0/2730443074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be800d900 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c7d2612b0 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.802+0000 7f2ae9602640 1 -- 172.21.15.129:0/2730443074 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2be801a070 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2ae9602640 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ad80342b0 0x7f2ad8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2ae9602640 1 -- 172.21.15.129:0/2730443074 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2be8017050 con 0x564c7d25fbb0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ad80342b0 0x7f2ad8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 Processor -- start 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- start start 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ad80342b0 0x7f2ad8036770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x564c7d24be00 tx=0x7f2bf0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d26cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7cfed790 con 0x564c7d26cb30 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bfed4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d26cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bfed4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d26cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49136/0 (socket says 172.21.15.129:49136) 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bfed4d640 1 -- 172.21.15.129:0/2477672819 learned_addr learned my addr 172.21.15.129:0/2477672819 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bfed4d640 1 -- 172.21.15.129:0/2477672819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d26d500 con 0x564c7d26cb30 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/2477672819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d26cf30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2be8027030 tx=0x7f2be800df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3547d1d527ea60 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2ae2ffd640 1 -- 172.21.15.129:0/2477672819 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be8039440 con 0x564c7d26cb30 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2ae2ffd640 1 -- 172.21.15.129:0/2477672819 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80395c0 con 0x564c7d26cb30 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2ae2ffd640 1 -- 172.21.15.129:0/2477672819 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be803ac80 con 0x564c7d26cb30 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- 172.21.15.129:0/2477672819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 msgr2=0x564c7d26cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 --2- 172.21.15.129:0/2477672819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d26cf30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2be8027030 tx=0x7f2be800df20 comp rx=0 tx=0).stop 2024-02-18T16:21:26.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- 172.21.15.129:0/2477672819 shutdown_connections 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 --2- 172.21.15.129:0/2477672819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d26cf30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- 172.21.15.129:0/2477672819 >> 172.21.15.129:0/2477672819 conn(0x564c7d268e70 msgr2=0x564c7d266ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- 172.21.15.129:0/2477672819 shutdown_connections 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- 172.21.15.129:0/2477672819 wait complete. 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 Processor -- start 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- start start 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d2739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.806+0000 7f2c01a33980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d273f30 con 0x564c7d26cb30 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bfed4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d2739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bfed4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d2739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49140/0 (socket says 172.21.15.129:49140) 2024-02-18T16:21:26.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 learned_addr learned my addr 172.21.15.129:0/4291408953 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:26.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d2612b0 con 0x564c7d26cb30 2024-02-18T16:21:26.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d2739f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2be800eea0 tx=0x7f2be8048b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2ae17fa640 1 -- 172.21.15.129:0/4291408953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be801a6f0 con 0x564c7d26cb30 2024-02-18T16:21:26.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2ae17fa640 1 -- 172.21.15.129:0/4291408953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be801a890 con 0x564c7d26cb30 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564c7d274130 con 0x564c7d26cb30 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2ae17fa640 1 -- 172.21.15.129:0/4291408953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be804aa70 con 0x564c7d26cb30 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c7d274560 con 0x564c7d26cb30 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2ae17fa640 1 -- 172.21.15.129:0/4291408953 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2be804abd0 con 0x564c7d26cb30 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2ae17fa640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ac80342b0 0x7f2ac8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2ae17fa640 1 -- 172.21.15.129:0/4291408953 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2be802c060 con 0x564c7d26cb30 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ac80342b0 0x7f2ac8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d27ef60 0x564c7d281420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d281b70 con 0x564c7d27ef60 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bff54e640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d27ef60 0x564c7d281420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ac80342b0 0x7f2ac8036770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0011010 tx=0x7f2bf0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.810+0000 7f2bff54e640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d27ef60 0x564c7d281420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf80b3040 con 0x564c7d27ef60 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 realm 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d281f40 con 0x564c7d27ef60 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf80b3040 con 0x564c7d27ef60 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d2827c0 con 0x564c7d27ef60 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf80b3040 con 0x564c7d27ef60 2024-02-18T16:21:26.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d282b20 con 0x564c7d27ef60 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2bf80b3040 con 0x564c7d27ef60 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d283320 con 0x564c7d27ef60 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2bf80b3040 con 0x564c7d27ef60 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 20 searching for the correct realm 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c7d2851b0 0x564c7d287640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c7d2851b0 0x564c7d287640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c7d2851b0 0x564c7d287640 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be8039b50 con 0x564c7d2851b0 2024-02-18T16:21:26.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bfed4d640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2be8027060 0x7f2be803a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2be8027060 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2be8027060 0x7f2be803a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2be8027060 0x7f2be803a470 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf000a4d0 con 0x7f2be8027060 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bffd4f640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2bf00141d0 0x7f2bf0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.814+0000 7f2bff54e640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2bf00141d0 0x7f2bf0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:26.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2bf00141d0 0x7f2bf0015940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80b3040 con 0x7f2bf00141d0 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2be8027060 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf000a4d0 con 0x7f2be8027060 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be8039b50 con 0x564c7d2851b0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.818+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2be8027060 2024-02-18T16:21:26.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be8039b50 con 0x564c7d2851b0 2024-02-18T16:21:26.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.822+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2be8027060 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2be8027060 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d2851b0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.826+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2bf00141d0 2024-02-18T16:21:26.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x564c7d27ef60 2024-02-18T16:21:26.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d287d10 con 0x7f2be8027060 2024-02-18T16:21:26.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d283c20 con 0x564c7d27ef60 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d284470 con 0x564c7d27ef60 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:26.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d288150 con 0x564c7d27ef60 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 zone default found 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 4 Realm: () 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 zonegroup default 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d288190 con 0x7f2bf00141d0 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d289f70 con 0x564c7d2851b0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28a300 con 0x564c7d2851b0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 started sync module instance, tier type = 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:26.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.830+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d289850 con 0x7f2be8027060 2024-02-18T16:21:26.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94886517314480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d289c00 con 0x7f2be8027060 2024-02-18T16:21:26.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28b040 con 0x564c7d27ef60 2024-02-18T16:21:26.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94886517314480] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94886517319424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28b000 con 0x564c7d27ef60 2024-02-18T16:21:26.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.834+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28ba50 con 0x564c7d2851b0 2024-02-18T16:21:26.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94886517319424] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94886517323088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28be00 con 0x564c7d2851b0 2024-02-18T16:21:26.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28c770 con 0x7f2be8027060 2024-02-18T16:21:26.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94886517326816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28cec0 con 0x7f2be8027060 2024-02-18T16:21:26.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28d990 con 0x564c7d27ef60 2024-02-18T16:21:26.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94886517323088] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.838+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94886517326816] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94886517331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28d950 con 0x564c7d27ef60 2024-02-18T16:21:26.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28ca90 con 0x7f2bf00141d0 2024-02-18T16:21:26.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94886517331056] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94886517332304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28e210 con 0x7f2bf00141d0 2024-02-18T16:21:26.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.842+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28ea10 con 0x7f2bf00141d0 2024-02-18T16:21:26.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94886517334816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28edc0 con 0x7f2bf00141d0 2024-02-18T16:21:26.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94886517332304] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28dd70 con 0x7f2bf00141d0 2024-02-18T16:21:26.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94886517334816] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94886517338992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28dd70 con 0x7f2bf00141d0 2024-02-18T16:21:26.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=0 2024-02-18T16:21:26.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=1 2024-02-18T16:21:26.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=2 2024-02-18T16:21:26.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=3 2024-02-18T16:21:26.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=4 2024-02-18T16:21:26.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=5 2024-02-18T16:21:26.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.846+0000 7f2c01a33980 20 add_watcher() i=6 2024-02-18T16:21:26.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94886517338992] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 20 add_watcher() i=7 2024-02-18T16:21:26.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:26.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d292880 con 0x564c7d27ef60 2024-02-18T16:21:26.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94886517336096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28fcf0 con 0x564c7d27ef60 2024-02-18T16:21:26.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94886517336096] v30'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2ab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:26.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:26.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.850+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29ad60 con 0x564c7d27ef60 2024-02-18T16:21:26.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.854+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.854+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29b1a0 con 0x7f2bf00141d0 2024-02-18T16:21:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.854+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.854+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29b640 con 0x564c7d2851b0 2024-02-18T16:21:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.858+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.858+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29be40 con 0x564c7d27ef60 2024-02-18T16:21:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.858+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.858+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d298db0 con 0x7f2be8027060 2024-02-18T16:21:26.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.858+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.858+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d298db0 con 0x564c7d2851b0 2024-02-18T16:21:26.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.862+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.862+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29ce70 con 0x564c7d27ef60 2024-02-18T16:21:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.862+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.862+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29ce70 con 0x7f2bf00141d0 2024-02-18T16:21:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.866+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.866+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29ce70 con 0x7f2be8027060 2024-02-18T16:21:26.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.866+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.866+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29d4e0 con 0x564c7d2851b0 2024-02-18T16:21:26.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.866+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.866+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29da10 con 0x7f2be8027060 2024-02-18T16:21:26.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.870+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.870+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29df40 con 0x7f2bf00141d0 2024-02-18T16:21:26.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.870+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.870+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29df40 con 0x7f2be8027060 2024-02-18T16:21:26.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.874+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.874+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2bf00141d0 2024-02-18T16:21:26.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.874+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.874+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d27ef60 2024-02-18T16:21:26.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.874+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.874+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.878+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.878+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2be8027060 2024-02-18T16:21:26.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.878+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.878+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.882+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.882+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d27ef60 2024-02-18T16:21:26.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.882+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.882+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d27ef60 2024-02-18T16:21:26.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.882+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.886+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.886+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.886+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2be8027060 2024-02-18T16:21:26.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.886+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.886+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.890+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.890+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.890+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.890+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.890+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.890+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.894+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.894+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2bf00141d0 2024-02-18T16:21:26.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.898+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.898+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.898+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.898+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2bf00141d0 2024-02-18T16:21:26.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.902+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.902+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x564c7d2851b0 2024-02-18T16:21:26.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.902+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.902+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2bf00141d0 2024-02-18T16:21:26.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d29e3e0 con 0x7f2be8027060 2024-02-18T16:21:26.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2ab4fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2c01a33980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2c01a33980 20 Filter name: none 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2a2e7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2c01a33980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2c01a33980 20 rados->read ofs=0 len=0 2024-02-18T16:21:26.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.906+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d248140 con 0x7f2bf00141d0 2024-02-18T16:21:26.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2c01a33980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:21:26.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2c01a33980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-18T16:21:26.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2c01a33980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:26.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2c01a33980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:26.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d2980e0 con 0x7f2bf00141d0 2024-02-18T16:21:26.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.915 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-18T16:21:26.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2ab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:26.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.910+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94886517336096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d294ba0 con 0x564c7d27ef60 2024-02-18T16:21:26.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94886517336096] v30'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94886517314480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28e820 con 0x7f2be8027060 2024-02-18T16:21:26.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94886517314480] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2c01a33980 20 remove_watcher() i=0 2024-02-18T16:21:26.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2c01a33980 2 removed watcher, disabling cache 2024-02-18T16:21:26.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94886517319424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d2893b0 con 0x564c7d27ef60 2024-02-18T16:21:26.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94886517319424] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2c01a33980 20 remove_watcher() i=1 2024-02-18T16:21:26.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.914+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94886517323088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d2893b0 con 0x564c7d2851b0 2024-02-18T16:21:26.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.918+0000 7f2bfed4d640 1 -- 172.21.15.129:0/4291408953 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94886517323088] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2be805f040 con 0x564c7d2851b0 2024-02-18T16:21:26.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.918+0000 7f2c01a33980 20 remove_watcher() i=2 2024-02-18T16:21:26.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.918+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94886517326816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28b550 con 0x7f2be8027060 2024-02-18T16:21:26.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.918+0000 7f2bffd4f640 1 -- 172.21.15.129:0/4291408953 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94886517326816] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf003a040 con 0x7f2be8027060 2024-02-18T16:21:26.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.918+0000 7f2c01a33980 20 remove_watcher() i=3 2024-02-18T16:21:26.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.918+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94886517331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d2893b0 con 0x564c7d27ef60 2024-02-18T16:21:26.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.922+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94886517331056] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x564c7d27ef60 2024-02-18T16:21:26.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.922+0000 7f2c01a33980 20 remove_watcher() i=4 2024-02-18T16:21:26.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.922+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94886517332304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28c3e0 con 0x7f2bf00141d0 2024-02-18T16:21:26.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.922+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94886517332304] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.922+0000 7f2c01a33980 20 remove_watcher() i=5 2024-02-18T16:21:26.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.922+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94886517334816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d28b550 con 0x7f2bf00141d0 2024-02-18T16:21:26.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94886517334816] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 20 remove_watcher() i=6 2024-02-18T16:21:26.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94886517338992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564c7d2893b0 con 0x7f2bf00141d0 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94886517338992] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bf80db080 con 0x7f2bf00141d0 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 20 remove_watcher() i=7 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2bf00141d0 msgr2=0x7f2bf0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2bf00141d0 0x7f2bf0015940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d27ef60 msgr2=0x564c7d281420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d27ef60 0x564c7d281420 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2be8027060 msgr2=0x7f2be803a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2be8027060 0x7f2be803a470 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c7d2851b0 msgr2=0x564c7d287640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x564c7d2851b0 0x564c7d287640 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ac80342b0 msgr2=0x7f2ac8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ac80342b0 0x7f2ac8036770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0011010 tx=0x7f2bf0020000 comp rx=0 tx=0).stop 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 msgr2=0x564c7d2739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2bff54e640 1 -- 172.21.15.129:0/4291408953 reap_dead start 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d2739f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2be800eea0 tx=0x7f2be8048b70 comp rx=0 tx=0).stop 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 shutdown_connections 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 --2- 172.21.15.129:0/4291408953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d26cb30 0x564c7d2739f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 >> 172.21.15.129:0/4291408953 conn(0x564c7d268e70 msgr2=0x564c7d2664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 shutdown_connections 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.926+0000 7f2c01a33980 1 -- 172.21.15.129:0/4291408953 wait complete. 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ad80342b0 msgr2=0x7f2ad8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ad80342b0 0x7f2ad8036770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x564c7d24be00 tx=0x7f2bf0005850 comp rx=0 tx=0).stop 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 msgr2=0x564c7d25ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 0x564c7d25ffd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2be8001ee0 tx=0x7f2be800ea10 comp rx=0 tx=0).stop 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 shutdown_connections 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ad80342b0 0x7f2ad8036770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/2730443074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d25fbb0 0x564c7d25ffd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 >> 172.21.15.129:0/2730443074 conn(0x564c7d2505b0 msgr2=0x564c7d2510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 shutdown_connections 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/2730443074 wait complete. 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d154930 msgr2=0x564c7d24af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d154930 0x564c7d24af20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ae40342b0 msgr2=0x7f2ae4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ae40342b0 0x7f2ae4036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2be8000f70 tx=0x7f2be8001380 comp rx=0 tx=0).stop 2024-02-18T16:21:26.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 msgr2=0x564c7d244290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d244290 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2bf801d030 tx=0x7f2bf8019fa0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 shutdown_connections 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x564c7d154930 0x564c7d24af20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2ae40342b0 0x7f2ae4036770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 --2- 172.21.15.129:0/3115238246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x564c7d154010 0x564c7d244290 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 >> 172.21.15.129:0/3115238246 conn(0x564c7d14f8e0 msgr2=0x564c7d237be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 shutdown_connections 2024-02-18T16:21:26.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:26.930+0000 7f2c01a33980 1 -- 172.21.15.129:0/3115238246 wait complete. 2024-02-18T16:21:26.947 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-18T16:21:26.947 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-18T16:21:26.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-18T16:21:26.948 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-02-18T16:21:27.029 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:27.029 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:27.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.022+0000 7f6327442980 1 Processor -- start 2024-02-18T16:21:27.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6327442980 1 -- start start 2024-02-18T16:21:27.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6327442980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d524967090 0x55d5249f8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6327442980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d52493f4d0 con 0x55d5249f8750 2024-02-18T16:21:27.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6327442980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d524906180 con 0x55d524967090 2024-02-18T16:21:27.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6324f5d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d524967090 0x55d5249f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f631ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55d5249f8750 0x55d5249fab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:42890/0 (socket says 172.21.15.129:42890) 2024-02-18T16:21:27.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f631ffff640 1 -- 172.21.15.129:0/2349691902 learned_addr learned my addr 172.21.15.129:0/2349691902 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:27.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6324f5d640 1 --2- 172.21.15.129:0/2349691902 >> v2:172.21.15.80:3300/0 conn(0x55d524967090 0x55d5249f8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49144/0 (socket says 172.21.15.129:49144) 2024-02-18T16:21:27.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f631f7fe640 1 -- 172.21.15.129:0/2349691902 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831782997 0 0) 0x55d52493f4d0 con 0x55d5249f8750 2024-02-18T16:21:27.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f631f7fe640 1 -- 172.21.15.129:0/2349691902 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6314001e20 con 0x55d5249f8750 2024-02-18T16:21:27.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6324f5d640 1 -- 172.21.15.129:0/2349691902 >> v1:172.21.15.80:6789/0 conn(0x55d5249f8750 legacy=0x55d5249fab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.026+0000 7f6324f5d640 1 -- 172.21.15.129:0/2349691902 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5249fd270 con 0x55d524967090 2024-02-18T16:21:27.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6324f5d640 1 --2- 172.21.15.129:0/2349691902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d5249f8210 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f631800a480 tx=0x7f631801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471501104b9ece22 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f631f7fe640 1 -- 172.21.15.129:0/2349691902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63180ab540 con 0x55d524967090 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f631f7fe640 1 -- 172.21.15.129:0/2349691902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63180ab6a0 con 0x55d524967090 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f631f7fe640 1 -- 172.21.15.129:0/2349691902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63180ab960 con 0x55d524967090 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 -- 172.21.15.129:0/2349691902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 msgr2=0x55d5249f8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 --2- 172.21.15.129:0/2349691902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d5249f8210 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f631800a480 tx=0x7f631801b280 comp rx=0 tx=0).stop 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 -- 172.21.15.129:0/2349691902 shutdown_connections 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 --2- 172.21.15.129:0/2349691902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d5249f8210 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 -- 172.21.15.129:0/2349691902 >> 172.21.15.129:0/2349691902 conn(0x55d5249ed8f0 msgr2=0x55d5249efd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 -- 172.21.15.129:0/2349691902 shutdown_connections 2024-02-18T16:21:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.030+0000 7f6327442980 1 -- 172.21.15.129:0/2349691902 wait complete. 2024-02-18T16:21:27.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6327442980 1 Processor -- start 2024-02-18T16:21:27.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6327442980 1 -- start start 2024-02-18T16:21:27.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6327442980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524adf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6327442980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5249036b0 con 0x55d524967090 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6324f5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524adf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6324f5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524adf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49156/0 (socket says 172.21.15.129:49156) 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6324f5d640 1 -- 172.21.15.129:0/865338145 learned_addr learned my addr 172.21.15.129:0/865338145 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6324f5d640 1 -- 172.21.15.129:0/865338145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318005d30 con 0x55d524967090 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6324f5d640 1 --2- 172.21.15.129:0/865338145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524adf220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6318018eb0 tx=0x7f6318003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753bffb197317e4e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6212e05640 1 -- 172.21.15.129:0/865338145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63180ab810 con 0x55d524967090 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6212e05640 1 -- 172.21.15.129:0/865338145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63180ab970 con 0x55d524967090 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.046+0000 7f6212e05640 1 -- 172.21.15.129:0/865338145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63180abc10 con 0x55d524967090 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/865338145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 msgr2=0x55d524adf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 --2- 172.21.15.129:0/865338145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524adf220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6318018eb0 tx=0x7f6318003030 comp rx=0 tx=0).stop 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/865338145 shutdown_connections 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 --2- 172.21.15.129:0/865338145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524adf220 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/865338145 >> 172.21.15.129:0/865338145 conn(0x55d5249ed8f0 msgr2=0x55d524adacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/865338145 shutdown_connections 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/865338145 wait complete. 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 Processor -- start 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- start start 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524ae5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5248fee90 con 0x55d524967090 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6324f5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524ae5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6324f5d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524ae5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49166/0 (socket says 172.21.15.129:49166) 2024-02-18T16:21:27.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6324f5d640 1 -- 172.21.15.129:0/701680512 learned_addr learned my addr 172.21.15.129:0/701680512 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6324f5d640 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5249fd270 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6324f5d640 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524ae5f90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f631800a480 tx=0x7f6318018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6211602640 1 -- 172.21.15.129:0/701680512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63180c3070 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6211602640 1 -- 172.21.15.129:0/701680512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63180ab530 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d524ae64d0 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6211602640 1 -- 172.21.15.129:0/701680512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63180b5580 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.050+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d524ae68c0 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6211602640 1 -- 172.21.15.129:0/701680512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f63180b2070 con 0x55d524967090 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6211602640 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f620c0342b0 0x7f620c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6211602640 1 -- 172.21.15.129:0/701680512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f63180e3aa0 con 0x55d524967090 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f631ffff640 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f620c0342b0 0x7f620c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5249f8750 0x55d524aecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524aed150 con 0x55d5249f8750 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5249f8750 0x55d524aecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f631ffff640 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f620c0342b0 0x7f620c036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6310001dc0 tx=0x7f6310001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5249f8750 0x55d524aecc10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 -- 172.21.15.129:0/701680512 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f632000a4d0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524aed530 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 -- 172.21.15.129:0/701680512 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f632000a4d0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524aeede0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 -- 172.21.15.129:0/701680512 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f632000a4d0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524aedfe0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 -- 172.21.15.129:0/701680512 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f632000a4d0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524aee3f0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f632575e640 1 -- 172.21.15.129:0/701680512 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f632000a4d0 con 0x55d5249f8750 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 Processor -- start 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- start start 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 0x55d524afd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.054+0000 7f6327442980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d524897f20 con 0x55d524afd4c0 2024-02-18T16:21:27.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f631ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 0x55d524afd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f631ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 0x55d524afd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49182/0 (socket says 172.21.15.129:49182) 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f631ffff640 1 -- 172.21.15.129:0/1748274916 learned_addr learned my addr 172.21.15.129:0/1748274916 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f631ffff640 1 -- 172.21.15.129:0/1748274916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d524afde20 con 0x55d524afd4c0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f631ffff640 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 0x55d524afd8e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f631000d660 tx=0x7f631000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f620a7fc640 1 -- 172.21.15.129:0/1748274916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6310020070 con 0x55d524afd4c0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f620a7fc640 1 -- 172.21.15.129:0/1748274916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631000c770 con 0x55d524afd4c0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f620a7fc640 1 -- 172.21.15.129:0/1748274916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6310013040 con 0x55d524afd4c0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d524afe070 con 0x55d524afd4c0 2024-02-18T16:21:27.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d524afebc0 con 0x55d524afd4c0 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f620a7fc640 1 -- 172.21.15.129:0/1748274916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f631000a040 con 0x55d524afd4c0 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f620a7fc640 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61fc034300 0x7f61fc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f620a7fc640 1 -- 172.21.15.129:0/1748274916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f631004b650 con 0x55d524afd4c0 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f632575e640 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61fc034300 0x7f61fc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f6327442980 1 Processor -- start 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f6327442980 1 -- start start 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f6327442980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b0a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f632575e640 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61fc034300 0x7f61fc0367c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55d524aeda20 tx=0x7f6320005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.058+0000 7f6327442980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d52488b790 con 0x55d524b0a4e0 2024-02-18T16:21:27.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b0a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b0a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49194/0 (socket says 172.21.15.129:49194) 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 -- 172.21.15.129:0/3556324666 learned_addr learned my addr 172.21.15.129:0/3556324666 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 -- 172.21.15.129:0/3556324666 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d524b0ae90 con 0x55d524b0a4e0 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 --2- 172.21.15.129:0/3556324666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b0a8c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6310049980 tx=0x7f6310019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c77b892fe0ef258 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f61fbfff640 1 -- 172.21.15.129:0/3556324666 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6310019320 con 0x55d524b0a4e0 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f61fbfff640 1 -- 172.21.15.129:0/3556324666 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310019480 con 0x55d524b0a4e0 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f61fbfff640 1 -- 172.21.15.129:0/3556324666 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6310024c70 con 0x55d524b0a4e0 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3556324666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 msgr2=0x55d524b0a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 --2- 172.21.15.129:0/3556324666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b0a8c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6310049980 tx=0x7f6310019a70 comp rx=0 tx=0).stop 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3556324666 shutdown_connections 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 --2- 172.21.15.129:0/3556324666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b0a8c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3556324666 >> 172.21.15.129:0/3556324666 conn(0x55d524b06820 msgr2=0x55d524b04880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3556324666 shutdown_connections 2024-02-18T16:21:27.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3556324666 wait complete. 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 Processor -- start 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- start start 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b113c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d524b11900 con 0x55d524b0a4e0 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b113c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:49204/0 (socket says 172.21.15.129:49204) 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 learned_addr learned my addr 172.21.15.129:0/3804085581 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d524afebc0 con 0x55d524b0a4e0 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f631ffff640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b113c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6310019f50 tx=0x7f6310049910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f61fa7fc640 1 -- 172.21.15.129:0/3804085581 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6310019320 con 0x55d524b0a4e0 2024-02-18T16:21:27.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d524b11b00 con 0x55d524b0a4e0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f61fa7fc640 1 -- 172.21.15.129:0/3804085581 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631001b420 con 0x55d524b0a4e0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f61fa7fc640 1 -- 172.21.15.129:0/3804085581 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63100480d0 con 0x55d524b0a4e0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.062+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d524b11f30 con 0x55d524b0a4e0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f61fa7fc640 1 -- 172.21.15.129:0/3804085581 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6310048230 con 0x55d524b0a4e0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f61fa7fc640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61f00342b0 0x7f61f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f61fa7fc640 1 -- 172.21.15.129:0/3804085581 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f631004a050 con 0x55d524b0a4e0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f632575e640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61f00342b0 0x7f61f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d524b1c990 0x55d524b1ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b1f5a0 con 0x55d524b1c990 2024-02-18T16:21:27.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d524b1c990 0x55d524b1ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f632575e640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61f00342b0 0x7f61f0036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6320011010 tx=0x7f6320020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d524b1c990 0x55d524b1ee50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 realm 2024-02-18T16:21:27.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b1f970 con 0x55d524b1c990 2024-02-18T16:21:27.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b201f0 con 0x55d524b1c990 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b20550 con 0x55d524b1c990 2024-02-18T16:21:27.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b20d50 con 0x55d524b1c990 2024-02-18T16:21:27.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:27.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 20 searching for the correct realm 2024-02-18T16:21:27.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d524b22be0 0x55d524b25050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.066+0000 7f631ffff640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d524b22be0 0x55d524b25050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f631ffff640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d524b22be0 0x55d524b25050 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f631ffff640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f631003a020 0x7f631004b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f631003a020 2024-02-18T16:21:27.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f632575e640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f631003a020 0x7f631004b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f632575e640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f631003a020 0x7f631004b8b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f632000a4d0 con 0x7f631003a020 2024-02-18T16:21:27.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f632575e640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f63200141d0 0x7f6320015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f63200141d0 0x7f6320015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f63200141d0 0x7f6320015940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x7f63200141d0 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.070+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x7f63200141d0 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x7f63200141d0 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f631003a020 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f632000a4d0 con 0x7f631003a020 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x7f63200141d0 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f631003a020 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.074+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x7f63200141d0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f63180cd070 con 0x55d524b1c990 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f631003a020 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.078+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f631003a020 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b22be0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f63200141d0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x55d524b1c990 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25720 con 0x7f631003a020 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b216b0 con 0x55d524b1c990 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b21f00 con 0x55d524b1c990 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b25b60 con 0x55d524b1c990 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 zone default found 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 4 Realm: () 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 zonegroup default 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.082+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b26000 con 0x7f63200141d0 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b279e0 con 0x55d524b22be0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b27d40 con 0x55d524b22be0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 started sync module instance, tier type = 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b26fb0 con 0x7f631003a020 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373932069728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b26fb0 con 0x7f631003a020 2024-02-18T16:21:27.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.086+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b28820 con 0x55d524b1c990 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373932069728] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373932073728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b26fb0 con 0x55d524b1c990 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b29220 con 0x55d524b22be0 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373932076352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b29a70 con 0x55d524b22be0 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2a440 con 0x7f631003a020 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.090+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373932073728] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373932080960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2a7f0 con 0x7f631003a020 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2b160 con 0x55d524b1c990 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373932076352] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373932080960] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373932067600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2acc0 con 0x55d524b1c990 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.094+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2b9b0 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373932067600] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373932078544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2b710 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2bf10 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373932078544] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373932086144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2bd00 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.098+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2c7d0 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373932086144] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373932090032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2c790 con 0x7f63200141d0 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=0 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=1 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=2 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=3 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=4 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=5 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=6 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373932090032] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 20 add_watcher() i=7 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.102+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2fbe0 con 0x55d524b1c990 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373932087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2d080 con 0x55d524b1c990 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373932087200] v30'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f61dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 5 note: GC not initialized 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f61d9fe3640 20 reqs_thread_entry: start 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 Filter name: none 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f614b7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b51b50 con 0x7f63200141d0 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:21:27.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-18T16:21:27.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:27.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:27.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b535d0 con 0x7f631003a020 2024-02-18T16:21:27.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:27.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:27.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.106+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b54c80 con 0x55d524b1c990 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(64 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b58170 con 0x7f63200141d0 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-18T16:21:27.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b57160 con 0x7f631003a020 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.110+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b5bdd0 con 0x7f631003a020 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6327442980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6327442980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6327442980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94373932284208 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b58ad0 con 0x7f63200141d0 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== watch-notify(notify (1) cookie 94373932086144 notify 128849018884 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x55d524ae68c0 con 0x7f63200141d0 2024-02-18T16:21:27.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f61fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94373932086144 notifier 4510 bl.length()=338 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(68 notify.6 [notify cookie 94373932284208 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f61fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f61fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f61fbfff640 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f61e8003ea0 con 0x7f63200141d0 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.114+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== watch-notify(notify_complete (2) cookie 94373932284208 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d524ae64d0 con 0x7f63200141d0 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f61dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373932087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b5b930 con 0x55d524b1c990 2024-02-18T16:21:27.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94373932087200] v30'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373932069728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2b7a0 con 0x7f631003a020 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94373932069728] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f6327442980 20 remove_watcher() i=0 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f6327442980 2 removed watcher, disabling cache 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.118+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373932073728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2b7a0 con 0x55d524b1c990 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.122+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94373932073728] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.122+0000 7f6327442980 20 remove_watcher() i=1 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.122+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373932076352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b2b7a0 con 0x55d524b22be0 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.122+0000 7f631ffff640 1 -- 172.21.15.129:0/3804085581 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94373932076352] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6310022070 con 0x55d524b22be0 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.122+0000 7f6327442980 20 remove_watcher() i=2 2024-02-18T16:21:27.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.122+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373932080960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b27360 con 0x7f631003a020 2024-02-18T16:21:27.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.126+0000 7f632575e640 1 -- 172.21.15.129:0/3804085581 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94373932080960] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f632003a040 con 0x7f631003a020 2024-02-18T16:21:27.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.126+0000 7f6327442980 20 remove_watcher() i=3 2024-02-18T16:21:27.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.126+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373932067600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b27360 con 0x55d524b1c990 2024-02-18T16:21:27.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.126+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94373932067600] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x55d524b1c990 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.126+0000 7f6327442980 20 remove_watcher() i=4 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.126+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373932078544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b27360 con 0x7f63200141d0 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.130+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94373932078544] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.130+0000 7f6327442980 20 remove_watcher() i=5 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.130+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373932086144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b295d0 con 0x7f63200141d0 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.130+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94373932086144] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.130+0000 7f6327442980 20 remove_watcher() i=6 2024-02-18T16:21:27.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.130+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373932090032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d524b27360 con 0x7f63200141d0 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94373932090032] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63180f3040 con 0x7f63200141d0 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 20 remove_watcher() i=7 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f63200141d0 msgr2=0x7f6320015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f63200141d0 0x7f6320015940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d524b1c990 msgr2=0x55d524b1ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d524b1c990 0x55d524b1ee50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f631003a020 msgr2=0x7f631004b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f631003a020 0x7f631004b8b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d524b22be0 msgr2=0x55d524b25050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d524b22be0 0x55d524b25050 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61f00342b0 msgr2=0x7f61f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61f00342b0 0x7f61f0036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6320011010 tx=0x7f6320020000 comp rx=0 tx=0).stop 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 msgr2=0x55d524b113c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6324f5d640 1 -- 172.21.15.129:0/3804085581 reap_dead start 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b113c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6310019f50 tx=0x7f6310049910 comp rx=0 tx=0).stop 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 shutdown_connections 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/3804085581 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524b0a4e0 0x55d524b113c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 >> 172.21.15.129:0/3804085581 conn(0x55d524b06820 msgr2=0x55d524b03e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 shutdown_connections 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/3804085581 wait complete. 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61fc034300 msgr2=0x7f61fc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61fc034300 0x7f61fc0367c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55d524aeda20 tx=0x7f6320005850 comp rx=0 tx=0).stop 2024-02-18T16:21:27.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 msgr2=0x55d524afd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 0x55d524afd8e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f631000d660 tx=0x7f631000da60 comp rx=0 tx=0).stop 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 shutdown_connections 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f61fc034300 0x7f61fc0367c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/1748274916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524afd4c0 0x55d524afd8e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 >> 172.21.15.129:0/1748274916 conn(0x55d524af22d0 msgr2=0x55d524af2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 shutdown_connections 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/1748274916 wait complete. 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5249f8750 msgr2=0x55d524aecc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5249f8750 0x55d524aecc10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f620c0342b0 msgr2=0x7f620c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f620c0342b0 0x7f620c036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6310001dc0 tx=0x7f6310001360 comp rx=0 tx=0).stop 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 msgr2=0x55d524ae5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524ae5f90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f631800a480 tx=0x7f6318018020 comp rx=0 tx=0).stop 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 shutdown_connections 2024-02-18T16:21:27.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d5249f8750 0x55d524aecc10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f620c0342b0 0x7f620c036770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 --2- 172.21.15.129:0/701680512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d524967090 0x55d524ae5f90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 >> 172.21.15.129:0/701680512 conn(0x55d5249ed8f0 msgr2=0x55d524ad97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 shutdown_connections 2024-02-18T16:21:27.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.134+0000 7f6327442980 1 -- 172.21.15.129:0/701680512 wait complete. 2024-02-18T16:21:27.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1'] 2024-02-18T16:21:27.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1'] 2024-02-18T16:21:27.152 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:27.240 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:27.240 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:27.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c50f6980 1 Processor -- start 2024-02-18T16:21:27.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c50f6980 1 -- start start 2024-02-18T16:21:27.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c50f6980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d990dab2f0 0x55d990dab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c50f6980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d990cf5460 con 0x55d990dabc10 2024-02-18T16:21:27.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c50f6980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d990cbc180 con 0x55d990dab2f0 2024-02-18T16:21:27.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c2c11640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d990dab2f0 0x55d990dab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.238+0000 7f03c2c11640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55d990dab2f0 0x55d990dab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55608/0 (socket says 172.21.15.129:55608) 2024-02-18T16:21:27.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.238+0000 7f03c2c11640 1 -- 172.21.15.129:0/1751398742 learned_addr learned my addr 172.21.15.129:0/1751398742 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.234+0000 7f03c2410640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55d990dabc10 0x55d990dac5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53014/0 (socket says 172.21.15.129:53014) 2024-02-18T16:21:27.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.238+0000 7f03c2c11640 1 -- 172.21.15.129:0/1751398742 >> v1:172.21.15.80:6789/0 conn(0x55d990dabc10 legacy=0x55d990dac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.238+0000 7f03c1c0f640 1 -- 172.21.15.129:0/1751398742 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387218505 0 0) 0x55d990cf5460 con 0x55d990dabc10 2024-02-18T16:21:27.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.238+0000 7f03c2c11640 1 -- 172.21.15.129:0/1751398742 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d990dacdf0 con 0x55d990dab2f0 2024-02-18T16:21:27.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c2c11640 1 --2- 172.21.15.129:0/1751398742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990dab6d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03b400a5c0 tx=0x7f03b401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169d45b48421dc86 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c1c0f640 1 -- 172.21.15.129:0/1751398742 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b40aa470 con 0x55d990dab2f0 2024-02-18T16:21:27.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c1c0f640 1 -- 172.21.15.129:0/1751398742 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b40aa5d0 con 0x55d990dab2f0 2024-02-18T16:21:27.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c1c0f640 1 -- 172.21.15.129:0/1751398742 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b40aa890 con 0x55d990dab2f0 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 -- 172.21.15.129:0/1751398742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 msgr2=0x55d990dab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1751398742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990dab6d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03b400a5c0 tx=0x7f03b401b340 comp rx=0 tx=0).stop 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 -- 172.21.15.129:0/1751398742 shutdown_connections 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1751398742 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990dab6d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 -- 172.21.15.129:0/1751398742 >> 172.21.15.129:0/1751398742 conn(0x55d990d1e9e0 msgr2=0x55d990d1edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 -- 172.21.15.129:0/1751398742 shutdown_connections 2024-02-18T16:21:27.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.242+0000 7f03c50f6980 1 -- 172.21.15.129:0/1751398742 wait complete. 2024-02-18T16:21:27.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 Processor -- start 2024-02-18T16:21:27.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 -- start start 2024-02-18T16:21:27.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e95670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d990cb96b0 con 0x55d990dab2f0 2024-02-18T16:21:27.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c2c11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e95670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c2c11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e95670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55612/0 (socket says 172.21.15.129:55612) 2024-02-18T16:21:27.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c2c11640 1 -- 172.21.15.129:0/3117391674 learned_addr learned my addr 172.21.15.129:0/3117391674 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c2c11640 1 -- 172.21.15.129:0/3117391674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4005df0 con 0x55d990dab2f0 2024-02-18T16:21:27.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c2c11640 1 --2- 172.21.15.129:0/3117391674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e95670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f03b40ac040 tx=0x7f03b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6c34a9ac3c500d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f02b0e09640 1 -- 172.21.15.129:0/3117391674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b40aa9b0 con 0x55d990dab2f0 2024-02-18T16:21:27.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f02b0e09640 1 -- 172.21.15.129:0/3117391674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b40aab30 con 0x55d990dab2f0 2024-02-18T16:21:27.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f02b0e09640 1 -- 172.21.15.129:0/3117391674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b40aae10 con 0x55d990dab2f0 2024-02-18T16:21:27.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 -- 172.21.15.129:0/3117391674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 msgr2=0x55d990e95670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 --2- 172.21.15.129:0/3117391674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e95670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f03b40ac040 tx=0x7f03b4003030 comp rx=0 tx=0).stop 2024-02-18T16:21:27.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 -- 172.21.15.129:0/3117391674 shutdown_connections 2024-02-18T16:21:27.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 --2- 172.21.15.129:0/3117391674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e95670 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.258+0000 7f03c50f6980 1 -- 172.21.15.129:0/3117391674 >> 172.21.15.129:0/3117391674 conn(0x55d990d1e9e0 msgr2=0x55d990e91200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 -- 172.21.15.129:0/3117391674 shutdown_connections 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 -- 172.21.15.129:0/3117391674 wait complete. 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 Processor -- start 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 -- start start 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e9c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d990cb4e90 con 0x55d990dab2f0 2024-02-18T16:21:27.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c2c11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e9c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c2c11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e9c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55628/0 (socket says 172.21.15.129:55628) 2024-02-18T16:21:27.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c2c11640 1 -- 172.21.15.129:0/2043645799 learned_addr learned my addr 172.21.15.129:0/2043645799 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c2c11640 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d990dacdf0 con 0x55d990dab2f0 2024-02-18T16:21:27.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c2c11640 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e9c420 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f03b4005940 tx=0x7f03b40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f02af606640 1 -- 172.21.15.129:0/2043645799 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b40c6690 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f02af606640 1 -- 172.21.15.129:0/2043645799 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b40c67f0 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d990e9c960 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f02af606640 1 -- 172.21.15.129:0/2043645799 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b40c6ab0 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d990e9cd90 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f02af606640 1 -- 172.21.15.129:0/2043645799 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03b40c6c10 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f02af606640 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f02a8034300 0x7f02a80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.262+0000 7f02af606640 1 -- 172.21.15.129:0/2043645799 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03b40e4090 con 0x55d990dab2f0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c2410640 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f02a8034300 0x7f02a80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990dabc10 0x55d990ea30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ea35e0 con 0x55d990dabc10 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990dabc10 0x55d990ea30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c2410640 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f02a8034300 0x7f02a80367c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f03b8000c10 tx=0x7f03b80013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990dabc10 0x55d990ea30a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 -- 172.21.15.129:0/2043645799 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03bc00a4d0 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ea3940 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 -- 172.21.15.129:0/2043645799 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03bc00a4d0 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ea51d0 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 -- 172.21.15.129:0/2043645799 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f03bc00a4d0 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ea4310 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 -- 172.21.15.129:0/2043645799 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03bc00a4d0 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ea4720 con 0x55d990dabc10 2024-02-18T16:21:27.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c3412640 1 -- 172.21.15.129:0/2043645799 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f03bc00a4d0 con 0x55d990dabc10 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 Processor -- start 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- start start 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 0x55d990eb3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c50f6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d990c4df20 con 0x55d990eb3870 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c2410640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 0x55d990eb3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c2410640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 0x55d990eb3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55644/0 (socket says 172.21.15.129:55644) 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.266+0000 7f03c2410640 1 -- 172.21.15.129:0/2975578767 learned_addr learned my addr 172.21.15.129:0/2975578767 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c2410640 1 -- 172.21.15.129:0/2975578767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d990eb41d0 con 0x55d990eb3870 2024-02-18T16:21:27.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c2410640 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 0x55d990eb3c90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f03b800e620 tx=0x7f03b800e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f02ace01640 1 -- 172.21.15.129:0/2975578767 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b801b380 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f02ace01640 1 -- 172.21.15.129:0/2975578767 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b801b4e0 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d990eb4420 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f02ace01640 1 -- 172.21.15.129:0/2975578767 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b801b780 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d990eb4f70 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f02ace01640 1 -- 172.21.15.129:0/2975578767 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03b801a070 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f02ace01640 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f029c0342b0 0x7f029c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f02ace01640 1 -- 172.21.15.129:0/2975578767 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03b8017050 con 0x55d990eb3870 2024-02-18T16:21:27.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c3412640 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f029c0342b0 0x7f029c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c50f6980 1 Processor -- start 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c50f6980 1 -- start start 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c3412640 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f029c0342b0 0x7f029c036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55d990ea3d50 tx=0x7f03bc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c50f6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c50f6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d990c41790 con 0x55d990ec0840 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c2410640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c2410640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55650/0 (socket says 172.21.15.129:55650) 2024-02-18T16:21:27.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c2410640 1 -- 172.21.15.129:0/3530626682 learned_addr learned my addr 172.21.15.129:0/3530626682 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.270+0000 7f03c2410640 1 -- 172.21.15.129:0/3530626682 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d990ec11f0 con 0x55d990ec0840 2024-02-18T16:21:27.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c2410640 1 --2- 172.21.15.129:0/3530626682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec0c20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f03b8027030 tx=0x7f03b800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9c8309fa4ed0a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f02a67fc640 1 -- 172.21.15.129:0/3530626682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8048ea0 con 0x55d990ec0840 2024-02-18T16:21:27.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f02a67fc640 1 -- 172.21.15.129:0/3530626682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b801bc60 con 0x55d990ec0840 2024-02-18T16:21:27.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f02a67fc640 1 -- 172.21.15.129:0/3530626682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8047070 con 0x55d990ec0840 2024-02-18T16:21:27.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/3530626682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 msgr2=0x55d990ec0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 --2- 172.21.15.129:0/3530626682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec0c20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f03b8027030 tx=0x7f03b800ded0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/3530626682 shutdown_connections 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 --2- 172.21.15.129:0/3530626682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec0c20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/3530626682 >> 172.21.15.129:0/3530626682 conn(0x55d990ebcb80 msgr2=0x55d990ebabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/3530626682 shutdown_connections 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/3530626682 wait complete. 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 Processor -- start 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- start start 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d990ec7c30 con 0x55d990ec0840 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c2410640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c2410640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55656/0 (socket says 172.21.15.129:55656) 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 learned_addr learned my addr 172.21.15.129:0/1527558210 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d990eb4f70 con 0x55d990ec0840 2024-02-18T16:21:27.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c2410640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec76f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f03b803c040 tx=0x7f03b8048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f02a4ff9640 1 -- 172.21.15.129:0/1527558210 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b8048ea0 con 0x55d990ec0840 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f02a4ff9640 1 -- 172.21.15.129:0/1527558210 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b801bdd0 con 0x55d990ec0840 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d990ec7e30 con 0x55d990ec0840 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f02a4ff9640 1 -- 172.21.15.129:0/1527558210 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03b803ae00 con 0x55d990ec0840 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.274+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d990ec8260 con 0x55d990ec0840 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f02a4ff9640 1 -- 172.21.15.129:0/1527558210 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f03b8032020 con 0x55d990ec0840 2024-02-18T16:21:27.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f02a4ff9640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f028c0342b0 0x7f028c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f02a4ff9640 1 -- 172.21.15.129:0/1527558210 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03b8009050 con 0x55d990ec0840 2024-02-18T16:21:27.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c3412640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f028c0342b0 0x7f028c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990ed2c80 0x55d990ed5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed5890 con 0x55d990ed2c80 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990ed2c80 0x55d990ed5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c3412640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f028c0342b0 0x7f028c036770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03bc011010 tx=0x7f03bc020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990ed2c80 0x55d990ed5140 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 realm 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed5c60 con 0x55d990ed2c80 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed64e0 con 0x55d990ed2c80 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed6840 con 0x55d990ed2c80 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed7040 con 0x55d990ed2c80 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 20 searching for the correct realm 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d990ed8ed0 0x55d990edb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2410640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d990ed8ed0 0x55d990edb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.278+0000 7f03c2410640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d990ed8ed0 0x55d990edb340 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b800c040 con 0x55d990ed8ed0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2410640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f03b8027060 0x7f03b8047210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03b8027060 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c3412640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f03b8027060 0x7f03b8047210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c3412640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f03b8027060 0x7f03b8047210 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00a4d0 con 0x7f03b8027060 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c3412640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f03bc0141d0 0x7f03bc015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f03bc0141d0 0x7f03bc015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f03bc0141d0 0x7f03bc015940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.282+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03b8027060 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc00a4d0 con 0x7f03b8027060 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b800c040 con 0x55d990ed8ed0 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03b8027060 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b800c040 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.286+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03b8027060 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.290+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03b8027060 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed8ed0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03bc0141d0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x55d990ed2c80 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edba10 con 0x7f03b8027060 2024-02-18T16:21:27.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed7940 con 0x55d990ed2c80 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed8190 con 0x55d990ed2c80 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.294+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed75c0 con 0x55d990ed2c80 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 zone default found 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 4 Realm: () 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 zonegroup default 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed81b0 con 0x7f03bc0141d0 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990eddd70 con 0x55d990ed8ed0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ede0d0 con 0x55d990ed8ed0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 started sync module instance, tier type = 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edd340 con 0x7f03b8027060 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94392927770352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edd340 con 0x7f03b8027060 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.298+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edea40 con 0x55d990ed2c80 2024-02-18T16:21:27.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94392927770352] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94392927768496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edea40 con 0x55d990ed2c80 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edf3f0 con 0x55d990ed8ed0 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94392927768496] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94392927774112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ede9c0 con 0x55d990ed8ed0 2024-02-18T16:21:27.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.302+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee00e0 con 0x7f03b8027060 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94392927780176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee0930 con 0x7f03b8027060 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee1330 con 0x55d990ed2c80 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94392927774112] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94392927780176] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94392927784496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee0490 con 0x55d990ed2c80 2024-02-18T16:21:27.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.306+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee1b80 con 0x7f03bc0141d0 2024-02-18T16:21:27.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94392927784496] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94392927778720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee0490 con 0x7f03bc0141d0 2024-02-18T16:21:27.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee2090 con 0x7f03bc0141d0 2024-02-18T16:21:27.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94392927778720] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94392927787888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee2050 con 0x7f03bc0141d0 2024-02-18T16:21:27.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.310+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee29c0 con 0x7f03bc0141d0 2024-02-18T16:21:27.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94392927787888] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94392927786208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee29c0 con 0x7f03bc0141d0 2024-02-18T16:21:27.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=0 2024-02-18T16:21:27.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=1 2024-02-18T16:21:27.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=2 2024-02-18T16:21:27.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=3 2024-02-18T16:21:27.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=4 2024-02-18T16:21:27.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=5 2024-02-18T16:21:27.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=6 2024-02-18T16:21:27.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94392927786208] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 20 add_watcher() i=7 2024-02-18T16:21:27.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:27.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee5e40 con 0x55d990ed2c80 2024-02-18T16:21:27.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.314+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94392927790832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee3350 con 0x55d990ed2c80 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94392927790832] v30'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f02797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 5 note: GC not initialized 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f01f3fff640 20 reqs_thread_entry: start 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 Filter name: none 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f01f1ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f07d90 con 0x55d990ed2c80 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f09790 con 0x7f03b8027060 2024-02-18T16:21:27.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0aee0 con 0x55d990ed2c80 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:27.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-18T16:21:27.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.318+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0f210 con 0x7f03bc0141d0 2024-02-18T16:21:27.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f151d0 con 0x55d990ed2c80 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c50f6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c50f6980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c50f6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c50f6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94392927957904 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0f600 con 0x55d990ed2c80 2024-02-18T16:21:27.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== watch-notify(notify (1) cookie 94392927768496 notify 128849018899 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55d990e9cd90 con 0x55d990ed2c80 2024-02-18T16:21:27.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f02a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94392927768496 notifier 4517 bl.length()=725 2024-02-18T16:21:27.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f02a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:27.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f02a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f02a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:27.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(67 notify.1 [notify cookie 94392927957904 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f02a67fc640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0288003ea0 con 0x55d990ed2c80 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.322+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== watch-notify(notify_complete (2) cookie 94392927957904 notify 128849018899 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d990e9c960 con 0x55d990ed2c80 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c50f6980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_sources= new_sources= 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c50f6980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential sources added=[] removed=[] 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c50f6980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_dests= new_dests= 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c50f6980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential dests added=[] removed=[] 2024-02-18T16:21:27.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0b370 con 0x7f03b8027060 2024-02-18T16:21:27.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.326+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0b370 con 0x7f03b8027060 2024-02-18T16:21:27.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c50f6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-18T16:21:27.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c50f6980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c50f6980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:27.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94392927957872 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f13e60 con 0x7f03bc0141d0 2024-02-18T16:21:27.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== watch-notify(notify (1) cookie 94392927787888 notify 128849018885 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55d990e9c960 con 0x7f03bc0141d0 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f02a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94392927787888 notifier 4517 bl.length()=314 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.6 [notify cookie 94392927957872 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f02a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f02a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f02a5ffb640 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f01f8003400 con 0x7f03bc0141d0 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== watch-notify(notify_complete (2) cookie 94392927957872 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d990dacdf0 con 0x7f03bc0141d0 2024-02-18T16:21:27.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f02797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.330+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94392927790832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0b370 con 0x55d990ed2c80 2024-02-18T16:21:27.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.334+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94392927790832] v30'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.334+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94392927770352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0b370 con 0x7f03b8027060 2024-02-18T16:21:27.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.334+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94392927770352] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.334+0000 7f03c50f6980 20 remove_watcher() i=0 2024-02-18T16:21:27.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.334+0000 7f03c50f6980 2 removed watcher, disabling cache 2024-02-18T16:21:27.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.334+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94392927768496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed7940 con 0x55d990ed2c80 2024-02-18T16:21:27.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.338+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94392927768496] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.338+0000 7f03c50f6980 20 remove_watcher() i=1 2024-02-18T16:21:27.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.338+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94392927774112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ed7920 con 0x55d990ed8ed0 2024-02-18T16:21:27.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.338+0000 7f03c2410640 1 -- 172.21.15.129:0/1527558210 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94392927774112] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b805f040 con 0x55d990ed8ed0 2024-02-18T16:21:27.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.338+0000 7f03c50f6980 20 remove_watcher() i=2 2024-02-18T16:21:27.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.338+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94392927780176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0b370 con 0x7f03b8027060 2024-02-18T16:21:27.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.342+0000 7f03c3412640 1 -- 172.21.15.129:0/1527558210 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94392927780176] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03bc03a040 con 0x7f03b8027060 2024-02-18T16:21:27.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.342+0000 7f03c50f6980 20 remove_watcher() i=3 2024-02-18T16:21:27.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.342+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94392927784496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990edcfb0 con 0x55d990ed2c80 2024-02-18T16:21:27.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.342+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94392927784496] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x55d990ed2c80 2024-02-18T16:21:27.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.342+0000 7f03c50f6980 20 remove_watcher() i=4 2024-02-18T16:21:27.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.342+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94392927778720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ede5a0 con 0x7f03bc0141d0 2024-02-18T16:21:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.346+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94392927778720] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.346+0000 7f03c50f6980 20 remove_watcher() i=5 2024-02-18T16:21:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.346+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94392927787888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990f0b370 con 0x7f03bc0141d0 2024-02-18T16:21:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.346+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94392927787888] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.346+0000 7f03c50f6980 20 remove_watcher() i=6 2024-02-18T16:21:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.346+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94392927786208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d990ee0e30 con 0x7f03bc0141d0 2024-02-18T16:21:27.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94392927786208] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f03b40b0020 con 0x7f03bc0141d0 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 20 remove_watcher() i=7 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f03bc0141d0 msgr2=0x7f03bc015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f03bc0141d0 0x7f03bc015940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990ed2c80 msgr2=0x55d990ed5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990ed2c80 0x55d990ed5140 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f03b8027060 msgr2=0x7f03b8047210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f03b8027060 0x7f03b8047210 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d990ed8ed0 msgr2=0x55d990edb340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55d990ed8ed0 0x55d990edb340 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f028c0342b0 msgr2=0x7f028c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f028c0342b0 0x7f028c036770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03bc011010 tx=0x7f03bc020000 comp rx=0 tx=0).stop 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 msgr2=0x55d990ec76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c2c11640 1 -- 172.21.15.129:0/1527558210 reap_dead start 2024-02-18T16:21:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec76f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f03b803c040 tx=0x7f03b8048a20 comp rx=0 tx=0).stop 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 shutdown_connections 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/1527558210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990ec0840 0x55d990ec76f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 >> 172.21.15.129:0/1527558210 conn(0x55d990ebcb80 msgr2=0x55d990eba1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 shutdown_connections 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/1527558210 wait complete. 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f029c0342b0 msgr2=0x7f029c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f029c0342b0 0x7f029c036770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55d990ea3d50 tx=0x7f03bc005850 comp rx=0 tx=0).stop 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 msgr2=0x55d990eb3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 0x55d990eb3c90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f03b800e620 tx=0x7f03b800e650 comp rx=0 tx=0).stop 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 shutdown_connections 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f029c0342b0 0x7f029c036770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2975578767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990eb3870 0x55d990eb3c90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 >> 172.21.15.129:0/2975578767 conn(0x55d990ea8680 msgr2=0x55d990ea9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 shutdown_connections 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2975578767 wait complete. 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990dabc10 msgr2=0x55d990ea30a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990dabc10 0x55d990ea30a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f02a8034300 msgr2=0x7f02a80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f02a8034300 0x7f02a80367c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f03b8000c10 tx=0x7f03b80013c0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 msgr2=0x55d990e9c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e9c420 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f03b4005940 tx=0x7f03b40180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 shutdown_connections 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55d990dabc10 0x55d990ea30a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f02a8034300 0x7f02a80367c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 --2- 172.21.15.129:0/2043645799 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d990dab2f0 0x55d990e9c420 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 >> 172.21.15.129:0/2043645799 conn(0x55d990d1e9e0 msgr2=0x55d990e8fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 shutdown_connections 2024-02-18T16:21:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.350+0000 7f03c50f6980 1 -- 172.21.15.129:0/2043645799 wait complete. 2024-02-18T16:21:27.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-18T16:21:27.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-18T16:21:27.368 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-18T16:21:27.443 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:27.444 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:27.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506f15a980 1 Processor -- start 2024-02-18T16:21:27.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506f15a980 1 -- start start 2024-02-18T16:21:27.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506f15a980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e239283910 0x55e239285d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506f15a980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e2391c94c0 con 0x55e2391f1900 2024-02-18T16:21:27.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506f15a980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e239190180 con 0x55e239283910 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506c474640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e239283910 0x55e239285d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506cc75640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55e2391f1900 0x55e2392821f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53026/0 (socket says 172.21.15.129:53026) 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.438+0000 7f506cc75640 1 -- 172.21.15.129:0/4123366780 learned_addr learned my addr 172.21.15.129:0/4123366780 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506bc73640 1 -- 172.21.15.129:0/4123366780 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123209749 0 0) 0x55e2391c94c0 con 0x55e2391f1900 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506bc73640 1 -- 172.21.15.129:0/4123366780 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5058001e20 con 0x55e2391f1900 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506c474640 1 -- 172.21.15.129:0/4123366780 >> v1:172.21.15.80:6789/0 conn(0x55e2391f1900 legacy=0x55e2392821f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506c474640 1 -- 172.21.15.129:0/4123366780 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e239287250 con 0x55e239283910 2024-02-18T16:21:27.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506c474640 1 --2- 172.21.15.129:0/4123366780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239283910 0x55e239285d00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f505400a480 tx=0x7f505401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22c4d172c43d199 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506bc73640 1 -- 172.21.15.129:0/4123366780 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540ab540 con 0x55e239283910 2024-02-18T16:21:27.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506bc73640 1 -- 172.21.15.129:0/4123366780 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540ab6a0 con 0x55e239283910 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506bc73640 1 -- 172.21.15.129:0/4123366780 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540ab940 con 0x55e239283910 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 -- 172.21.15.129:0/4123366780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239283910 msgr2=0x55e239285d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 --2- 172.21.15.129:0/4123366780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239283910 0x55e239285d00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f505400a480 tx=0x7f505401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 -- 172.21.15.129:0/4123366780 shutdown_connections 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 --2- 172.21.15.129:0/4123366780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239283910 0x55e239285d00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 -- 172.21.15.129:0/4123366780 >> 172.21.15.129:0/4123366780 conn(0x55e239277910 msgr2=0x55e239279d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 -- 172.21.15.129:0/4123366780 shutdown_connections 2024-02-18T16:21:27.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.442+0000 7f506f15a980 1 -- 172.21.15.129:0/4123366780 wait complete. 2024-02-18T16:21:27.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.458+0000 7f506f15a980 1 Processor -- start 2024-02-18T16:21:27.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.458+0000 7f506f15a980 1 -- start start 2024-02-18T16:21:27.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e2393690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23918d6b0 con 0x55e2391f1900 2024-02-18T16:21:27.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e2393690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e2393690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55668/0 (socket says 172.21.15.129:55668) 2024-02-18T16:21:27.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 -- 172.21.15.129:0/564643954 learned_addr learned my addr 172.21.15.129:0/564643954 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 -- 172.21.15.129:0/564643954 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054005d30 con 0x55e2391f1900 2024-02-18T16:21:27.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 --2- 172.21.15.129:0/564643954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e2393690e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5064001c30 tx=0x7f506400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fb438b223460ad server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f4f5ae0d640 1 -- 172.21.15.129:0/564643954 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506400e690 con 0x55e2391f1900 2024-02-18T16:21:27.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f4f5ae0d640 1 -- 172.21.15.129:0/564643954 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400e7f0 con 0x55e2391f1900 2024-02-18T16:21:27.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f4f5ae0d640 1 -- 172.21.15.129:0/564643954 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506400eb50 con 0x55e2391f1900 2024-02-18T16:21:27.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- 172.21.15.129:0/564643954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 msgr2=0x55e2393690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 --2- 172.21.15.129:0/564643954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e2393690e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5064001c30 tx=0x7f506400b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- 172.21.15.129:0/564643954 shutdown_connections 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 --2- 172.21.15.129:0/564643954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e2393690e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- 172.21.15.129:0/564643954 >> 172.21.15.129:0/564643954 conn(0x55e239277910 msgr2=0x55e239364c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- 172.21.15.129:0/564643954 shutdown_connections 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- 172.21.15.129:0/564643954 wait complete. 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 Processor -- start 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- start start 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e23936ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506f15a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e239188e90 con 0x55e2391f1900 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e23936ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e23936ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55670/0 (socket says 172.21.15.129:55670) 2024-02-18T16:21:27.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.462+0000 7f506cc75640 1 -- 172.21.15.129:0/974029198 learned_addr learned my addr 172.21.15.129:0/974029198 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506cc75640 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058001e20 con 0x55e2391f1900 2024-02-18T16:21:27.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506cc75640 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e23936ff90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f506400b710 tx=0x7f5064000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f4f5960a640 1 -- 172.21.15.129:0/974029198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506401f070 con 0x55e2391f1900 2024-02-18T16:21:27.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f4f5960a640 1 -- 172.21.15.129:0/974029198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506401a2e0 con 0x55e2391f1900 2024-02-18T16:21:27.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e2393704d0 con 0x55e2391f1900 2024-02-18T16:21:27.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f4f5960a640 1 -- 172.21.15.129:0/974029198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506401a820 con 0x55e2391f1900 2024-02-18T16:21:27.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e239370920 con 0x55e2391f1900 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f4f5960a640 1 -- 172.21.15.129:0/974029198 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f506400a040 con 0x55e2391f1900 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f4f5960a640 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f54034300 0x7f4f540367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f4f5960a640 1 -- 172.21.15.129:0/974029198 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f5064049740 con 0x55e2391f1900 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506c474640 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f54034300 0x7f4f540367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e239283910 0x55e239376bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e239377100 con 0x55e239283910 2024-02-18T16:21:27.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506d476640 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e239283910 0x55e239376bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506c474640 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f54034300 0x7f4f540367c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f50540ad000 tx=0x7f50540a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.466+0000 7f506d476640 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e239283910 0x55e239376bc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506d476640 1 -- 172.21.15.129:0/974029198 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f505c00a4d0 con 0x55e239283910 2024-02-18T16:21:27.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393774a0 con 0x55e239283910 2024-02-18T16:21:27.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506d476640 1 -- 172.21.15.129:0/974029198 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f505c00a4d0 con 0x55e239283910 2024-02-18T16:21:27.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e239378d20 con 0x55e239283910 2024-02-18T16:21:27.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506d476640 1 -- 172.21.15.129:0/974029198 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f505c00a4d0 con 0x55e239283910 2024-02-18T16:21:27.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e239377f20 con 0x55e239283910 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506d476640 1 -- 172.21.15.129:0/974029198 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f505c00a4d0 con 0x55e239283910 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e239378330 con 0x55e239283910 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506d476640 1 -- 172.21.15.129:0/974029198 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f505c00a4d0 con 0x55e239283910 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 Processor -- start 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 -- start start 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 0x55e239387840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506f15a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e239121f20 con 0x55e239387420 2024-02-18T16:21:27.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506c474640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 0x55e239387840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506c474640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 0x55e239387840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55680/0 (socket says 172.21.15.129:55680) 2024-02-18T16:21:27.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506c474640 1 -- 172.21.15.129:0/3110689939 learned_addr learned my addr 172.21.15.129:0/3110689939 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506c474640 1 -- 172.21.15.129:0/3110689939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e239387d80 con 0x55e239387420 2024-02-18T16:21:27.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.470+0000 7f506c474640 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 0x55e239387840 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5054017e90 tx=0x7f5054018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f4f527fc640 1 -- 172.21.15.129:0/3110689939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540aa7b0 con 0x55e239387420 2024-02-18T16:21:27.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f4f527fc640 1 -- 172.21.15.129:0/3110689939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540bc040 con 0x55e239387420 2024-02-18T16:21:27.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e239387f70 con 0x55e239387420 2024-02-18T16:21:27.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f4f527fc640 1 -- 172.21.15.129:0/3110689939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540aaa60 con 0x55e239387420 2024-02-18T16:21:27.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e239388a60 con 0x55e239387420 2024-02-18T16:21:27.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f4f527fc640 1 -- 172.21.15.129:0/3110689939 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f50540aabc0 con 0x55e239387420 2024-02-18T16:21:27.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f4f527fc640 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f44034300 0x7f4f440367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f4f527fc640 1 -- 172.21.15.129:0/3110689939 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f50540e5f60 con 0x55e239387420 2024-02-18T16:21:27.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506d476640 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f44034300 0x7f4f440367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506f15a980 1 Processor -- start 2024-02-18T16:21:27.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506f15a980 1 -- start start 2024-02-18T16:21:27.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506d476640 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f44034300 0x7f4f440367c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55e239377960 tx=0x7f505c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506f15a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e239394870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506f15a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e239115790 con 0x55e239394490 2024-02-18T16:21:27.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506c474640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e239394870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506c474640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e239394870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55694/0 (socket says 172.21.15.129:55694) 2024-02-18T16:21:27.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506c474640 1 -- 172.21.15.129:0/2877901450 learned_addr learned my addr 172.21.15.129:0/2877901450 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506c474640 1 -- 172.21.15.129:0/2877901450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e239394e40 con 0x55e239394490 2024-02-18T16:21:27.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.474+0000 7f506c474640 1 --2- 172.21.15.129:0/2877901450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e239394870 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f50540e4380 tx=0x7f50540c0520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6968be45149419 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f4f43fff640 1 -- 172.21.15.129:0/2877901450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540ca460 con 0x55e239394490 2024-02-18T16:21:27.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f4f43fff640 1 -- 172.21.15.129:0/2877901450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540ca5c0 con 0x55e239394490 2024-02-18T16:21:27.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f4f43fff640 1 -- 172.21.15.129:0/2877901450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540ca880 con 0x55e239394490 2024-02-18T16:21:27.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/2877901450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 msgr2=0x55e239394870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 --2- 172.21.15.129:0/2877901450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e239394870 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f50540e4380 tx=0x7f50540c0520 comp rx=0 tx=0).stop 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/2877901450 shutdown_connections 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 --2- 172.21.15.129:0/2877901450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e239394870 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/2877901450 >> 172.21.15.129:0/2877901450 conn(0x55e2393907d0 msgr2=0x55e23938e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/2877901450 shutdown_connections 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/2877901450 wait complete. 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 Processor -- start 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- start start 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e23939b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23939b840 con 0x55e239394490 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506c474640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e23939b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506c474640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e23939b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55702/0 (socket says 172.21.15.129:55702) 2024-02-18T16:21:27.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 learned_addr learned my addr 172.21.15.129:0/656140963 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e239388a60 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506c474640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e23939b300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f50540bf6f0 tx=0x7f50540e42e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f4f427fc640 1 -- 172.21.15.129:0/656140963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540ca460 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f4f427fc640 1 -- 172.21.15.129:0/656140963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540c03f0 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e23939ba40 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f4f427fc640 1 -- 172.21.15.129:0/656140963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50540b4b00 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.478+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e23939be70 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f4f427fc640 1 -- 172.21.15.129:0/656140963 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f50540b4c60 con 0x55e239394490 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f4f427fc640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f380342b0 0x7f4f38036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f4f427fc640 1 -- 172.21.15.129:0/656140963 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f50540f89c0 con 0x55e239394490 2024-02-18T16:21:27.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506d476640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f380342b0 0x7f4f38036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e2393a6720 0x55e2393a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393a9330 con 0x55e2393a6720 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e2393a6720 0x55e2393a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506d476640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f380342b0 0x7f4f38036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f505c011010 tx=0x7f505c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e2393a6720 0x55e2393a8be0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 realm 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393a9700 con 0x55e2393a6720 2024-02-18T16:21:27.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393a9f80 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393aa2e0 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393aaae0 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 20 searching for the correct realm 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e2393ac970 0x55e2393aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506c474640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e2393ac970 0x55e2393aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506c474640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e2393ac970 0x55e2393aede0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506c474640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f50540df070 0x7f50540a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.482+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f50540df070 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506d476640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f50540df070 0x7f50540a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506d476640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f50540df070 0x7f50540a5aa0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c00a4d0 con 0x7f50540df070 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506d476640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f505c0141d0 0x7f505c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f505c0141d0 0x7f505c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f505c0141d0 0x7f505c015940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.486+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f50540df070 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c00a4d0 con 0x7f50540df070 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f50540df070 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.490+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f50540df070 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.494+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f50540df070 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393ac970 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f505c0141d0 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x55e2393a6720 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af4b0 con 0x7f50540df070 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:27.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393ab410 con 0x55e2393a6720 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393abc60 con 0x55e2393a6720 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af8f0 con 0x55e2393a6720 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 zone default found 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 4 Realm: () 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 zonegroup default 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.498+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393af940 con 0x7f505c0141d0 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b1720 con 0x55e2393ac970 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b1b00 con 0x55e2393ac970 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 started sync module instance, tier type = 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b1000 con 0x7f50540df070 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94430111140704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b0f80 con 0x7f50540df070 2024-02-18T16:21:27.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b2860 con 0x55e2393a6720 2024-02-18T16:21:27.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.502+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94430111140704] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94430111145760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b0f80 con 0x55e2393a6720 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b2f00 con 0x55e2393ac970 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94430111148544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b3750 con 0x55e2393ac970 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b4100 con 0x7f50540df070 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.506+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94430111145760] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94430111146816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b44b0 con 0x7f50540df070 2024-02-18T16:21:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b4e60 con 0x55e2393a6720 2024-02-18T16:21:27.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94430111148544] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94430111146816] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94430111153184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b4980 con 0x55e2393a6720 2024-02-18T16:21:27.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.510+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b56b0 con 0x7f505c0141d0 2024-02-18T16:21:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94430111158016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b57c0 con 0x7f505c0141d0 2024-02-18T16:21:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b6130 con 0x7f505c0141d0 2024-02-18T16:21:27.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94430111153184] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94430111158016] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94430111159072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b5740 con 0x7f505c0141d0 2024-02-18T16:21:27.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.514+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b65d0 con 0x7f505c0141d0 2024-02-18T16:21:27.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94430111162672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b69f0 con 0x7f505c0141d0 2024-02-18T16:21:27.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=0 2024-02-18T16:21:27.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=1 2024-02-18T16:21:27.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=2 2024-02-18T16:21:27.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=3 2024-02-18T16:21:27.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=4 2024-02-18T16:21:27.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=5 2024-02-18T16:21:27.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94430111159072] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=6 2024-02-18T16:21:27.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94430111162672] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 20 add_watcher() i=7 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b69f0 con 0x55e2393a6720 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.518+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94430111163728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b6970 con 0x55e2393a6720 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94430111163728] v30'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f4f237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f506f15a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f506f15a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:27.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c1f60 con 0x55e2393a6720 2024-02-18T16:21:27.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.522+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c2420 con 0x7f505c0141d0 2024-02-18T16:21:27.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.526+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.526+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c28c0 con 0x55e2393ac970 2024-02-18T16:21:27.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.526+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.526+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c30c0 con 0x55e2393a6720 2024-02-18T16:21:27.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.526+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.526+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393bffd0 con 0x7f50540df070 2024-02-18T16:21:27.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.530+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.530+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393bffd0 con 0x55e2393ac970 2024-02-18T16:21:27.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.530+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.530+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c42a0 con 0x55e2393a6720 2024-02-18T16:21:27.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.534+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.534+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c42a0 con 0x7f505c0141d0 2024-02-18T16:21:27.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.534+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.534+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c42a0 con 0x7f50540df070 2024-02-18T16:21:27.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.538+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.538+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c47d0 con 0x55e2393ac970 2024-02-18T16:21:27.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.538+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.538+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c4d00 con 0x7f50540df070 2024-02-18T16:21:27.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.538+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.538+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c5230 con 0x7f505c0141d0 2024-02-18T16:21:27.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.542+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.542+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c5230 con 0x7f50540df070 2024-02-18T16:21:27.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.542+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.542+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c41a0 con 0x7f505c0141d0 2024-02-18T16:21:27.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.546+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.546+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c41a0 con 0x55e2393a6720 2024-02-18T16:21:27.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.546+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.546+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c41a0 con 0x55e2393ac970 2024-02-18T16:21:27.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.550+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.550+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c41a0 con 0x7f50540df070 2024-02-18T16:21:27.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.550+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.550+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.554+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.554+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393a6720 2024-02-18T16:21:27.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.554+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.554+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393a6720 2024-02-18T16:21:27.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.558+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.558+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.558+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.558+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x7f50540df070 2024-02-18T16:21:27.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.562+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.562+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.562+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.562+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.566+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.566+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.566+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.566+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.566+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.566+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x7f505c0141d0 2024-02-18T16:21:27.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.570+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.570+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.570+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.574+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x7f505c0141d0 2024-02-18T16:21:27.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.574+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.574+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x55e2393ac970 2024-02-18T16:21:27.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.578+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.578+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x7f505c0141d0 2024-02-18T16:21:27.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.578+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.578+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393c56d0 con 0x7f50540df070 2024-02-18T16:21:27.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f4f227e4640 20 reqs_thread_entry: start 2024-02-18T16:21:27.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:27.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 20 Filter name: none 2024-02-18T16:21:27.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f4f1b7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:27.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:21:27.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393be260 con 0x7f505c0141d0 2024-02-18T16:21:27.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.582+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393be260 con 0x7f505c0141d0 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506f15a980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506f15a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94430111194560 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393e1cf0 con 0x55e2393ac970 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== watch-notify(notify (1) cookie 94430111148544 notify 128849018883 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55e23939ba40 con 0x55e2393ac970 2024-02-18T16:21:27.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f4f43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94430111148544 notifier 4524 bl.length()=170 2024-02-18T16:21:27.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(96 notify.2 [notify cookie 94430111194560 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f4f43fff640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4f30003d60 con 0x55e2393ac970 2024-02-18T16:21:27.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== watch-notify(notify_complete (2) cookie 94430111194560 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e239388a60 con 0x55e2393ac970 2024-02-18T16:21:27.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.586+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393bd250 con 0x7f505c0141d0 2024-02-18T16:21:27.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506f15a980 10 removing email index: 2024-02-18T16:21:27.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506f15a980 10 removing user buckets index 2024-02-18T16:21:27.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506f15a980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-18T16:21:27.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94430111194560 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393e1cf0 con 0x7f505c0141d0 2024-02-18T16:21:27.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== watch-notify(notify (1) cookie 94430111159072 notify 128849018886 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55e239370920 con 0x7f505c0141d0 2024-02-18T16:21:27.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f4f43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94430111159072 notifier 4524 bl.length()=160 2024-02-18T16:21:27.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f4f43fff640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4f30003d60 con 0x7f505c0141d0 2024-02-18T16:21:27.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(99 notify.6 [notify cookie 94430111194560 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== watch-notify(notify_complete (2) cookie 94430111194560 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e2393704d0 con 0x7f505c0141d0 2024-02-18T16:21:27.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.590+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393bd250 con 0x7f505c0141d0 2024-02-18T16:21:27.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(101 fud.buckets [delete] v30'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506f15a980 10 removing user index: fud 2024-02-18T16:21:27.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506f15a980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-18T16:21:27.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506f15a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-18T16:21:27.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94430111190448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393e0ce0 con 0x7f505c0141d0 2024-02-18T16:21:27.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== watch-notify(notify (1) cookie 94430111158016 notify 128849018887 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55e2393704d0 con 0x7f505c0141d0 2024-02-18T16:21:27.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(102 notify.5 [notify cookie 94430111190448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f4f437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94430111158016 notifier 4524 bl.length()=152 2024-02-18T16:21:27.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f4f437fe640 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4e940032c0 con 0x7f505c0141d0 2024-02-18T16:21:27.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== watch-notify(notify_complete (2) cookie 94430111190448 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5064028030 con 0x7f505c0141d0 2024-02-18T16:21:27.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.594+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393bddc0 con 0x7f505c0141d0 2024-02-18T16:21:27.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.598+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== osd_op_reply(104 fud [call,call,delete] v30'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.598+0000 7f4f237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.598+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94430111163728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393be940 con 0x55e2393a6720 2024-02-18T16:21:27.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.598+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94430111163728] v30'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.598+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94430111140704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b6550 con 0x7f50540df070 2024-02-18T16:21:27.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94430111140704] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506f15a980 20 remove_watcher() i=0 2024-02-18T16:21:27.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506f15a980 2 removed watcher, disabling cache 2024-02-18T16:21:27.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94430111145760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b6550 con 0x55e2393a6720 2024-02-18T16:21:27.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94430111145760] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506f15a980 20 remove_watcher() i=1 2024-02-18T16:21:27.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.602+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94430111148544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b1f20 con 0x55e2393ac970 2024-02-18T16:21:27.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.606+0000 7f506c474640 1 -- 172.21.15.129:0/656140963 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94430111148544] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50540c6020 con 0x55e2393ac970 2024-02-18T16:21:27.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.606+0000 7f506f15a980 20 remove_watcher() i=2 2024-02-18T16:21:27.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.606+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94430111146816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b6550 con 0x7f50540df070 2024-02-18T16:21:27.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.606+0000 7f506d476640 1 -- 172.21.15.129:0/656140963 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94430111146816] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f505c03a040 con 0x7f50540df070 2024-02-18T16:21:27.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.606+0000 7f506f15a980 20 remove_watcher() i=3 2024-02-18T16:21:27.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.606+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94430111153184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b23c0 con 0x55e2393a6720 2024-02-18T16:21:27.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.610+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94430111153184] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x55e2393a6720 2024-02-18T16:21:27.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.610+0000 7f506f15a980 20 remove_watcher() i=4 2024-02-18T16:21:27.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.610+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94430111158016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b23c0 con 0x7f505c0141d0 2024-02-18T16:21:27.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.610+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94430111158016] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.610+0000 7f506f15a980 20 remove_watcher() i=5 2024-02-18T16:21:27.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.610+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94430111159072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b23c0 con 0x7f505c0141d0 2024-02-18T16:21:27.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94430111159072] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 20 remove_watcher() i=6 2024-02-18T16:21:27.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94430111162672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2393b23c0 con 0x7f505c0141d0 2024-02-18T16:21:27.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 <== osd.0 v2:172.21.15.80:6800/4245413050 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94430111162672] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5064014070 con 0x7f505c0141d0 2024-02-18T16:21:27.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 20 remove_watcher() i=7 2024-02-18T16:21:27.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f505c0141d0 msgr2=0x7f505c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f505c0141d0 0x7f505c015940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e2393a6720 msgr2=0x55e2393a8be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e2393a6720 0x55e2393a8be0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f50540df070 msgr2=0x7f50540a5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f50540df070 0x7f50540a5aa0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e2393ac970 msgr2=0x55e2393aede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.614+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e2393ac970 0x55e2393aede0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f380342b0 msgr2=0x7f4f38036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f380342b0 0x7f4f38036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f505c011010 tx=0x7f505c020000 comp rx=0 tx=0).stop 2024-02-18T16:21:27.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 msgr2=0x55e23939b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e23939b300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f50540bf6f0 tx=0x7f50540e42e0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506cc75640 1 -- 172.21.15.129:0/656140963 reap_dead start 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 shutdown_connections 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/656140963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239394490 0x55e23939b300 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 >> 172.21.15.129:0/656140963 conn(0x55e2393907d0 msgr2=0x55e23938de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 shutdown_connections 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/656140963 wait complete. 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f44034300 msgr2=0x7f4f440367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f44034300 0x7f4f440367c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55e239377960 tx=0x7f505c005850 comp rx=0 tx=0).stop 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 msgr2=0x55e239387840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 0x55e239387840 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5054017e90 tx=0x7f5054018020 comp rx=0 tx=0).stop 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 shutdown_connections 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f44034300 0x7f4f440367c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/3110689939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e239387420 0x55e239387840 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 >> 172.21.15.129:0/3110689939 conn(0x55e23937c230 msgr2=0x55e23937cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 shutdown_connections 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/3110689939 wait complete. 2024-02-18T16:21:27.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e239283910 msgr2=0x55e239376bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e239283910 0x55e239376bc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f54034300 msgr2=0x7f4f540367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f54034300 0x7f4f540367c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f50540ad000 tx=0x7f50540a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 msgr2=0x55e23936ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e23936ff90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f506400b710 tx=0x7f5064000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 shutdown_connections 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e239283910 0x55e239376bc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4f54034300 0x7f4f540367c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 --2- 172.21.15.129:0/974029198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e2391f1900 0x55e23936ff90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 >> 172.21.15.129:0/974029198 conn(0x55e239277910 msgr2=0x55e239363780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 shutdown_connections 2024-02-18T16:21:27.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.618+0000 7f506f15a980 1 -- 172.21.15.129:0/974029198 wait complete. 2024-02-18T16:21:27.637 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-18T16:21:27.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-18T16:21:27.637 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-18T16:21:27.733 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:27.734 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:27.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3b224a980 1 Processor -- start 2024-02-18T16:21:27.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3b224a980 1 -- start start 2024-02-18T16:21:27.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3b224a980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b1095a2110 0x55b1095a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3b224a980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b1094ee460 con 0x55b1095a2a30 2024-02-18T16:21:27.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3b224a980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b1094b5180 con 0x55b1095a2110 2024-02-18T16:21:27.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3afd65640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b1095a2110 0x55b1095a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3af564640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55b1095a2a30 0x55b1095a33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53032/0 (socket says 172.21.15.129:53032) 2024-02-18T16:21:27.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3af564640 1 -- 172.21.15.129:0/560432889 learned_addr learned my addr 172.21.15.129:0/560432889 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:27.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3afd65640 1 -- 172.21.15.129:0/560432889 >> v1:172.21.15.80:6789/0 conn(0x55b1095a2a30 legacy=0x55b1095a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.730+0000 7fd3afd65640 1 -- 172.21.15.129:0/560432889 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1095a3c20 con 0x55b1095a2110 2024-02-18T16:21:27.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3afd65640 1 --2- 172.21.15.129:0/560432889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1095a24f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800a480 tx=0x7fd3a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cba632f0ecf6c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3aed63640 1 -- 172.21.15.129:0/560432889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a80ab540 con 0x55b1095a2110 2024-02-18T16:21:27.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3aed63640 1 -- 172.21.15.129:0/560432889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a80ab6a0 con 0x55b1095a2110 2024-02-18T16:21:27.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3aed63640 1 -- 172.21.15.129:0/560432889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a80ab960 con 0x55b1095a2110 2024-02-18T16:21:27.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 -- 172.21.15.129:0/560432889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 msgr2=0x55b1095a24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 --2- 172.21.15.129:0/560432889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1095a24f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800a480 tx=0x7fd3a801b280 comp rx=0 tx=0).stop 2024-02-18T16:21:27.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 -- 172.21.15.129:0/560432889 shutdown_connections 2024-02-18T16:21:27.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 --2- 172.21.15.129:0/560432889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1095a24f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 -- 172.21.15.129:0/560432889 >> 172.21.15.129:0/560432889 conn(0x55b10959d9e0 msgr2=0x55b10959fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 -- 172.21.15.129:0/560432889 shutdown_connections 2024-02-18T16:21:27.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.734+0000 7fd3b224a980 1 -- 172.21.15.129:0/560432889 wait complete. 2024-02-18T16:21:27.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 Processor -- start 2024-02-18T16:21:27.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 -- start start 2024-02-18T16:21:27.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b10968a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1094b26b0 con 0x55b1095a2110 2024-02-18T16:21:27.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3afd65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b10968a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3afd65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b10968a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55712/0 (socket says 172.21.15.129:55712) 2024-02-18T16:21:27.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3afd65640 1 -- 172.21.15.129:0/2325861763 learned_addr learned my addr 172.21.15.129:0/2325861763 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3afd65640 1 -- 172.21.15.129:0/2325861763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8005d30 con 0x55b1095a2110 2024-02-18T16:21:27.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3afd65640 1 --2- 172.21.15.129:0/2325861763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b10968a4d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800a480 tx=0x7fd3a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c4a3a6b4961c48 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd29ce19640 1 -- 172.21.15.129:0/2325861763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a80ab940 con 0x55b1095a2110 2024-02-18T16:21:27.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd29ce19640 1 -- 172.21.15.129:0/2325861763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a80abaa0 con 0x55b1095a2110 2024-02-18T16:21:27.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd29ce19640 1 -- 172.21.15.129:0/2325861763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a80abd80 con 0x55b1095a2110 2024-02-18T16:21:27.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 -- 172.21.15.129:0/2325861763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 msgr2=0x55b10968a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2325861763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b10968a4d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800a480 tx=0x7fd3a8003030 comp rx=0 tx=0).stop 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 -- 172.21.15.129:0/2325861763 shutdown_connections 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2325861763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b10968a4d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.750+0000 7fd3b224a980 1 -- 172.21.15.129:0/2325861763 >> 172.21.15.129:0/2325861763 conn(0x55b10959d9e0 msgr2=0x55b109686060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 -- 172.21.15.129:0/2325861763 shutdown_connections 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 -- 172.21.15.129:0/2325861763 wait complete. 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 Processor -- start 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 -- start start 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1096912a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1094ade90 con 0x55b1095a2110 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3afd65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1096912a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3afd65640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1096912a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55722/0 (socket says 172.21.15.129:55722) 2024-02-18T16:21:27.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3afd65640 1 -- 172.21.15.129:0/2794976539 learned_addr learned my addr 172.21.15.129:0/2794976539 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3afd65640 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1095a3c20 con 0x55b1095a2110 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3afd65640 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1096912a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80b8040 tx=0x7fd3a8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd29b616640 1 -- 172.21.15.129:0/2794976539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a80c0670 con 0x55b1095a2110 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd29b616640 1 -- 172.21.15.129:0/2794976539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a80c07d0 con 0x55b1095a2110 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1096917e0 con 0x55b1095a2110 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd29b616640 1 -- 172.21.15.129:0/2794976539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a80c0a70 con 0x55b1095a2110 2024-02-18T16:21:27.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b109691c30 con 0x55b1095a2110 2024-02-18T16:21:27.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd29b616640 1 -- 172.21.15.129:0/2794976539 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3a80c0bd0 con 0x55b1095a2110 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd29b616640 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2940342b0 0x7fd294036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.754+0000 7fd29b616640 1 -- 172.21.15.129:0/2794976539 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd3a80e42d0 con 0x55b1095a2110 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3af564640 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2940342b0 0x7fd294036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1095a2a30 0x55b109697f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b109698440 con 0x55b1095a2a30 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1095a2a30 0x55b109697f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3af564640 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2940342b0 0x7fd294036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00012f0 tx=0x7fd3a0006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1095a2a30 0x55b109697f00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 -- 172.21.15.129:0/2794976539 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3980083f0 con 0x55b1095a2a30 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096987c0 con 0x55b1095a2a30 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 -- 172.21.15.129:0/2794976539 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd3980083f0 con 0x55b1095a2a30 2024-02-18T16:21:27.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b10969a070 con 0x55b1095a2a30 2024-02-18T16:21:27.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 -- 172.21.15.129:0/2794976539 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fd3980083f0 con 0x55b1095a2a30 2024-02-18T16:21:27.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b109699270 con 0x55b1095a2a30 2024-02-18T16:21:27.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 -- 172.21.15.129:0/2794976539 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd3980083f0 con 0x55b1095a2a30 2024-02-18T16:21:27.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b109699680 con 0x55b1095a2a30 2024-02-18T16:21:27.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b0566640 1 -- 172.21.15.129:0/2794976539 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd398012040 con 0x55b1095a2a30 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 Processor -- start 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- start start 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 0x55b1096a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3b224a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b109446f20 con 0x55b1096a8770 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3af564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 0x55b1096a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3af564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 0x55b1096a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55732/0 (socket says 172.21.15.129:55732) 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.758+0000 7fd3af564640 1 -- 172.21.15.129:0/3651107340 learned_addr learned my addr 172.21.15.129:0/3651107340 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3af564640 1 -- 172.21.15.129:0/3651107340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1096a90d0 con 0x55b1096a8770 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3af564640 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 0x55b1096a8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0004f20 tx=0x7fd3a0006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd298e11640 1 -- 172.21.15.129:0/3651107340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a001a070 con 0x55b1096a8770 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd298e11640 1 -- 172.21.15.129:0/3651107340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0011440 con 0x55b1096a8770 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1096a9320 con 0x55b1096a8770 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd298e11640 1 -- 172.21.15.129:0/3651107340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a0011700 con 0x55b1096a8770 2024-02-18T16:21:27.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1096a9e70 con 0x55b1096a8770 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd298e11640 1 -- 172.21.15.129:0/3651107340 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3a0011860 con 0x55b1096a8770 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd298e11640 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd288034320 0x7fd2880367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd298e11640 1 -- 172.21.15.129:0/3651107340 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd3a004aa90 con 0x55b1096a8770 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd288034320 0x7fd2880367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b224a980 1 Processor -- start 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b224a980 1 -- start start 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd288034320 0x7fd2880367e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55b109698cb0 tx=0x7fd398003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b224a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3b224a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b10943a790 con 0x55b1096b5720 2024-02-18T16:21:27.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3af564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3af564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55738/0 (socket says 172.21.15.129:55738) 2024-02-18T16:21:27.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3af564640 1 -- 172.21.15.129:0/3693915567 learned_addr learned my addr 172.21.15.129:0/3693915567 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.762+0000 7fd3af564640 1 -- 172.21.15.129:0/3693915567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1096b6110 con 0x55b1096b5720 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3af564640 1 --2- 172.21.15.129:0/3693915567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096b5b40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0048dc0 tx=0x7fd3a0049070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c022c98f574f6ac server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd2927fc640 1 -- 172.21.15.129:0/3693915567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a0042360 con 0x55b1096b5720 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd2927fc640 1 -- 172.21.15.129:0/3693915567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a00424c0 con 0x55b1096b5720 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd2927fc640 1 -- 172.21.15.129:0/3693915567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a001ed60 con 0x55b1096b5720 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3693915567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 msgr2=0x55b1096b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3693915567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096b5b40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0048dc0 tx=0x7fd3a0049070 comp rx=0 tx=0).stop 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3693915567 shutdown_connections 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3693915567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096b5b40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3693915567 >> 172.21.15.129:0/3693915567 conn(0x55b1096b1ab0 msgr2=0x55b1096afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3693915567 shutdown_connections 2024-02-18T16:21:27.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3693915567 wait complete. 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 Processor -- start 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- start start 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096bc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1096bcbd0 con 0x55b1096b5720 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3af564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3af564640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096bc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55746/0 (socket says 172.21.15.129:55746) 2024-02-18T16:21:27.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 learned_addr learned my addr 172.21.15.129:0/3930333209 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1096a9e70 con 0x55b1096b5720 2024-02-18T16:21:27.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3af564640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096bc690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0015d00 tx=0x7fd3a0048d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd290ff9640 1 -- 172.21.15.129:0/3930333209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a0042360 con 0x55b1096b5720 2024-02-18T16:21:27.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd290ff9640 1 -- 172.21.15.129:0/3930333209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a002f070 con 0x55b1096b5720 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1096bcdd0 con 0x55b1096b5720 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd290ff9640 1 -- 172.21.15.129:0/3930333209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3a004a230 con 0x55b1096b5720 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.766+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1096bd1a0 con 0x55b1096b5720 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd290ff9640 1 -- 172.21.15.129:0/3930333209 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd3a004a390 con 0x55b1096b5720 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd290ff9640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2780342b0 0x7fd278036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd290ff9640 1 -- 172.21.15.129:0/3930333209 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd3a0037cb0 con 0x55b1096b5720 2024-02-18T16:21:27.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2780342b0 0x7fd278036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1096c7c20 0x55b1096ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096ca830 con 0x55b1096c7c20 2024-02-18T16:21:27.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1096c7c20 0x55b1096ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2780342b0 0x7fd278036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd398008fd0 tx=0x7fd39801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1096c7c20 0x55b1096ca0e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 realm 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096cac00 con 0x55b1096c7c20 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096cb480 con 0x55b1096c7c20 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096cb7e0 con 0x55b1096c7c20 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096cbfe0 con 0x55b1096c7c20 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 20 searching for the correct realm 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b1096cde70 0x55b1096d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3af564640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b1096cde70 0x55b1096d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.770+0000 7fd3af564640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b1096cde70 0x55b1096d0330 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a0035d40 con 0x55b1096cde70 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3af564640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd3a004a640 0x7fd3a000b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd3a004a640 2024-02-18T16:21:27.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd3a004a640 0x7fd3a000b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd3a004a640 0x7fd3a000b0e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd39802c040 con 0x7fd3a004a640 2024-02-18T16:21:27.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3b0566640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd398027940 0x7fd3980333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd398027940 0x7fd3980333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd398027940 0x7fd3980333c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.774+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd3a004a640 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd39802c040 con 0x7fd3a004a640 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a0035d40 con 0x55b1096cde70 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd3a004a640 2024-02-18T16:21:27.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd39802c040 con 0x7fd3a004a640 2024-02-18T16:21:27.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.778+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd3a004a640 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd39802c040 con 0x7fd3a004a640 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x55b1096c7c20 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.782+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd3a004a640 2024-02-18T16:21:27.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd39802c040 con 0x7fd3a004a640 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096cde70 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd398027940 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3a80b2040 con 0x7fd398027940 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x55b1096c7c20 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0a00 con 0x7fd3a004a640 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd39802c040 con 0x7fd3a004a640 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:27.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096cc8e0 con 0x55b1096c7c20 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096cd130 con 0x55b1096c7c20 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.786+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0e40 con 0x55b1096c7c20 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 zone default found 2024-02-18T16:21:27.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 4 Realm: () 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 zonegroup default 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d0e60 con 0x7fd398027940 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2c40 con 0x55b1096cde70 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2fc0 con 0x55b1096cde70 2024-02-18T16:21:27.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 started sync module instance, tier type = 2024-02-18T16:21:27.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:27.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2520 con 0x7fd3a004a640 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94218855719040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d24a0 con 0x7fd3a004a640 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.790+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d3d20 con 0x55b1096c7c20 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94218855719040] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94218855724000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d24a0 con 0x55b1096c7c20 2024-02-18T16:21:27.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d4410 con 0x55b1096cde70 2024-02-18T16:21:27.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94218855724000] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94218855726832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d47c0 con 0x55b1096cde70 2024-02-18T16:21:27.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.794+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d5130 con 0x7fd3a004a640 2024-02-18T16:21:27.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94218855730592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d5880 con 0x7fd3a004a640 2024-02-18T16:21:27.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d6350 con 0x55b1096c7c20 2024-02-18T16:21:27.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94218855726832] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94218855730592] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94218855734832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d6310 con 0x55b1096c7c20 2024-02-18T16:21:27.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.798+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d5450 con 0x7fd398027940 2024-02-18T16:21:27.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94218855734832] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94218855736080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d6bd0 con 0x7fd398027940 2024-02-18T16:21:27.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d73d0 con 0x7fd398027940 2024-02-18T16:21:27.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94218855736080] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94218855737408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d71e0 con 0x7fd398027940 2024-02-18T16:21:27.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.802+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d7cb0 con 0x7fd398027940 2024-02-18T16:21:27.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94218855741328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d8150 con 0x7fd398027940 2024-02-18T16:21:27.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=0 2024-02-18T16:21:27.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=1 2024-02-18T16:21:27.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=2 2024-02-18T16:21:27.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=3 2024-02-18T16:21:27.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=4 2024-02-18T16:21:27.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=5 2024-02-18T16:21:27.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94218855737408] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=6 2024-02-18T16:21:27.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94218855741328] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 20 add_watcher() i=7 2024-02-18T16:21:27.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:27.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d6ca0 con 0x55b1096c7c20 2024-02-18T16:21:27.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.806+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94218855738464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d85f0 con 0x55b1096c7c20 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94218855738464] v30'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd2657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 5 note: GC not initialized 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd1dffff640 20 reqs_thread_entry: start 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 Filter name: none 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd1ddffb640 20 reqs_thread_entry: start 2024-02-18T16:21:27.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-18T16:21:27.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096fd2a0 con 0x7fd398027940 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096fb9a0 con 0x7fd398027940 2024-02-18T16:21:27.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-18T16:21:27.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:27.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:21:27.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:21:27.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.810+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096ff890 con 0x7fd398027940 2024-02-18T16:21:27.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~385] v30'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b224a980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-18T16:21:27.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b224a980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-18T16:21:27.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b224a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94218855899888 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b109700240 con 0x7fd3a004a640 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== watch-notify(notify (1) cookie 94218855730592 notify 128849018895 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x7fd39801ac40 con 0x7fd3a004a640 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd2927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94218855730592 notifier 4531 bl.length()=576 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd2927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd2927fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 notify.3 [notify cookie 94218855899888 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd2927fc640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd274003ea0 con 0x7fd3a004a640 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== watch-notify(notify_complete (2) cookie 94218855899888 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd39801add0 con 0x7fd3a004a640 2024-02-18T16:21:27.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.814+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1097001b0 con 0x7fd398027940 2024-02-18T16:21:27.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3b224a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:21:27.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3b224a980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:27.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3b224a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94218855907760 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b109700630 con 0x55b1096cde70 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== watch-notify(notify (1) cookie 94218855726832 notify 128849018884 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x55b1096bd1a0 con 0x55b1096cde70 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd2927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94218855726832 notifier 4531 bl.length()=192 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd2927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd2927fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 notify.2 [notify cookie 94218855907760 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd2927fc640 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd274003ea0 con 0x55b1096cde70 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== watch-notify(notify_complete (2) cookie 94218855907760 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b1096bcdd0 con 0x55b1096cde70 2024-02-18T16:21:27.824 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:27.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd2657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94218855738464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096dd480 con 0x55b1096c7c20 2024-02-18T16:21:27.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.818+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94218855738464] v30'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94218855719040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d6c60 con 0x7fd3a004a640 2024-02-18T16:21:27.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94218855719040] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b224a980 20 remove_watcher() i=0 2024-02-18T16:21:27.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b224a980 2 removed watcher, disabling cache 2024-02-18T16:21:27.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94218855724000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2080 con 0x55b1096c7c20 2024-02-18T16:21:27.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94218855724000] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b224a980 20 remove_watcher() i=1 2024-02-18T16:21:27.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.822+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94218855726832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2080 con 0x55b1096cde70 2024-02-18T16:21:27.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.826+0000 7fd3af564640 1 -- 172.21.15.129:0/3930333209 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94218855726832] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a005d040 con 0x55b1096cde70 2024-02-18T16:21:27.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.826+0000 7fd3b224a980 20 remove_watcher() i=2 2024-02-18T16:21:27.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.826+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94218855730592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d3ef0 con 0x7fd3a004a640 2024-02-18T16:21:27.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.826+0000 7fd3b0566640 1 -- 172.21.15.129:0/3930333209 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94218855730592] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd39803f040 con 0x7fd3a004a640 2024-02-18T16:21:27.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.826+0000 7fd3b224a980 20 remove_watcher() i=3 2024-02-18T16:21:27.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.826+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94218855734832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2080 con 0x55b1096c7c20 2024-02-18T16:21:27.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.830+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94218855734832] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x55b1096c7c20 2024-02-18T16:21:27.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.830+0000 7fd3b224a980 20 remove_watcher() i=4 2024-02-18T16:21:27.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.830+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94218855736080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d4da0 con 0x7fd398027940 2024-02-18T16:21:27.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.830+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94218855736080] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.830+0000 7fd3b224a980 20 remove_watcher() i=5 2024-02-18T16:21:27.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.830+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94218855737408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d2080 con 0x7fd398027940 2024-02-18T16:21:27.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94218855737408] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 20 remove_watcher() i=6 2024-02-18T16:21:27.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94218855741328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b1096d6310 con 0x7fd398027940 2024-02-18T16:21:27.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94218855741328] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3a80f40c0 con 0x7fd398027940 2024-02-18T16:21:27.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 20 remove_watcher() i=7 2024-02-18T16:21:27.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd398027940 msgr2=0x7fd3980333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd398027940 0x7fd3980333c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1096c7c20 msgr2=0x55b1096ca0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1096c7c20 0x55b1096ca0e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd3a004a640 msgr2=0x7fd3a000b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd3a004a640 0x7fd3a000b0e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b1096cde70 msgr2=0x55b1096d0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b1096cde70 0x55b1096d0330 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2780342b0 msgr2=0x7fd278036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2780342b0 0x7fd278036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd398008fd0 tx=0x7fd39801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:27.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3afd65640 1 -- 172.21.15.129:0/3930333209 reap_dead start 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 msgr2=0x55b1096bc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096bc690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0015d00 tx=0x7fd3a0048d50 comp rx=0 tx=0).stop 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 shutdown_connections 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3930333209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096b5720 0x55b1096bc690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 >> 172.21.15.129:0/3930333209 conn(0x55b1096b1ab0 msgr2=0x55b1096af110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 shutdown_connections 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3930333209 wait complete. 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd288034320 msgr2=0x7fd2880367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd288034320 0x7fd2880367e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55b109698cb0 tx=0x7fd398003070 comp rx=0 tx=0).stop 2024-02-18T16:21:27.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 msgr2=0x55b1096a8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 0x55b1096a8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0004f20 tx=0x7fd3a0006500 comp rx=0 tx=0).stop 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 shutdown_connections 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd288034320 0x7fd2880367e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 --2- 172.21.15.129:0/3651107340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1096a8770 0x55b1096a8b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 >> 172.21.15.129:0/3651107340 conn(0x55b10969d580 msgr2=0x55b10969e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 shutdown_connections 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.834+0000 7fd3b224a980 1 -- 172.21.15.129:0/3651107340 wait complete. 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1095a2a30 msgr2=0x55b109697f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1095a2a30 0x55b109697f00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2940342b0 msgr2=0x7fd294036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2940342b0 0x7fd294036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00012f0 tx=0x7fd3a0006700 comp rx=0 tx=0).stop 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 msgr2=0x55b1096912a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1096912a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80b8040 tx=0x7fd3a8018020 comp rx=0 tx=0).stop 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 shutdown_connections 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b1095a2a30 0x55b109697f00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd2940342b0 0x7fd294036770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 --2- 172.21.15.129:0/2794976539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b1095a2110 0x55b1096912a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 >> 172.21.15.129:0/2794976539 conn(0x55b10959d9e0 msgr2=0x55b109684b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 shutdown_connections 2024-02-18T16:21:27.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.838+0000 7fd3b224a980 1 -- 172.21.15.129:0/2794976539 wait complete. 2024-02-18T16:21:27.853 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:27.854 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-18T16:21:27.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-18T16:21:27.854 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-02-18T16:21:27.890 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:27.890 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:27.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf7ae9980 1 Processor -- start 2024-02-18T16:21:27.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf7ae9980 1 -- start start 2024-02-18T16:21:27.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf7ae9980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5612abad78f0 0x5612abad9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf7ae9980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5612aba1d460 con 0x5612aba45860 2024-02-18T16:21:27.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf7ae9980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5612ab9e4180 con 0x5612abad78f0 2024-02-18T16:21:27.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf4e03640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5612abad78f0 0x5612abad9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf5604640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5612aba45860 0x5612abad61d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53036/0 (socket says 172.21.15.129:53036) 2024-02-18T16:21:27.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf5604640 1 -- 172.21.15.129:0/3930986416 learned_addr learned my addr 172.21.15.129:0/3930986416 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:27.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf4e03640 1 -- 172.21.15.129:0/3930986416 >> v1:172.21.15.80:6789/0 conn(0x5612aba45860 legacy=0x5612abad61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.886+0000 7fcdf4e03640 1 -- 172.21.15.129:0/3930986416 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612abad1bf0 con 0x5612abad78f0 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/3930986416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abad78f0 0x5612abad9ce0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00a480 tx=0x7fcdec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd738441a01574b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcde7fff640 1 -- 172.21.15.129:0/3930986416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0ab540 con 0x5612abad78f0 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcde7fff640 1 -- 172.21.15.129:0/3930986416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec0ab6a0 con 0x5612abad78f0 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcde7fff640 1 -- 172.21.15.129:0/3930986416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0ab960 con 0x5612abad78f0 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/3930986416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abad78f0 msgr2=0x5612abad9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/3930986416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abad78f0 0x5612abad9ce0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00a480 tx=0x7fcdec01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/3930986416 shutdown_connections 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/3930986416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abad78f0 0x5612abad9ce0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/3930986416 >> 172.21.15.129:0/3930986416 conn(0x5612abacb8b0 msgr2=0x5612abacdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/3930986416 shutdown_connections 2024-02-18T16:21:27.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.890+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/3930986416 wait complete. 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 Processor -- start 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- start start 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbbd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab9e16b0 con 0x5612aba45860 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf5604640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbbd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf5604640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbbd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55778/0 (socket says 172.21.15.129:55778) 2024-02-18T16:21:27.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf5604640 1 -- 172.21.15.129:0/4069366198 learned_addr learned my addr 172.21.15.129:0/4069366198 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf5604640 1 -- 172.21.15.129:0/4069366198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec005d30 con 0x5612aba45860 2024-02-18T16:21:27.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf5604640 1 --2- 172.21.15.129:0/4069366198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbbd220 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcde8001c00 tx=0x7fcde800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab1a3a8de1b968b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcce3606640 1 -- 172.21.15.129:0/4069366198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcde800e690 con 0x5612aba45860 2024-02-18T16:21:27.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcce3606640 1 -- 172.21.15.129:0/4069366198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde800e810 con 0x5612aba45860 2024-02-18T16:21:27.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcce3606640 1 -- 172.21.15.129:0/4069366198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcde800eb30 con 0x5612aba45860 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/4069366198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 msgr2=0x5612abbbd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/4069366198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbbd220 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcde8001c00 tx=0x7fcde800b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/4069366198 shutdown_connections 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/4069366198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbbd220 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/4069366198 >> 172.21.15.129:0/4069366198 conn(0x5612abacb8b0 msgr2=0x5612abbb8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/4069366198 shutdown_connections 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/4069366198 wait complete. 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 Processor -- start 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- start start 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbc4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.906+0000 7fcdf7ae9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab9dce90 con 0x5612aba45860 2024-02-18T16:21:27.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5604640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbc4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5604640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbc4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55794/0 (socket says 172.21.15.129:55794) 2024-02-18T16:21:27.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5604640 1 -- 172.21.15.129:0/1890065060 learned_addr learned my addr 172.21.15.129:0/1890065060 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5604640 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612aba1d460 con 0x5612aba45860 2024-02-18T16:21:27.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5604640 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbc4190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcde800b710 tx=0x7fcde8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcce1e03640 1 -- 172.21.15.129:0/1890065060 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcde801f070 con 0x5612aba45860 2024-02-18T16:21:27.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612abbc46d0 con 0x5612aba45860 2024-02-18T16:21:27.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcce1e03640 1 -- 172.21.15.129:0/1890065060 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde801a910 con 0x5612aba45860 2024-02-18T16:21:27.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcce1e03640 1 -- 172.21.15.129:0/1890065060 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcde801abf0 con 0x5612aba45860 2024-02-18T16:21:27.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612abbc4b20 con 0x5612aba45860 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcce1e03640 1 -- 172.21.15.129:0/1890065060 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcde800a040 con 0x5612aba45860 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcce1e03640 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccdc0342b0 0x7fccdc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcce1e03640 1 -- 172.21.15.129:0/1890065060 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcde8049f50 con 0x5612aba45860 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccdc0342b0 0x7fccdc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abad78f0 0x5612abbcad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbcb2b0 con 0x5612abad78f0 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abad78f0 0x5612abbcad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccdc0342b0 0x7fccdc036770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0ad000 tx=0x7fcdec0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abad78f0 0x5612abbcad70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1890065060 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcdf000a4d0 con 0x5612abad78f0 2024-02-18T16:21:27.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.910+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbcb6a0 con 0x5612abad78f0 2024-02-18T16:21:27.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1890065060 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcdf000a4d0 con 0x5612abad78f0 2024-02-18T16:21:27.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbccf50 con 0x5612abad78f0 2024-02-18T16:21:27.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1890065060 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fcdf000a4d0 con 0x5612abad78f0 2024-02-18T16:21:27.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbcc150 con 0x5612abad78f0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1890065060 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcdf000a4d0 con 0x5612abad78f0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbcc560 con 0x5612abad78f0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1890065060 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcdf000a4d0 con 0x5612abad78f0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 Processor -- start 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 -- start start 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 0x5612abbdba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab975f20 con 0x5612abbdb5f0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf4e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 0x5612abbdba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf4e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 0x5612abbdba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55808/0 (socket says 172.21.15.129:55808) 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf4e03640 1 -- 172.21.15.129:0/186239531 learned_addr learned my addr 172.21.15.129:0/186239531 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf4e03640 1 -- 172.21.15.129:0/186239531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612abbdbf50 con 0x5612abbdb5f0 2024-02-18T16:21:27.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 0x5612abbdba10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcdec096e80 tx=0x7fcdec018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fccdaffd640 1 -- 172.21.15.129:0/186239531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0bd8a0 con 0x5612abbdb5f0 2024-02-18T16:21:27.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fccdaffd640 1 -- 172.21.15.129:0/186239531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec0bda00 con 0x5612abbdb5f0 2024-02-18T16:21:27.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fccdaffd640 1 -- 172.21.15.129:0/186239531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0bdca0 con 0x5612abbdb5f0 2024-02-18T16:21:27.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.914+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612abbdc140 con 0x5612abbdb5f0 2024-02-18T16:21:27.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612abbdcc90 con 0x5612abbdb5f0 2024-02-18T16:21:27.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fccdaffd640 1 -- 172.21.15.129:0/186239531 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcdec0be480 con 0x5612abbdb5f0 2024-02-18T16:21:27.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fccdaffd640 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcccc034300 0x7fcccc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fccdaffd640 1 -- 172.21.15.129:0/186239531 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcdec0e6320 con 0x5612abbdb5f0 2024-02-18T16:21:27.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcccc034300 0x7fcccc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 Processor -- start 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 -- start start 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcccc034300 0x7fcccc0367c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5612abbcbb90 tx=0x7fcdf0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbe89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab969790 con 0x5612abbe85d0 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf4e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbe89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf4e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbe89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55814/0 (socket says 172.21.15.129:55814) 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf4e03640 1 -- 172.21.15.129:0/2825006662 learned_addr learned my addr 172.21.15.129:0/2825006662 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf4e03640 1 -- 172.21.15.129:0/2825006662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612abbe8fc0 con 0x5612abbe85d0 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/2825006662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbe89f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcdec006c40 tx=0x7fcdec0aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a57ff8645321d77 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fccd8ff9640 1 -- 172.21.15.129:0/2825006662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0be860 con 0x5612abbe85d0 2024-02-18T16:21:27.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fccd8ff9640 1 -- 172.21.15.129:0/2825006662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec006cb0 con 0x5612abbe85d0 2024-02-18T16:21:27.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fccd8ff9640 1 -- 172.21.15.129:0/2825006662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0b4c50 con 0x5612abbe85d0 2024-02-18T16:21:27.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/2825006662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 msgr2=0x5612abbe89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:27.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.918+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/2825006662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbe89f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcdec006c40 tx=0x7fcdec0aae30 comp rx=0 tx=0).stop 2024-02-18T16:21:27.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/2825006662 shutdown_connections 2024-02-18T16:21:27.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/2825006662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbe89f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/2825006662 >> 172.21.15.129:0/2825006662 conn(0x5612abbe4960 msgr2=0x5612abbe29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/2825006662 shutdown_connections 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/2825006662 wait complete. 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 Processor -- start 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- start start 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612abbefa40 con 0x5612abbe85d0 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf4e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf4e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55822/0 (socket says 172.21.15.129:55822) 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 learned_addr learned my addr 172.21.15.129:0/1571886717 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612abbdcc90 con 0x5612abbe85d0 2024-02-18T16:21:27.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbef500 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcdec006c40 tx=0x7fcdec0e46a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcccaffd640 1 -- 172.21.15.129:0/1571886717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0e4e90 con 0x5612abbe85d0 2024-02-18T16:21:27.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcccaffd640 1 -- 172.21.15.129:0/1571886717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec006890 con 0x5612abbe85d0 2024-02-18T16:21:27.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612abbefc40 con 0x5612abbe85d0 2024-02-18T16:21:27.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcccaffd640 1 -- 172.21.15.129:0/1571886717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0b4c50 con 0x5612abbe85d0 2024-02-18T16:21:27.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612abbf0070 con 0x5612abbe85d0 2024-02-18T16:21:27.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcccaffd640 1 -- 172.21.15.129:0/1571886717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fcdec0b4370 con 0x5612abbe85d0 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.922+0000 7fcccaffd640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccc0034300 0x7fccc00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcccaffd640 1 -- 172.21.15.129:0/1571886717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcdec0f59e0 con 0x5612abbe85d0 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccc0034300 0x7fccc00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abbfa930 0x5612abbfcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbfd540 con 0x5612abbfa930 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abbfa930 0x5612abbfcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccc0034300 0x7fccc00367c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0011010 tx=0x7fcdf0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abbfa930 0x5612abbfcdf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 realm 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbfd910 con 0x5612abbfa930 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbfe190 con 0x5612abbfa930 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbfe4f0 con 0x5612abbfa930 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbfecf0 con 0x5612abbfa930 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 20 searching for the correct realm 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5612abc00b80 0x5612abc03020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5612abc00b80 0x5612abc03020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5612abc00b80 0x5612abc03020 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf4e03640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fcdec0c7070 0x7fcdec0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.926+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fcdec0c7070 0x7fcdec0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fcdec0c7070 0x7fcdec0c7450 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf000a4d0 con 0x7fcdec0c7070 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5e05640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fcdf00141d0 0x7fcdf0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fcdf00141d0 0x7fcdf0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fcdf00141d0 0x7fcdf0015940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf000a4d0 con 0x7fcdec0c7070 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.930+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.934+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x5612abbfa930 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8024cd0 con 0x7fcdf00141d0 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.938+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abc00b80 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdf00141d0 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x5612abbfa930 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc036f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbff650 con 0x5612abbfa930 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbffea0 con 0x5612abbfa930 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abbffea0 con 0x5612abbfa930 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 zone default found 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 4 Realm: () 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:27.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 zonegroup default 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc03b30 con 0x7fcdf00141d0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc05540 con 0x5612abc00b80 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc05990 con 0x5612abc00b80 2024-02-18T16:21:27.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.942+0000 7fcdf7ae9980 20 started sync module instance, tier type = 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf7ae9980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc04df0 con 0x7fcdec0c7070 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638190905680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc051a0 con 0x7fcdec0c7070 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc066f0 con 0x5612abbfa930 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638190905680] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638190910896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc06670 con 0x5612abbfa930 2024-02-18T16:21:27.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.946+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc07100 con 0x5612abc00b80 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638190910896] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638190911952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc065f0 con 0x5612abc00b80 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc07df0 con 0x7fcdec0c7070 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638190918272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc08640 con 0x7fcdec0c7070 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.950+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc09030 con 0x5612abbfa930 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638190911952] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638190918272] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638190922512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc081a0 con 0x5612abbfa930 2024-02-18T16:21:27.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc09880 con 0x7fcdf00141d0 2024-02-18T16:21:27.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638190924304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc09ad0 con 0x7fcdf00141d0 2024-02-18T16:21:27.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc0a2d0 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.954+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638190922512] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.958+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638190924304] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.958+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.958+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638190925360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc09ef0 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.958+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc0ab50 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638190925360] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638190926416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc09e70 con 0x7fcdf00141d0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=0 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=1 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=2 2024-02-18T16:21:27.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=3 2024-02-18T16:21:27.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=4 2024-02-18T16:21:27.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=5 2024-02-18T16:21:27.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=6 2024-02-18T16:21:27.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638190926416] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 20 add_watcher() i=7 2024-02-18T16:21:27.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:27.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc0db80 con 0x5612abbfa930 2024-02-18T16:21:27.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.962+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638190929504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc0aff0 con 0x5612abbfa930 2024-02-18T16:21:27.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638190929504] v30'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcde8055040 con 0x5612abbfa930 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fccab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 5 note: GC not initialized 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fccaa7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 Filter name: none 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcc1bfff640 20 reqs_thread_entry: start 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc2fba0 con 0x7fcdf00141d0 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7fcde8055040 con 0x7fcdf00141d0 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=385 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc2f5f0 con 0x7fcdec0c7070 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:27.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc32b30 con 0x5612abbfa930 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(64 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:27.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:27.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-02-18T16:21:27.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.966+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc36dd0 con 0x7fcdec0c7070 2024-02-18T16:21:27.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.17 8:e90d4d9e:root::.bucket.meta.testx%3amyfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc3a6e0 con 0x5612abbfa930 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [create,call,writefull 0~371,setxattr (203)] v30'4 uv4 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf7ae9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x7 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf7ae9980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf7ae9980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf7ae9980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94638191116752 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39e40 con 0x7fcdec0c7070 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== watch-notify(notify (1) cookie 94638190905680 notify 128849018896 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7fcdf0026e00 con 0x7fcdec0c7070 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fccd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94638190905680 notifier 4538 bl.length()=806 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fccd8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x7 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fccd8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:27.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fccd8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(67 notify.0 [notify cookie 94638191116752 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.970+0000 7fccd8ff9640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fccb8003ea0 con 0x7fcdec0c7070 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== watch-notify(notify_complete (2) cookie 94638191116752 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcdf00304e0 con 0x7fcdec0c7070 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 20 handle_bi_update(): bucket=testx:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_sources= new_sources= 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 20 handle_bi_update(): bucket=testx:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential sources added=[] removed=[] 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 20 handle_bi_update(): bucket=testx:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_dests= new_dests= 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 20 handle_bi_update(): bucket=testx:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential dests added=[] removed=[] 2024-02-18T16:21:27.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39f20 con 0x5612abbfa930 2024-02-18T16:21:27.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39f20 con 0x5612abbfa930 2024-02-18T16:21:27.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-18T16:21:27.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94638191123072 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39ea0 con 0x5612abbfa930 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== watch-notify(notify (1) cookie 94638190922512 notify 128849018900 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x5612abbc4b20 con 0x5612abbfa930 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcccbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94638190922512 notifier 4538 bl.length()=348 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcccbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcccbfff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcccbfff640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcc28003400 con 0x5612abbfa930 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.974+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(71 notify.4 [notify cookie 94638191123072 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== watch-notify(notify_complete (2) cookie 94638191123072 notify 128849018900 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5612abbc46d0 con 0x5612abbfa930 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf7ae9980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-18T16:21:27.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf7ae9980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:27.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94638191123072 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39ea0 con 0x7fcdf00141d0 2024-02-18T16:21:27.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== watch-notify(notify (1) cookie 94638190925360 notify 128849018888 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x5612abbc46d0 con 0x7fcdf00141d0 2024-02-18T16:21:27.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fccd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94638190925360 notifier 4538 bl.length()=149 2024-02-18T16:21:27.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fccd8ff9640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fccb8003ea0 con 0x7fcdf00141d0 2024-02-18T16:21:27.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 notify.6 [notify cookie 94638191123072 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcde8061040 con 0x7fcdf00141d0 2024-02-18T16:21:27.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== watch-notify(notify_complete (2) cookie 94638191123072 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcde8029030 con 0x7fcdf00141d0 2024-02-18T16:21:27.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8061040 con 0x7fcdf00141d0 2024-02-18T16:21:27.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.978+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39f20 con 0x7fcdec0c7070 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(75 myfoo [call,delete] v30'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf7ae9980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 from cache 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf7ae9980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [notify cookie 94638191095744 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39f20 con 0x5612abbfa930 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== watch-notify(notify (1) cookie 94638190910896 notify 128849018901 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7fcde8029030 con 0x5612abbfa930 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcccbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94638190910896 notifier 4538 bl.length()=206 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(76 notify.1 [notify cookie 94638191095744 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcccbfff640 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcc28003400 con 0x5612abbfa930 2024-02-18T16:21:27.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(77 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde8061040 con 0x5612abbfa930 2024-02-18T16:21:27.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== watch-notify(notify_complete (2) cookie 94638191095744 notify 128849018901 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5612aba1d460 con 0x5612abbfa930 2024-02-18T16:21:27.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc39a80 con 0x5612abbfa930 2024-02-18T16:21:27.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(78 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call,delete] v30'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x5612abbfa930 2024-02-18T16:21:27.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fccab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:27.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.982+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638190929504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc21b00 con 0x5612abbfa930 2024-02-18T16:21:27.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.986+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94638190929504] v30'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x5612abbfa930 2024-02-18T16:21:27.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.986+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638190905680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc21b00 con 0x7fcdec0c7070 2024-02-18T16:21:27.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.986+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94638190905680] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.986+0000 7fcdf7ae9980 20 remove_watcher() i=0 2024-02-18T16:21:27.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.986+0000 7fcdf7ae9980 2 removed watcher, disabling cache 2024-02-18T16:21:27.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.986+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638190910896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc21b00 con 0x5612abbfa930 2024-02-18T16:21:27.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94638190910896] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x5612abbfa930 2024-02-18T16:21:27.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf7ae9980 20 remove_watcher() i=1 2024-02-18T16:21:27.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638190911952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc21b00 con 0x5612abc00b80 2024-02-18T16:21:27.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf4e03640 1 -- 172.21.15.129:0/1571886717 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94638190911952] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdec0ec020 con 0x5612abc00b80 2024-02-18T16:21:27.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf7ae9980 20 remove_watcher() i=2 2024-02-18T16:21:27.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638190918272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc32510 con 0x7fcdec0c7070 2024-02-18T16:21:27.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf5e05640 1 -- 172.21.15.129:0/1571886717 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94638190918272] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcdf003a040 con 0x7fcdec0c7070 2024-02-18T16:21:27.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf7ae9980 20 remove_watcher() i=3 2024-02-18T16:21:27.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.990+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638190922512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc32510 con 0x5612abbfa930 2024-02-18T16:21:28.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.994+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94638190922512] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x5612abbfa930 2024-02-18T16:21:28.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.994+0000 7fcdf7ae9980 20 remove_watcher() i=4 2024-02-18T16:21:28.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.994+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638190924304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc32510 con 0x7fcdf00141d0 2024-02-18T16:21:28.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.998+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94638190924304] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x7fcdf00141d0 2024-02-18T16:21:28.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.998+0000 7fcdf7ae9980 20 remove_watcher() i=5 2024-02-18T16:21:28.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.998+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638190925360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc32510 con 0x7fcdf00141d0 2024-02-18T16:21:28.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.998+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94638190925360] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x7fcdf00141d0 2024-02-18T16:21:28.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.998+0000 7fcdf7ae9980 20 remove_watcher() i=6 2024-02-18T16:21:28.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:27.998+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638190926416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5612abc32510 con 0x7fcdf00141d0 2024-02-18T16:21:28.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94638190926416] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcde806d040 con 0x7fcdf00141d0 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 20 remove_watcher() i=7 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fcdf00141d0 msgr2=0x7fcdf0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fcdf00141d0 0x7fcdf0015940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abbfa930 msgr2=0x5612abbfcdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abbfa930 0x5612abbfcdf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fcdec0c7070 msgr2=0x7fcdec0c7450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fcdec0c7070 0x7fcdec0c7450 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5612abc00b80 msgr2=0x5612abc03020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5612abc00b80 0x5612abc03020 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccc0034300 msgr2=0x7fccc00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccc0034300 0x7fccc00367c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0011010 tx=0x7fcdf0020000 comp rx=0 tx=0).stop 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 msgr2=0x5612abbef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf5604640 1 -- 172.21.15.129:0/1571886717 reap_dead start 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbef500 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcdec006c40 tx=0x7fcdec0e46a0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 shutdown_connections 2024-02-18T16:21:28.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1571886717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbe85d0 0x5612abbef500 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 >> 172.21.15.129:0/1571886717 conn(0x5612abbe4960 msgr2=0x5612abbe1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 shutdown_connections 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1571886717 wait complete. 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcccc034300 msgr2=0x7fcccc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcccc034300 0x7fcccc0367c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5612abbcbb90 tx=0x7fcdf0005850 comp rx=0 tx=0).stop 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 msgr2=0x5612abbdba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 0x5612abbdba10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcdec096e80 tx=0x7fcdec018020 comp rx=0 tx=0).stop 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 shutdown_connections 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcccc034300 0x7fcccc0367c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/186239531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612abbdb5f0 0x5612abbdba10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 >> 172.21.15.129:0/186239531 conn(0x5612abbd0400 msgr2=0x5612abbd0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 shutdown_connections 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/186239531 wait complete. 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abad78f0 msgr2=0x5612abbcad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abad78f0 0x5612abbcad70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccdc0342b0 msgr2=0x7fccdc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccdc0342b0 0x7fccdc036770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0ad000 tx=0x7fcdec0a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 msgr2=0x5612abbc4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbc4190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcde800b710 tx=0x7fcde8000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 shutdown_connections 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5612abad78f0 0x5612abbcad70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fccdc0342b0 0x7fccdc036770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 --2- 172.21.15.129:0/1890065060 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5612aba45860 0x5612abbc4190 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 >> 172.21.15.129:0/1890065060 conn(0x5612abacb8b0 msgr2=0x5612abbb78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 shutdown_connections 2024-02-18T16:21:28.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.002+0000 7fcdf7ae9980 1 -- 172.21.15.129:0/1890065060 wait complete. 2024-02-18T16:21:28.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-02-18T16:21:28.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-02-18T16:21:28.020 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-02-18T16:21:28.097 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:28.097 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:28.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c949ea980 1 Processor -- start 2024-02-18T16:21:28.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c949ea980 1 -- start start 2024-02-18T16:21:28.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c949ea980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55f7479f3910 0x55f7479f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c949ea980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f7479394c0 con 0x55f747961900 2024-02-18T16:21:28.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c949ea980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f747900180 con 0x55f7479f3910 2024-02-18T16:21:28.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c92505640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55f747961900 0x55f7479f21f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53038/0 (socket says 172.21.15.129:53038) 2024-02-18T16:21:28.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c91d04640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55f7479f3910 0x55f7479f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c92505640 1 -- 172.21.15.129:0/2389243974 learned_addr learned my addr 172.21.15.129:0/2389243974 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:28.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c91d04640 1 -- 172.21.15.129:0/2389243974 >> v1:172.21.15.80:6789/0 conn(0x55f747961900 legacy=0x55f7479f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.094+0000 7f4c91d04640 1 -- 172.21.15.129:0/2389243974 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7479f7250 con 0x55f7479f3910 2024-02-18T16:21:28.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c91d04640 1 --2- 172.21.15.129:0/2389243974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479f3910 0x55f7479f5d00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800a480 tx=0x7f4c8801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f6b2bbdec899e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c91503640 1 -- 172.21.15.129:0/2389243974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c880aa530 con 0x55f7479f3910 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c91503640 1 -- 172.21.15.129:0/2389243974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c880a6050 con 0x55f7479f3910 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c91503640 1 -- 172.21.15.129:0/2389243974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c880aa7e0 con 0x55f7479f3910 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 -- 172.21.15.129:0/2389243974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479f3910 msgr2=0x55f7479f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2389243974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479f3910 0x55f7479f5d00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800a480 tx=0x7f4c8801b110 comp rx=0 tx=0).stop 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 -- 172.21.15.129:0/2389243974 shutdown_connections 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2389243974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479f3910 0x55f7479f5d00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 -- 172.21.15.129:0/2389243974 >> 172.21.15.129:0/2389243974 conn(0x55f7479e7910 msgr2=0x55f7479e9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 -- 172.21.15.129:0/2389243974 shutdown_connections 2024-02-18T16:21:28.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.098+0000 7f4c949ea980 1 -- 172.21.15.129:0/2389243974 wait complete. 2024-02-18T16:21:28.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 Processor -- start 2024-02-18T16:21:28.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- start start 2024-02-18T16:21:28.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ad9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7478fd6b0 con 0x55f747961900 2024-02-18T16:21:28.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c92505640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ad9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c92505640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ad9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55850/0 (socket says 172.21.15.129:55850) 2024-02-18T16:21:28.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c92505640 1 -- 172.21.15.129:0/2669707989 learned_addr learned my addr 172.21.15.129:0/2669707989 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c92505640 1 -- 172.21.15.129:0/2669707989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c88005d30 con 0x55f747961900 2024-02-18T16:21:28.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c92505640 1 --2- 172.21.15.129:0/2669707989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ad9390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c006600 tx=0x7f4c8c006ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44015b695a2c73b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4b80608640 1 -- 172.21.15.129:0/2669707989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c8c003460 con 0x55f747961900 2024-02-18T16:21:28.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4b80608640 1 -- 172.21.15.129:0/2669707989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0035c0 con 0x55f747961900 2024-02-18T16:21:28.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4b80608640 1 -- 172.21.15.129:0/2669707989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c8c0038a0 con 0x55f747961900 2024-02-18T16:21:28.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- 172.21.15.129:0/2669707989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 msgr2=0x55f747ad9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2669707989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ad9390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c006600 tx=0x7f4c8c006ac0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- 172.21.15.129:0/2669707989 shutdown_connections 2024-02-18T16:21:28.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2669707989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ad9390 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- 172.21.15.129:0/2669707989 >> 172.21.15.129:0/2669707989 conn(0x55f7479e7910 msgr2=0x55f747ad4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- 172.21.15.129:0/2669707989 shutdown_connections 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 -- 172.21.15.129:0/2669707989 wait complete. 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.114+0000 7f4c949ea980 1 Processor -- start 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 -- start start 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ae0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7478f8e90 con 0x55f747961900 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92505640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ae0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92505640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ae0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55856/0 (socket says 172.21.15.129:55856) 2024-02-18T16:21:28.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92505640 1 -- 172.21.15.129:0/370608297 learned_addr learned my addr 172.21.15.129:0/370608297 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92505640 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c002090 con 0x55f747961900 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92505640 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ae0240 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c000f90 tx=0x7f4c8c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4b7ee05640 1 -- 172.21.15.129:0/370608297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c8c013760 con 0x55f747961900 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f747ae0780 con 0x55f747961900 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4b7ee05640 1 -- 172.21.15.129:0/370608297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0138c0 con 0x55f747961900 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4b7ee05640 1 -- 172.21.15.129:0/370608297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c8c013ba0 con 0x55f747961900 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f747ae0bd0 con 0x55f747961900 2024-02-18T16:21:28.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4b7ee05640 1 -- 172.21.15.129:0/370608297 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4c8c013d00 con 0x55f747961900 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4b7ee05640 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b78034300 0x7f4b780367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4b7ee05640 1 -- 172.21.15.129:0/370608297 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4c8c049700 con 0x55f747961900 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c91d04640 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b78034300 0x7f4b780367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f7479f3910 0x55f747ae6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747ae73b0 con 0x55f7479f3910 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92d06640 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f7479f3910 0x55f747ae6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c91d04640 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b78034300 0x7f4b780367c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c880ac000 tx=0x7f4c880a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.118+0000 7f4c92d06640 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f7479f3910 0x55f747ae6e70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c92d06640 1 -- 172.21.15.129:0/370608297 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c840083f0 con 0x55f7479f3910 2024-02-18T16:21:28.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747ae7770 con 0x55f7479f3910 2024-02-18T16:21:28.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c92d06640 1 -- 172.21.15.129:0/370608297 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4c840083f0 con 0x55f7479f3910 2024-02-18T16:21:28.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747ae9020 con 0x55f7479f3910 2024-02-18T16:21:28.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c92d06640 1 -- 172.21.15.129:0/370608297 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4c840083f0 con 0x55f7479f3910 2024-02-18T16:21:28.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747ae8220 con 0x55f7479f3910 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c92d06640 1 -- 172.21.15.129:0/370608297 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4c840083f0 con 0x55f7479f3910 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747ae8630 con 0x55f7479f3910 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c92d06640 1 -- 172.21.15.129:0/370608297 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4c84012040 con 0x55f7479f3910 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 Processor -- start 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- start start 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 0x55f747af7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f747891f20 con 0x55f747af7700 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c91d04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 0x55f747af7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c91d04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 0x55f747af7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55866/0 (socket says 172.21.15.129:55866) 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c91d04640 1 -- 172.21.15.129:0/277466994 learned_addr learned my addr 172.21.15.129:0/277466994 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c91d04640 1 -- 172.21.15.129:0/277466994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f747af8060 con 0x55f747af7700 2024-02-18T16:21:28.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c91d04640 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 0x55f747af7b20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4c8801b150 tx=0x7f4c88017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4b77fff640 1 -- 172.21.15.129:0/277466994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c880b4db0 con 0x55f747af7700 2024-02-18T16:21:28.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4b77fff640 1 -- 172.21.15.129:0/277466994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c880bd480 con 0x55f747af7700 2024-02-18T16:21:28.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.122+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f747af8250 con 0x55f747af7700 2024-02-18T16:21:28.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b77fff640 1 -- 172.21.15.129:0/277466994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c880bd740 con 0x55f747af7700 2024-02-18T16:21:28.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f747af8da0 con 0x55f747af7700 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b77fff640 1 -- 172.21.15.129:0/277466994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4c880bd8a0 con 0x55f747af7700 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b77fff640 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b6c034350 0x7f4b6c036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b77fff640 1 -- 172.21.15.129:0/277466994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4c880e5e20 con 0x55f747af7700 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c92d06640 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b6c034350 0x7f4b6c036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c949ea980 1 Processor -- start 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c949ea980 1 -- start start 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c92d06640 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b6c034350 0x7f4b6c036810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55f747ae7c60 tx=0x7f4c84003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c949ea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f7479ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c949ea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f747885790 con 0x55f7479ee0f0 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c91d04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f7479ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c91d04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f7479ee4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55874/0 (socket says 172.21.15.129:55874) 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c91d04640 1 -- 172.21.15.129:0/3959539222 learned_addr learned my addr 172.21.15.129:0/3959539222 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c91d04640 1 -- 172.21.15.129:0/3959539222 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7479eeaa0 con 0x55f7479ee0f0 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4c91d04640 1 --2- 172.21.15.129:0/3959539222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f7479ee4d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4c880e4180 tx=0x7f4c88006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824a936f5302bc46 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b75ffb640 1 -- 172.21.15.129:0/3959539222 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c88006990 con 0x55f7479ee0f0 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b75ffb640 1 -- 172.21.15.129:0/3959539222 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c88006af0 con 0x55f7479ee0f0 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.126+0000 7f4b75ffb640 1 -- 172.21.15.129:0/3959539222 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c88006db0 con 0x55f7479ee0f0 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/3959539222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 msgr2=0x55f7479ee4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 --2- 172.21.15.129:0/3959539222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f7479ee4d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4c880e4180 tx=0x7f4c88006500 comp rx=0 tx=0).stop 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/3959539222 shutdown_connections 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 --2- 172.21.15.129:0/3959539222 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f7479ee4d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/3959539222 >> 172.21.15.129:0/3959539222 conn(0x55f747b00aa0 msgr2=0x55f747afeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/3959539222 shutdown_connections 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/3959539222 wait complete. 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 Processor -- start 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- start start 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f747b0fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f747b0ffa0 con 0x55f7479ee0f0 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c91d04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f747b0fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c91d04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f747b0fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55880/0 (socket says 172.21.15.129:55880) 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 learned_addr learned my addr 172.21.15.129:0/2253889895 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f747af8da0 con 0x55f7479ee0f0 2024-02-18T16:21:28.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c91d04640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f747b0fa60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4c880b3760 tx=0x7f4c880e40e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4b63fff640 1 -- 172.21.15.129:0/2253889895 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c880b3d10 con 0x55f7479ee0f0 2024-02-18T16:21:28.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f747b101a0 con 0x55f7479ee0f0 2024-02-18T16:21:28.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4b63fff640 1 -- 172.21.15.129:0/2253889895 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c880b3e70 con 0x55f7479ee0f0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4b63fff640 1 -- 172.21.15.129:0/2253889895 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c880a96a0 con 0x55f7479ee0f0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f747b105d0 con 0x55f7479ee0f0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.130+0000 7f4b63fff640 1 -- 172.21.15.129:0/2253889895 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4c880a9800 con 0x55f7479ee0f0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4b63fff640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b5c0342b0 0x7f4b5c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4b63fff640 1 -- 172.21.15.129:0/2253889895 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4c880e0040 con 0x55f7479ee0f0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92d06640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b5c0342b0 0x7f4b5c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f747b1ae30 0x55f747b1d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1da20 con 0x55f747b1ae30 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f747b1ae30 0x55f747b1d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92d06640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b5c0342b0 0x7f4b5c036770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c84008fd0 tx=0x7f4c8401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f747b1ae30 0x55f747b1d2d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c8c024020 con 0x55f747b1ae30 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 realm 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1ddf0 con 0x55f747b1ae30 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c8c024020 con 0x55f747b1ae30 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1e640 con 0x55f747b1ae30 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c8c024020 con 0x55f747b1ae30 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1e9a0 con 0x55f747b1ae30 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4c8c024020 con 0x55f747b1ae30 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1e2e0 con 0x55f747b1ae30 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4c8c024020 con 0x55f747b1ae30 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 20 searching for the correct realm 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f747b20bf0 0x55f747b23020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c91d04640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f747b20bf0 0x55f747b23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c91d04640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f747b20bf0 0x55f747b23020 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c91d04640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4c880db050 0x7f4c880dc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c880db050 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.134+0000 7f4c92d06640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4c880db050 0x7f4c880dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92d06640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4c880db050 0x7f4c880dc900 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8402c040 con 0x7f4c880db050 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92d06640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4c84027940 0x7f4c840333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4c84027940 0x7f4c840333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4c84027940 0x7f4c840333c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c024020 con 0x7f4c84027940 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c880db050 2024-02-18T16:21:28.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8402c040 con 0x7f4c880db050 2024-02-18T16:21:28.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.138+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c880db050 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4c8402c040 con 0x7f4c880db050 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.142+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c880db050 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8402c040 con 0x7f4c880db050 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x55f747b1ae30 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c03d040 con 0x7f4c84027940 2024-02-18T16:21:28.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.146+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c880db050 2024-02-18T16:21:28.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8402c040 con 0x7f4c880db050 2024-02-18T16:21:28.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b20bf0 2024-02-18T16:21:28.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c84027940 2024-02-18T16:21:28.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x55f747b1ae30 2024-02-18T16:21:28.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b236f0 con 0x7f4c880db050 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c8402c040 con 0x7f4c880db050 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1f810 con 0x55f747b1ae30 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b1f490 con 0x55f747b1ae30 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b20160 con 0x55f747b1ae30 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 zone default found 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 4 Realm: () 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:28.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 zonegroup default 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b23fd0 con 0x7f4c84027940 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b259b0 con 0x55f747b20bf0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.150+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b25d10 con 0x55f747b20bf0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 20 started sync module instance, tier type = 2024-02-18T16:21:28.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24f80 con 0x7f4c880db050 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8403f040 con 0x7f4c880db050 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94520548152112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24f80 con 0x7f4c880db050 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b26780 con 0x55f747b1ae30 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94520548152112] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8403f040 con 0x7f4c880db050 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94520548156000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24f80 con 0x55f747b1ae30 2024-02-18T16:21:28.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.154+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b27140 con 0x55f747b20bf0 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94520548156000] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94520548149984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24f00 con 0x55f747b20bf0 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b27e70 con 0x7f4c880db050 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8403f040 con 0x7f4c880db050 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94520548161936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b286c0 con 0x7f4c880db050 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.158+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b290e0 con 0x55f747b1ae30 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.162+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94520548149984] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.162+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94520548161936] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8403f040 con 0x7f4c880db050 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.162+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.162+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94520548166592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b28220 con 0x55f747b1ae30 2024-02-18T16:21:28.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.162+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b29930 con 0x7f4c84027940 2024-02-18T16:21:28.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94520548168400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b29b90 con 0x7f4c84027940 2024-02-18T16:21:28.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2a390 con 0x7f4c84027940 2024-02-18T16:21:28.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94520548166592] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94520548168400] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94520548169456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b29fb0 con 0x7f4c84027940 2024-02-18T16:21:28.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.166+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2abe0 con 0x7f4c84027940 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94520548173264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2ae90 con 0x7f4c84027940 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=0 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=1 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=2 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=3 2024-02-18T16:21:28.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=4 2024-02-18T16:21:28.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=5 2024-02-18T16:21:28.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94520548169456] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=6 2024-02-18T16:21:28.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94520548173264] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 add_watcher() i=7 2024-02-18T16:21:28.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:28.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2dec0 con 0x55f747b1ae30 2024-02-18T16:21:28.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94520548174320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2b2b0 con 0x55f747b1ae30 2024-02-18T16:21:28.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94520548174320] v30'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4b48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:28.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:28.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.170+0000 7f4c949ea980 5 note: GC not initialized 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4ac37fe640 20 reqs_thread_entry: start 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 20 Filter name: none 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4ac17fa640 20 reqs_thread_entry: start 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b4f460 con 0x55f747b1ae30 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 20 rados_obj.operate() r=0 bl.length=193 2024-02-18T16:21:28.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4b48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94520548174320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2fd40 con 0x55f747b1ae30 2024-02-18T16:21:28.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94520548174320] v30'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.174+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94520548152112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b2fd40 con 0x7f4c880db050 2024-02-18T16:21:28.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94520548152112] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8403f040 con 0x7f4c880db050 2024-02-18T16:21:28.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c949ea980 20 remove_watcher() i=0 2024-02-18T16:21:28.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c949ea980 2 removed watcher, disabling cache 2024-02-18T16:21:28.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94520548156000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b25330 con 0x55f747b1ae30 2024-02-18T16:21:28.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94520548156000] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c949ea980 20 remove_watcher() i=1 2024-02-18T16:21:28.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.178+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94520548149984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b25330 con 0x55f747b20bf0 2024-02-18T16:21:28.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c91d04640 1 -- 172.21.15.129:0/2253889895 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94520548149984] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c880d0d40 con 0x55f747b20bf0 2024-02-18T16:21:28.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c949ea980 20 remove_watcher() i=2 2024-02-18T16:21:28.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94520548161936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24ae0 con 0x7f4c880db050 2024-02-18T16:21:28.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c92d06640 1 -- 172.21.15.129:0/2253889895 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94520548161936] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8403f040 con 0x7f4c880db050 2024-02-18T16:21:28.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c949ea980 20 remove_watcher() i=3 2024-02-18T16:21:28.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94520548166592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24ae0 con 0x55f747b1ae30 2024-02-18T16:21:28.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94520548166592] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x55f747b1ae30 2024-02-18T16:21:28.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c949ea980 20 remove_watcher() i=4 2024-02-18T16:21:28.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.182+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94520548168400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24ae0 con 0x7f4c84027940 2024-02-18T16:21:28.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.186+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94520548168400] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.186+0000 7f4c949ea980 20 remove_watcher() i=5 2024-02-18T16:21:28.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.186+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94520548169456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24ae0 con 0x7f4c84027940 2024-02-18T16:21:28.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94520548169456] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 20 remove_watcher() i=6 2024-02-18T16:21:28.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94520548173264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f747b24ae0 con 0x7f4c84027940 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94520548173264] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c8c059040 con 0x7f4c84027940 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 20 remove_watcher() i=7 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4c84027940 msgr2=0x7f4c840333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4c84027940 0x7f4c840333c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f747b1ae30 msgr2=0x55f747b1d2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f747b1ae30 0x55f747b1d2d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4c880db050 msgr2=0x7f4c880dc900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4c880db050 0x7f4c880dc900 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f747b20bf0 msgr2=0x55f747b23020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55f747b20bf0 0x55f747b23020 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b5c0342b0 msgr2=0x7f4b5c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b5c0342b0 0x7f4b5c036770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c84008fd0 tx=0x7f4c8401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 msgr2=0x55f747b0fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c92505640 1 -- 172.21.15.129:0/2253889895 reap_dead start 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f747b0fa60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4c880b3760 tx=0x7f4c880e40e0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 shutdown_connections 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/2253889895 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f7479ee0f0 0x55f747b0fa60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 >> 172.21.15.129:0/2253889895 conn(0x55f747b00aa0 msgr2=0x55f747afe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 shutdown_connections 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/2253889895 wait complete. 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b6c034350 msgr2=0x7f4b6c036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b6c034350 0x7f4b6c036810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55f747ae7c60 tx=0x7f4c84003070 comp rx=0 tx=0).stop 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 msgr2=0x55f747af7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 0x55f747af7b20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4c8801b150 tx=0x7f4c88017eb0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 shutdown_connections 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b6c034350 0x7f4b6c036810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/277466994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747af7700 0x55f747af7b20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 >> 172.21.15.129:0/277466994 conn(0x55f747aec510 msgr2=0x55f747aed020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 shutdown_connections 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/277466994 wait complete. 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f7479f3910 msgr2=0x55f747ae6e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f7479f3910 0x55f747ae6e70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b78034300 msgr2=0x7f4b780367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b78034300 0x7f4b780367c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c880ac000 tx=0x7f4c880a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 msgr2=0x55f747ae0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.190+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ae0240 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c000f90 tx=0x7f4c8c001260 comp rx=0 tx=0).stop 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 shutdown_connections 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55f7479f3910 0x55f747ae6e70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b78034300 0x7f4b780367c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 --2- 172.21.15.129:0/370608297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55f747961900 0x55f747ae0240 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 >> 172.21.15.129:0/370608297 conn(0x55f7479e7910 msgr2=0x55f747ad3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 shutdown_connections 2024-02-18T16:21:28.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.194+0000 7f4c949ea980 1 -- 172.21.15.129:0/370608297 wait complete. 2024-02-18T16:21:28.208 INFO:teuthology.orchestra.run.smithi129.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"5vZFyiZ8/JtzkDTSzDzvEVQ+","ver":2},"mtime":"2024-02-18T16:21:27.976127Z","data":{"bucket":{"name":"myfoo","marker":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","bucket_id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-02-18T16:21:24.450254Z","linked":true,"has_bucket_info":false}} 2024-02-18T16:21:28.208 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '5vZFyiZ8/JtzkDTSzDzvEVQ+', 'ver': 2}, 'mtime': '2024-02-18T16:21:27.976127Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'bucket_id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-02-18T16:21:24.450254Z', 'linked': True, 'has_bucket_info': False}} 2024-02-18T16:21:28.209 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-18T16:21:28.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-18T16:21:28.209 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-02-18T16:21:28.288 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:28.288 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:28.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869f633980 1 Processor -- start 2024-02-18T16:21:28.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869f633980 1 -- start start 2024-02-18T16:21:28.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869f633980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b3bfca8690 0x55b3bfcaaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869f633980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b3bfbf04d0 con 0x55b3bfca4180 2024-02-18T16:21:28.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869f633980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b3bfbb7180 con 0x55b3bfca8690 2024-02-18T16:21:28.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869c94d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b3bfca8690 0x55b3bfcaaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.282+0000 7f869d14e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55b3bfca4180 0x55b3bfca4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53046/0 (socket says 172.21.15.129:53046) 2024-02-18T16:21:28.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f869d14e640 1 -- 172.21.15.129:0/2139979893 learned_addr learned my addr 172.21.15.129:0/2139979893 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:28.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f869c94d640 1 -- 172.21.15.129:0/2139979893 >> v1:172.21.15.80:6789/0 conn(0x55b3bfca4180 legacy=0x55b3bfca4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f869c94d640 1 -- 172.21.15.129:0/2139979893 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3bfcabfd0 con 0x55b3bfca8690 2024-02-18T16:21:28.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f869c94d640 1 --2- 172.21.15.129:0/2139979893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca8690 0x55b3bfcaaa80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f869000a420 tx=0x7f869001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bff05ae77a24b16 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f8697fff640 1 -- 172.21.15.129:0/2139979893 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900aa530 con 0x55b3bfca8690 2024-02-18T16:21:28.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f8697fff640 1 -- 172.21.15.129:0/2139979893 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900a6050 con 0x55b3bfca8690 2024-02-18T16:21:28.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.286+0000 7f8697fff640 1 -- 172.21.15.129:0/2139979893 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900aa800 con 0x55b3bfca8690 2024-02-18T16:21:28.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 -- 172.21.15.129:0/2139979893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca8690 msgr2=0x55b3bfcaaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 --2- 172.21.15.129:0/2139979893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca8690 0x55b3bfcaaa80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f869000a420 tx=0x7f869001afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 -- 172.21.15.129:0/2139979893 shutdown_connections 2024-02-18T16:21:28.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 --2- 172.21.15.129:0/2139979893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca8690 0x55b3bfcaaa80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 -- 172.21.15.129:0/2139979893 >> 172.21.15.129:0/2139979893 conn(0x55b3bfc9fa50 msgr2=0x55b3bfca1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 -- 172.21.15.129:0/2139979893 shutdown_connections 2024-02-18T16:21:28.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.290+0000 7f869f633980 1 -- 172.21.15.129:0/2139979893 wait complete. 2024-02-18T16:21:28.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.302+0000 7f869f633980 1 Processor -- start 2024-02-18T16:21:28.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.302+0000 7f869f633980 1 -- start start 2024-02-18T16:21:28.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.302+0000 7f869f633980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd8e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.302+0000 7f869f633980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3bfbb46b0 con 0x55b3bfca4180 2024-02-18T16:21:28.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd8e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd8e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55898/0 (socket says 172.21.15.129:55898) 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 -- 172.21.15.129:0/492845752 learned_addr learned my addr 172.21.15.129:0/492845752 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 -- 172.21.15.129:0/492845752 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869000a100 con 0x55b3bfca4180 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 --2- 172.21.15.129:0/492845752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd8e040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8688001c00 tx=0x7f868800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15667a75a08248c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f858b606640 1 -- 172.21.15.129:0/492845752 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f868800e690 con 0x55b3bfca4180 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f858b606640 1 -- 172.21.15.129:0/492845752 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868800e810 con 0x55b3bfca4180 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f858b606640 1 -- 172.21.15.129:0/492845752 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f868800eb30 con 0x55b3bfca4180 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- 172.21.15.129:0/492845752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 msgr2=0x55b3bfd8e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 --2- 172.21.15.129:0/492845752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd8e040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8688001c00 tx=0x7f868800b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- 172.21.15.129:0/492845752 shutdown_connections 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 --2- 172.21.15.129:0/492845752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd8e040 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- 172.21.15.129:0/492845752 >> 172.21.15.129:0/492845752 conn(0x55b3bfc9fa50 msgr2=0x55b3bfd89bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- 172.21.15.129:0/492845752 shutdown_connections 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- 172.21.15.129:0/492845752 wait complete. 2024-02-18T16:21:28.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 Processor -- start 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- start start 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd94ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869f633980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3bfbafe90 con 0x55b3bfca4180 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd94ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd94ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55910/0 (socket says 172.21.15.129:55910) 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.306+0000 7f869d14e640 1 -- 172.21.15.129:0/3696254872 learned_addr learned my addr 172.21.15.129:0/3696254872 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869d14e640 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3bfbf04d0 con 0x55b3bfca4180 2024-02-18T16:21:28.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869d14e640 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd94ed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f868800b710 tx=0x7f8688000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f8589e03640 1 -- 172.21.15.129:0/3696254872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f868801f070 con 0x55b3bfca4180 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f8589e03640 1 -- 172.21.15.129:0/3696254872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868801a910 con 0x55b3bfca4180 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3bfd95410 con 0x55b3bfca4180 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f8589e03640 1 -- 172.21.15.129:0/3696254872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f868801abf0 con 0x55b3bfca4180 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3bfd95860 con 0x55b3bfca4180 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f8589e03640 1 -- 172.21.15.129:0/3696254872 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f868800a040 con 0x55b3bfca4180 2024-02-18T16:21:28.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f8589e03640 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8584034300 0x7f85840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f8589e03640 1 -- 172.21.15.129:0/3696254872 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8688049e50 con 0x55b3bfca4180 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869c94d640 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8584034300 0x7f85840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfca8690 0x55b3bfd9bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfd9c050 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869d94f640 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfca8690 0x55b3bfd9bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869c94d640 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8584034300 0x7f85840367c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86900ac000 tx=0x7f86900a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869d94f640 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfca8690 0x55b3bfd9bb10 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869d94f640 1 -- 172.21.15.129:0/3696254872 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86980083f0 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfd99210 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869d94f640 1 -- 172.21.15.129:0/3696254872 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f86980083f0 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.310+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfd9dd50 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869d94f640 1 -- 172.21.15.129:0/3696254872 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f86980083f0 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfd9cf50 con 0x55b3bfca8690 2024-02-18T16:21:28.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869d94f640 1 -- 172.21.15.129:0/3696254872 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86980083f0 con 0x55b3bfca8690 2024-02-18T16:21:28.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfd9d360 con 0x55b3bfca8690 2024-02-18T16:21:28.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869d94f640 1 -- 172.21.15.129:0/3696254872 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8698012040 con 0x55b3bfca8690 2024-02-18T16:21:28.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 Processor -- start 2024-02-18T16:21:28.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 -- start start 2024-02-18T16:21:28.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 0x55b3bfc18770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3bfb48f20 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869c94d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 0x55b3bfc18770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869c94d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 0x55b3bfc18770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55916/0 (socket says 172.21.15.129:55916) 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869c94d640 1 -- 172.21.15.129:0/870283717 learned_addr learned my addr 172.21.15.129:0/870283717 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869c94d640 1 -- 172.21.15.129:0/870283717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3bfc18cb0 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869c94d640 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 0x55b3bfc18770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8690017be0 tx=0x7f8690017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f8582ffd640 1 -- 172.21.15.129:0/870283717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900bb070 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f8582ffd640 1 -- 172.21.15.129:0/870283717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900b6c10 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3bfc18f00 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f8582ffd640 1 -- 172.21.15.129:0/870283717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900c0470 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.314+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3bfc19330 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f8582ffd640 1 -- 172.21.15.129:0/870283717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f86900b4400 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f8582ffd640 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8574034300 0x7f85740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f8582ffd640 1 -- 172.21.15.129:0/870283717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f86900e53a0 con 0x55b3bfc1a2d0 2024-02-18T16:21:28.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869d94f640 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8574034300 0x7f85740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 Processor -- start 2024-02-18T16:21:28.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- start start 2024-02-18T16:21:28.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869d94f640 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8574034300 0x7f85740367c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55b3bfd9c8d0 tx=0x7f8698003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdbbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3bfb3c790 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869c94d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdbbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869c94d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdbbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55930/0 (socket says 172.21.15.129:55930) 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869c94d640 1 -- 172.21.15.129:0/1303199403 learned_addr learned my addr 172.21.15.129:0/1303199403 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869c94d640 1 -- 172.21.15.129:0/1303199403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3bfdbc0b0 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869c94d640 1 --2- 172.21.15.129:0/1303199403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdbbae0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86900b6fb0 tx=0x7f86900a94e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d97d3bd9f5fd9d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f8580ff9640 1 -- 172.21.15.129:0/1303199403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900b47e0 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f8580ff9640 1 -- 172.21.15.129:0/1303199403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900e1070 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f8580ff9640 1 -- 172.21.15.129:0/1303199403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900e22a0 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- 172.21.15.129:0/1303199403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 msgr2=0x55b3bfdbbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 --2- 172.21.15.129:0/1303199403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdbbae0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86900b6fb0 tx=0x7f86900a94e0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- 172.21.15.129:0/1303199403 shutdown_connections 2024-02-18T16:21:28.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 --2- 172.21.15.129:0/1303199403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdbbae0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- 172.21.15.129:0/1303199403 >> 172.21.15.129:0/1303199403 conn(0x55b3bfdb7a20 msgr2=0x55b3bfdb5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- 172.21.15.129:0/1303199403 shutdown_connections 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.318+0000 7f869f633980 1 -- 172.21.15.129:0/1303199403 wait complete. 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 Processor -- start 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 -- start start 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdc25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3bfdc2b00 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869c94d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdc25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869c94d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdc25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55940/0 (socket says 172.21.15.129:55940) 2024-02-18T16:21:28.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 learned_addr learned my addr 172.21.15.129:0/3122677707 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3bfc19330 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869c94d640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdc25c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f869000a0d0 tx=0x7f86900e3720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f8572ffd640 1 -- 172.21.15.129:0/3122677707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900be370 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f8572ffd640 1 -- 172.21.15.129:0/3122677707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900be4d0 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3bfdc2d00 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f8572ffd640 1 -- 172.21.15.129:0/3122677707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86900be790 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3bfdc3130 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f8572ffd640 1 -- 172.21.15.129:0/3122677707 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f86900c51d0 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f8572ffd640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8568034300 0x7f85680367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f8572ffd640 1 -- 172.21.15.129:0/3122677707 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f86900c1070 con 0x55b3bfdbb6e0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869d94f640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8568034300 0x7f85680367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfdcdb60 0x55b3bfdd0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.322+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd0770 con 0x55b3bfdcdb60 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfdcdb60 0x55b3bfdd0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d94f640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8568034300 0x7f85680367c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8698008fd0 tx=0x7f869801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfdcdb60 0x55b3bfdd0020 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 realm 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd0b40 con 0x55b3bfdcdb60 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd13c0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd1720 con 0x55b3bfdcdb60 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd1f20 con 0x55b3bfdcdb60 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:28.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 20 searching for the correct realm 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b3bfdd3db0 0x55b3bfdd61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869c94d640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b3bfdd3db0 0x55b3bfdd61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869c94d640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b3bfdd3db0 0x55b3bfdd61a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869c94d640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f86900ef060 0x7f86900f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f86900ef060 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d94f640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f86900ef060 0x7f86900f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d94f640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f86900ef060 0x7f86900f1830 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f869802c040 con 0x7f86900ef060 2024-02-18T16:21:28.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d94f640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8698027940 0x7f86980333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.326+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8698027940 0x7f86980333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8698027940 0x7f86980333c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f86900ef060 2024-02-18T16:21:28.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f869802c040 con 0x7f86900ef060 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.330+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f86900ef060 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f869802c040 con 0x7f86900ef060 2024-02-18T16:21:28.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.334+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f86900ef060 2024-02-18T16:21:28.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f869802c040 con 0x7f86900ef060 2024-02-18T16:21:28.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.338+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f86900ef060 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f869802c040 con 0x7f86900ef060 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdd3db0 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f8698027940 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6850 con 0x7f86900ef060 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f869802c040 con 0x7f86900ef060 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd2850 con 0x55b3bfdcdb60 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd30a0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6c90 con 0x55b3bfdcdb60 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 zone default found 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 4 Realm: () 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 zonegroup default 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd6d20 con 0x7f8698027940 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.342+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd8b00 con 0x55b3bfdd3db0 2024-02-18T16:21:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd8f10 con 0x55b3bfdd3db0 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 20 started sync module instance, tier type = 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd83e0 con 0x7f86900ef060 2024-02-18T16:21:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230506471232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd8790 con 0x7f86900ef060 2024-02-18T16:21:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd9c70 con 0x55b3bfdcdb60 2024-02-18T16:21:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.346+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94230506471232] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230506476336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd9bf0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdda600 con 0x55b3bfdd3db0 2024-02-18T16:21:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94230506476336] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230506477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdd9b70 con 0x55b3bfdd3db0 2024-02-18T16:21:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddb320 con 0x7f86900ef060 2024-02-18T16:21:28.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230506483632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddbb70 con 0x7f86900ef060 2024-02-18T16:21:28.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.350+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddc5a0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.354+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94230506477392] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.354+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94230506483632] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.354+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.354+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230506488000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddb6d0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.354+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddce20 con 0x7f8698027940 2024-02-18T16:21:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.354+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94230506488000] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230506482144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddb6d0 con 0x7f8698027940 2024-02-18T16:21:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddd290 con 0x7f8698027940 2024-02-18T16:21:28.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94230506482144] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230506491280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddd250 con 0x7f8698027940 2024-02-18T16:21:28.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.358+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdddbc0 con 0x7f8698027940 2024-02-18T16:21:28.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230506493728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdde020 con 0x7f8698027940 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94230506491280] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=0 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=1 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=2 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=3 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=4 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=5 2024-02-18T16:21:28.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=6 2024-02-18T16:21:28.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94230506493728] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 20 add_watcher() i=7 2024-02-18T16:21:28.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:28.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddc840 con 0x55b3bfdcdb60 2024-02-18T16:21:28.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.362+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230506494784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfddc840 con 0x55b3bfdcdb60 2024-02-18T16:21:28.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94230506494784] v30'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f85537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:28.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:28.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 5 note: GC not initialized 2024-02-18T16:21:28.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f85527e4640 20 reqs_thread_entry: start 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 Filter name: none 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f84c3fff640 20 reqs_thread_entry: start 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe02f40 con 0x55b3bfdcdb60 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:28.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe04940 con 0x55b3bfdcdb60 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=193 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 8.17 8:e90d4d9e:root::.bucket.meta.testx%3amyfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe06010 con 0x55b3bfdcdb60 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv4 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 20 rados_obj.operate() r=0 bl.length=371 2024-02-18T16:21:28.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:28.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:28.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:28.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-18T16:21:28.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:28.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-18T16:21:28.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.366+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0a450 con 0x55b3bfdcdb60 2024-02-18T16:21:28.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'4 uv4 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0dd10 con 0x55b3bfdcdb60 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(66 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [create,call,writefull 0~352,setxattr (123)] v30'6 uv6 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x7 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94230506683072 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d750 con 0x55b3bfdcdb60 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify (1) cookie 94230506476336 notify 128849018902 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x7f8688033040 con 0x55b3bfdcdb60 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f8580ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018902 cookie 94230506476336 notifier 4552 bl.length()=701 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(67 notify.1 [notify cookie 94230506683072 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f8580ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x7 2024-02-18T16:21:28.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f8580ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f8580ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f8580ff9640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8560003ea0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== watch-notify(notify_complete (2) cookie 94230506683072 notify 128849018902 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b3bfd95860 con 0x55b3bfdcdb60 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_sources= new_sources= 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential sources added=[] removed=[] 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_dests= new_dests= 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential dests added=[] removed=[] 2024-02-18T16:21:28.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.370+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d7d0 con 0x7f86900ef060 2024-02-18T16:21:28.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d7d0 con 0x7f86900ef060 2024-02-18T16:21:28.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869f633980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-18T16:21:28.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869f633980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:28.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869f633980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:28.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.374+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94230506689328 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d750 con 0x7f8698027940 2024-02-18T16:21:28.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== watch-notify(notify (1) cookie 94230506491280 notify 128849018889 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55b3bfd95860 con 0x7f8698027940 2024-02-18T16:21:28.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(71 notify.6 [notify cookie 94230506689328 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f8580ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94230506491280 notifier 4552 bl.length()=314 2024-02-18T16:21:28.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f8580ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-18T16:21:28.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f8580ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:28.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f8580ff9640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8560003ea0 con 0x7f8698027940 2024-02-18T16:21:28.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== watch-notify(notify_complete (2) cookie 94230506689328 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b3bfd95410 con 0x7f8698027940 2024-02-18T16:21:28.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-02-18T16:21:28.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-18T16:21:28.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94230506689328 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d750 con 0x55b3bfdcdb60 2024-02-18T16:21:28.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== watch-notify(notify (1) cookie 94230506488000 notify 128849018903 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x55b3bfd95410 con 0x55b3bfdcdb60 2024-02-18T16:21:28.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f8580ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018903 cookie 94230506488000 notifier 4552 bl.length()=155 2024-02-18T16:21:28.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(73 notify.4 [notify cookie 94230506689328 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f8580ff9640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8560003ea0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== watch-notify(notify_complete (2) cookie 94230506689328 notify 128849018903 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8688029030 con 0x55b3bfdcdb60 2024-02-18T16:21:28.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d7d0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(75 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 from cache 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.378+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:76 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94230506661056 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d7d0 con 0x7f86900ef060 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== watch-notify(notify (1) cookie 94230506471232 notify 128849018897 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7f869801a990 con 0x7f86900ef060 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f8573fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94230506471232 notifier 4552 bl.length()=212 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(76 notify.0 [notify cookie 94230506661056 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f8573fff640 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f84d0003330 con 0x7f86900ef060 2024-02-18T16:21:28.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== watch-notify(notify_complete (2) cookie 94230506661056 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f869801ab20 con 0x7f86900ef060 2024-02-18T16:21:28.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(77 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 8.17 8:e90d4d9e:root::.bucket.meta.testx%3amyfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe0d330 con 0x55b3bfdcdb60 2024-02-18T16:21:28.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call,delete] v30'7 uv7 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f85537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.382+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230506494784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdf4fe0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94230506494784] v30'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230506471232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe059e0 con 0x7f86900ef060 2024-02-18T16:21:28.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94230506471232] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869f633980 20 remove_watcher() i=0 2024-02-18T16:21:28.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869f633980 2 removed watcher, disabling cache 2024-02-18T16:21:28.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230506476336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe059e0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94230506476336] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869f633980 20 remove_watcher() i=1 2024-02-18T16:21:28.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.386+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230506477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfe059e0 con 0x55b3bfdd3db0 2024-02-18T16:21:28.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.390+0000 7f869c94d640 1 -- 172.21.15.129:0/3122677707 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94230506477392] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86900b1040 con 0x55b3bfdd3db0 2024-02-18T16:21:28.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.390+0000 7f869f633980 20 remove_watcher() i=2 2024-02-18T16:21:28.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.390+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230506483632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdf4fe0 con 0x7f86900ef060 2024-02-18T16:21:28.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.390+0000 7f869d94f640 1 -- 172.21.15.129:0/3122677707 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94230506483632] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f869803f040 con 0x7f86900ef060 2024-02-18T16:21:28.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.390+0000 7f869f633980 20 remove_watcher() i=3 2024-02-18T16:21:28.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.390+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230506488000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdf4fe0 con 0x55b3bfdcdb60 2024-02-18T16:21:28.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.394+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94230506488000] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x55b3bfdcdb60 2024-02-18T16:21:28.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.394+0000 7f869f633980 20 remove_watcher() i=4 2024-02-18T16:21:28.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.394+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230506482144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdf4fe0 con 0x7f8698027940 2024-02-18T16:21:28.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.394+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94230506482144] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.394+0000 7f869f633980 20 remove_watcher() i=5 2024-02-18T16:21:28.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.394+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230506491280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdf4fe0 con 0x7f8698027940 2024-02-18T16:21:28.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.398+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94230506491280] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.398+0000 7f869f633980 20 remove_watcher() i=6 2024-02-18T16:21:28.404 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.398+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230506493728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3bfdf4fe0 con 0x7f8698027940 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94230506493728] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8688017900 con 0x7f8698027940 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 20 remove_watcher() i=7 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8698027940 msgr2=0x7f86980333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8698027940 0x7f86980333c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfdcdb60 msgr2=0x55b3bfdd0020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfdcdb60 0x55b3bfdd0020 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f86900ef060 msgr2=0x7f86900f1830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f86900ef060 0x7f86900f1830 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b3bfdd3db0 msgr2=0x55b3bfdd61a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b3bfdd3db0 0x55b3bfdd61a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8568034300 msgr2=0x7f85680367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8568034300 0x7f85680367c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8698008fd0 tx=0x7f869801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 msgr2=0x55b3bfdc25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3122677707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfdbb6e0 0x55b3bfdc25c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f869000a0d0 tx=0x7f86900e3720 comp rx=0 tx=0).stop 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 reap_dead start 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869d14e640 1 -- 172.21.15.129:0/3122677707 reap_dead start 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 shutdown_connections 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 >> 172.21.15.129:0/3122677707 conn(0x55b3bfdb7a20 msgr2=0x55b3bfdb5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 shutdown_connections 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3122677707 wait complete. 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8574034300 msgr2=0x7f85740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8574034300 0x7f85740367c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55b3bfd9c8d0 tx=0x7f8698003070 comp rx=0 tx=0).stop 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 msgr2=0x55b3bfc18770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 0x55b3bfc18770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8690017be0 tx=0x7f8690017d70 comp rx=0 tx=0).stop 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 shutdown_connections 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8574034300 0x7f85740367c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/870283717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfc1a2d0 0x55b3bfc18770 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 >> 172.21.15.129:0/870283717 conn(0x55b3bfda12d0 msgr2=0x55b3bfda1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 shutdown_connections 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/870283717 wait complete. 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfca8690 msgr2=0x55b3bfd9bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfca8690 0x55b3bfd9bb10 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8584034300 msgr2=0x7f85840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8584034300 0x7f85840367c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86900ac000 tx=0x7f86900a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 msgr2=0x55b3bfd94ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd94ed0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f868800b710 tx=0x7f8688000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 shutdown_connections 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b3bfca8690 0x55b3bfd9bb10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8584034300 0x7f85840367c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 --2- 172.21.15.129:0/3696254872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b3bfca4180 0x55b3bfd94ed0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 >> 172.21.15.129:0/3696254872 conn(0x55b3bfc9fa50 msgr2=0x55b3bfd886e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 shutdown_connections 2024-02-18T16:21:28.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.402+0000 7f869f633980 1 -- 172.21.15.129:0/3696254872 wait complete. 2024-02-18T16:21:28.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-18T16:21:28.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-18T16:21:28.419 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-02-18T16:21:28.500 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:28.500 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9f2c4980 1 Processor -- start 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9f2c4980 1 -- start start 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9f2c4980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x555790ea1860 0x555790ea3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9f2c4980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555790de74d0 con 0x555790e9d360 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9f2c4980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x555790dae180 con 0x555790ea1860 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9c5de640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x555790ea1860 0x555790ea3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9cddf640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x555790e9d360 0x555790e9d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53050/0 (socket says 172.21.15.129:53050) 2024-02-18T16:21:28.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.494+0000 7f2b9cddf640 1 -- 172.21.15.129:0/4249420955 learned_addr learned my addr 172.21.15.129:0/4249420955 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:28.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9c5de640 1 -- 172.21.15.129:0/4249420955 >> v1:172.21.15.80:6789/0 conn(0x555790e9d360 legacy=0x555790e9d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9c5de640 1 -- 172.21.15.129:0/4249420955 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555790ea51a0 con 0x555790ea1860 2024-02-18T16:21:28.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/4249420955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790ea1860 0x555790ea3c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00a480 tx=0x7f2b8c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d116133e3c3df287 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9bddd640 1 -- 172.21.15.129:0/4249420955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0ab540 con 0x555790ea1860 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9bddd640 1 -- 172.21.15.129:0/4249420955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0ab6a0 con 0x555790ea1860 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9bddd640 1 -- 172.21.15.129:0/4249420955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0ab960 con 0x555790ea1860 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/4249420955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790ea1860 msgr2=0x555790ea3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/4249420955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790ea1860 0x555790ea3c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00a480 tx=0x7f2b8c01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/4249420955 shutdown_connections 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/4249420955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790ea1860 0x555790ea3c50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/4249420955 >> 172.21.15.129:0/4249420955 conn(0x555790e10a50 msgr2=0x555790e10e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/4249420955 shutdown_connections 2024-02-18T16:21:28.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.498+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/4249420955 wait complete. 2024-02-18T16:21:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9f2c4980 1 Processor -- start 2024-02-18T16:21:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9f2c4980 1 -- start start 2024-02-18T16:21:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9f2c4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9f2c4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555790dab6b0 con 0x555790e9d360 2024-02-18T16:21:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9cddf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9cddf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f872b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55960/0 (socket says 172.21.15.129:55960) 2024-02-18T16:21:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.514+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3244892804 learned_addr learned my addr 172.21.15.129:0/3244892804 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3244892804 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c005d30 con 0x555790e9d360 2024-02-18T16:21:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 --2- 172.21.15.129:0/3244892804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f872b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001c90 tx=0x7f2b9000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ead080d8923ef94 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2a8ae0d640 1 -- 172.21.15.129:0/3244892804 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9000e690 con 0x555790e9d360 2024-02-18T16:21:28.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2a8ae0d640 1 -- 172.21.15.129:0/3244892804 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9000e7f0 con 0x555790e9d360 2024-02-18T16:21:28.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2a8ae0d640 1 -- 172.21.15.129:0/3244892804 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9000eaf0 con 0x555790e9d360 2024-02-18T16:21:28.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3244892804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 msgr2=0x555790f872b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3244892804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f872b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001c90 tx=0x7f2b9000b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3244892804 shutdown_connections 2024-02-18T16:21:28.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3244892804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f872b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3244892804 >> 172.21.15.129:0/3244892804 conn(0x555790e10a50 msgr2=0x555790f82e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3244892804 shutdown_connections 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3244892804 wait complete. 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 Processor -- start 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- start start 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f8e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555790da6e90 con 0x555790e9d360 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f8e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55966/0 (socket says 172.21.15.129:55966) 2024-02-18T16:21:28.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 -- 172.21.15.129:0/833113784 learned_addr learned my addr 172.21.15.129:0/833113784 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555790de74d0 con 0x555790e9d360 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9cddf640 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f8e100 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001ee0 tx=0x7f2b90000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2a8960a640 1 -- 172.21.15.129:0/833113784 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9001f070 con 0x555790e9d360 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2a8960a640 1 -- 172.21.15.129:0/833113784 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9001a4d0 con 0x555790e9d360 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555790f8e640 con 0x555790e9d360 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2a8960a640 1 -- 172.21.15.129:0/833113784 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9001a770 con 0x555790e9d360 2024-02-18T16:21:28.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.518+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555790f8ea90 con 0x555790e9d360 2024-02-18T16:21:28.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2a8960a640 1 -- 172.21.15.129:0/833113784 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b9000a040 con 0x555790e9d360 2024-02-18T16:21:28.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2a8960a640 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a840342b0 0x7f2a84036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2a8960a640 1 -- 172.21.15.129:0/833113784 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b90049820 con 0x555790e9d360 2024-02-18T16:21:28.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a840342b0 0x7f2a84036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790ea1860 0x555790f94d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790f952c0 con 0x555790ea1860 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790ea1860 0x555790f94d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a840342b0 0x7f2a84036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ad000 tx=0x7f2b8c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790ea1860 0x555790f94d80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/833113784 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b9400a4d0 con 0x555790ea1860 2024-02-18T16:21:28.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790f95690 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/833113784 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b9400a4d0 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790f96f40 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/833113784 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2b9400a4d0 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790f96140 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/833113784 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b9400a4d0 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790f96550 con 0x555790ea1860 2024-02-18T16:21:28.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/833113784 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2b9400a4d0 con 0x555790ea1860 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.522+0000 7f2b9f2c4980 1 Processor -- start 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9f2c4980 1 -- start start 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9f2c4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 0x555790fa5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9f2c4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555790d3ff20 con 0x555790fa5600 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9c5de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 0x555790fa5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9c5de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 0x555790fa5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55980/0 (socket says 172.21.15.129:55980) 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9c5de640 1 -- 172.21.15.129:0/920922597 learned_addr learned my addr 172.21.15.129:0/920922597 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9c5de640 1 -- 172.21.15.129:0/920922597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555790fa5f60 con 0x555790fa5600 2024-02-18T16:21:28.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 0x555790fa5a20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ab670 tx=0x7f2b8c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2a827fc640 1 -- 172.21.15.129:0/920922597 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0be7c0 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2a827fc640 1 -- 172.21.15.129:0/920922597 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0be920 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555790fa6150 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2a827fc640 1 -- 172.21.15.129:0/920922597 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0bebc0 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555790fa6ca0 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2a827fc640 1 -- 172.21.15.129:0/920922597 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b8c0bd3e0 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2a827fc640 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a740342b0 0x7f2a74036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2a827fc640 1 -- 172.21.15.129:0/920922597 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b8c0e6300 con 0x555790fa5600 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a740342b0 0x7f2a74036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.526+0000 7f2b9f2c4980 1 Processor -- start 2024-02-18T16:21:28.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- start start 2024-02-18T16:21:28.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a740342b0 0x7f2a74036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x555790f95b80 tx=0x7f2b94005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555790d33790 con 0x555790fb25b0 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55996/0 (socket says 172.21.15.129:55996) 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 -- 172.21.15.129:0/95342329 learned_addr learned my addr 172.21.15.129:0/95342329 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 -- 172.21.15.129:0/95342329 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555790fb2fa0 con 0x555790fb25b0 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/95342329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb29d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0e4720 tx=0x7f2b8c0c5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b0132c48e9037 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2a73fff640 1 -- 172.21.15.129:0/95342329 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0b49a0 con 0x555790fb25b0 2024-02-18T16:21:28.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2a73fff640 1 -- 172.21.15.129:0/95342329 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0bccd0 con 0x555790fb25b0 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2a73fff640 1 -- 172.21.15.129:0/95342329 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0e31d0 con 0x555790fb25b0 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/95342329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 msgr2=0x555790fb29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/95342329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb29d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0e4720 tx=0x7f2b8c0c5f50 comp rx=0 tx=0).stop 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/95342329 shutdown_connections 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/95342329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb29d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/95342329 >> 172.21.15.129:0/95342329 conn(0x555790fae940 msgr2=0x555790fac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/95342329 shutdown_connections 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/95342329 wait complete. 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 Processor -- start 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- start start 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9f2c4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555790fb9a50 con 0x555790fb25b0 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56006/0 (socket says 172.21.15.129:56006) 2024-02-18T16:21:28.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 learned_addr learned my addr 172.21.15.129:0/3102777261 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.530+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555790fa6ca0 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb9510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0e3610 tx=0x7f2b8c0e1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2a727fc640 1 -- 172.21.15.129:0/3102777261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0d6040 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2a727fc640 1 -- 172.21.15.129:0/3102777261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0e60d0 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555790fb9c50 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2a727fc640 1 -- 172.21.15.129:0/3102777261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0bc4d0 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555790fba0e0 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2a727fc640 1 -- 172.21.15.129:0/3102777261 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b8c0aaa30 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2a727fc640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a680342b0 0x7f2a68036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2a727fc640 1 -- 172.21.15.129:0/3102777261 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b8c0b66d0 con 0x555790fb25b0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a680342b0 0x7f2a68036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790fc4910 0x555790fc6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc7520 con 0x555790fc4910 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9cddf640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790fc4910 0x555790fc6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a680342b0 0x7f2a68036770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b94011010 tx=0x7f2b94020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9cddf640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790fc4910 0x555790fc6dd0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 realm 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc78f0 con 0x555790fc4910 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc8170 con 0x555790fc4910 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.534+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc84d0 con 0x555790fc4910 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc8cd0 con 0x555790fc4910 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 20 searching for the correct realm 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555790fcab60 0x555790fcd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555790fcab60 0x555790fcd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555790fcab60 0x555790fcd000 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0ef600 con 0x555790fcab60 2024-02-18T16:21:28.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9c5de640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2b8c0c7070 0x7f2b8c0e5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2b8c0c7070 0x7f2b8c0e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2b8c0c7070 0x7f2b8c0e5070 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9400a4d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9d5e0640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2b940141d0 0x7f2b94015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9cddf640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2b940141d0 0x7f2b94015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9cddf640 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2b940141d0 0x7f2b94015940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.538+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9400a4d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0ef600 con 0x555790fcab60 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.542+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.546+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fcab60 2024-02-18T16:21:28.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b940141d0 2024-02-18T16:21:28.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x555790fc4910 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcd6d0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.550+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc9600 con 0x555790fc4910 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fc9e50 con 0x555790fc4910 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcdb10 con 0x555790fc4910 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 zone default found 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 4 Realm: () 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:28.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 zonegroup default 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcdb40 con 0x7f2b940141d0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcf920 con 0x555790fcab60 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcfcb0 con 0x555790fcab60 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 started sync module instance, tier type = 2024-02-18T16:21:28.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:28.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcf200 con 0x7f2b8c0c7070 2024-02-18T16:21:28.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834583010656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fcf5b0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.554+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0a10 con 0x555790fc4910 2024-02-18T16:21:28.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.558+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834583010656] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.558+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.558+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834583015632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0990 con 0x555790fc4910 2024-02-18T16:21:28.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.558+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd1440 con 0x555790fcab60 2024-02-18T16:21:28.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.558+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834583015632] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834583016688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0910 con 0x555790fcab60 2024-02-18T16:21:28.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd2130 con 0x7f2b8c0c7070 2024-02-18T16:21:28.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834583023040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd2980 con 0x7f2b8c0c7070 2024-02-18T16:21:28.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd3380 con 0x555790fc4910 2024-02-18T16:21:28.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834583016688] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834583023040] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834583027328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd24e0 con 0x555790fc4910 2024-02-18T16:21:28.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.562+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd3bd0 con 0x7f2b940141d0 2024-02-18T16:21:28.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834583027328] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834583021552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd24e0 con 0x7f2b940141d0 2024-02-18T16:21:28.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd40a0 con 0x7f2b940141d0 2024-02-18T16:21:28.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834583030688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd4500 con 0x7f2b940141d0 2024-02-18T16:21:28.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.566+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd4ef0 con 0x7f2b940141d0 2024-02-18T16:21:28.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834583021552] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834583030688] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834583034320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd4060 con 0x7f2b940141d0 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=0 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=1 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=2 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=3 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=4 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=5 2024-02-18T16:21:28.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=6 2024-02-18T16:21:28.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834583034320] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 20 add_watcher() i=7 2024-02-18T16:21:28.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.570+0000 7f2b9f2c4980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:28.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd7ff0 con 0x555790fc4910 2024-02-18T16:21:28.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834583029008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd5460 con 0x555790fc4910 2024-02-18T16:21:28.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834583029008] v30'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2a537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9f2c4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:28.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9f2c4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:28.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe03c0 con 0x555790fc4910 2024-02-18T16:21:28.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.574+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe0470 con 0x7f2b940141d0 2024-02-18T16:21:28.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.578+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.578+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe0f70 con 0x555790fcab60 2024-02-18T16:21:28.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.578+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.578+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe1770 con 0x555790fc4910 2024-02-18T16:21:28.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.582+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.582+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe1ca0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.582+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.582+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe21d0 con 0x555790fcab60 2024-02-18T16:21:28.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.582+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.582+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe2ba0 con 0x555790fc4910 2024-02-18T16:21:28.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.586+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.586+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe2ba0 con 0x7f2b940141d0 2024-02-18T16:21:28.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.586+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.586+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe2ba0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.590+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.590+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe2fa0 con 0x555790fcab60 2024-02-18T16:21:28.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.590+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.590+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe3970 con 0x7f2b8c0c7070 2024-02-18T16:21:28.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.590+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.590+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fde400 con 0x7f2b940141d0 2024-02-18T16:21:28.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.594+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.594+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdea10 con 0x7f2b8c0c7070 2024-02-18T16:21:28.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.594+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.594+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdea10 con 0x7f2b940141d0 2024-02-18T16:21:28.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.594+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.594+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe44e0 con 0x555790fc4910 2024-02-18T16:21:28.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.598+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.598+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe44e0 con 0x555790fcab60 2024-02-18T16:21:28.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.598+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.598+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x7f2b8c0c7070 2024-02-18T16:21:28.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.602+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.602+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.602+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.602+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fc4910 2024-02-18T16:21:28.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.602+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.602+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fc4910 2024-02-18T16:21:28.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.606+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.606+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.606+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.606+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x7f2b8c0c7070 2024-02-18T16:21:28.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.606+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.606+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.610+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.610+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.610+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.610+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.610+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.610+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.614+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.614+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x7f2b940141d0 2024-02-18T16:21:28.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.614+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.614+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.614+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.614+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x7f2b940141d0 2024-02-18T16:21:28.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.618+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.618+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x555790fcab60 2024-02-18T16:21:28.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.618+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.618+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x7f2b940141d0 2024-02-18T16:21:28.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fe4310 con 0x7f2b8c0c7070 2024-02-18T16:21:28.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2a527e4640 20 reqs_thread_entry: start 2024-02-18T16:21:28.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9f2c4980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:28.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9f2c4980 20 Filter name: none 2024-02-18T16:21:28.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2a4b7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:28.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9f2c4980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-18T16:21:28.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9f2c4980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.622+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdc4c0 con 0x7f2b940141d0 2024-02-18T16:21:28.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 20 rados_obj.operate() r=0 bl.length=385 2024-02-18T16:21:28.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-18T16:21:28.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-18T16:21:28.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:28.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdd750 con 0x555790fc4910 2024-02-18T16:21:28.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-18T16:21:28.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:21:28.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 93834583069264 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdd720 con 0x555790fcab60 2024-02-18T16:21:28.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== watch-notify(notify (1) cookie 93834583016688 notify 128849018885 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x555790fb9c50 con 0x555790fcab60 2024-02-18T16:21:28.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2a73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93834583016688 notifier 4559 bl.length()=170 2024-02-18T16:21:28.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(96 notify.2 [notify cookie 93834583069264 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2a73fff640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2a60003d60 con 0x555790fcab60 2024-02-18T16:21:28.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== watch-notify(notify_complete (2) cookie 93834583069264 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2b8c0ea030 con 0x555790fcab60 2024-02-18T16:21:28.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.626+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdd720 con 0x7f2b940141d0 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 10 removing email index: 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 10 removing user buckets index 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 93834583069264 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdd720 con 0x555790fc4910 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== watch-notify(notify (1) cookie 93834583027328 notify 128849018904 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x555790f8ea90 con 0x555790fc4910 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2a73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018904 cookie 93834583027328 notifier 4559 bl.length()=175 2024-02-18T16:21:28.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2a73fff640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2a60003d60 con 0x555790fc4910 2024-02-18T16:21:28.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(99 notify.4 [notify cookie 93834583069264 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== watch-notify(notify_complete (2) cookie 93834583069264 notify 128849018904 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555790f8e640 con 0x555790fc4910 2024-02-18T16:21:28.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdd720 con 0x555790fc4910 2024-02-18T16:21:28.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v30'5 uv5 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 10 removing user index: testx$tenanteduser 2024-02-18T16:21:28.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-02-18T16:21:28.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 93834583065152 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fffd60 con 0x7f2b8c0c7070 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== watch-notify(notify (1) cookie 93834583023040 notify 128849018898 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x7f2b940269c0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2a737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 93834583023040 notifier 4559 bl.length()=167 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(102 notify.3 [notify cookie 93834583065152 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2a737fe640 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f29c40032c0 con 0x7f2b8c0c7070 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== watch-notify(notify_complete (2) cookie 93834583065152 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2b94026c20 con 0x7f2b8c0c7070 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.630+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdd250 con 0x7f2b940141d0 2024-02-18T16:21:28.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2a537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834583029008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fdb340 con 0x555790fc4910 2024-02-18T16:21:28.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93834583029008] v30'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834583010656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd3510 con 0x7f2b8c0c7070 2024-02-18T16:21:28.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93834583010656] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9f2c4980 20 remove_watcher() i=0 2024-02-18T16:21:28.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9f2c4980 2 removed watcher, disabling cache 2024-02-18T16:21:28.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.634+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834583015632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd3510 con 0x555790fc4910 2024-02-18T16:21:28.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.638+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93834583015632] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.638+0000 7f2b9f2c4980 20 remove_watcher() i=1 2024-02-18T16:21:28.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.638+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834583016688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd00d0 con 0x555790fcab60 2024-02-18T16:21:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.638+0000 7f2b9c5de640 1 -- 172.21.15.129:0/3102777261 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93834583016688] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0f8040 con 0x555790fcab60 2024-02-18T16:21:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.638+0000 7f2b9f2c4980 20 remove_watcher() i=2 2024-02-18T16:21:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.638+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834583023040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0570 con 0x7f2b8c0c7070 2024-02-18T16:21:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.642+0000 7f2b9d5e0640 1 -- 172.21.15.129:0/3102777261 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93834583023040] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9403a040 con 0x7f2b8c0c7070 2024-02-18T16:21:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.642+0000 7f2b9f2c4980 20 remove_watcher() i=3 2024-02-18T16:21:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.642+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834583027328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0570 con 0x555790fc4910 2024-02-18T16:21:28.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.642+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93834583027328] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x555790fc4910 2024-02-18T16:21:28.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.642+0000 7f2b9f2c4980 20 remove_watcher() i=4 2024-02-18T16:21:28.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.642+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834583021552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0570 con 0x7f2b940141d0 2024-02-18T16:21:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.646+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93834583021552] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.646+0000 7f2b9f2c4980 20 remove_watcher() i=5 2024-02-18T16:21:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.646+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834583030688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd0570 con 0x7f2b940141d0 2024-02-18T16:21:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.646+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93834583030688] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.646+0000 7f2b9f2c4980 20 remove_watcher() i=6 2024-02-18T16:21:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.646+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834583034320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555790fd2e80 con 0x7f2b940141d0 2024-02-18T16:21:28.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93834583034320] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b90014070 con 0x7f2b940141d0 2024-02-18T16:21:28.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 20 remove_watcher() i=7 2024-02-18T16:21:28.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2b940141d0 msgr2=0x7f2b94015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f2b940141d0 0x7f2b94015940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790fc4910 msgr2=0x555790fc6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790fc4910 0x555790fc6dd0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2b8c0c7070 msgr2=0x7f2b8c0e5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f2b8c0c7070 0x7f2b8c0e5070 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555790fcab60 msgr2=0x555790fcd000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555790fcab60 0x555790fcd000 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a680342b0 msgr2=0x7f2a68036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a680342b0 0x7f2a68036770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b94011010 tx=0x7f2b94020000 comp rx=0 tx=0).stop 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 msgr2=0x555790fb9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb9510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0e3610 tx=0x7f2b8c0e1040 comp rx=0 tx=0).stop 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9cddf640 1 -- 172.21.15.129:0/3102777261 reap_dead start 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 shutdown_connections 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/3102777261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fb25b0 0x555790fb9510 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 >> 172.21.15.129:0/3102777261 conn(0x555790fae940 msgr2=0x555790fabfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 shutdown_connections 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/3102777261 wait complete. 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a740342b0 msgr2=0x7f2a74036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a740342b0 0x7f2a74036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x555790f95b80 tx=0x7f2b94005850 comp rx=0 tx=0).stop 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 msgr2=0x555790fa5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 0x555790fa5a20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ab670 tx=0x7f2b8c018020 comp rx=0 tx=0).stop 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 shutdown_connections 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a740342b0 0x7f2a74036770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/920922597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790fa5600 0x555790fa5a20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 >> 172.21.15.129:0/920922597 conn(0x555790f9a410 msgr2=0x555790f9af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 shutdown_connections 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/920922597 wait complete. 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790ea1860 msgr2=0x555790f94d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790ea1860 0x555790f94d80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a840342b0 msgr2=0x7f2a84036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a840342b0 0x7f2a84036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ad000 tx=0x7f2b8c0a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 msgr2=0x555790f8e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f8e100 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001ee0 tx=0x7f2b90000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 shutdown_connections 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555790ea1860 0x555790f94d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2a840342b0 0x7f2a84036770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 --2- 172.21.15.129:0/833113784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555790e9d360 0x555790f8e100 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 >> 172.21.15.129:0/833113784 conn(0x555790e10a50 msgr2=0x555790f81950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 shutdown_connections 2024-02-18T16:21:28.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.650+0000 7f2b9f2c4980 1 -- 172.21.15.129:0/833113784 wait complete. 2024-02-18T16:21:28.674 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-18T16:21:28.678 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-02-18T16:21:28.724 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:28.725 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-18T16:21:28.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-18T16:21:28.725 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-02-18T16:21:28.763 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:28.763 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:28.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a7b31e980 1 Processor -- start 2024-02-18T16:21:28.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a7b31e980 1 -- start start 2024-02-18T16:21:28.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a7b31e980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a4cd74e560 0x55a4cd750950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a7b31e980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a4cd6974d0 con 0x55a4cd74a050 2024-02-18T16:21:28.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a7b31e980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a4cd65e180 con 0x55a4cd74e560 2024-02-18T16:21:28.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a78638640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a4cd74e560 0x55a4cd750950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a78638640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a4cd74e560 0x55a4cd750950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56012/0 (socket says 172.21.15.129:56012) 2024-02-18T16:21:28.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a78638640 1 -- 172.21.15.129:0/616111509 learned_addr learned my addr 172.21.15.129:0/616111509 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a78638640 1 -- 172.21.15.129:0/616111509 >> v1:172.21.15.80:6789/0 conn(0x55a4cd74a050 legacy=0x55a4cd74a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.758+0000 7f0a78638640 1 -- 172.21.15.129:0/616111509 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4cd751ea0 con 0x55a4cd74e560 2024-02-18T16:21:28.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a78638640 1 --2- 172.21.15.129:0/616111509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74e560 0x55a4cd750950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000a750 tx=0x7f0a6001d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69324d85a6376d3d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a77e37640 1 -- 172.21.15.129:0/616111509 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a6000a200 con 0x55a4cd74e560 2024-02-18T16:21:28.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a77e37640 1 -- 172.21.15.129:0/616111509 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a600a8050 con 0x55a4cd74e560 2024-02-18T16:21:28.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a77e37640 1 -- 172.21.15.129:0/616111509 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600085a0 con 0x55a4cd74e560 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 -- 172.21.15.129:0/616111509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74e560 msgr2=0x55a4cd750950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/616111509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74e560 0x55a4cd750950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000a750 tx=0x7f0a6001d200 comp rx=0 tx=0).stop 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 -- 172.21.15.129:0/616111509 shutdown_connections 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/616111509 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74e560 0x55a4cd750950 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 -- 172.21.15.129:0/616111509 >> 172.21.15.129:0/616111509 conn(0x55a4cd745920 msgr2=0x55a4cd747d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 -- 172.21.15.129:0/616111509 shutdown_connections 2024-02-18T16:21:28.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.762+0000 7f0a7b31e980 1 -- 172.21.15.129:0/616111509 wait complete. 2024-02-18T16:21:28.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 Processor -- start 2024-02-18T16:21:28.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 -- start start 2024-02-18T16:21:28.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd832e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4cd65b6b0 con 0x55a4cd74a050 2024-02-18T16:21:28.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a78e39640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd832e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a78e39640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd832e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56014/0 (socket says 172.21.15.129:56014) 2024-02-18T16:21:28.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a78e39640 1 -- 172.21.15.129:0/1843404632 learned_addr learned my addr 172.21.15.129:0/1843404632 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a78e39640 1 -- 172.21.15.129:0/1843404632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60005df0 con 0x55a4cd74a050 2024-02-18T16:21:28.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a78e39640 1 --2- 172.21.15.129:0/1843404632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd832e60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006fb0 tx=0x7f0a70001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb0dd0c2a3eb3de server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0966e0d640 1 -- 172.21.15.129:0/1843404632 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a7000f640 con 0x55a4cd74a050 2024-02-18T16:21:28.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0966e0d640 1 -- 172.21.15.129:0/1843404632 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7000f7c0 con 0x55a4cd74a050 2024-02-18T16:21:28.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0966e0d640 1 -- 172.21.15.129:0/1843404632 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a7000fae0 con 0x55a4cd74a050 2024-02-18T16:21:28.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1843404632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 msgr2=0x55a4cd832e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/1843404632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd832e60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006fb0 tx=0x7f0a70001940 comp rx=0 tx=0).stop 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1843404632 shutdown_connections 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/1843404632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd832e60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1843404632 >> 172.21.15.129:0/1843404632 conn(0x55a4cd745920 msgr2=0x55a4cd82e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.778+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1843404632 shutdown_connections 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1843404632 wait complete. 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 Processor -- start 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 -- start start 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd839cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4cd656e90 con 0x55a4cd74a050 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a78e39640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd839cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a78e39640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd839cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56022/0 (socket says 172.21.15.129:56022) 2024-02-18T16:21:28.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a78e39640 1 -- 172.21.15.129:0/782853846 learned_addr learned my addr 172.21.15.129:0/782853846 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a78e39640 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4cd6974d0 con 0x55a4cd74a050 2024-02-18T16:21:28.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a78e39640 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd839cd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55a4cd833cf0 tx=0x7f0a70000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f096560a640 1 -- 172.21.15.129:0/782853846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a70005450 con 0x55a4cd74a050 2024-02-18T16:21:28.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a4cd83a210 con 0x55a4cd74a050 2024-02-18T16:21:28.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f096560a640 1 -- 172.21.15.129:0/782853846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700055b0 con 0x55a4cd74a050 2024-02-18T16:21:28.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f096560a640 1 -- 172.21.15.129:0/782853846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a700058b0 con 0x55a4cd74a050 2024-02-18T16:21:28.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4cd83a720 con 0x55a4cd74a050 2024-02-18T16:21:28.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f096560a640 1 -- 172.21.15.129:0/782853846 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0a70005b20 con 0x55a4cd74a050 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f096560a640 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09600342b0 0x7f0960036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f096560a640 1 -- 172.21.15.129:0/782853846 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0a70049210 con 0x55a4cd74a050 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a78638640 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09600342b0 0x7f0960036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd74e560 0x55a4cd8408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.782+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd840e20 con 0x55a4cd74e560 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd74e560 0x55a4cd8408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a78638640 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09600342b0 0x7f0960036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a600ae000 tx=0x7f0a600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd74e560 0x55a4cd8408e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 -- 172.21.15.129:0/782853846 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a680083f0 con 0x55a4cd74e560 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd83e010 con 0x55a4cd74e560 2024-02-18T16:21:28.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 -- 172.21.15.129:0/782853846 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0a680083f0 con 0x55a4cd74e560 2024-02-18T16:21:28.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd842b50 con 0x55a4cd74e560 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 -- 172.21.15.129:0/782853846 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0a680083f0 con 0x55a4cd74e560 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd841d50 con 0x55a4cd74e560 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 -- 172.21.15.129:0/782853846 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0a680083f0 con 0x55a4cd74e560 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd842160 con 0x55a4cd74e560 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7963a640 1 -- 172.21.15.129:0/782853846 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0a68012040 con 0x55a4cd74e560 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 Processor -- start 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 -- start start 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 0x55a4cd851650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a7b31e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4cd5eff20 con 0x55a4cd851230 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a78638640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 0x55a4cd851650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a78638640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 0x55a4cd851650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56034/0 (socket says 172.21.15.129:56034) 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a78638640 1 -- 172.21.15.129:0/1080698369 learned_addr learned my addr 172.21.15.129:0/1080698369 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a78638640 1 -- 172.21.15.129:0/1080698369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4cd851b90 con 0x55a4cd851230 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.786+0000 7f0a78638640 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 0x55a4cd851650 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0a600af040 tx=0x7f0a60019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f095e7fc640 1 -- 172.21.15.129:0/1080698369 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600bd070 con 0x55a4cd851230 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f095e7fc640 1 -- 172.21.15.129:0/1080698369 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a600b8c00 con 0x55a4cd851230 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a4cd851d80 con 0x55a4cd851230 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f095e7fc640 1 -- 172.21.15.129:0/1080698369 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600b8ea0 con 0x55a4cd851230 2024-02-18T16:21:28.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4cd852870 con 0x55a4cd851230 2024-02-18T16:21:28.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f095e7fc640 1 -- 172.21.15.129:0/1080698369 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0a600b6400 con 0x55a4cd851230 2024-02-18T16:21:28.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f095e7fc640 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0950034300 0x7f09500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f095e7fc640 1 -- 172.21.15.129:0/1080698369 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0a600e6f90 con 0x55a4cd851230 2024-02-18T16:21:28.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7963a640 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0950034300 0x7f09500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7b31e980 1 Processor -- start 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7b31e980 1 -- start start 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7963a640 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0950034300 0x7f09500367c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a4cd841790 tx=0x7f0a68003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7b31e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd85e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a7b31e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4cd5e3790 con 0x55a4cd85e1d0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a78638640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd85e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a78638640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd85e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56038/0 (socket says 172.21.15.129:56038) 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a78638640 1 -- 172.21.15.129:0/148661145 learned_addr learned my addr 172.21.15.129:0/148661145 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a78638640 1 -- 172.21.15.129:0/148661145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4cd85ebc0 con 0x55a4cd85e1d0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f0a78638640 1 --2- 172.21.15.129:0/148661145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd85e5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0a600b6000 tx=0x7f0a600c9ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edee9c74e10cdf04 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f094ffff640 1 -- 172.21.15.129:0/148661145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600cabf0 con 0x55a4cd85e1d0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f094ffff640 1 -- 172.21.15.129:0/148661145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a600ca8e0 con 0x55a4cd85e1d0 2024-02-18T16:21:28.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.790+0000 7f094ffff640 1 -- 172.21.15.129:0/148661145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600b6a50 con 0x55a4cd85e1d0 2024-02-18T16:21:28.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/148661145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 msgr2=0x55a4cd85e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/148661145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd85e5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0a600b6000 tx=0x7f0a600c9ab0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/148661145 shutdown_connections 2024-02-18T16:21:28.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/148661145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd85e5f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/148661145 >> 172.21.15.129:0/148661145 conn(0x55a4cd85a560 msgr2=0x55a4cd8585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/148661145 shutdown_connections 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/148661145 wait complete. 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 Processor -- start 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- start start 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd865100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4cd865640 con 0x55a4cd85e1d0 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a78638640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd865100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a78638640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd865100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56046/0 (socket says 172.21.15.129:56046) 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 learned_addr learned my addr 172.21.15.129:0/3837838999 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4cd852870 con 0x55a4cd85e1d0 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a78638640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd865100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0a600b11e0 tx=0x7f0a600e5310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f094e7fc640 1 -- 172.21.15.129:0/3837838999 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600b55c0 con 0x55a4cd85e1d0 2024-02-18T16:21:28.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a4cd865840 con 0x55a4cd85e1d0 2024-02-18T16:21:28.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f094e7fc640 1 -- 172.21.15.129:0/3837838999 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a600b5720 con 0x55a4cd85e1d0 2024-02-18T16:21:28.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f094e7fc640 1 -- 172.21.15.129:0/3837838999 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a600b5a40 con 0x55a4cd85e1d0 2024-02-18T16:21:28.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4cd865c70 con 0x55a4cd85e1d0 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f094e7fc640 1 -- 172.21.15.129:0/3837838999 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0a600e9070 con 0x55a4cd85e1d0 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f094e7fc640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09440342b0 0x7f0944036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.794+0000 7f094e7fc640 1 -- 172.21.15.129:0/3837838999 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0a600df030 con 0x55a4cd85e1d0 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09440342b0 0x7f0944036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd870510 0x55a4cd8729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd873120 con 0x55a4cd870510 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd870510 0x55a4cd8729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09440342b0 0x7f0944036770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a68008fd0 tx=0x7f0a6801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd870510 0x55a4cd8729d0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 realm 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8734f0 con 0x55a4cd870510 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd873d70 con 0x55a4cd870510 2024-02-18T16:21:28.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8740d0 con 0x55a4cd870510 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8748d0 con 0x55a4cd870510 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 20 searching for the correct realm 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a4cd876760 0x55a4cd878bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8792a0 con 0x55a4cd876760 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78638640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a4cd876760 0x55a4cd878bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78638640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a4cd876760 0x55a4cd878bd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78638640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0a600d9040 0x7f0a600d9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8792a0 con 0x7f0a600d9040 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0a600d9040 0x7f0a600d9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0a600d9040 0x7f0a600d9420 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a6802c040 con 0x7f0a600d9040 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0a68027940 0x7f0a680333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:28.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.798+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8792a0 con 0x7f0a68027940 2024-02-18T16:21:28.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0a68027940 0x7f0a680333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:28.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0a68027940 0x7f0a680333c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x7f0a68027940 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8792a0 con 0x55a4cd870510 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8792a0 con 0x55a4cd870510 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x7f0a68027940 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x7f0a68027940 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a600d9040 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a6802c040 con 0x7f0a600d9040 2024-02-18T16:21:28.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd870510 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.802+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x7f0a68027940 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd870510 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a600d9040 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0a6802c040 con 0x7f0a600d9040 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x7f0a68027940 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd870510 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd870510 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0a70023070 con 0x55a4cd870510 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.806+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a600d9040 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a6802c040 con 0x7f0a600d9040 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd870510 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a600d9040 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a6802c040 con 0x7f0a600d9040 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd876760 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a68027940 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x55a4cd870510 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.810+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0a70039040 con 0x7f0a600d9040 2024-02-18T16:21:28.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0a6802c040 con 0x7f0a600d9040 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd875200 con 0x55a4cd870510 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd875a50 con 0x55a4cd870510 2024-02-18T16:21:28.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd875a50 con 0x55a4cd870510 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 zone default found 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 4 Realm: () 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 zonegroup default 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8796e0 con 0x7f0a68027940 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87b120 con 0x55a4cd876760 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87b5b0 con 0x55a4cd876760 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 started sync module instance, tier type = 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87a9a0 con 0x7f0a600d9040 2024-02-18T16:21:28.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94166311216384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87ad50 con 0x7f0a600d9040 2024-02-18T16:21:28.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.814+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87c310 con 0x55a4cd870510 2024-02-18T16:21:28.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94166311216384] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94166311221712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87ad50 con 0x55a4cd870510 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87c990 con 0x55a4cd876760 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94166311221712] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94166311224496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87cd70 con 0x55a4cd876760 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.818+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87d6e0 con 0x7f0a600d9040 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94166311228240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87ddf0 con 0x7f0a600d9040 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87e8c0 con 0x55a4cd870510 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94166311224496] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94166311228240] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94166311232416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87e880 con 0x55a4cd870510 2024-02-18T16:21:28.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.822+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87d9c0 con 0x7f0a68027940 2024-02-18T16:21:28.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94166311232416] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94166311233664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87f140 con 0x7f0a68027940 2024-02-18T16:21:28.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87f980 con 0x7f0a68027940 2024-02-18T16:21:28.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94166311233664] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94166311234720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd87fa90 con 0x7f0a68027940 2024-02-18T16:21:28.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.826+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd880290 con 0x7f0a68027940 2024-02-18T16:21:28.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94166311234720] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94166311238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd880350 con 0x7f0a68027940 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=0 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=1 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=2 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=3 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=4 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=5 2024-02-18T16:21:28.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=6 2024-02-18T16:21:28.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94166311238288] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 20 add_watcher() i=7 2024-02-18T16:21:28.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:28.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd883630 con 0x55a4cd870510 2024-02-18T16:21:28.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.830+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94166311239712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8808e0 con 0x55a4cd870510 2024-02-18T16:21:28.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94166311239712] v30'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f092f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f0a7b31e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:28.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f0a7b31e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:28.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88bca0 con 0x55a4cd870510 2024-02-18T16:21:28.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.834+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88bd20 con 0x7f0a68027940 2024-02-18T16:21:28.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.838+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.838+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88c350 con 0x55a4cd876760 2024-02-18T16:21:28.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.838+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.838+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88cd20 con 0x55a4cd870510 2024-02-18T16:21:28.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.838+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.838+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd889cf0 con 0x7f0a600d9040 2024-02-18T16:21:28.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.842+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.842+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd889cf0 con 0x55a4cd876760 2024-02-18T16:21:28.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.842+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.842+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88df00 con 0x55a4cd870510 2024-02-18T16:21:28.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.842+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.842+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88df00 con 0x7f0a68027940 2024-02-18T16:21:28.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.846+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.846+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88df00 con 0x7f0a600d9040 2024-02-18T16:21:28.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.846+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.846+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88e430 con 0x55a4cd876760 2024-02-18T16:21:28.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.850+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.850+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88de00 con 0x7f0a600d9040 2024-02-18T16:21:28.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.850+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.850+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88efd0 con 0x7f0a68027940 2024-02-18T16:21:28.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.850+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.850+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88efd0 con 0x7f0a600d9040 2024-02-18T16:21:28.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.854+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.854+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88ee90 con 0x7f0a68027940 2024-02-18T16:21:28.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.854+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.854+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88ee90 con 0x55a4cd870510 2024-02-18T16:21:28.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.854+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.854+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88ee90 con 0x55a4cd876760 2024-02-18T16:21:28.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.858+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.858+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f440 con 0x7f0a600d9040 2024-02-18T16:21:28.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.858+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.858+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f330 con 0x55a4cd876760 2024-02-18T16:21:28.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.858+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.858+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f330 con 0x55a4cd870510 2024-02-18T16:21:28.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.862+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.862+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd870510 2024-02-18T16:21:28.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.862+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.862+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x7f0a600d9040 2024-02-18T16:21:28.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.866+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.870+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.875 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.870+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.870+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.870+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x7f0a68027940 2024-02-18T16:21:28.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.874+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.874+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.874+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.874+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x7f0a68027940 2024-02-18T16:21:28.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.874+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.874+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x55a4cd876760 2024-02-18T16:21:28.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.878+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.878+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x7f0a68027940 2024-02-18T16:21:28.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.878+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.878+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88f260 con 0x7f0a600d9040 2024-02-18T16:21:28.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f092e7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 Filter name: none 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0927fff640 20 reqs_thread_entry: start 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd83dae0 con 0x7f0a600d9040 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:28.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 rados->read ofs=0 len=0 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd88aeb0 con 0x55a4cd870510 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(95 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 get_obj_state: octx=0x7f0a70018d00 obj=myfoo:four state=0x55a4cd8abab8 s->prefetch_data=0 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 3.15s0 3:abd0b6c2:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8aca70 con 0x7f0a600d9040 2024-02-18T16:21:28.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(96 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+867 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 10 manifest: total_size = 4 2024-02-18T16:21:28.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.16639983456553306378 2024-02-18T16:21:28.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 get_obj_state: octx=0x7f0a70018d00 obj=myfoo:four state=0x55a4cd8abab8 s->prefetch_data=0 2024-02-18T16:21:28.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 prepare_atomic_modification: state is not atomic. state=0x55a4cd8abab8 2024-02-18T16:21:28.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 2024-02-18T16:21:28.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.882+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b1470 con 0x55a4cd870510 2024-02-18T16:21:28.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.886+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(97 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [stat,call,call] v30'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.886+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 3.15s0 3:abd0b6c2:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b1470 con 0x7f0a600d9040 2024-02-18T16:21:28.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.886+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(98 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1_four [call] v30'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.886+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x55a4cd870510 2024-02-18T16:21:28.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.890+0000 7f092f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:28.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.890+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94166311239712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x55a4cd870510 2024-02-18T16:21:28.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.890+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(99 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [stat,call,call] v30'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.890+0000 7f094ffff640 20 handle_completion(): completion ok for obj=four 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.890+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94166311239712] v30'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.890+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94166311216384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x7f0a600d9040 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94166311216384] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a7b31e980 20 remove_watcher() i=0 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a7b31e980 2 removed watcher, disabling cache 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94166311221712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x55a4cd870510 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94166311221712] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a7b31e980 20 remove_watcher() i=1 2024-02-18T16:21:28.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.894+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94166311224496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x55a4cd876760 2024-02-18T16:21:28.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a78638640 1 -- 172.21.15.129:0/3837838999 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94166311224496] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a600e8030 con 0x55a4cd876760 2024-02-18T16:21:28.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7b31e980 20 remove_watcher() i=2 2024-02-18T16:21:28.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94166311228240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x7f0a600d9040 2024-02-18T16:21:28.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7963a640 1 -- 172.21.15.129:0/3837838999 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94166311228240] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a6803f040 con 0x7f0a600d9040 2024-02-18T16:21:28.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7b31e980 20 remove_watcher() i=3 2024-02-18T16:21:28.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94166311232416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x55a4cd870510 2024-02-18T16:21:28.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94166311232416] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x55a4cd870510 2024-02-18T16:21:28.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7b31e980 20 remove_watcher() i=4 2024-02-18T16:21:28.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.898+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94166311233664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x7f0a68027940 2024-02-18T16:21:28.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.902+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94166311233664] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.902+0000 7f0a7b31e980 20 remove_watcher() i=5 2024-02-18T16:21:28.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.902+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94166311234720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x7f0a68027940 2024-02-18T16:21:28.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.902+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94166311234720] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.902+0000 7f0a7b31e980 20 remove_watcher() i=6 2024-02-18T16:21:28.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.902+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94166311238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4cd8b14f0 con 0x7f0a68027940 2024-02-18T16:21:28.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94166311238288] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0a70040040 con 0x7f0a68027940 2024-02-18T16:21:28.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 20 remove_watcher() i=7 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0a68027940 msgr2=0x7f0a680333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0a68027940 0x7f0a680333c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd870510 msgr2=0x55a4cd8729d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd870510 0x55a4cd8729d0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0a600d9040 msgr2=0x7f0a600d9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f0a600d9040 0x7f0a600d9420 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a4cd876760 msgr2=0x55a4cd878bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a4cd876760 0x55a4cd878bd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09440342b0 msgr2=0x7f0944036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09440342b0 0x7f0944036770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a68008fd0 tx=0x7f0a6801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 msgr2=0x55a4cd865100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a78e39640 1 -- 172.21.15.129:0/3837838999 reap_dead start 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd865100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0a600b11e0 tx=0x7f0a600e5310 comp rx=0 tx=0).stop 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 shutdown_connections 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/3837838999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd85e1d0 0x55a4cd865100 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 >> 172.21.15.129:0/3837838999 conn(0x55a4cd85a560 msgr2=0x55a4cd857bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 shutdown_connections 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/3837838999 wait complete. 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0950034300 msgr2=0x7f09500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0950034300 0x7f09500367c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a4cd841790 tx=0x7f0a68003070 comp rx=0 tx=0).stop 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 msgr2=0x55a4cd851650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 0x55a4cd851650 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0a600af040 tx=0x7f0a60019fa0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 shutdown_connections 2024-02-18T16:21:28.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0950034300 0x7f09500367c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/1080698369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd851230 0x55a4cd851650 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 >> 172.21.15.129:0/1080698369 conn(0x55a4cd846040 msgr2=0x55a4cd846b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 shutdown_connections 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/1080698369 wait complete. 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd74e560 msgr2=0x55a4cd8408e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd74e560 0x55a4cd8408e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09600342b0 msgr2=0x7f0960036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09600342b0 0x7f0960036770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a600ae000 tx=0x7f0a600a7000 comp rx=0 tx=0).stop 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 msgr2=0x55a4cd839cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd839cd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55a4cd833cf0 tx=0x7f0a70000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:28.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 shutdown_connections 2024-02-18T16:21:28.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a4cd74e560 0x55a4cd8408e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f09600342b0 0x7f0960036770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 --2- 172.21.15.129:0/782853846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a4cd74a050 0x55a4cd839cd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:28.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 >> 172.21.15.129:0/782853846 conn(0x55a4cd745920 msgr2=0x55a4cd82d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:28.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 shutdown_connections 2024-02-18T16:21:28.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.906+0000 7f0a7b31e980 1 -- 172.21.15.129:0/782853846 wait complete. 2024-02-18T16:21:28.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-18T16:21:28.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-18T16:21:28.926 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-18T16:21:29.003 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:29.003 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:29.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75cacd7980 1 Processor -- start 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75cacd7980 1 -- start start 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75cacd7980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x555bfe7bc010 0x555bfe7bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75cacd7980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555bfe7094c0 con 0x555bfe7bc930 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75cacd7980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x555bfe6d0180 con 0x555bfe7bc010 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75c87f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x555bfe7bc010 0x555bfe7bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75c7ff1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x555bfe7bc930 0x555bfe7bd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53066/0 (socket says 172.21.15.129:53066) 2024-02-18T16:21:29.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75c7ff1640 1 -- 172.21.15.129:0/1885286999 learned_addr learned my addr 172.21.15.129:0/1885286999 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:29.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75c87f2640 1 -- 172.21.15.129:0/1885286999 >> v1:172.21.15.80:6789/0 conn(0x555bfe7bc930 legacy=0x555bfe7bd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75c87f2640 1 -- 172.21.15.129:0/1885286999 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfe7bdb70 con 0x555bfe7bc010 2024-02-18T16:21:29.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:28.998+0000 7f75c77f0640 1 -- 172.21.15.129:0/1885286999 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129105154 0 0) 0x555bfe7094c0 con 0x555bfe7bc930 2024-02-18T16:21:29.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75c87f2640 1 --2- 172.21.15.129:0/1885286999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe7bc3f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f75b800a420 tx=0x7f75b801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92087c028e290d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75c77f0640 1 -- 172.21.15.129:0/1885286999 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b80aa530 con 0x555bfe7bc010 2024-02-18T16:21:29.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75c77f0640 1 -- 172.21.15.129:0/1885286999 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80a6050 con 0x555bfe7bc010 2024-02-18T16:21:29.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75c77f0640 1 -- 172.21.15.129:0/1885286999 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b80aa7c0 con 0x555bfe7bc010 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 -- 172.21.15.129:0/1885286999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 msgr2=0x555bfe7bc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 --2- 172.21.15.129:0/1885286999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe7bc3f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f75b800a420 tx=0x7f75b801afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 -- 172.21.15.129:0/1885286999 shutdown_connections 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 --2- 172.21.15.129:0/1885286999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe7bc3f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 -- 172.21.15.129:0/1885286999 >> 172.21.15.129:0/1885286999 conn(0x555bfe7b78e0 msgr2=0x555bfe7b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 -- 172.21.15.129:0/1885286999 shutdown_connections 2024-02-18T16:21:29.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.002+0000 7f75cacd7980 1 -- 172.21.15.129:0/1885286999 wait complete. 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 Processor -- start 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- start start 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe730790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfe6cd6b0 con 0x555bfe7bc010 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75c87f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe730790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75c87f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe730790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56064/0 (socket says 172.21.15.129:56064) 2024-02-18T16:21:29.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75c87f2640 1 -- 172.21.15.129:0/3765503206 learned_addr learned my addr 172.21.15.129:0/3765503206 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75c87f2640 1 -- 172.21.15.129:0/3765503206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b800a100 con 0x555bfe7bc010 2024-02-18T16:21:29.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75c87f2640 1 --2- 172.21.15.129:0/3765503206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe730790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f75b80ad040 tx=0x7f75b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23923b5a1cce68e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f74b660c640 1 -- 172.21.15.129:0/3765503206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b80aa6c0 con 0x555bfe7bc010 2024-02-18T16:21:29.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f74b660c640 1 -- 172.21.15.129:0/3765503206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80aa820 con 0x555bfe7bc010 2024-02-18T16:21:29.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f74b660c640 1 -- 172.21.15.129:0/3765503206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b80aaac0 con 0x555bfe7bc010 2024-02-18T16:21:29.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- 172.21.15.129:0/3765503206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 msgr2=0x555bfe730790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 --2- 172.21.15.129:0/3765503206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe730790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f75b80ad040 tx=0x7f75b80033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- 172.21.15.129:0/3765503206 shutdown_connections 2024-02-18T16:21:29.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 --2- 172.21.15.129:0/3765503206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe730790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- 172.21.15.129:0/3765503206 >> 172.21.15.129:0/3765503206 conn(0x555bfe7b78e0 msgr2=0x555bfe8a1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- 172.21.15.129:0/3765503206 shutdown_connections 2024-02-18T16:21:29.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- 172.21.15.129:0/3765503206 wait complete. 2024-02-18T16:21:29.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 Processor -- start 2024-02-18T16:21:29.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- start start 2024-02-18T16:21:29.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe8b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.018+0000 7f75cacd7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfe6c8e90 con 0x555bfe7bc010 2024-02-18T16:21:29.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c87f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe8b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c87f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe8b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56078/0 (socket says 172.21.15.129:56078) 2024-02-18T16:21:29.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c87f2640 1 -- 172.21.15.129:0/2375923134 learned_addr learned my addr 172.21.15.129:0/2375923134 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c87f2640 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfe7bdb70 con 0x555bfe7bc010 2024-02-18T16:21:29.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c87f2640 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe8b02b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f75b8003430 tx=0x7f75b8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f74b4e09640 1 -- 172.21.15.129:0/2375923134 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b80b6950 con 0x555bfe7bc010 2024-02-18T16:21:29.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555bfe8b07f0 con 0x555bfe7bc010 2024-02-18T16:21:29.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f74b4e09640 1 -- 172.21.15.129:0/2375923134 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80b6ab0 con 0x555bfe7bc010 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f74b4e09640 1 -- 172.21.15.129:0/2375923134 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b80b6d50 con 0x555bfe7bc010 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bfe8b0d00 con 0x555bfe7bc010 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f74b4e09640 1 -- 172.21.15.129:0/2375923134 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75b80c0450 con 0x555bfe7bc010 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f74b4e09640 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b0034300 0x7f74b00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f74b4e09640 1 -- 172.21.15.129:0/2375923134 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f75b80e3f30 con 0x555bfe7bc010 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b0034300 0x7f74b00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe7bc930 0x555bfe8b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8b7480 con 0x555bfe7bc930 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe7bc930 0x555bfe8b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b0034300 0x7f74b00367c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75b0000c10 tx=0x7f75b00013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe7bc930 0x555bfe8b6f40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.022+0000 7f75c8ff3640 1 -- 172.21.15.129:0/2375923134 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75c00083f0 con 0x555bfe7bc930 2024-02-18T16:21:29.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8b4650 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c8ff3640 1 -- 172.21.15.129:0/2375923134 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75c00083f0 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8b9200 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c8ff3640 1 -- 172.21.15.129:0/2375923134 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f75c00083f0 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8b8400 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c8ff3640 1 -- 172.21.15.129:0/2375923134 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75c00083f0 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8b8810 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c8ff3640 1 -- 172.21.15.129:0/2375923134 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f75c00121d0 con 0x555bfe7bc930 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 Processor -- start 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- start start 2024-02-18T16:21:29.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 0x555bfe8c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfe661f20 con 0x555bfe8c78a0 2024-02-18T16:21:29.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c7ff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 0x555bfe8c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c7ff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 0x555bfe8c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56080/0 (socket says 172.21.15.129:56080) 2024-02-18T16:21:29.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c7ff1640 1 -- 172.21.15.129:0/1284686124 learned_addr learned my addr 172.21.15.129:0/1284686124 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c7ff1640 1 -- 172.21.15.129:0/1284686124 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfe8c8200 con 0x555bfe8c78a0 2024-02-18T16:21:29.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 0x555bfe8c7cc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f75b000e620 tx=0x7f75b000e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f74adffb640 1 -- 172.21.15.129:0/1284686124 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b001b380 con 0x555bfe8c78a0 2024-02-18T16:21:29.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f74adffb640 1 -- 172.21.15.129:0/1284686124 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b001b4e0 con 0x555bfe8c78a0 2024-02-18T16:21:29.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555bfe8c8450 con 0x555bfe8c78a0 2024-02-18T16:21:29.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f74adffb640 1 -- 172.21.15.129:0/1284686124 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b001b780 con 0x555bfe8c78a0 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.026+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bfe8c8fa0 con 0x555bfe8c78a0 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f74adffb640 1 -- 172.21.15.129:0/1284686124 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75b001a070 con 0x555bfe8c78a0 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f74adffb640 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a0034300 0x7f74a00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f74adffb640 1 -- 172.21.15.129:0/1284686124 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f75b0017050 con 0x555bfe8c78a0 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a0034300 0x7f74a00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 Processor -- start 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- start start 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a0034300 0x7f74a00367c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x555bfe8b7ea0 tx=0x7f75c0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfe655790 con 0x555bfe8d4870 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c7ff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c7ff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8d4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56086/0 (socket says 172.21.15.129:56086) 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c7ff1640 1 -- 172.21.15.129:0/2433738427 learned_addr learned my addr 172.21.15.129:0/2433738427 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c7ff1640 1 -- 172.21.15.129:0/2433738427 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfe8d5240 con 0x555bfe8d4870 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/2433738427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8d4c70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f75b0027030 tx=0x7f75b000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf311202007a8c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f74a77fe640 1 -- 172.21.15.129:0/2433738427 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b0047070 con 0x555bfe8d4870 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f74a77fe640 1 -- 172.21.15.129:0/2433738427 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000d300 con 0x555bfe8d4870 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f74a77fe640 1 -- 172.21.15.129:0/2433738427 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b000d490 con 0x555bfe8d4870 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- 172.21.15.129:0/2433738427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 msgr2=0x555bfe8d4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2433738427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8d4c70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f75b0027030 tx=0x7f75b000ded0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- 172.21.15.129:0/2433738427 shutdown_connections 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2433738427 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8d4c70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- 172.21.15.129:0/2433738427 >> 172.21.15.129:0/2433738427 conn(0x555bfe8d0bb0 msgr2=0x555bfe8cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- 172.21.15.129:0/2433738427 shutdown_connections 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- 172.21.15.129:0/2433738427 wait complete. 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 Processor -- start 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- start start 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8db7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.030+0000 7f75cacd7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bfe8dbd00 con 0x555bfe8d4870 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c7ff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8db7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c7ff1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8db7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56092/0 (socket says 172.21.15.129:56092) 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 learned_addr learned my addr 172.21.15.129:0/4209303766 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bfe8c8fa0 con 0x555bfe8d4870 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8db7c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f75b000eae0 tx=0x7f75b0048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f74a5ffb640 1 -- 172.21.15.129:0/4209303766 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b000d470 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555bfe8dbf00 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f74a5ffb640 1 -- 172.21.15.129:0/4209303766 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b004a300 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f74a5ffb640 1 -- 172.21.15.129:0/4209303766 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b004a470 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bfe8dc330 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f74a5ffb640 1 -- 172.21.15.129:0/4209303766 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f75b0032020 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f74a5ffb640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74980342b0 0x7f7498036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f74a5ffb640 1 -- 172.21.15.129:0/4209303766 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f75b0009050 con 0x555bfe8d4870 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74980342b0 0x7f7498036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe8e6d30 0x555bfe8e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8e9940 con 0x555bfe8e6d30 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c87f2640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe8e6d30 0x555bfe8e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74980342b0 0x7f7498036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75c0008fd0 tx=0x7f75c001d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c87f2640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe8e6d30 0x555bfe8e91f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75b80c6070 con 0x555bfe8e6d30 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 realm 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8e9d10 con 0x555bfe8e6d30 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75b80c6070 con 0x555bfe8e6d30 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ea560 con 0x555bfe8e6d30 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75b80c6070 con 0x555bfe8e6d30 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.034+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ea8c0 con 0x555bfe8e6d30 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75b80c6070 con 0x555bfe8e6d30 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ea200 con 0x555bfe8e6d30 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f75b80c6070 con 0x555bfe8e6d30 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 20 searching for the correct realm 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555bfe8ecb10 0x555bfe8eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555bfe8ecb10 0x555bfe8eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555bfe8ecb10 0x555bfe8eef00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c7ff1640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75b0027060 0x7f75b0027870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75b0027060 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75b0027060 0x7f75b0027870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75b0027060 0x7f75b0027870 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c002d040 con 0x7f75b0027060 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c8ff3640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c0028940 0x7f75c0012420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c87f2640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c0028940 0x7f75c0012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c87f2640 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c0028940 0x7f75c0012420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80c6070 con 0x7f75c0028940 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.038+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75b0027060 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c002d040 con 0x7f75b0027060 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75b0027060 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f75c002d040 con 0x7f75b0027060 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.042+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75b0027060 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c002d040 con 0x7f75b0027060 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.046+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75b0027060 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c002d040 con 0x7f75b0027060 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8ecb10 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75c0028940 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x555bfe8e6d30 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ef5d0 con 0x7f75b0027060 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75c002d040 con 0x7f75b0027060 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:29.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8eb760 con 0x555bfe8e6d30 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8eb3b0 con 0x555bfe8e6d30 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8ec000 con 0x555bfe8e6d30 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:29.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 zone default found 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 4 Realm: () 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 zonegroup default 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8efa30 con 0x7f75c0028940 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f1810 con 0x555bfe8ecb10 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.050+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f1c20 con 0x555bfe8ecb10 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 20 started sync module instance, tier type = 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f10f0 con 0x7f75b0027060 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93853601172560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f14a0 con 0x7f75b0027060 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f2af0 con 0x555bfe8e6d30 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93853601172560] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93853601179216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f2f10 con 0x555bfe8e6d30 2024-02-18T16:21:29.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.054+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f3790 con 0x555bfe8ecb10 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93853601179216] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93853601180544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f3b40 con 0x555bfe8ecb10 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f44b0 con 0x7f75b0027060 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93853601186080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f4c00 con 0x7f75b0027060 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f56b0 con 0x555bfe8e6d30 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.058+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93853601180544] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93853601186080] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93853601190320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f5670 con 0x555bfe8e6d30 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f47d0 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93853601190320] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93853601181664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f5ee0 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.062+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f6760 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.066+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93853601181664] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.066+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.066+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93853601192512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f6940 con 0x7f75c0028940 2024-02-18T16:21:29.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.066+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f7140 con 0x7f75c0028940 2024-02-18T16:21:29.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93853601192512] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93853601196352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f7200 con 0x7f75c0028940 2024-02-18T16:21:29.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=0 2024-02-18T16:21:29.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=1 2024-02-18T16:21:29.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=2 2024-02-18T16:21:29.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=3 2024-02-18T16:21:29.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=4 2024-02-18T16:21:29.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=5 2024-02-18T16:21:29.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=6 2024-02-18T16:21:29.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93853601196352] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 add_watcher() i=7 2024-02-18T16:21:29.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:29.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8fa510 con 0x555bfe8e6d30 2024-02-18T16:21:29.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93853601197776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f7790 con 0x555bfe8e6d30 2024-02-18T16:21:29.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93853601197776] v30'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f747e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:29.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.070+0000 7f75cacd7980 5 note: GC not initialized 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f747d7e2640 20 reqs_thread_entry: start 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 Filter name: none 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f73eeffd640 20 reqs_thread_entry: start 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe91c590 con 0x7f75b0027060 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe91b9f0 con 0x555bfe8e6d30 2024-02-18T16:21:29.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(63 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe91b9a0 con 0x7f75b0027060 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe91dda0 con 0x555bfe8e6d30 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 4.22 4:469ecc78:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe91d830 con 0x555bfe8e6d30 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 4.38 4:1dfd4e12:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe9228c0 con 0x555bfe8e6d30 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 4.28 4:176c8e0f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe9250e0 con 0x555bfe8e6d30 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 4.30 4:0cc5cfbd:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe927aa0 con 0x555bfe8ecb10 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 4.27 4:e50fab02:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe92a380 con 0x555bfe8e6d30 2024-02-18T16:21:29.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 4.19 4:99dba4f1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe92ce50 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 4.20 4:06c226c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe92f7f0 con 0x555bfe8e6d30 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 4.14 4:2b33d095:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe932590 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:74 4.3b 4:df59ffdb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe934f10 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 4.38 4:1d3e2d48:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe937910 con 0x555bfe8e6d30 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:76 4.3b 4:dcfc03a1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe93a740 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(74 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.8 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(67 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(73 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(71 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(70 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(68 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(76 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(72 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(75 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.10 6:0b01f3f3:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe934f10 con 0x7f75c0028940 2024-02-18T16:21:29.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(77 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.074+0000 7f75cacd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f747e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93853601197776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x555bfe8e6d30 2024-02-18T16:21:29.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93853601197776] v30'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93853601172560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x7f75b0027060 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93853601172560] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75cacd7980 20 remove_watcher() i=0 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75cacd7980 2 removed watcher, disabling cache 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.078+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93853601179216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x555bfe8e6d30 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93853601179216] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75cacd7980 20 remove_watcher() i=1 2024-02-18T16:21:29.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93853601180544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x555bfe8ecb10 2024-02-18T16:21:29.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75c7ff1640 1 -- 172.21.15.129:0/4209303766 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93853601180544] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b000c040 con 0x555bfe8ecb10 2024-02-18T16:21:29.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75cacd7980 20 remove_watcher() i=2 2024-02-18T16:21:29.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93853601186080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x7f75b0027060 2024-02-18T16:21:29.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75c8ff3640 1 -- 172.21.15.129:0/4209303766 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93853601186080] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75c0040040 con 0x7f75b0027060 2024-02-18T16:21:29.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75cacd7980 20 remove_watcher() i=3 2024-02-18T16:21:29.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.082+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93853601190320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x555bfe8e6d30 2024-02-18T16:21:29.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.086+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93853601190320] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x555bfe8e6d30 2024-02-18T16:21:29.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.086+0000 7f75cacd7980 20 remove_watcher() i=4 2024-02-18T16:21:29.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.086+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93853601181664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x7f75c0028940 2024-02-18T16:21:29.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.086+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93853601181664] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.086+0000 7f75cacd7980 20 remove_watcher() i=5 2024-02-18T16:21:29.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.086+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93853601192512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x7f75c0028940 2024-02-18T16:21:29.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93853601192512] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 20 remove_watcher() i=6 2024-02-18T16:21:29.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93853601196352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555bfe8f9df0 con 0x7f75c0028940 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93853601196352] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75b80dd080 con 0x7f75c0028940 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 20 remove_watcher() i=7 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c0028940 msgr2=0x7f75c0012420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f75c0028940 0x7f75c0012420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe8e6d30 msgr2=0x555bfe8e91f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe8e6d30 0x555bfe8e91f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75b0027060 msgr2=0x7f75b0027870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f75b0027060 0x7f75b0027870 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555bfe8ecb10 msgr2=0x555bfe8eef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555bfe8ecb10 0x555bfe8eef00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74980342b0 msgr2=0x7f7498036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74980342b0 0x7f7498036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75c0008fd0 tx=0x7f75c001d070 comp rx=0 tx=0).stop 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75c87f2640 1 -- 172.21.15.129:0/4209303766 reap_dead start 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 msgr2=0x555bfe8db7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8db7c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f75b000eae0 tx=0x7f75b0048a20 comp rx=0 tx=0).stop 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 shutdown_connections 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 --2- 172.21.15.129:0/4209303766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8d4870 0x555bfe8db7c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.090+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 >> 172.21.15.129:0/4209303766 conn(0x555bfe8d0bb0 msgr2=0x555bfe8ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 shutdown_connections 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/4209303766 wait complete. 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a0034300 msgr2=0x7f74a00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a0034300 0x7f74a00367c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x555bfe8b7ea0 tx=0x7f75c0003070 comp rx=0 tx=0).stop 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 msgr2=0x555bfe8c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 0x555bfe8c7cc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f75b000e620 tx=0x7f75b000e650 comp rx=0 tx=0).stop 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 shutdown_connections 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74a0034300 0x7f74a00367c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/1284686124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe8c78a0 0x555bfe8c7cc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 >> 172.21.15.129:0/1284686124 conn(0x555bfe8bc6b0 msgr2=0x555bfe8bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 shutdown_connections 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/1284686124 wait complete. 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe7bc930 msgr2=0x555bfe8b6f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe7bc930 0x555bfe8b6f40 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b0034300 msgr2=0x7f74b00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b0034300 0x7f74b00367c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75b0000c10 tx=0x7f75b00013c0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 msgr2=0x555bfe8b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe8b02b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f75b8003430 tx=0x7f75b8019810 comp rx=0 tx=0).stop 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 shutdown_connections 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555bfe7bc930 0x555bfe8b6f40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f74b0034300 0x7f74b00367c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 --2- 172.21.15.129:0/2375923134 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555bfe7bc010 0x555bfe8b02b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 >> 172.21.15.129:0/2375923134 conn(0x555bfe7b78e0 msgr2=0x555bfe8a09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 shutdown_connections 2024-02-18T16:21:29.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.094+0000 7f75cacd7980 1 -- 172.21.15.129:0/2375923134 wait complete. 2024-02-18T16:21:29.108 INFO:teuthology.orchestra.run.smithi129.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"5cf777d6-7609-4766-9b82-6394139fd65a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","marker":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-18T16:21:28.370660Z","creation_time":"2024-02-18T16:21:24.450254Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-18T16:21:29.108 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '5cf777d6-7609-4766-9b82-6394139fd65a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'marker': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-18T16:21:28.370660Z', 'creation_time': '2024-02-18T16:21:24.450254Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-18T16:21:29.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-02-18T16:21:29.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-02-18T16:21:29.109 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-02-18T16:21:29.180 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:29.180 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:29.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b8f32980 1 Processor -- start 2024-02-18T16:21:29.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b8f32980 1 -- start start 2024-02-18T16:21:29.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b8f32980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x56080fe38690 0x56080fecc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b8f32980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56080fe0f4b0 con 0x56080fe399d0 2024-02-18T16:21:29.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b8f32980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x56080fdd6180 con 0x56080fe38690 2024-02-18T16:21:29.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b6a4d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x56080fe399d0 0x56080fe37f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53072/0 (socket says 172.21.15.129:53072) 2024-02-18T16:21:29.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.174+0000 7f73b6a4d640 1 -- 172.21.15.129:0/4184466869 learned_addr learned my addr 172.21.15.129:0/4184466869 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:29.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b624c640 1 --2- 172.21.15.129:0/4184466869 >> v2:172.21.15.80:3300/0 conn(0x56080fe38690 0x56080fecc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b5a4b640 1 -- 172.21.15.129:0/4184466869 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858366703 0 0) 0x56080fe0f4b0 con 0x56080fe399d0 2024-02-18T16:21:29.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b5a4b640 1 -- 172.21.15.129:0/4184466869 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a4001e20 con 0x56080fe399d0 2024-02-18T16:21:29.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b624c640 1 -- 172.21.15.129:0/4184466869 >> v1:172.21.15.80:6789/0 conn(0x56080fe399d0 legacy=0x56080fe37f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b624c640 1 -- 172.21.15.129:0/4184466869 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080fe38aa0 con 0x56080fe38690 2024-02-18T16:21:29.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b624c640 1 --2- 172.21.15.129:0/4184466869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080fecc130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f73a000a480 tx=0x7f73a001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bfd11fb1789adf server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b5a4b640 1 -- 172.21.15.129:0/4184466869 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00aa530 con 0x56080fe38690 2024-02-18T16:21:29.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b5a4b640 1 -- 172.21.15.129:0/4184466869 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00a6050 con 0x56080fe38690 2024-02-18T16:21:29.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b5a4b640 1 -- 172.21.15.129:0/4184466869 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00aa7c0 con 0x56080fe38690 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 -- 172.21.15.129:0/4184466869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 msgr2=0x56080fecc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 --2- 172.21.15.129:0/4184466869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080fecc130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f73a000a480 tx=0x7f73a001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 -- 172.21.15.129:0/4184466869 shutdown_connections 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 --2- 172.21.15.129:0/4184466869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080fecc130 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 -- 172.21.15.129:0/4184466869 >> 172.21.15.129:0/4184466869 conn(0x56080febe9f0 msgr2=0x56080fec0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 -- 172.21.15.129:0/4184466869 shutdown_connections 2024-02-18T16:21:29.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.178+0000 7f73b8f32980 1 -- 172.21.15.129:0/4184466869 wait complete. 2024-02-18T16:21:29.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 Processor -- start 2024-02-18T16:21:29.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- start start 2024-02-18T16:21:29.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffaf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fdd36b0 con 0x56080fe38690 2024-02-18T16:21:29.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b6a4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffaf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b6a4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffaf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56110/0 (socket says 172.21.15.129:56110) 2024-02-18T16:21:29.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b6a4d640 1 -- 172.21.15.129:0/925795372 learned_addr learned my addr 172.21.15.129:0/925795372 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b6a4d640 1 -- 172.21.15.129:0/925795372 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0005d30 con 0x56080fe38690 2024-02-18T16:21:29.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b6a4d640 1 --2- 172.21.15.129:0/925795372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffaf360 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f73a8001c30 tx=0x7f73a800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c7d7a8652204c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f72a4e09640 1 -- 172.21.15.129:0/925795372 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a800e690 con 0x56080fe38690 2024-02-18T16:21:29.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f72a4e09640 1 -- 172.21.15.129:0/925795372 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800e7f0 con 0x56080fe38690 2024-02-18T16:21:29.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f72a4e09640 1 -- 172.21.15.129:0/925795372 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a800eb50 con 0x56080fe38690 2024-02-18T16:21:29.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- 172.21.15.129:0/925795372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 msgr2=0x56080ffaf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 --2- 172.21.15.129:0/925795372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffaf360 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f73a8001c30 tx=0x7f73a800b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- 172.21.15.129:0/925795372 shutdown_connections 2024-02-18T16:21:29.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 --2- 172.21.15.129:0/925795372 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffaf360 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- 172.21.15.129:0/925795372 >> 172.21.15.129:0/925795372 conn(0x56080febe9f0 msgr2=0x56080ffaaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- 172.21.15.129:0/925795372 shutdown_connections 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.194+0000 7f73b8f32980 1 -- 172.21.15.129:0/925795372 wait complete. 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 Processor -- start 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 -- start start 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffb6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fdcee90 con 0x56080fe38690 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b6a4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffb6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b6a4d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffb6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56126/0 (socket says 172.21.15.129:56126) 2024-02-18T16:21:29.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b6a4d640 1 -- 172.21.15.129:0/3368766258 learned_addr learned my addr 172.21.15.129:0/3368766258 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b6a4d640 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4001e20 con 0x56080fe38690 2024-02-18T16:21:29.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b6a4d640 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffb6250 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b710 tx=0x7f73a8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f72a3606640 1 -- 172.21.15.129:0/3368766258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a801f070 con 0x56080fe38690 2024-02-18T16:21:29.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56080ffb6790 con 0x56080fe38690 2024-02-18T16:21:29.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f72a3606640 1 -- 172.21.15.129:0/3368766258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a801a2e0 con 0x56080fe38690 2024-02-18T16:21:29.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f72a3606640 1 -- 172.21.15.129:0/3368766258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a801a820 con 0x56080fe38690 2024-02-18T16:21:29.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56080ffb6c40 con 0x56080fe38690 2024-02-18T16:21:29.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f72a3606640 1 -- 172.21.15.129:0/3368766258 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f73a800a040 con 0x56080fe38690 2024-02-18T16:21:29.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f72a3606640 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f729c0342b0 0x7f729c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f72a3606640 1 -- 172.21.15.129:0/3368766258 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f73a8049810 con 0x56080fe38690 2024-02-18T16:21:29.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b624c640 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f729c0342b0 0x7f729c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080fe399d0 0x56080ffbcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffbd420 con 0x56080fe399d0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.198+0000 7f73b724e640 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080fe399d0 0x56080ffbcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b624c640 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f729c0342b0 0x7f729c036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f73a00ac000 tx=0x7f73a00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b724e640 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080fe399d0 0x56080ffbcee0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b724e640 1 -- 172.21.15.129:0/3368766258 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73b000a4d0 con 0x56080fe399d0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffba5c0 con 0x56080fe399d0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b724e640 1 -- 172.21.15.129:0/3368766258 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f73b000a4d0 con 0x56080fe399d0 2024-02-18T16:21:29.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffbee00 con 0x56080fe399d0 2024-02-18T16:21:29.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b724e640 1 -- 172.21.15.129:0/3368766258 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f73b000a4d0 con 0x56080fe399d0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffbdc60 con 0x56080fe399d0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b724e640 1 -- 172.21.15.129:0/3368766258 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f73b000a4d0 con 0x56080fe399d0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffbe070 con 0x56080fe399d0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b724e640 1 -- 172.21.15.129:0/3368766258 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f73b000a4d0 con 0x56080fe399d0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 Processor -- start 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- start start 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 0x56080ffcdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fd67f20 con 0x56080ffcd740 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b624c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 0x56080ffcdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b624c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 0x56080ffcdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56134/0 (socket says 172.21.15.129:56134) 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b624c640 1 -- 172.21.15.129:0/2715784683 learned_addr learned my addr 172.21.15.129:0/2715784683 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b624c640 1 -- 172.21.15.129:0/2715784683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080ffce0a0 con 0x56080ffcd740 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b624c640 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 0x56080ffcdb60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f73a0096d70 tx=0x7f73a0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f72a0e01640 1 -- 172.21.15.129:0/2715784683 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00b4d40 con 0x56080ffcd740 2024-02-18T16:21:29.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f72a0e01640 1 -- 172.21.15.129:0/2715784683 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00bb040 con 0x56080ffcd740 2024-02-18T16:21:29.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f72a0e01640 1 -- 172.21.15.129:0/2715784683 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00bf3f0 con 0x56080ffcd740 2024-02-18T16:21:29.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.202+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56080ffce290 con 0x56080ffcd740 2024-02-18T16:21:29.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56080ffced80 con 0x56080ffcd740 2024-02-18T16:21:29.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f72a0e01640 1 -- 172.21.15.129:0/2715784683 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f73a00bf550 con 0x56080ffcd740 2024-02-18T16:21:29.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f72a0e01640 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7290034300 0x7f72900367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f72a0e01640 1 -- 172.21.15.129:0/2715784683 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f73a00e5820 con 0x56080ffcd740 2024-02-18T16:21:29.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b724e640 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7290034300 0x7f72900367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 Processor -- start 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- start start 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b724e640 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7290034300 0x7f72900367c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56080ffbe810 tx=0x7f73b0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffdaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080fd5b790 con 0x56080ffda780 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b624c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffdaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b624c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffdaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56138/0 (socket says 172.21.15.129:56138) 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b624c640 1 -- 172.21.15.129:0/737203889 learned_addr learned my addr 172.21.15.129:0/737203889 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b624c640 1 -- 172.21.15.129:0/737203889 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080ffdb170 con 0x56080ffda780 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b624c640 1 --2- 172.21.15.129:0/737203889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffdaba0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f73a00e3b90 tx=0x7f73a00bf800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab5e895ce9a5a69 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f729a7fc640 1 -- 172.21.15.129:0/737203889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00bfb80 con 0x56080ffda780 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f729a7fc640 1 -- 172.21.15.129:0/737203889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00bfce0 con 0x56080ffda780 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f729a7fc640 1 -- 172.21.15.129:0/737203889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00b3370 con 0x56080ffda780 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- 172.21.15.129:0/737203889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 msgr2=0x56080ffdaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 --2- 172.21.15.129:0/737203889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffdaba0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f73a00e3b90 tx=0x7f73a00bf800 comp rx=0 tx=0).stop 2024-02-18T16:21:29.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- 172.21.15.129:0/737203889 shutdown_connections 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 --2- 172.21.15.129:0/737203889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffdaba0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- 172.21.15.129:0/737203889 >> 172.21.15.129:0/737203889 conn(0x56080ffd6b10 msgr2=0x56080ffd4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.206+0000 7f73b8f32980 1 -- 172.21.15.129:0/737203889 shutdown_connections 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 -- 172.21.15.129:0/737203889 wait complete. 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 Processor -- start 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 -- start start 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffe1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080ffe1c50 con 0x56080ffda780 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b624c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffe1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b624c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffe1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56152/0 (socket says 172.21.15.129:56152) 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 learned_addr learned my addr 172.21.15.129:0/1727565880 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56080ffced80 con 0x56080ffda780 2024-02-18T16:21:29.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b624c640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffe1710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f73a00bf840 tx=0x7f73a00e3b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f7298ff9640 1 -- 172.21.15.129:0/1727565880 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00e5a80 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56080ffe1e50 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f7298ff9640 1 -- 172.21.15.129:0/1727565880 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00e2070 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56080ffe2280 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f7298ff9640 1 -- 172.21.15.129:0/1727565880 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73a00e5d10 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f7298ff9640 1 -- 172.21.15.129:0/1727565880 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f73a00a9a40 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f7298ff9640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f72800342b0 0x7f7280036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f7298ff9640 1 -- 172.21.15.129:0/1727565880 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f73a00efcb0 con 0x56080ffda780 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b724e640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f72800342b0 0x7f7280036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080ffecad0 0x56080ffeef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffef6c0 con 0x56080ffecad0 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b6a4d640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080ffecad0 0x56080ffeef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b724e640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f72800342b0 0x7f7280036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f73b0011010 tx=0x7f73b0020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.222 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.210+0000 7f73b6a4d640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080ffecad0 0x56080ffeef70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 realm 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffefa90 con 0x56080ffecad0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff02e0 con 0x56080ffecad0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff0640 con 0x56080ffecad0 2024-02-18T16:21:29.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080ffeff80 con 0x56080ffecad0 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 20 searching for the correct realm 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56080fff2890 0x56080fff4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b624c640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56080fff2890 0x56080fff4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b624c640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56080fff2890 0x56080fff4ca0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b624c640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f73a00ee070 0x7f73a00e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b724e640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f73a00ee070 0x7f73a00e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b724e640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f73a00ee070 0x7f73a00e7110 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4d0 con 0x7f73a00ee070 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b724e640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f73b00141d0 0x7f73b0015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f73b00141d0 0x7f73b0015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.214+0000 7f73b6a4d640 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f73b00141d0 0x7f73b0015940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4d0 con 0x7f73a00ee070 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.218+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x56080ffecad0 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.222+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73a8014070 con 0x7f73b00141d0 2024-02-18T16:21:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff14b0 con 0x56080ffecad0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x56080ffecad0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1e00 con 0x56080ffecad0 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 zone default found 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 4 Realm: () 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 zonegroup default 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5c50 con 0x7f73b00141d0 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff7630 con 0x56080fff2890 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.226+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff7990 con 0x56080fff2890 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 20 started sync module instance, tier type = 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6c00 con 0x7f73a00ee070 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94592628125616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6c00 con 0x7f73a00ee070 2024-02-18T16:21:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff83e0 con 0x56080ffecad0 2024-02-18T16:21:29.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94592628125616] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94592628123488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff83a0 con 0x56080ffecad0 2024-02-18T16:21:29.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.230+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff8d80 con 0x56080fff2890 2024-02-18T16:21:29.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94592628132000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff9580 con 0x56080fff2890 2024-02-18T16:21:29.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff9fd0 con 0x7f73a00ee070 2024-02-18T16:21:29.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94592628123488] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94592628136624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffa380 con 0x7f73a00ee070 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffad30 con 0x56080ffecad0 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94592628132000] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.234+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94592628136624] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94592628129536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffa850 con 0x56080ffecad0 2024-02-18T16:21:29.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffb580 con 0x7f73b00141d0 2024-02-18T16:21:29.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94592628129536] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94592628134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffb2a0 con 0x7f73b00141d0 2024-02-18T16:21:29.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.238+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffbaa0 con 0x7f73b00141d0 2024-02-18T16:21:29.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94592628134112] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94592628141568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffb950 con 0x7f73b00141d0 2024-02-18T16:21:29.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffc460 con 0x7f73b00141d0 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94592628146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffc8c0 con 0x7f73b00141d0 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=0 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=1 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=2 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=3 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=4 2024-02-18T16:21:29.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=5 2024-02-18T16:21:29.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94592628141568] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.242+0000 7f73b8f32980 20 add_watcher() i=6 2024-02-18T16:21:29.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94592628146112] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 20 add_watcher() i=7 2024-02-18T16:21:29.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:29.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffb4b0 con 0x56080ffecad0 2024-02-18T16:21:29.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94592628147168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fffb4e0 con 0x56080ffecad0 2024-02-18T16:21:29.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94592628147168] v30'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f726d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 5 note: GC not initialized 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f71e7fff640 20 reqs_thread_entry: start 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 20 Filter name: none 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f71e5ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:29.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.246+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560810020ea0 con 0x7f73b00141d0 2024-02-18T16:21:29.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x7f73b00141d0 2024-02-18T16:21:29.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x56080fff2890 2024-02-18T16:21:29.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x7f73b00141d0 2024-02-18T16:21:29.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73a80590c0 con 0x7f73b00141d0 2024-02-18T16:21:29.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x56080ffecad0 2024-02-18T16:21:29.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x7f73a00ee070 2024-02-18T16:21:29.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.250+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'18 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'18 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f73a00da070 con 0x56080fff2890 2024-02-18T16:21:29.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f73a80590c0 con 0x56080ffecad0 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f73a8063130 con 0x56080ffecad0 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.254+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f73a8063130 con 0x56080ffecad0 2024-02-18T16:21:29.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73a8063130 con 0x7f73b00141d0 2024-02-18T16:21:29.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73a8063130 con 0x7f73b00141d0 2024-02-18T16:21:29.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080fff2890 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x56080ffecad0 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f73a8063130 con 0x56080ffecad0 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73a00ee070 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.258+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff5370 con 0x7f73b00141d0 2024-02-18T16:21:29.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.262+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'20 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f73a8063130 con 0x7f73b00141d0 2024-02-18T16:21:29.267 INFO:teuthology.orchestra.run.smithi129.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-02-18T16:21:29.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.262+0000 7f726d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.262+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94592628147168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x56080ffecad0 2024-02-18T16:21:29.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.262+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94592628147168] v30'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f73a8063130 con 0x56080ffecad0 2024-02-18T16:21:29.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.262+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94592628125616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff1130 con 0x7f73a00ee070 2024-02-18T16:21:29.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94592628125616] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b8f32980 20 remove_watcher() i=0 2024-02-18T16:21:29.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b8f32980 2 removed watcher, disabling cache 2024-02-18T16:21:29.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94592628123488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6fb0 con 0x56080ffecad0 2024-02-18T16:21:29.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94592628123488] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a8063130 con 0x56080ffecad0 2024-02-18T16:21:29.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b8f32980 20 remove_watcher() i=1 2024-02-18T16:21:29.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.266+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94592628132000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6760 con 0x56080fff2890 2024-02-18T16:21:29.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b624c640 1 -- 172.21.15.129:0/1727565880 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94592628132000] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a0116040 con 0x56080fff2890 2024-02-18T16:21:29.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b8f32980 20 remove_watcher() i=2 2024-02-18T16:21:29.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94592628136624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6fb0 con 0x7f73a00ee070 2024-02-18T16:21:29.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b724e640 1 -- 172.21.15.129:0/1727565880 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94592628136624] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73b003a040 con 0x7f73a00ee070 2024-02-18T16:21:29.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b8f32980 20 remove_watcher() i=3 2024-02-18T16:21:29.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94592628129536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff9ab0 con 0x56080ffecad0 2024-02-18T16:21:29.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94592628129536] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a8063130 con 0x56080ffecad0 2024-02-18T16:21:29.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b8f32980 20 remove_watcher() i=4 2024-02-18T16:21:29.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.270+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94592628134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6fb0 con 0x7f73b00141d0 2024-02-18T16:21:29.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.274+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94592628134112] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a8063130 con 0x7f73b00141d0 2024-02-18T16:21:29.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.274+0000 7f73b8f32980 20 remove_watcher() i=5 2024-02-18T16:21:29.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.274+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94592628141568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff7f00 con 0x7f73b00141d0 2024-02-18T16:21:29.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.274+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94592628141568] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a8063130 con 0x7f73b00141d0 2024-02-18T16:21:29.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.274+0000 7f73b8f32980 20 remove_watcher() i=6 2024-02-18T16:21:29.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.274+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94592628146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56080fff6fb0 con 0x7f73b00141d0 2024-02-18T16:21:29.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94592628146112] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73a8063130 con 0x7f73b00141d0 2024-02-18T16:21:29.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 20 remove_watcher() i=7 2024-02-18T16:21:29.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f73b00141d0 msgr2=0x7f73b0015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f73b00141d0 0x7f73b0015940 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080ffecad0 msgr2=0x56080ffeef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080ffecad0 0x56080ffeef70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f73a00ee070 msgr2=0x7f73a00e7110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f73a00ee070 0x7f73a00e7110 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56080fff2890 msgr2=0x56080fff4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x56080fff2890 0x56080fff4ca0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f72800342b0 msgr2=0x7f7280036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f72800342b0 0x7f7280036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f73b0011010 tx=0x7f73b0020000 comp rx=0 tx=0).stop 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b6a4d640 1 -- 172.21.15.129:0/1727565880 reap_dead start 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 msgr2=0x56080ffe1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffe1710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f73a00bf840 tx=0x7f73a00e3b20 comp rx=0 tx=0).stop 2024-02-18T16:21:29.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 shutdown_connections 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/1727565880 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffda780 0x56080ffe1710 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 >> 172.21.15.129:0/1727565880 conn(0x56080ffd6b10 msgr2=0x56080ffd4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 shutdown_connections 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/1727565880 wait complete. 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7290034300 msgr2=0x7f72900367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7290034300 0x7f72900367c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56080ffbe810 tx=0x7f73b0005850 comp rx=0 tx=0).stop 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 msgr2=0x56080ffcdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 0x56080ffcdb60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f73a0096d70 tx=0x7f73a0018020 comp rx=0 tx=0).stop 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 shutdown_connections 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7290034300 0x7f72900367c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/2715784683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080ffcd740 0x56080ffcdb60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 >> 172.21.15.129:0/2715784683 conn(0x56080ffc2550 msgr2=0x56080ffc3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 shutdown_connections 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/2715784683 wait complete. 2024-02-18T16:21:29.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080fe399d0 msgr2=0x56080ffbcee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080fe399d0 0x56080ffbcee0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f729c0342b0 msgr2=0x7f729c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f729c0342b0 0x7f729c036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f73a00ac000 tx=0x7f73a00a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 msgr2=0x56080ffb6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffb6250 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b710 tx=0x7f73a8000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 shutdown_connections 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x56080fe399d0 0x56080ffbcee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f729c0342b0 0x7f729c036770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 --2- 172.21.15.129:0/3368766258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x56080fe38690 0x56080ffb6250 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 >> 172.21.15.129:0/3368766258 conn(0x56080febe9f0 msgr2=0x56080ffa9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 shutdown_connections 2024-02-18T16:21:29.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.278+0000 7f73b8f32980 1 -- 172.21.15.129:0/3368766258 wait complete. 2024-02-18T16:21:29.293 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-02-18T16:21:29.294 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-18T16:21:29.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-18T16:21:29.294 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-18T16:21:29.368 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:29.369 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:29.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.362+0000 7fc08151a980 1 Processor -- start 2024-02-18T16:21:29.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.362+0000 7fc08151a980 1 -- start start 2024-02-18T16:21:29.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.362+0000 7fc08151a980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e5631e5150 0x55e5631e3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.362+0000 7fc08151a980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e5631bb4c0 con 0x55e5631e3c40 2024-02-18T16:21:29.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.362+0000 7fc08151a980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e563182180 con 0x55e5631e5150 2024-02-18T16:21:29.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.366+0000 7fc07f035640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e5631e5150 0x55e5631e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.366+0000 7fc07e834640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55e5631e3c40 0x55e56327b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53076/0 (socket says 172.21.15.129:53076) 2024-02-18T16:21:29.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.366+0000 7fc07e834640 1 -- 172.21.15.129:0/307136131 learned_addr learned my addr 172.21.15.129:0/307136131 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:29.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.366+0000 7fc07f035640 1 -- 172.21.15.129:0/307136131 >> v1:172.21.15.80:6789/0 conn(0x55e5631e3c40 legacy=0x55e56327b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.366+0000 7fc07e033640 1 -- 172.21.15.129:0/307136131 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248640734 0 0) 0x55e5631bb4c0 con 0x55e5631e3c40 2024-02-18T16:21:29.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.366+0000 7fc07f035640 1 -- 172.21.15.129:0/307136131 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e563272d60 con 0x55e5631e5150 2024-02-18T16:21:29.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc07f035640 1 --2- 172.21.15.129:0/307136131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e5150 0x55e5631e3700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc07000a420 tx=0x7fc07001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688a9e84273111a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc07e033640 1 -- 172.21.15.129:0/307136131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0700a3cb0 con 0x55e5631e5150 2024-02-18T16:21:29.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc07e033640 1 -- 172.21.15.129:0/307136131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0700a3e10 con 0x55e5631e5150 2024-02-18T16:21:29.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc07e033640 1 -- 172.21.15.129:0/307136131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0700ab570 con 0x55e5631e5150 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 -- 172.21.15.129:0/307136131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e5150 msgr2=0x55e5631e3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 --2- 172.21.15.129:0/307136131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e5150 0x55e5631e3700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc07000a420 tx=0x7fc07001afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 -- 172.21.15.129:0/307136131 shutdown_connections 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 --2- 172.21.15.129:0/307136131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e5150 0x55e5631e3700 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 -- 172.21.15.129:0/307136131 >> 172.21.15.129:0/307136131 conn(0x55e56326aa40 msgr2=0x55e56326ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 -- 172.21.15.129:0/307136131 shutdown_connections 2024-02-18T16:21:29.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.370+0000 7fc08151a980 1 -- 172.21.15.129:0/307136131 wait complete. 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc08151a980 1 Processor -- start 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc08151a980 1 -- start start 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc08151a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e56335fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc08151a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56317f6b0 con 0x55e5631e3c40 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc07f035640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e56335fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc07f035640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e56335fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56174/0 (socket says 172.21.15.129:56174) 2024-02-18T16:21:29.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.382+0000 7fc07f035640 1 -- 172.21.15.129:0/3052740432 learned_addr learned my addr 172.21.15.129:0/3052740432 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 -- 172.21.15.129:0/3052740432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07000a100 con 0x55e5631e3c40 2024-02-18T16:21:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 --2- 172.21.15.129:0/3052740432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e56335fd90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc070017be0 tx=0x7fc0700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d64b69a08900381 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fbf6d60a640 1 -- 172.21.15.129:0/3052740432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0700ab570 con 0x55e5631e3c40 2024-02-18T16:21:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fbf6d60a640 1 -- 172.21.15.129:0/3052740432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0700ab6d0 con 0x55e5631e3c40 2024-02-18T16:21:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fbf6d60a640 1 -- 172.21.15.129:0/3052740432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0700ab990 con 0x55e5631e3c40 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/3052740432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 msgr2=0x55e56335fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 --2- 172.21.15.129:0/3052740432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e56335fd90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc070017be0 tx=0x7fc0700033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/3052740432 shutdown_connections 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 --2- 172.21.15.129:0/3052740432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e56335fd90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/3052740432 >> 172.21.15.129:0/3052740432 conn(0x55e56326aa40 msgr2=0x55e56335b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/3052740432 shutdown_connections 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/3052740432 wait complete. 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 Processor -- start 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- start start 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e563366b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56317ae90 con 0x55e5631e3c40 2024-02-18T16:21:29.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e563366b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e563366b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56184/0 (socket says 172.21.15.129:56184) 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 -- 172.21.15.129:0/784014266 learned_addr learned my addr 172.21.15.129:0/784014266 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e563272d60 con 0x55e5631e3c40 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc07f035640 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e563366b20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc07001b010 tx=0x7fc070017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fbf6be07640 1 -- 172.21.15.129:0/784014266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0700b4680 con 0x55e5631e3c40 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e563367060 con 0x55e5631e3c40 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fbf6be07640 1 -- 172.21.15.129:0/784014266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0700c2070 con 0x55e5631e3c40 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fbf6be07640 1 -- 172.21.15.129:0/784014266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0700b4930 con 0x55e5631e3c40 2024-02-18T16:21:29.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.386+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e563367510 con 0x55e5631e3c40 2024-02-18T16:21:29.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fbf6be07640 1 -- 172.21.15.129:0/784014266 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc0700c4030 con 0x55e5631e3c40 2024-02-18T16:21:29.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fbf6be07640 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf64034300 0x7fbf640367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fbf6be07640 1 -- 172.21.15.129:0/784014266 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc0700e3cb0 con 0x55e5631e3c40 2024-02-18T16:21:29.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07e834640 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf64034300 0x7fbf640367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e5631e5150 0x55e56336d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e56336dc50 con 0x55e5631e5150 2024-02-18T16:21:29.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e5631e5150 0x55e56336d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07e834640 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf64034300 0x7fbf640367c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc074000c10 tx=0x7fc0740013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e5631e5150 0x55e56336d710 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 -- 172.21.15.129:0/784014266 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0780083f0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e56336e020 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 -- 172.21.15.129:0/784014266 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0780083f0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e56336f8b0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 -- 172.21.15.129:0/784014266 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc0780083f0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e56336eab0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 -- 172.21.15.129:0/784014266 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0780083f0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e56336eec0 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc07f836640 1 -- 172.21.15.129:0/784014266 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc078012040 con 0x55e5631e5150 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 Processor -- start 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- start start 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 0x55e56337e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.390+0000 7fc08151a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563113f20 con 0x55e56337df40 2024-02-18T16:21:29.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 0x55e56337e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 0x55e56337e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56190/0 (socket says 172.21.15.129:56190) 2024-02-18T16:21:29.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 -- 172.21.15.129:0/3816497696 learned_addr learned my addr 172.21.15.129:0/3816497696 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 -- 172.21.15.129:0/3816497696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e56337e8a0 con 0x55e56337df40 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 0x55e56337e360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc07400e620 tx=0x7fc07400e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fbf69602640 1 -- 172.21.15.129:0/3816497696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc07401b380 con 0x55e56337df40 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fbf69602640 1 -- 172.21.15.129:0/3816497696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07401b4e0 con 0x55e56337df40 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e56337eaf0 con 0x55e56337df40 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fbf69602640 1 -- 172.21.15.129:0/3816497696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc07401b780 con 0x55e56337df40 2024-02-18T16:21:29.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e56337f640 con 0x55e56337df40 2024-02-18T16:21:29.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fbf69602640 1 -- 172.21.15.129:0/3816497696 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc07401a070 con 0x55e56337df40 2024-02-18T16:21:29.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fbf69602640 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf580342b0 0x7fbf58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fbf69602640 1 -- 172.21.15.129:0/3816497696 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc074017050 con 0x55e56337df40 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07f836640 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf580342b0 0x7fbf58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc08151a980 1 Processor -- start 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc08151a980 1 -- start start 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc08151a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e56338b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc08151a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563107790 con 0x55e56338af20 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07f836640 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf580342b0 0x7fbf58036770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e56336e4f0 tx=0x7fc078003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e56338b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e56338b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56194/0 (socket says 172.21.15.129:56194) 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.394+0000 7fc07e834640 1 -- 172.21.15.129:0/4202109862 learned_addr learned my addr 172.21.15.129:0/4202109862 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 -- 172.21.15.129:0/4202109862 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e56338b910 con 0x55e56338af20 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 --2- 172.21.15.129:0/4202109862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e56338b340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc074027030 tx=0x7fc07400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e35aeaad3e8be6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fbf62ffd640 1 -- 172.21.15.129:0/4202109862 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc074047070 con 0x55e56338af20 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fbf62ffd640 1 -- 172.21.15.129:0/4202109862 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07400d300 con 0x55e56338af20 2024-02-18T16:21:29.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fbf62ffd640 1 -- 172.21.15.129:0/4202109862 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc07401bc60 con 0x55e56338af20 2024-02-18T16:21:29.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/4202109862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 msgr2=0x55e56338b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 --2- 172.21.15.129:0/4202109862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e56338b340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc074027030 tx=0x7fc07400ded0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/4202109862 shutdown_connections 2024-02-18T16:21:29.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 --2- 172.21.15.129:0/4202109862 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e56338b340 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/4202109862 >> 172.21.15.129:0/4202109862 conn(0x55e563387260 msgr2=0x55e5633852c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/4202109862 shutdown_connections 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/4202109862 wait complete. 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 Processor -- start 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- start start 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e563391e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563392380 con 0x55e56338af20 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e563391e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e563391e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56196/0 (socket says 172.21.15.129:56196) 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 learned_addr learned my addr 172.21.15.129:0/232299215 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e56337f640 con 0x55e56338af20 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc07e834640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e563391e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc07403c040 tx=0x7fc074048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fbf617fa640 1 -- 172.21.15.129:0/232299215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc074048e80 con 0x55e56338af20 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e563392580 con 0x55e56338af20 2024-02-18T16:21:29.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fbf617fa640 1 -- 172.21.15.129:0/232299215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07400d470 con 0x55e56338af20 2024-02-18T16:21:29.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5633929b0 con 0x55e56338af20 2024-02-18T16:21:29.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.398+0000 7fbf617fa640 1 -- 172.21.15.129:0/232299215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc07404a300 con 0x55e56338af20 2024-02-18T16:21:29.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fbf617fa640 1 -- 172.21.15.129:0/232299215 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc074032020 con 0x55e56338af20 2024-02-18T16:21:29.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fbf617fa640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf48034300 0x7fbf480367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fbf617fa640 1 -- 172.21.15.129:0/232299215 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc074009050 con 0x55e56338af20 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f836640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf48034300 0x7fbf480367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e56339d3f0 0x55e56339f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a0000 con 0x55e56339d3f0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e56339d3f0 0x55e56339f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f836640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf48034300 0x7fbf480367c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc078008fd0 tx=0x7fc07801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e56339d3f0 0x55e56339f8b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 realm 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a03d0 con 0x55e56339d3f0 2024-02-18T16:21:29.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a0c50 con 0x55e56339d3f0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a0fb0 con 0x55e56339d3f0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a17b0 con 0x55e56339d3f0 2024-02-18T16:21:29.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 20 searching for the correct realm 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e5633a3640 0x55e5633a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07e834640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e5633a3640 0x55e5633a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07e834640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e5633a3640 0x55e5633a5ad0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07e834640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc074027060 0x7fc074024900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc074027060 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f836640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc074027060 0x7fc074024900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.402+0000 7fc07f836640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc074027060 0x7fc074024900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07802c040 con 0x7fc074027060 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f836640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc078027940 0x7fc0780333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc078027940 0x7fc0780333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc078027940 0x7fc0780333c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc074027060 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07802c040 con 0x7fc074027060 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.406+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc074027060 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc07802c040 con 0x7fc074027060 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.410+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc074027060 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07802c040 con 0x7fc074027060 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x55e56339d3f0 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700c6430 con 0x7fc078027940 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc074027060 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07802c040 con 0x7fc074027060 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e5633a3640 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc078027940 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.414+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x55e56339d3f0 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a61a0 con 0x7fc074027060 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc07802c040 con 0x7fc074027060 2024-02-18T16:21:29.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a20e0 con 0x55e56339d3f0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a2930 con 0x55e56339d3f0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a65e0 con 0x55e56339d3f0 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 zone default found 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 4 Realm: () 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 zonegroup default 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a6650 con 0x7fc078027940 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a8430 con 0x55e5633a3640 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a87c0 con 0x55e5633a3640 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 started sync module instance, tier type = 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:29.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a7d10 con 0x7fc074027060 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443700648048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a80c0 con 0x7fc074027060 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.418+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a9520 con 0x55e56339d3f0 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443700648048] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443700653024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a94e0 con 0x55e56339d3f0 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a9f90 con 0x55e5633a3640 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443700656784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633aa7e0 con 0x55e5633a3640 2024-02-18T16:21:29.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.422+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ab190 con 0x7fc074027060 2024-02-18T16:21:29.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443700653024] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443700654080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ab540 con 0x7fc074027060 2024-02-18T16:21:29.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633abef0 con 0x55e56339d3f0 2024-02-18T16:21:29.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443700656784] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443700654080] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443700661424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633aba10 con 0x55e56339d3f0 2024-02-18T16:21:29.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.426+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ac740 con 0x7fc078027940 2024-02-18T16:21:29.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443700661424] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443700659008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ac460 con 0x7fc078027940 2024-02-18T16:21:29.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633acc60 con 0x7fc078027940 2024-02-18T16:21:29.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443700659008] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443700666576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633aca90 con 0x7fc078027940 2024-02-18T16:21:29.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.430+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ad530 con 0x7fc078027940 2024-02-18T16:21:29.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443700666576] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443700670480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ad4f0 con 0x7fc078027940 2024-02-18T16:21:29.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=0 2024-02-18T16:21:29.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=1 2024-02-18T16:21:29.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=2 2024-02-18T16:21:29.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=3 2024-02-18T16:21:29.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=4 2024-02-18T16:21:29.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=5 2024-02-18T16:21:29.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=6 2024-02-18T16:21:29.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443700670480] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 20 add_watcher() i=7 2024-02-18T16:21:29.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:29.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633b0940 con 0x55e56339d3f0 2024-02-18T16:21:29.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.434+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443700667696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633adde0 con 0x55e56339d3f0 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443700667696] v30'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fbf35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 5 note: GC not initialized 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fbf34fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 Filter name: none 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fbeae7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:29.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633d2890 con 0x55e56339d3f0 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633d4c50 con 0x7fc074027060 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 disabling bucket name=myfoo 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633d2c30 con 0x7fc074027060 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:29.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-18T16:21:29.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:29.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:29.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633d54a0 con 0x55e56339d3f0 2024-02-18T16:21:29.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:29.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:29.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:29.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:29.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633dcca0 con 0x55e56339d3f0 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'8 uv8 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.438+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94443700836656 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633da530 con 0x55e56339d3f0 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== watch-notify(notify (1) cookie 94443700653024 notify 128849018905 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55e563367510 con 0x55e56339d3f0 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018905 cookie 94443700653024 notifier 4587 bl.length()=725 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:29.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(67 notify.1 [notify cookie 94443700836656 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbf44003ea0 con 0x55e56339d3f0 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== watch-notify(notify_complete (2) cookie 94443700836656 notify 128849018905 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e563367060 con 0x55e56339d3f0 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_sources= new_sources= 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential sources added=[] removed=[] 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_dests= new_dests= 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential dests added=[] removed=[] 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633d7d90 con 0x55e56339d3f0 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v30'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:29.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94443700854928 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633da4b0 con 0x55e56339d3f0 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== watch-notify(notify (1) cookie 94443700661424 notify 128849018906 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55e563367060 con 0x55e56339d3f0 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018906 cookie 94443700661424 notifier 4587 bl.length()=533 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(70 notify.4 [notify cookie 94443700854928 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf62ffd640 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbf44004200 con 0x55e56339d3f0 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== watch-notify(notify_complete (2) cookie 94443700854928 notify 128849018906 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc0700cb030 con 0x55e56339d3f0 2024-02-18T16:21:29.451 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:29.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fbf35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.442+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443700667696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633b0880 con 0x55e56339d3f0 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94443700667696] v30'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443700648048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ac530 con 0x7fc074027060 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94443700648048] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc08151a980 20 remove_watcher() i=0 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc08151a980 2 removed watcher, disabling cache 2024-02-18T16:21:29.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443700653024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a2930 con 0x55e56339d3f0 2024-02-18T16:21:29.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94443700653024] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc08151a980 20 remove_watcher() i=1 2024-02-18T16:21:29.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.446+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443700656784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633a2930 con 0x55e5633a3640 2024-02-18T16:21:29.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.450+0000 7fc07e834640 1 -- 172.21.15.129:0/232299215 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94443700656784] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07400c040 con 0x55e5633a3640 2024-02-18T16:21:29.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.450+0000 7fc08151a980 20 remove_watcher() i=2 2024-02-18T16:21:29.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.450+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443700654080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ac530 con 0x7fc074027060 2024-02-18T16:21:29.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.450+0000 7fc07f836640 1 -- 172.21.15.129:0/232299215 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94443700654080] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc07803f040 con 0x7fc074027060 2024-02-18T16:21:29.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.450+0000 7fc08151a980 20 remove_watcher() i=3 2024-02-18T16:21:29.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.450+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443700661424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ac530 con 0x55e56339d3f0 2024-02-18T16:21:29.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.454+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94443700661424] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x55e56339d3f0 2024-02-18T16:21:29.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.454+0000 7fc08151a980 20 remove_watcher() i=4 2024-02-18T16:21:29.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.454+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443700659008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633aacb0 con 0x7fc078027940 2024-02-18T16:21:29.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.454+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94443700659008] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.454+0000 7fc08151a980 20 remove_watcher() i=5 2024-02-18T16:21:29.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.454+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443700666576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633ac530 con 0x7fc078027940 2024-02-18T16:21:29.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94443700666576] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.463 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 20 remove_watcher() i=6 2024-02-18T16:21:29.463 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443700670480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e5633aacb0 con 0x7fc078027940 2024-02-18T16:21:29.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94443700670480] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0700f3040 con 0x7fc078027940 2024-02-18T16:21:29.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 20 remove_watcher() i=7 2024-02-18T16:21:29.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc078027940 msgr2=0x7fc0780333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc078027940 0x7fc0780333c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e56339d3f0 msgr2=0x55e56339f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e56339d3f0 0x55e56339f8b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc074027060 msgr2=0x7fc074024900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc074027060 0x7fc074024900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e5633a3640 msgr2=0x55e5633a5ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e5633a3640 0x55e5633a5ad0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf48034300 msgr2=0x7fbf480367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf48034300 0x7fbf480367c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc078008fd0 tx=0x7fc07801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 msgr2=0x55e563391e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e563391e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc07403c040 tx=0x7fc074048a20 comp rx=0 tx=0).stop 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc07f035640 1 -- 172.21.15.129:0/232299215 reap_dead start 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 shutdown_connections 2024-02-18T16:21:29.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/232299215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56338af20 0x55e563391e40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 >> 172.21.15.129:0/232299215 conn(0x55e563387260 msgr2=0x55e5633848e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 shutdown_connections 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/232299215 wait complete. 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf580342b0 msgr2=0x7fbf58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf580342b0 0x7fbf58036770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e56336e4f0 tx=0x7fc078003070 comp rx=0 tx=0).stop 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 msgr2=0x55e56337e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 0x55e56337e360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc07400e620 tx=0x7fc07400e650 comp rx=0 tx=0).stop 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 shutdown_connections 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf580342b0 0x7fbf58036770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/3816497696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e56337df40 0x55e56337e360 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 >> 172.21.15.129:0/3816497696 conn(0x55e563372d80 msgr2=0x55e563373890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 shutdown_connections 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/3816497696 wait complete. 2024-02-18T16:21:29.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e5631e5150 msgr2=0x55e56336d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.458+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e5631e5150 0x55e56336d710 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf64034300 msgr2=0x7fbf640367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf64034300 0x7fbf640367c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc074000c10 tx=0x7fc0740013c0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 msgr2=0x55e563366b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e563366b20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc07001b010 tx=0x7fc070017d70 comp rx=0 tx=0).stop 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 shutdown_connections 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e5631e5150 0x55e56336d710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbf64034300 0x7fbf640367c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 --2- 172.21.15.129:0/784014266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e5631e3c40 0x55e563366b20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 >> 172.21.15.129:0/784014266 conn(0x55e56326aa40 msgr2=0x55e56335a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 shutdown_connections 2024-02-18T16:21:29.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.462+0000 7fc08151a980 1 -- 172.21.15.129:0/784014266 wait complete. 2024-02-18T16:21:29.475 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:29.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-18T16:21:29.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-18T16:21:29.477 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-18T16:21:29.548 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fd035980 1 Processor -- start 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fd035980 1 -- start start 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fd035980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b31aa07520 0x55b31aa09910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fd035980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b31a94f4c0 con 0x55b31a977080 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fd035980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b31a916180 con 0x55b31aa07520 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fa34f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b31aa07520 0x55b31aa09910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fab50640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55b31a977080 0x55b31aa05e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:53092/0 (socket says 172.21.15.129:53092) 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fab50640 1 -- 172.21.15.129:0/171750954 learned_addr learned my addr 172.21.15.129:0/171750954 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fa34f640 1 -- 172.21.15.129:0/171750954 >> v1:172.21.15.80:6789/0 conn(0x55b31a977080 legacy=0x55b31aa05e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.542+0000 7fd0fa34f640 1 -- 172.21.15.129:0/171750954 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b31aa0aef0 con 0x55b31aa07520 2024-02-18T16:21:29.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/171750954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31aa07520 0x55b31aa09910 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000a480 tx=0x7fd0f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3d0791a484a74b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0f9b4e640 1 -- 172.21.15.129:0/171750954 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00ab540 con 0x55b31aa07520 2024-02-18T16:21:29.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0f9b4e640 1 -- 172.21.15.129:0/171750954 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f00ab6a0 con 0x55b31aa07520 2024-02-18T16:21:29.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0f9b4e640 1 -- 172.21.15.129:0/171750954 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00ab960 con 0x55b31aa07520 2024-02-18T16:21:29.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 -- 172.21.15.129:0/171750954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31aa07520 msgr2=0x55b31aa09910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 --2- 172.21.15.129:0/171750954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31aa07520 0x55b31aa09910 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000a480 tx=0x7fd0f001b280 comp rx=0 tx=0).stop 2024-02-18T16:21:29.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 -- 172.21.15.129:0/171750954 shutdown_connections 2024-02-18T16:21:29.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 --2- 172.21.15.129:0/171750954 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31aa07520 0x55b31aa09910 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 -- 172.21.15.129:0/171750954 >> 172.21.15.129:0/171750954 conn(0x55b31a9fd8e0 msgr2=0x55b31a9ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 -- 172.21.15.129:0/171750954 shutdown_connections 2024-02-18T16:21:29.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.546+0000 7fd0fd035980 1 -- 172.21.15.129:0/171750954 wait complete. 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fd035980 1 Processor -- start 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fd035980 1 -- start start 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fd035980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fd035980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b31a9136b0 con 0x55b31a977080 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fab50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fab50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaed0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56216/0 (socket says 172.21.15.129:56216) 2024-02-18T16:21:29.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fab50640 1 -- 172.21.15.129:0/1435286264 learned_addr learned my addr 172.21.15.129:0/1435286264 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fab50640 1 -- 172.21.15.129:0/1435286264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0005d30 con 0x55b31a977080 2024-02-18T16:21:29.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.558+0000 7fd0fab50640 1 --2- 172.21.15.129:0/1435286264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaed0b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006fb0 tx=0x7fd0f4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d671e40e44ab3a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fcfe8e09640 1 -- 172.21.15.129:0/1435286264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4004530 con 0x55b31a977080 2024-02-18T16:21:29.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fcfe8e09640 1 -- 172.21.15.129:0/1435286264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4004690 con 0x55b31a977080 2024-02-18T16:21:29.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fcfe8e09640 1 -- 172.21.15.129:0/1435286264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f40049b0 con 0x55b31a977080 2024-02-18T16:21:29.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1435286264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 msgr2=0x55b31aaed0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1435286264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaed0b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006fb0 tx=0x7fd0f4001940 comp rx=0 tx=0).stop 2024-02-18T16:21:29.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1435286264 shutdown_connections 2024-02-18T16:21:29.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1435286264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaed0b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1435286264 >> 172.21.15.129:0/1435286264 conn(0x55b31a9fd8e0 msgr2=0x55b31aae8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1435286264 shutdown_connections 2024-02-18T16:21:29.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1435286264 wait complete. 2024-02-18T16:21:29.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 Processor -- start 2024-02-18T16:21:29.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- start start 2024-02-18T16:21:29.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaf3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b31a90ee90 con 0x55b31a977080 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fab50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaf3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fab50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaf3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56218/0 (socket says 172.21.15.129:56218) 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fab50640 1 -- 172.21.15.129:0/1374748114 learned_addr learned my addr 172.21.15.129:0/1374748114 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fab50640 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b31a94f4c0 con 0x55b31a977080 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fab50640 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaf3f00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55b31aaedf40 tx=0x7fd0f4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fcfe7606640 1 -- 172.21.15.129:0/1374748114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4013760 con 0x55b31a977080 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b31aaf4440 con 0x55b31a977080 2024-02-18T16:21:29.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fcfe7606640 1 -- 172.21.15.129:0/1374748114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40138c0 con 0x55b31a977080 2024-02-18T16:21:29.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fcfe7606640 1 -- 172.21.15.129:0/1374748114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4013b60 con 0x55b31a977080 2024-02-18T16:21:29.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.562+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b31aaf4870 con 0x55b31a977080 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fcfe7606640 1 -- 172.21.15.129:0/1374748114 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd0f4028460 con 0x55b31a977080 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fcfe7606640 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfe0034300 0x7fcfe00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fcfe7606640 1 -- 172.21.15.129:0/1374748114 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd0f4049600 con 0x55b31a977080 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfe0034300 0x7fcfe00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31aa07520 0x55b31aafab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31aafb0c0 con 0x55b31aa07520 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31aa07520 0x55b31aafab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfe0034300 0x7fcfe00367c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00ad000 tx=0x7fd0f00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31aa07520 0x55b31aafab80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 -- 172.21.15.129:0/1374748114 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd0ec0083f0 con 0x55b31aa07520 2024-02-18T16:21:29.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31aafb480 con 0x55b31aa07520 2024-02-18T16:21:29.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 -- 172.21.15.129:0/1374748114 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd0ec0083f0 con 0x55b31aa07520 2024-02-18T16:21:29.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31aafcd30 con 0x55b31aa07520 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 -- 172.21.15.129:0/1374748114 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fd0ec0083f0 con 0x55b31aa07520 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31aafbf30 con 0x55b31aa07520 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 -- 172.21.15.129:0/1374748114 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd0ec0083f0 con 0x55b31aa07520 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31aafc340 con 0x55b31aa07520 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fb351640 1 -- 172.21.15.129:0/1374748114 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd0ec012040 con 0x55b31aa07520 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 Processor -- start 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- start start 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 0x55b31ab0b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.566+0000 7fd0fd035980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b31a8a7f20 con 0x55b31ab0b410 2024-02-18T16:21:29.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 0x55b31ab0b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 0x55b31ab0b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56228/0 (socket says 172.21.15.129:56228) 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 -- 172.21.15.129:0/224999659 learned_addr learned my addr 172.21.15.129:0/224999659 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 -- 172.21.15.129:0/224999659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b31ab0bd70 con 0x55b31ab0b410 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 0x55b31ab0b830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0096e80 tx=0x7fd0f0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fcfe4e01640 1 -- 172.21.15.129:0/224999659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00bd8a0 con 0x55b31ab0b410 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b31ab0bf60 con 0x55b31ab0b410 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fcfe4e01640 1 -- 172.21.15.129:0/224999659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f00bda00 con 0x55b31ab0b410 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fcfe4e01640 1 -- 172.21.15.129:0/224999659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00bdca0 con 0x55b31ab0b410 2024-02-18T16:21:29.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b31ab0cab0 con 0x55b31ab0b410 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fcfe4e01640 1 -- 172.21.15.129:0/224999659 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd0f00be480 con 0x55b31ab0b410 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fcfe4e01640 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfd40342b0 0x7fcfd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fcfe4e01640 1 -- 172.21.15.129:0/224999659 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd0f00e6360 con 0x55b31ab0b410 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fb351640 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfd40342b0 0x7fcfd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fd035980 1 Processor -- start 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fd035980 1 -- start start 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fb351640 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfd40342b0 0x7fcfd4036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b31aafb970 tx=0x7fd0ec003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fd035980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab18870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fd035980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b31a89b790 con 0x55b31ab18470 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab18870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab18870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56234/0 (socket says 172.21.15.129:56234) 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.570+0000 7fd0fa34f640 1 -- 172.21.15.129:0/20612461 learned_addr learned my addr 172.21.15.129:0/20612461 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 -- 172.21.15.129:0/20612461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b31ab18e40 con 0x55b31ab18470 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/20612461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab18870 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00e4780 tx=0x7fd0f00aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9f76ba8bdc8e07 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fcfde7fc640 1 -- 172.21.15.129:0/20612461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00064c0 con 0x55b31ab18470 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fcfde7fc640 1 -- 172.21.15.129:0/20612461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f00be730 con 0x55b31ab18470 2024-02-18T16:21:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fcfde7fc640 1 -- 172.21.15.129:0/20612461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00b4c50 con 0x55b31ab18470 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/20612461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 msgr2=0x55b31ab18870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 --2- 172.21.15.129:0/20612461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab18870 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00e4780 tx=0x7fd0f00aae30 comp rx=0 tx=0).stop 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/20612461 shutdown_connections 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 --2- 172.21.15.129:0/20612461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab18870 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/20612461 >> 172.21.15.129:0/20612461 conn(0x55b31ab147b0 msgr2=0x55b31ab12810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/20612461 shutdown_connections 2024-02-18T16:21:29.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/20612461 wait complete. 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 Processor -- start 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- start start 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab1f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b31ab1f920 con 0x55b31ab18470 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab1f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab1f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56236/0 (socket says 172.21.15.129:56236) 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 learned_addr learned my addr 172.21.15.129:0/885339585 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b31ab0cab0 con 0x55b31ab18470 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab1f3e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00aae70 tx=0x7fd0f00e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fcfdcff9640 1 -- 172.21.15.129:0/885339585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00d5050 con 0x55b31ab18470 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fcfdcff9640 1 -- 172.21.15.129:0/885339585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f00d6040 con 0x55b31ab18470 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b31ab1fb20 con 0x55b31ab18470 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fcfdcff9640 1 -- 172.21.15.129:0/885339585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0f00be8a0 con 0x55b31ab18470 2024-02-18T16:21:29.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.574+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b31ab1fef0 con 0x55b31ab18470 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fcfdcff9640 1 -- 172.21.15.129:0/885339585 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd0f00b4c50 con 0x55b31ab18470 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fcfdcff9640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfc40342b0 0x7fcfc4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fcfdcff9640 1 -- 172.21.15.129:0/885339585 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd0f00b6160 con 0x55b31ab18470 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fb351640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfc40342b0 0x7fcfc4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31ab2a980 0x55b31ab2ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2d590 con 0x55b31ab2a980 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31ab2a980 0x55b31ab2ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fb351640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfc40342b0 0x7fcfc4036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec008fd0 tx=0x7fd0ec01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31ab2a980 0x55b31ab2ce40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd0f4024020 con 0x55b31ab2a980 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 realm 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2d960 con 0x55b31ab2a980 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd0f4024020 con 0x55b31ab2a980 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2e1b0 con 0x55b31ab2a980 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd0f4024020 con 0x55b31ab2a980 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2e510 con 0x55b31ab2a980 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd0f4024020 con 0x55b31ab2a980 2024-02-18T16:21:29.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2ed10 con 0x55b31ab2a980 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd0f4024020 con 0x55b31ab2a980 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 20 searching for the correct realm 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b31ab30ba0 0x55b31ab32f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b31ab30ba0 0x55b31ab32f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b31ab30ba0 0x55b31ab32f90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fa34f640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd0f00ef070 0x7fd0f00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0f00ef070 2024-02-18T16:21:29.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fb351640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd0f00ef070 0x7fd0f00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.578+0000 7fd0fb351640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd0f00ef070 0x7fd0f00c7880 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02c040 con 0x7fd0f00ef070 2024-02-18T16:21:29.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fb351640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd0ec027940 0x7fd0ec0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:29.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd0ec027940 0x7fd0ec0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:29.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd0ec027940 0x7fd0ec0333c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:29.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f4024020 con 0x7fd0ec027940 2024-02-18T16:21:29.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd0f403d080 con 0x55b31ab2a980 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x55b31ab2a980 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x7fd0ec027940 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x7fd0ec027940 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0f00ef070 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02c040 con 0x7fd0f00ef070 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.582+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x55b31ab2a980 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x7fd0ec027940 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x55b31ab2a980 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0f00ef070 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd0ec02c040 con 0x7fd0f00ef070 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x7fd0ec027940 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f403d080 con 0x55b31ab2a980 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd0f403d080 con 0x55b31ab2a980 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.586+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0f00ef070 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02c040 con 0x7fd0f00ef070 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0f00ef070 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02c040 con 0x7fd0f00ef070 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab30ba0 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0ec027940 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.590+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x55b31ab2a980 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33640 con 0x7fd0f00ef070 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd0ec02c040 con 0x7fd0f00ef070 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:29.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2f670 con 0x55b31ab2a980 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2fec0 con 0x55b31ab2a980 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33a80 con 0x55b31ab2a980 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 zone default found 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 4 Realm: () 2024-02-18T16:21:29.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 zonegroup default 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab33f20 con 0x7fd0ec027940 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab35900 con 0x55b31ab30ba0 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab35cb0 con 0x55b31ab30ba0 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 started sync module instance, tier type = 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab34ed0 con 0x7fd0f00ef070 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94227735466624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab34ed0 con 0x7fd0f00ef070 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.594+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab366e0 con 0x55b31ab2a980 2024-02-18T16:21:29.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94227735466624] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94227735470928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab34ed0 con 0x55b31ab2a980 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab370e0 con 0x55b31ab30ba0 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94227735470928] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94227735464496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab34e50 con 0x55b31ab30ba0 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.598+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab37dd0 con 0x7fd0f00ef070 2024-02-18T16:21:29.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94227735476800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab38620 con 0x7fd0f00ef070 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab39020 con 0x55b31ab2a980 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94227735464496] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94227735476800] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94227735481120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab38180 con 0x55b31ab2a980 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.602+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab39870 con 0x7fd0ec027940 2024-02-18T16:21:29.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94227735481120] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94227735475344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab38180 con 0x7fd0ec027940 2024-02-18T16:21:29.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab39d10 con 0x7fd0ec027940 2024-02-18T16:21:29.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94227735475344] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94227735484432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab39cd0 con 0x7fd0ec027940 2024-02-18T16:21:29.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.606+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab3a6c0 con 0x7fd0ec027940 2024-02-18T16:21:29.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94227735486880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab3a680 con 0x7fd0ec027940 2024-02-18T16:21:29.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=0 2024-02-18T16:21:29.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=1 2024-02-18T16:21:29.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=2 2024-02-18T16:21:29.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=3 2024-02-18T16:21:29.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=4 2024-02-18T16:21:29.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=5 2024-02-18T16:21:29.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94227735484432] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=6 2024-02-18T16:21:29.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94227735486880] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 20 add_watcher() i=7 2024-02-18T16:21:29.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:29.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab39200 con 0x55b31ab2a980 2024-02-18T16:21:29.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.610+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94227735488896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab39200 con 0x55b31ab2a980 2024-02-18T16:21:29.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94227735488896] v30'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fcfb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 5 note: GC not initialized 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fcf2bfff640 20 reqs_thread_entry: start 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 Filter name: none 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fcf29ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab5fac0 con 0x55b31ab2a980 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:29.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:29.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:29.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:29.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab61f00 con 0x7fd0f00ef070 2024-02-18T16:21:29.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 enabling bucket name=myfoo 2024-02-18T16:21:29.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:29.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab5fee0 con 0x7fd0f00ef070 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 : miss 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rados->read ofs=0 len=0 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab626c0 con 0x55b31ab2a980 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv8 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:29.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.614+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.17 8:e9f42cc7:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab69e70 con 0x55b31ab2a980 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'9 uv9 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1, ofs0, ns] 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94227735653232 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab68ae0 con 0x55b31ab2a980 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== watch-notify(notify (1) cookie 94227735470928 notify 128849018907 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55b31aaf4870 con 0x55b31ab2a980 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018907 cookie 94227735470928 notifier 4594 bl.length()=725 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 info.flags=0x17 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1 to cache LRU end 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(67 notify.1 [notify cookie 94227735653232 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcfc0003ea0 con 0x55b31ab2a980 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== watch-notify(notify_complete (2) cookie 94227735653232 notify 128849018907 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd0f402d070 con 0x55b31ab2a980 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_sources= new_sources= 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential sources added=[] removed=[] 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): orig_dests= new_dests= 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 20 handle_bi_update(): bucket=:myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1]): potential dests added=[] removed=[] 2024-02-18T16:21:29.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab65010 con 0x55b31ab2a980 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v30'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94227735671472 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab67b70 con 0x55b31ab2a980 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== watch-notify(notify (1) cookie 94227735481120 notify 128849018908 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fd0f402d070 con 0x55b31ab2a980 2024-02-18T16:21:29.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018908 cookie 94227735481120 notifier 4594 bl.length()=533 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(70 notify.4 [notify cookie 94227735671472 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fcfde7fc640 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fcfc0004200 con 0x55b31ab2a980 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.618+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== watch-notify(notify_complete (2) cookie 94227735671472 notify 128849018908 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b31aaf4440 con 0x55b31ab2a980 2024-02-18T16:21:29.628 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:29.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fcfb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:29.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94227735488896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab51b60 con 0x55b31ab2a980 2024-02-18T16:21:29.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94227735488896] v30'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94227735466624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab3a980 con 0x7fd0f00ef070 2024-02-18T16:21:29.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94227735466624] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fd035980 20 remove_watcher() i=0 2024-02-18T16:21:29.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fd035980 2 removed watcher, disabling cache 2024-02-18T16:21:29.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.622+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94227735470928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2fec0 con 0x55b31ab2a980 2024-02-18T16:21:29.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94227735470928] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fd035980 20 remove_watcher() i=1 2024-02-18T16:21:29.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94227735464496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab2fec0 con 0x55b31ab30ba0 2024-02-18T16:21:29.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fa34f640 1 -- 172.21.15.129:0/885339585 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94227735464496] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f00ec070 con 0x55b31ab30ba0 2024-02-18T16:21:29.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fd035980 20 remove_watcher() i=2 2024-02-18T16:21:29.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94227735476800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab3a980 con 0x7fd0f00ef070 2024-02-18T16:21:29.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fb351640 1 -- 172.21.15.129:0/885339585 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94227735476800] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0ec03f040 con 0x7fd0f00ef070 2024-02-18T16:21:29.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fd035980 20 remove_watcher() i=3 2024-02-18T16:21:29.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.626+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94227735481120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab36350 con 0x55b31ab2a980 2024-02-18T16:21:29.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.630+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94227735481120] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x55b31ab2a980 2024-02-18T16:21:29.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.630+0000 7fd0fd035980 20 remove_watcher() i=4 2024-02-18T16:21:29.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.630+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94227735475344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab34a30 con 0x7fd0ec027940 2024-02-18T16:21:29.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.630+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94227735475344] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.630+0000 7fd0fd035980 20 remove_watcher() i=5 2024-02-18T16:21:29.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.630+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94227735484432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab3a980 con 0x7fd0ec027940 2024-02-18T16:21:29.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94227735484432] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 20 remove_watcher() i=6 2024-02-18T16:21:29.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94227735486880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b31ab38b20 con 0x7fd0ec027940 2024-02-18T16:21:29.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94227735486880] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd0f404f040 con 0x7fd0ec027940 2024-02-18T16:21:29.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 20 remove_watcher() i=7 2024-02-18T16:21:29.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd0ec027940 msgr2=0x7fd0ec0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd0ec027940 0x7fd0ec0333c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31ab2a980 msgr2=0x55b31ab2ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31ab2a980 0x55b31ab2ce40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd0f00ef070 msgr2=0x7fd0f00c7880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd0f00ef070 0x7fd0f00c7880 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b31ab30ba0 msgr2=0x55b31ab32f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b31ab30ba0 0x55b31ab32f90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfc40342b0 msgr2=0x7fcfc4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfc40342b0 0x7fcfc4036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec008fd0 tx=0x7fd0ec01c070 comp rx=0 tx=0).stop 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fab50640 1 -- 172.21.15.129:0/885339585 reap_dead start 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 msgr2=0x55b31ab1f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab1f3e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00aae70 tx=0x7fd0f00e46e0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 shutdown_connections 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/885339585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab18470 0x55b31ab1f3e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 >> 172.21.15.129:0/885339585 conn(0x55b31ab147b0 msgr2=0x55b31ab11e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 shutdown_connections 2024-02-18T16:21:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/885339585 wait complete. 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfd40342b0 msgr2=0x7fcfd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfd40342b0 0x7fcfd4036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b31aafb970 tx=0x7fd0ec003070 comp rx=0 tx=0).stop 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 msgr2=0x55b31ab0b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 0x55b31ab0b830 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0096e80 tx=0x7fd0f0018020 comp rx=0 tx=0).stop 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 shutdown_connections 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfd40342b0 0x7fcfd4036770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/224999659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31ab0b410 0x55b31ab0b830 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 >> 172.21.15.129:0/224999659 conn(0x55b31ab00220 msgr2=0x55b31ab00d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 shutdown_connections 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/224999659 wait complete. 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31aa07520 msgr2=0x55b31aafab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31aa07520 0x55b31aafab80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfe0034300 msgr2=0x7fcfe00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfe0034300 0x7fcfe00367c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00ad000 tx=0x7fd0f00a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:29.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 msgr2=0x55b31aaf3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaf3f00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55b31aaedf40 tx=0x7fd0f4000f50 comp rx=0 tx=0).stop 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 shutdown_connections 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b31aa07520 0x55b31aafab80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fcfe0034300 0x7fcfe00367c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 --2- 172.21.15.129:0/1374748114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b31a977080 0x55b31aaf3f00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.634+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 >> 172.21.15.129:0/1374748114 conn(0x55b31a9fd8e0 msgr2=0x55b31aae7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.638+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 shutdown_connections 2024-02-18T16:21:29.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:29.638+0000 7fd0fd035980 1 -- 172.21.15.129:0/1374748114 wait complete. 2024-02-18T16:21:29.651 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:29.659 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-18T16:21:30.010 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-02-18T16:21:30.024 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:45.025 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-18T16:21:45.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-18T16:21:45.026 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-18T16:21:45.064 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:45.065 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:45.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.057+0000 7f4f31e35980 1 Processor -- start 2024-02-18T16:21:45.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.057+0000 7f4f31e35980 1 -- start start 2024-02-18T16:21:45.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f31e35980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5654252d1850 0x5654252d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f31e35980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5654252174c0 con 0x5654252cd350 2024-02-18T16:21:45.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f31e35980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5654251de180 con 0x5654252d1850 2024-02-18T16:21:45.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2f14f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5654252d1850 0x5654252d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2f14f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5654252d1850 0x5654252d3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45658/0 (socket says 172.21.15.129:45658) 2024-02-18T16:21:45.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2f14f640 1 -- 172.21.15.129:0/3255160224 learned_addr learned my addr 172.21.15.129:0/3255160224 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2f14f640 1 -- 172.21.15.129:0/3255160224 >> v1:172.21.15.80:6789/0 conn(0x5654252cd350 legacy=0x5654252cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2f14f640 1 -- 172.21.15.129:0/3255160224 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654252d5190 con 0x5654252d1850 2024-02-18T16:21:45.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/3255160224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252d1850 0x5654252d3c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000a4e0 tx=0x7f4f2001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e4ea2516006f22 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2e94e640 1 -- 172.21.15.129:0/3255160224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200aa540 con 0x5654252d1850 2024-02-18T16:21:45.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2e94e640 1 -- 172.21.15.129:0/3255160224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f200a6070 con 0x5654252d1850 2024-02-18T16:21:45.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.061+0000 7f4f2e94e640 1 -- 172.21.15.129:0/3255160224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200aa850 con 0x5654252d1850 2024-02-18T16:21:45.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 -- 172.21.15.129:0/3255160224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252d1850 msgr2=0x5654252d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 --2- 172.21.15.129:0/3255160224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252d1850 0x5654252d3c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000a4e0 tx=0x7f4f2001b090 comp rx=0 tx=0).stop 2024-02-18T16:21:45.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 -- 172.21.15.129:0/3255160224 shutdown_connections 2024-02-18T16:21:45.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 --2- 172.21.15.129:0/3255160224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252d1850 0x5654252d3c40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 -- 172.21.15.129:0/3255160224 >> 172.21.15.129:0/3255160224 conn(0x565425240a40 msgr2=0x565425240e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 -- 172.21.15.129:0/3255160224 shutdown_connections 2024-02-18T16:21:45.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.065+0000 7f4f31e35980 1 -- 172.21.15.129:0/3255160224 wait complete. 2024-02-18T16:21:45.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.077+0000 7f4f31e35980 1 Processor -- start 2024-02-18T16:21:45.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.077+0000 7f4f31e35980 1 -- start start 2024-02-18T16:21:45.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654251db6b0 con 0x5654252cd350 2024-02-18T16:21:45.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45670/0 (socket says 172.21.15.129:45670) 2024-02-18T16:21:45.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 -- 172.21.15.129:0/2734824779 learned_addr learned my addr 172.21.15.129:0/2734824779 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 -- 172.21.15.129:0/2734824779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2000a1c0 con 0x5654252cd350 2024-02-18T16:21:45.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 --2- 172.21.15.129:0/2734824779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253b7250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4f18001d60 tx=0x7f4f1800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba2aa92da524b55 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4e1de0b640 1 -- 172.21.15.129:0/2734824779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f18014070 con 0x5654252cd350 2024-02-18T16:21:45.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4e1de0b640 1 -- 172.21.15.129:0/2734824779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1800f540 con 0x5654252cd350 2024-02-18T16:21:45.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4e1de0b640 1 -- 172.21.15.129:0/2734824779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f1800f820 con 0x5654252cd350 2024-02-18T16:21:45.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- 172.21.15.129:0/2734824779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 msgr2=0x5654253b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2734824779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253b7250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4f18001d60 tx=0x7f4f1800b5c0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- 172.21.15.129:0/2734824779 shutdown_connections 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2734824779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253b7250 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- 172.21.15.129:0/2734824779 >> 172.21.15.129:0/2734824779 conn(0x565425240a40 msgr2=0x5654253b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- 172.21.15.129:0/2734824779 shutdown_connections 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- 172.21.15.129:0/2734824779 wait complete. 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 Processor -- start 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- start start 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f31e35980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654251d6e90 con 0x5654252cd350 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253be0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45678/0 (socket says 172.21.15.129:45678) 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.081+0000 7f4f2f950640 1 -- 172.21.15.129:0/2840407180 learned_addr learned my addr 172.21.15.129:0/2840407180 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f2f950640 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654252174c0 con 0x5654252cd350 2024-02-18T16:21:45.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f2f950640 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253be0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800f510 tx=0x7f4f18000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4e17fff640 1 -- 172.21.15.129:0/2840407180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f18014050 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4e17fff640 1 -- 172.21.15.129:0/2840407180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18001300 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654253be600 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4e17fff640 1 -- 172.21.15.129:0/2840407180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f1801bb20 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654253beab0 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4e17fff640 1 -- 172.21.15.129:0/2840407180 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4f18022020 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4e17fff640 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e180342b0 0x7f4e18036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4e17fff640 1 -- 172.21.15.129:0/2840407180 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4f18048f20 con 0x5654252cd350 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e180342b0 0x7f4e18036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654252d1850 0x5654253c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253c5260 con 0x5654252d1850 2024-02-18T16:21:45.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f30151640 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654252d1850 0x5654253c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e180342b0 0x7f4e18036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f200ab000 tx=0x7f4f200a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f30151640 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654252d1850 0x5654253c4d20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f30151640 1 -- 172.21.15.129:0/2840407180 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f280083f0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253c2420 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f30151640 1 -- 172.21.15.129:0/2840407180 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4f280083f0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.085+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253c6fb0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f30151640 1 -- 172.21.15.129:0/2840407180 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4f280083f0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253c61b0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f30151640 1 -- 172.21.15.129:0/2840407180 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4f280083f0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253c65c0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f30151640 1 -- 172.21.15.129:0/2840407180 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4f280121d0 con 0x5654252d1850 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 Processor -- start 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 -- start start 2024-02-18T16:21:45.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 0x5654253d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542516ff20 con 0x5654253d55f0 2024-02-18T16:21:45.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f2f14f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 0x5654253d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f2f14f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 0x5654253d5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45682/0 (socket says 172.21.15.129:45682) 2024-02-18T16:21:45.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f2f14f640 1 -- 172.21.15.129:0/1189384811 learned_addr learned my addr 172.21.15.129:0/1189384811 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f2f14f640 1 -- 172.21.15.129:0/1189384811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654253d5f50 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 0x5654253d5a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4f2001b0d0 tx=0x7f4f20017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4e157fa640 1 -- 172.21.15.129:0/1189384811 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200b5be0 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4e157fa640 1 -- 172.21.15.129:0/1189384811 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f200b5d40 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654253d6140 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4e157fa640 1 -- 172.21.15.129:0/1189384811 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200be410 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.089+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654253d6c30 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4e157fa640 1 -- 172.21.15.129:0/1189384811 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4f200a8070 con 0x5654253d55f0 2024-02-18T16:21:45.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4e157fa640 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e080342b0 0x7f4e08036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4e157fa640 1 -- 172.21.15.129:0/1189384811 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4f200e5da0 con 0x5654253d55f0 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f30151640 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e080342b0 0x7f4e08036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 Processor -- start 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- start start 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f30151640 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e080342b0 0x7f4e08036770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5654253c5c50 tx=0x7f4f28003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x565425163790 con 0x5654253e25f0 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f2f14f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f2f14f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45690/0 (socket says 172.21.15.129:45690) 2024-02-18T16:21:45.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f2f14f640 1 -- 172.21.15.129:0/3379985460 learned_addr learned my addr 172.21.15.129:0/3379985460 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f2f14f640 1 -- 172.21.15.129:0/3379985460 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654253e2fc0 con 0x5654253e25f0 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/3379985460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e29f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4f200e4120 tx=0x7f4f200bd4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffad6c97a6b84ca server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4e0effd640 1 -- 172.21.15.129:0/3379985460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200d6070 con 0x5654253e25f0 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4e0effd640 1 -- 172.21.15.129:0/3379985460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f200b4d60 con 0x5654253e25f0 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4e0effd640 1 -- 172.21.15.129:0/3379985460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200a9870 con 0x5654253e25f0 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- 172.21.15.129:0/3379985460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 msgr2=0x5654253e29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 --2- 172.21.15.129:0/3379985460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e29f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4f200e4120 tx=0x7f4f200bd4e0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- 172.21.15.129:0/3379985460 shutdown_connections 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 --2- 172.21.15.129:0/3379985460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e29f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- 172.21.15.129:0/3379985460 >> 172.21.15.129:0/3379985460 conn(0x5654253de930 msgr2=0x5654253dc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- 172.21.15.129:0/3379985460 shutdown_connections 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- 172.21.15.129:0/3379985460 wait complete. 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 Processor -- start 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- start start 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.093+0000 7f4f31e35980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654253e9a30 con 0x5654253e25f0 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f14f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f14f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45702/0 (socket says 172.21.15.129:45702) 2024-02-18T16:21:45.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 learned_addr learned my addr 172.21.15.129:0/490894024 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654253d6c30 con 0x5654253e25f0 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e94f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4f200c5ff0 tx=0x7f4f200e4080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4e0d7fa640 1 -- 172.21.15.129:0/490894024 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200a9c80 con 0x5654253e25f0 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654253e9c30 con 0x5654253e25f0 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4e0d7fa640 1 -- 172.21.15.129:0/490894024 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f200c5360 con 0x5654253e25f0 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4e0d7fa640 1 -- 172.21.15.129:0/490894024 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f200c54d0 con 0x5654253e25f0 2024-02-18T16:21:45.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654253ea000 con 0x5654253e25f0 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4e0d7fa640 1 -- 172.21.15.129:0/490894024 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4f200d9070 con 0x5654253e25f0 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4e0d7fa640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4df80342b0 0x7f4df8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4e0d7fa640 1 -- 172.21.15.129:0/490894024 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4f200edd50 con 0x5654253e25f0 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f30151640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4df80342b0 0x7f4df8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654253f4ad0 0x5654253f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f76e0 con 0x5654253f4ad0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f950640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654253f4ad0 0x5654253f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f30151640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4df80342b0 0x7f4df8036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f28008fd0 tx=0x7f4f2801d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f950640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654253f4ad0 0x5654253f6f90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 20 realm 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.097+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7ab0 con 0x5654253f4ad0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f8300 con 0x5654253f4ad0 2024-02-18T16:21:45.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f8660 con 0x5654253f4ad0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 20 searching for the correct realm 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5654253fa8b0 0x5654253fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253fd370 con 0x5654253fa8b0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5654253fa8b0 0x5654253fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5654253fa8b0 0x5654253fcca0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f14f640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4f200f5070 0x7f4f200f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253fd370 con 0x7f4f200f5070 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f30151640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4f200f5070 0x7f4f200f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f30151640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4f200f5070 0x7f4f200f5450 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f2802d040 con 0x7f4f200f5070 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f30151640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4f28028940 0x7f4f28012420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253fd370 con 0x7f4f28028940 2024-02-18T16:21:45.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.101+0000 7f4f2f950640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4f28028940 0x7f4f28012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4f28028940 0x7f4f28012420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f28028940 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f28028940 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f2802d040 con 0x7f4f200f5070 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.105+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f28028940 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4f2802d040 con 0x7f4f200f5070 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f28028940 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f28028940 2024-02-18T16:21:45.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.109+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f2802d040 con 0x7f4f200f5070 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x5654253f4ad0 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f2802d040 con 0x7f4f200f5070 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f28028940 2024-02-18T16:21:45.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f18016070 con 0x7f4f28028940 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f2802d040 con 0x7f4f200f5070 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253fa8b0 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x5654253f4ad0 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f7fa0 con 0x7f4f200f5070 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:45.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.113+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f9390 con 0x5654253f4ad0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f9740 con 0x5654253f4ad0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:45.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f9740 con 0x5654253f4ad0 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 zone default found 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 4 Realm: () 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 zonegroup default 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253f9fc0 con 0x7f4f200f5070 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253ff1c0 con 0x5654253fa8b0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253ff670 con 0x5654253fa8b0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 started sync module instance, tier type = 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253fea70 con 0x7f4f200f5070 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919402186192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654253fee20 con 0x7f4f200f5070 2024-02-18T16:21:45.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.117+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654254003d0 con 0x5654253f4ad0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919402186192] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919402191504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654254003d0 con 0x5654253f4ad0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425400ea0 con 0x5654253fa8b0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919402191504] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919402195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425401250 con 0x5654253fa8b0 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.121+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425401bc0 con 0x7f4f200f5070 2024-02-18T16:21:45.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919402199088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425402410 con 0x7f4f200f5070 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425402e00 con 0x5654253f4ad0 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919402195328] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919402199088] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919402203360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425401f70 con 0x5654253f4ad0 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.125+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425403650 con 0x7f4f28028940 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.129+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919402203360] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.129+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.129+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919402192560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425401f70 con 0x7f4f28028940 2024-02-18T16:21:45.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.129+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425403b80 con 0x7f4f28028940 2024-02-18T16:21:45.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919402192560] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919402206816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425403fe0 con 0x7f4f28028940 2024-02-18T16:21:45.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425403060 con 0x7f4f28028940 2024-02-18T16:21:45.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919402206816] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919402208064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425403f60 con 0x7f4f28028940 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=0 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=1 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=2 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=3 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=4 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=5 2024-02-18T16:21:45.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.133+0000 7f4f31e35980 20 add_watcher() i=6 2024-02-18T16:21:45.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919402208064] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 20 add_watcher() i=7 2024-02-18T16:21:45.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:45.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425407a60 con 0x5654253f4ad0 2024-02-18T16:21:45.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919402210704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425404ef0 con 0x5654253f4ad0 2024-02-18T16:21:45.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919402210704] v32'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:45.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:45.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:45.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.137+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540fe80 con 0x5654253f4ad0 2024-02-18T16:21:45.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.141+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.141+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540fe80 con 0x7f4f28028940 2024-02-18T16:21:45.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.141+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.141+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654254102c0 con 0x5654253fa8b0 2024-02-18T16:21:45.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.145+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.145+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425410b40 con 0x5654253f4ad0 2024-02-18T16:21:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.145+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.145+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425411070 con 0x7f4f200f5070 2024-02-18T16:21:45.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.145+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'44 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.145+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654254115a0 con 0x5654253fa8b0 2024-02-18T16:21:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.149+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.149+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425410a20 con 0x5654253f4ad0 2024-02-18T16:21:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.149+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.149+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425411f70 con 0x7f4f28028940 2024-02-18T16:21:45.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.153+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.153+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425411f70 con 0x7f4f200f5070 2024-02-18T16:21:45.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.153+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.153+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654254124a0 con 0x5654253fa8b0 2024-02-18T16:21:45.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.157+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.157+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5654254129d0 con 0x7f4f200f5070 2024-02-18T16:21:45.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.157+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.157+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412f00 con 0x7f4f28028940 2024-02-18T16:21:45.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.157+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.157+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412f00 con 0x7f4f200f5070 2024-02-18T16:21:45.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.161+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.161+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425411e70 con 0x7f4f28028940 2024-02-18T16:21:45.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.161+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.161+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412e70 con 0x5654253f4ad0 2024-02-18T16:21:45.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.165+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.165+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412e70 con 0x5654253fa8b0 2024-02-18T16:21:45.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.165+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.165+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x7f4f200f5070 2024-02-18T16:21:45.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.169+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.169+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253fa8b0 2024-02-18T16:21:45.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.169+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.169+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253f4ad0 2024-02-18T16:21:45.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.173+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.173+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253f4ad0 2024-02-18T16:21:45.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.173+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.173+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253fa8b0 2024-02-18T16:21:45.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.177+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.177+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x7f4f200f5070 2024-02-18T16:21:45.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.177+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.177+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412d60 con 0x5654253fa8b0 2024-02-18T16:21:45.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.181+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.181+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412d60 con 0x5654253fa8b0 2024-02-18T16:21:45.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.181+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.181+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412d30 con 0x5654253fa8b0 2024-02-18T16:21:45.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.185+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.185+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253fa8b0 2024-02-18T16:21:45.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.185+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.185+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x7f4f28028940 2024-02-18T16:21:45.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.189+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.189+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253fa8b0 2024-02-18T16:21:45.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.193+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'20 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.193+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x7f4f28028940 2024-02-18T16:21:45.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.193+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.193+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x5654253fa8b0 2024-02-18T16:21:45.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.197+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.197+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425412ca0 con 0x7f4f28028940 2024-02-18T16:21:45.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565425413250 con 0x7f4f200f5070 2024-02-18T16:21:45.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4de4fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:45.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4f31e35980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:45.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4f31e35980 20 Filter name: none 2024-02-18T16:21:45.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.201+0000 7f4d5e7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:45.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253f4ad0 2024-02-18T16:21:45.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5c0 con 0x5654253f4ad0 2024-02-18T16:21:45.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253f4ad0 2024-02-18T16:21:45.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e580 con 0x7f4f28028940 2024-02-18T16:21:45.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.205+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253fa8b0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253fa8b0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253f4ad0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.209+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253f4ad0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5e0 con 0x7f4f28028940 2024-02-18T16:21:45.240 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.213+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f200f5070 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253fa8b0 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x5654253fa8b0 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253fa8b0 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f200f5070 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.217+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5e0 con 0x7f4f200f5070 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.221+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f28028940 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f28028940 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253f4ad0 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253f4ad0 2024-02-18T16:21:45.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253fa8b0 2024-02-18T16:21:45.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.225+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x5654253fa8b0 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540dd60 con 0x7f4f200f5070 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.229+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253f4ad0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.255 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f200f5070 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.233+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f28028940 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.237+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f28028940 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x7f4f28028940 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540cd50 con 0x5654253fa8b0 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 58 ==== osd_op_reply(177 gc.27 [call out=1701b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.241+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 37 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 38 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x5654253fa8b0 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x5654253fa8b0 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x5654253fa8b0 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 40 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.245+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f28028940 2024-02-18T16:21:45.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 41 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e5b0 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e560 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540e560 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.249+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919402210704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540d8c0 con 0x5654253f4ad0 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.253+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94919402210704] v32'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.253+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919402186192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.253+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94919402186192] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.253+0000 7f4f31e35980 20 remove_watcher() i=0 2024-02-18T16:21:45.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.253+0000 7f4f31e35980 2 removed watcher, disabling cache 2024-02-18T16:21:45.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.253+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919402191504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x5654253f4ad0 2024-02-18T16:21:45.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.257+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94919402191504] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.257+0000 7f4f31e35980 20 remove_watcher() i=1 2024-02-18T16:21:45.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.257+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919402195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x5654253fa8b0 2024-02-18T16:21:45.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.257+0000 7f4f2f14f640 1 -- 172.21.15.129:0/490894024 <== osd.3 v2:172.21.15.129:6800/2085458436 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94919402195328] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f200f2070 con 0x5654253fa8b0 2024-02-18T16:21:45.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.257+0000 7f4f31e35980 20 remove_watcher() i=2 2024-02-18T16:21:45.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.257+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919402199088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x7f4f200f5070 2024-02-18T16:21:45.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.261+0000 7f4f30151640 1 -- 172.21.15.129:0/490894024 <== osd.2 v2:172.21.15.129:6808/222672308 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94919402199088] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f28040040 con 0x7f4f200f5070 2024-02-18T16:21:45.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.261+0000 7f4f31e35980 20 remove_watcher() i=3 2024-02-18T16:21:45.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.261+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919402203360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x5654253f4ad0 2024-02-18T16:21:45.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.261+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.1 v2:172.21.15.129:6816/834716550 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94919402203360] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x5654253f4ad0 2024-02-18T16:21:45.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.261+0000 7f4f31e35980 20 remove_watcher() i=4 2024-02-18T16:21:45.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.261+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919402192560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x7f4f28028940 2024-02-18T16:21:45.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.265+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 42 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94919402192560] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.265+0000 7f4f31e35980 20 remove_watcher() i=5 2024-02-18T16:21:45.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.265+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919402206816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x7f4f28028940 2024-02-18T16:21:45.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 43 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94919402206816] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 20 remove_watcher() i=6 2024-02-18T16:21:45.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919402208064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56542540ccb0 con 0x7f4f28028940 2024-02-18T16:21:45.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 <== osd.0 v2:172.21.15.80:6800/4245413050 44 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94919402208064] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4f18055040 con 0x7f4f28028940 2024-02-18T16:21:45.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 20 remove_watcher() i=7 2024-02-18T16:21:45.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4f28028940 msgr2=0x7f4f28012420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f4f28028940 0x7f4f28012420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654253f4ad0 msgr2=0x5654253f6f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654253f4ad0 0x5654253f6f90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4f200f5070 msgr2=0x7f4f200f5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f4f200f5070 0x7f4f200f5450 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5654253fa8b0 msgr2=0x5654253fcca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5654253fa8b0 0x5654253fcca0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4df80342b0 msgr2=0x7f4df8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4df80342b0 0x7f4df8036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f28008fd0 tx=0x7f4f2801d070 comp rx=0 tx=0).stop 2024-02-18T16:21:45.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 msgr2=0x5654253e94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f2f950640 1 -- 172.21.15.129:0/490894024 reap_dead start 2024-02-18T16:21:45.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e94f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4f200c5ff0 tx=0x7f4f200e4080 comp rx=0 tx=0).stop 2024-02-18T16:21:45.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 shutdown_connections 2024-02-18T16:21:45.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 --2- 172.21.15.129:0/490894024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253e25f0 0x5654253e94f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 >> 172.21.15.129:0/490894024 conn(0x5654253de930 msgr2=0x5654253dbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 shutdown_connections 2024-02-18T16:21:45.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.269+0000 7f4f31e35980 1 -- 172.21.15.129:0/490894024 wait complete. 2024-02-18T16:21:45.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e080342b0 msgr2=0x7f4e08036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e080342b0 0x7f4e08036770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5654253c5c50 tx=0x7f4f28003070 comp rx=0 tx=0).stop 2024-02-18T16:21:45.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 msgr2=0x5654253d5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 0x5654253d5a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4f2001b0d0 tx=0x7f4f20017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:45.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 shutdown_connections 2024-02-18T16:21:45.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e080342b0 0x7f4e08036770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/1189384811 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654253d55f0 0x5654253d5a10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 >> 172.21.15.129:0/1189384811 conn(0x5654253ca400 msgr2=0x5654253caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 shutdown_connections 2024-02-18T16:21:45.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/1189384811 wait complete. 2024-02-18T16:21:45.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654252d1850 msgr2=0x5654253c4d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654252d1850 0x5654253c4d20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e180342b0 msgr2=0x7f4e18036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e180342b0 0x7f4e18036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f200ab000 tx=0x7f4f200a5000 comp rx=0 tx=0).stop 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 msgr2=0x5654253be0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253be0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800f510 tx=0x7f4f18000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 shutdown_connections 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5654252d1850 0x5654253c4d20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4e180342b0 0x7f4e18036770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 --2- 172.21.15.129:0/2840407180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5654252cd350 0x5654253be0c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 >> 172.21.15.129:0/2840407180 conn(0x565425240a40 msgr2=0x5654253b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 shutdown_connections 2024-02-18T16:21:45.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.273+0000 7f4f31e35980 1 -- 172.21.15.129:0/2840407180 wait complete. 2024-02-18T16:21:45.300 INFO:teuthology.orchestra.run.smithi129.stdout:[{"tag":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9394742697569840280\u0000","time":"2024-02-18T16:21:45.017863+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__7","key":"","instance":""}]}] 2024-02-18T16:21:45.300 DEBUG:tasks.util.rgw: json result: [{'tag': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9394742697569840280\x00', 'time': '2024-02-18T16:21:45.017863+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__7', 'key': '', 'instance': ''}]}] 2024-02-18T16:21:45.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-02-18T16:21:45.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-02-18T16:21:45.301 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-02-18T16:21:45.377 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:45.377 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.369+0000 7fea13fc3980 1 Processor -- start 2024-02-18T16:21:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.369+0000 7fea13fc3980 1 -- start start 2024-02-18T16:21:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea13fc3980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55dba9fd00b0 0x55dbaa05cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea13fc3980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dba9fa84b0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea13fc3980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dba9f6f180 con 0x55dba9fd00b0 2024-02-18T16:21:45.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea11ade640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55dba9fd00b0 0x55dbaa05cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea11ade640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55dba9fd00b0 0x55dbaa05cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45708/0 (socket says 172.21.15.129:45708) 2024-02-18T16:21:45.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea11ade640 1 -- 172.21.15.129:0/2581535062 learned_addr learned my addr 172.21.15.129:0/2581535062 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea112dd640 1 --1- 172.21.15.129:0/2581535062 >> v1:172.21.15.80:6789/0 conn(0x55dbaa05d0e0 0x55dbaa05f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:36968/0 (socket says 172.21.15.129:36968) 2024-02-18T16:21:45.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea11ade640 1 -- 172.21.15.129:0/2581535062 >> v1:172.21.15.80:6789/0 conn(0x55dbaa05d0e0 legacy=0x55dbaa05f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.373+0000 7fea11ade640 1 -- 172.21.15.129:0/2581535062 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbaa060cb0 con 0x55dba9fd00b0 2024-02-18T16:21:45.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea11ade640 1 --2- 172.21.15.129:0/2581535062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa05cba0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fea0400a4e0 tx=0x7fea0401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2c943494bd7911 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea10adc640 1 -- 172.21.15.129:0/2581535062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040aa540 con 0x55dba9fd00b0 2024-02-18T16:21:45.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea10adc640 1 -- 172.21.15.129:0/2581535062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040a6070 con 0x55dba9fd00b0 2024-02-18T16:21:45.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea10adc640 1 -- 172.21.15.129:0/2581535062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040aa850 con 0x55dba9fd00b0 2024-02-18T16:21:45.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 -- 172.21.15.129:0/2581535062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 msgr2=0x55dbaa05cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2581535062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa05cba0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fea0400a4e0 tx=0x7fea0401b090 comp rx=0 tx=0).stop 2024-02-18T16:21:45.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 -- 172.21.15.129:0/2581535062 shutdown_connections 2024-02-18T16:21:45.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2581535062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa05cba0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 -- 172.21.15.129:0/2581535062 >> 172.21.15.129:0/2581535062 conn(0x55dbaa0568d0 msgr2=0x55dbaa058cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 -- 172.21.15.129:0/2581535062 shutdown_connections 2024-02-18T16:21:45.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.377+0000 7fea13fc3980 1 -- 172.21.15.129:0/2581535062 wait complete. 2024-02-18T16:21:45.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea13fc3980 1 Processor -- start 2024-02-18T16:21:45.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea13fc3980 1 -- start start 2024-02-18T16:21:45.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea13fc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa14c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea13fc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba9f6c6b0 con 0x55dba9fd00b0 2024-02-18T16:21:45.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea11ade640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea11ade640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45710/0 (socket says 172.21.15.129:45710) 2024-02-18T16:21:45.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea11ade640 1 -- 172.21.15.129:0/4275742651 learned_addr learned my addr 172.21.15.129:0/4275742651 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea11ade640 1 -- 172.21.15.129:0/4275742651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0400a1c0 con 0x55dba9fd00b0 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fea11ade640 1 --2- 172.21.15.129:0/4275742651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa14c910 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fea04018cc0 tx=0x7fea040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1f977d1fa8cc65 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fe8ffe07640 1 -- 172.21.15.129:0/4275742651 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040aa700 con 0x55dba9fd00b0 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fe8ffe07640 1 -- 172.21.15.129:0/4275742651 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040aa860 con 0x55dba9fd00b0 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.393+0000 7fe8ffe07640 1 -- 172.21.15.129:0/4275742651 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040aab20 con 0x55dba9fd00b0 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/4275742651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 msgr2=0x55dbaa14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 --2- 172.21.15.129:0/4275742651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa14c910 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fea04018cc0 tx=0x7fea040033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/4275742651 shutdown_connections 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 --2- 172.21.15.129:0/4275742651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa14c910 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/4275742651 >> 172.21.15.129:0/4275742651 conn(0x55dbaa0568d0 msgr2=0x55dbaa1484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/4275742651 shutdown_connections 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/4275742651 wait complete. 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 Processor -- start 2024-02-18T16:21:45.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- start start 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba9f67e90 con 0x55dba9fd00b0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea11ade640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea11ade640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45712/0 (socket says 172.21.15.129:45712) 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea11ade640 1 -- 172.21.15.129:0/2405701308 learned_addr learned my addr 172.21.15.129:0/2405701308 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea11ade640 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbaa060cb0 con 0x55dba9fd00b0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea11ade640 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa153660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fea04000f90 tx=0x7fea04017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fe8fe604640 1 -- 172.21.15.129:0/2405701308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040c4070 con 0x55dba9fd00b0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fe8fe604640 1 -- 172.21.15.129:0/2405701308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040b5650 con 0x55dba9fd00b0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbaa153ba0 con 0x55dba9fd00b0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fe8fe604640 1 -- 172.21.15.129:0/2405701308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040b58f0 con 0x55dba9fd00b0 2024-02-18T16:21:45.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbaa153ff0 con 0x55dba9fd00b0 2024-02-18T16:21:45.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.397+0000 7fe8fe604640 1 -- 172.21.15.129:0/2405701308 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea040a8070 con 0x55dba9fd00b0 2024-02-18T16:21:45.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fe8fe604640 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8f80342b0 0x7fe8f8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fe8fe604640 1 -- 172.21.15.129:0/2405701308 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fea040e3b10 con 0x55dba9fd00b0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea112dd640 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8f80342b0 0x7fe8f8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa05d0e0 0x55dbaa15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa15a7e0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa05d0e0 0x55dbaa15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea112dd640 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8f80342b0 0x7fe8f8036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea08001e50 tx=0x7fea080013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa05d0e0 0x55dbaa15a2a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 -- 172.21.15.129:0/2405701308 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea0c0083f0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa157980 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 -- 172.21.15.129:0/2405701308 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fea0c0083f0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa15c1c0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 -- 172.21.15.129:0/2405701308 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fea0c0083f0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa15b020 con 0x55dbaa05d0e0 2024-02-18T16:21:45.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 -- 172.21.15.129:0/2405701308 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fea0c0083f0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa15b430 con 0x55dbaa05d0e0 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea122df640 1 -- 172.21.15.129:0/2405701308 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fea0c0121d0 con 0x55dbaa05d0e0 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 Processor -- start 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- start start 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 0x55dbaa16af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea13fc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba9f00f20 con 0x55dbaa16ab00 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea112dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 0x55dbaa16af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea112dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 0x55dbaa16af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45714/0 (socket says 172.21.15.129:45714) 2024-02-18T16:21:45.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.401+0000 7fea112dd640 1 -- 172.21.15.129:0/3012320272 learned_addr learned my addr 172.21.15.129:0/3012320272 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea112dd640 1 -- 172.21.15.129:0/3012320272 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbaa16b460 con 0x55dbaa16ab00 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea112dd640 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 0x55dbaa16af20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fea0800e640 tx=0x7fea0800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fe8f77fe640 1 -- 172.21.15.129:0/3012320272 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea08007040 con 0x55dbaa16ab00 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fe8f77fe640 1 -- 172.21.15.129:0/3012320272 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800d660 con 0x55dbaa16ab00 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbaa16b6b0 con 0x55dbaa16ab00 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbaa16c200 con 0x55dbaa16ab00 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fe8f77fe640 1 -- 172.21.15.129:0/3012320272 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea0800d920 con 0x55dbaa16ab00 2024-02-18T16:21:45.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fe8f77fe640 1 -- 172.21.15.129:0/3012320272 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea0801a070 con 0x55dbaa16ab00 2024-02-18T16:21:45.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fe8f77fe640 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8ec0342b0 0x7fe8ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fe8f77fe640 1 -- 172.21.15.129:0/3012320272 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fea08017050 con 0x55dbaa16ab00 2024-02-18T16:21:45.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea122df640 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8ec0342b0 0x7fe8ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea13fc3980 1 Processor -- start 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea13fc3980 1 -- start start 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea122df640 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8ec0342b0 0x7fe8ec036770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55dbaa15bbd0 tx=0x7fea0c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea13fc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa177ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.405+0000 7fea13fc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba9ef4790 con 0x55dbaa177a80 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa177ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa177ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45716/0 (socket says 172.21.15.129:45716) 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 -- 172.21.15.129:0/3509734645 learned_addr learned my addr 172.21.15.129:0/3509734645 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 -- 172.21.15.129:0/3509734645 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbaa178470 con 0x55dbaa177a80 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 --2- 172.21.15.129:0/3509734645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa177ea0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fea0800ff70 tx=0x7fea0801ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1631be61df01957 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fe8f57fa640 1 -- 172.21.15.129:0/3509734645 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea08025360 con 0x55dbaa177a80 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fe8f57fa640 1 -- 172.21.15.129:0/3509734645 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800de00 con 0x55dbaa177a80 2024-02-18T16:21:45.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fe8f57fa640 1 -- 172.21.15.129:0/3509734645 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea08024a30 con 0x55dbaa177a80 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- 172.21.15.129:0/3509734645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 msgr2=0x55dbaa177ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 --2- 172.21.15.129:0/3509734645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa177ea0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fea0800ff70 tx=0x7fea0801ae40 comp rx=0 tx=0).stop 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- 172.21.15.129:0/3509734645 shutdown_connections 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 --2- 172.21.15.129:0/3509734645 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa177ea0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- 172.21.15.129:0/3509734645 >> 172.21.15.129:0/3509734645 conn(0x55dbaa173e10 msgr2=0x55dbaa171e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- 172.21.15.129:0/3509734645 shutdown_connections 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- 172.21.15.129:0/3509734645 wait complete. 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 Processor -- start 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- start start 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa17ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea13fc3980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbaa17ef60 con 0x55dbaa177a80 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa17ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa17ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45722/0 (socket says 172.21.15.129:45722) 2024-02-18T16:21:45.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 learned_addr learned my addr 172.21.15.129:0/294333672 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbaa16c200 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fea112dd640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa17ea20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fea08047be0 tx=0x7fea08048c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.409+0000 7fe8e37fe640 1 -- 172.21.15.129:0/294333672 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea08035070 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fe8e37fe640 1 -- 172.21.15.129:0/294333672 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08024e30 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dbaa17f160 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fe8e37fe640 1 -- 172.21.15.129:0/294333672 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea08025b60 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbaa17f5f0 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fe8e37fe640 1 -- 172.21.15.129:0/294333672 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea08041070 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fe8e37fe640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8dc0342b0 0x7fe8dc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fe8e37fe640 1 -- 172.21.15.129:0/294333672 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fea08032990 con 0x55dbaa177a80 2024-02-18T16:21:45.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea122df640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8dc0342b0 0x7fe8dc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa189fa0 0x55dbaa18c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18cbb0 con 0x55dbaa189fa0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa189fa0 0x55dbaa18c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea122df640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8dc0342b0 0x7fe8dc036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea0c008fd0 tx=0x7fea0c01d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa189fa0 0x55dbaa18c460 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 realm 2024-02-18T16:21:45.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18cf40 con 0x55dbaa189fa0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18d7c0 con 0x55dbaa189fa0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18db20 con 0x55dbaa189fa0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18e320 con 0x55dbaa189fa0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.413+0000 7fea13fc3980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea13fc3980 20 searching for the correct realm 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dbaa190270 0x55dbaa192700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea112dd640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dbaa190270 0x55dbaa192700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea112dd640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dbaa190270 0x55dbaa192700 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea112dd640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fea08027060 0x7fea0801b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea08027060 2024-02-18T16:21:45.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea122df640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fea08027060 0x7fea0801b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea122df640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fea08027060 0x7fea0801b520 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c02d040 con 0x7fea08027060 2024-02-18T16:21:45.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea122df640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fea0c028940 0x7fea0c012420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea0c028940 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea11ade640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fea0c028940 0x7fea0c012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea11ade640 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fea0c028940 0x7fea0c012420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.417+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa189fa0 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa189fa0 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea0c028940 2024-02-18T16:21:45.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea0c028940 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea08027060 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c02d040 con 0x7fea08027060 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa189fa0 2024-02-18T16:21:45.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea0c028940 2024-02-18T16:21:45.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa189fa0 2024-02-18T16:21:45.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.421+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea08027060 2024-02-18T16:21:45.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fea0c02d040 con 0x7fea08027060 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea0c028940 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa189fa0 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa189fa0 2024-02-18T16:21:45.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x7fea0c028940 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa192d80 con 0x55dbaa190270 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x7fea08027060 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c02d040 con 0x7fea08027060 2024-02-18T16:21:45.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.425+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x55dbaa189fa0 2024-02-18T16:21:45.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x7fea08027060 2024-02-18T16:21:45.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c02d040 con 0x7fea08027060 2024-02-18T16:21:45.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x55dbaa190270 2024-02-18T16:21:45.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x7fea0c028940 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x7fea08027060 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c02d040 con 0x7fea08027060 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x55dbaa190270 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x7fea08027060 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x55dbaa189fa0 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fea08064040 con 0x7fea08027060 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:45.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:45.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:45.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:45.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:45.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18ece0 con 0x55dbaa189fa0 2024-02-18T16:21:45.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18f530 con 0x55dbaa189fa0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.429+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa18f530 con 0x55dbaa189fa0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 zone default found 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 4 Realm: () 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:45.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 zonegroup default 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1931c0 con 0x7fea08027060 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa194f00 con 0x55dbaa190270 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa195380 con 0x55dbaa190270 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 started sync module instance, tier type = 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1947e0 con 0x7fea08027060 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94401939981120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa194b90 con 0x7fea08027060 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1960e0 con 0x55dbaa189fa0 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.433+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94401939981120] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94401939986336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa196060 con 0x55dbaa189fa0 2024-02-18T16:21:45.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa196b30 con 0x55dbaa190270 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94401939986336] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94401939987392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa195fe0 con 0x55dbaa190270 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.437+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa197820 con 0x7fea08027060 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94401939993776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa198070 con 0x7fea08027060 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa198ad0 con 0x55dbaa189fa0 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94401939987392] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94401939993776] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94401939992288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa197bd0 con 0x55dbaa189fa0 2024-02-18T16:21:45.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.441+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa199320 con 0x7fea0c028940 2024-02-18T16:21:45.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94401939992288] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94401939998144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa197bd0 con 0x7fea0c028940 2024-02-18T16:21:45.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1997f0 con 0x7fea0c028940 2024-02-18T16:21:45.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94401939998144] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94401940001520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa199c50 con 0x7fea0c028940 2024-02-18T16:21:45.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.445+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa198cb0 con 0x7fea0c028940 2024-02-18T16:21:45.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94401940001520] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94401940002736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa199bd0 con 0x7fea0c028940 2024-02-18T16:21:45.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=0 2024-02-18T16:21:45.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=1 2024-02-18T16:21:45.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=2 2024-02-18T16:21:45.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=3 2024-02-18T16:21:45.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=4 2024-02-18T16:21:45.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=5 2024-02-18T16:21:45.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.449+0000 7fea13fc3980 20 add_watcher() i=6 2024-02-18T16:21:45.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94401940002736] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 20 add_watcher() i=7 2024-02-18T16:21:45.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:45.458 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19d5f0 con 0x55dbaa189fa0 2024-02-18T16:21:45.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94401940005152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19aab0 con 0x55dbaa189fa0 2024-02-18T16:21:45.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94401940005152] v32'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fe8c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:45.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:45.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:45.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.453+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a5b50 con 0x55dbaa189fa0 2024-02-18T16:21:45.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.457+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.462 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.457+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a5c10 con 0x7fea0c028940 2024-02-18T16:21:45.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.457+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.457+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a6260 con 0x55dbaa190270 2024-02-18T16:21:45.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.457+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.457+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a6c30 con 0x55dbaa189fa0 2024-02-18T16:21:45.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.461+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.461+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a3b70 con 0x7fea08027060 2024-02-18T16:21:45.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.461+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'47 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.461+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a3b70 con 0x55dbaa190270 2024-02-18T16:21:45.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.461+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.461+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a7970 con 0x55dbaa189fa0 2024-02-18T16:21:45.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.465+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.465+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a7970 con 0x7fea0c028940 2024-02-18T16:21:45.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.465+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.465+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a7970 con 0x7fea08027060 2024-02-18T16:21:45.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.469+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.469+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a7ea0 con 0x55dbaa190270 2024-02-18T16:21:45.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.469+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.469+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a7ea0 con 0x7fea08027060 2024-02-18T16:21:45.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.473+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.473+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a83d0 con 0x7fea0c028940 2024-02-18T16:21:45.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.473+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.473+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a83d0 con 0x7fea08027060 2024-02-18T16:21:45.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.473+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.473+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x7fea0c028940 2024-02-18T16:21:45.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.477+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.477+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x55dbaa189fa0 2024-02-18T16:21:45.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.481+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.481+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x55dbaa190270 2024-02-18T16:21:45.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.481+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.481+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x7fea08027060 2024-02-18T16:21:45.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.485+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.485+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x55dbaa190270 2024-02-18T16:21:45.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.485+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.485+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x55dbaa189fa0 2024-02-18T16:21:45.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.485+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.485+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x55dbaa189fa0 2024-02-18T16:21:45.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.489+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.489+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x55dbaa190270 2024-02-18T16:21:45.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.489+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.489+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a85c0 con 0x7fea08027060 2024-02-18T16:21:45.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x55dbaa190270 2024-02-18T16:21:45.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x55dbaa190270 2024-02-18T16:21:45.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x55dbaa190270 2024-02-18T16:21:45.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.493+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x55dbaa190270 2024-02-18T16:21:45.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.497+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.497+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x7fea0c028940 2024-02-18T16:21:45.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.497+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.497+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x55dbaa190270 2024-02-18T16:21:45.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.501+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'21 uv19 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.501+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x7fea0c028940 2024-02-18T16:21:45.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.501+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.501+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x55dbaa190270 2024-02-18T16:21:45.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.505+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.511 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.505+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x7fea0c028940 2024-02-18T16:21:45.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.505+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a8670 con 0x7fea08027060 2024-02-18T16:21:45.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fe8c27fc640 20 reqs_thread_entry: start 2024-02-18T16:21:45.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fea13fc3980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:45.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fea13fc3980 20 Filter name: none 2024-02-18T16:21:45.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fe833fff640 20 reqs_thread_entry: start 2024-02-18T16:21:45.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-02-18T16:21:45.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.509+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 gc.3 [call] v32'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(95 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(96 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(97 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:98 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(98 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(99 gc.3 [call] v32'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-02-18T16:21:45.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.513+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:100 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(100 gc.4 [call] v32'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:101 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(101 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:102 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(102 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:103 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(103 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:104 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(104 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:105 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(105 gc.4 [call] v32'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-02-18T16:21:45.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.517+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:106 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(106 gc.5 [call] v32'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:107 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(107 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:108 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(108 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(110 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(111 gc.5 [call] v32'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-02-18T16:21:45.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.521+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(112 gc.6 [call] v32'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(113 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(114 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:115 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(115 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:116 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(116 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.525+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:117 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.529+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(117 gc.6 [call] v32'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.529+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-02-18T16:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.529+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:118 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.529+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(118 gc.7 [call] v32'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.529+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:119 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(119 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:120 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea0c028940 2024-02-18T16:21:45.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(120 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:121 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea0c028940 2024-02-18T16:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(121 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:122 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea0c028940 2024-02-18T16:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(122 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.533+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:123 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.537+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(123 gc.7 [call] v32'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.537+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-02-18T16:21:45.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.537+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:124 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.537+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(124 gc.8 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.537+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:125 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(125 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:126 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 29 ==== osd_op_reply(126 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:127 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 30 ==== osd_op_reply(127 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:128 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 31 ==== osd_op_reply(128 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.541+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:129 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 32 ==== osd_op_reply(129 gc.8 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-02-18T16:21:45.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:130 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(130 gc.9 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:131 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(131 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:132 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.545+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(132 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:133 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 35 ==== osd_op_reply(133 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:134 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 36 ==== osd_op_reply(134 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:135 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 37 ==== osd_op_reply(135 gc.9 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-02-18T16:21:45.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.549+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:136 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 33 ==== osd_op_reply(136 gc.10 [call] v32'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:137 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 34 ==== osd_op_reply(137 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:138 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 35 ==== osd_op_reply(138 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:139 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 36 ==== osd_op_reply(139 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:140 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 37 ==== osd_op_reply(140 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.553+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:141 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 38 ==== osd_op_reply(141 gc.10 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-02-18T16:21:45.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:142 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(142 gc.11 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:143 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(143 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:144 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea0c028940 2024-02-18T16:21:45.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.557+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(144 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:145 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(145 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:146 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(146 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.561+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:147 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(147 gc.11 [call] v32'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-02-18T16:21:45.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 39 ==== osd_op_reply(148 gc.12 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 40 ==== osd_op_reply(149 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:150 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 41 ==== osd_op_reply(150 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.565+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:151 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 42 ==== osd_op_reply(151 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:152 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 43 ==== osd_op_reply(152 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:153 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 44 ==== osd_op_reply(153 gc.12 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-02-18T16:21:45.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.569+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(154 gc.13 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(155 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:156 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea0c028940 2024-02-18T16:21:45.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(156 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.573+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:157 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== osd_op_reply(157 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:158 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 37 ==== osd_op_reply(158 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:159 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 38 ==== osd_op_reply(159 gc.13 [call] v32'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-02-18T16:21:45.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.577+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 41 ==== osd_op_reply(160 gc.14 [call] v32'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 42 ==== osd_op_reply(161 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:162 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 43 ==== osd_op_reply(162 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:163 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 44 ==== osd_op_reply(163 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.581+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:164 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.585+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 45 ==== osd_op_reply(164 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.585+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.585+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:165 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.585+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 46 ==== osd_op_reply(165 gc.14 [call] v32'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.585+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-02-18T16:21:45.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.585+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 38 ==== osd_op_reply(166 gc.15 [call] v32'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 39 ==== osd_op_reply(167 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:168 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 40 ==== osd_op_reply(168 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:169 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 41 ==== osd_op_reply(169 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:170 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 42 ==== osd_op_reply(170 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.589+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:171 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.593+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 43 ==== osd_op_reply(171 gc.15 [call] v32'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.593+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-02-18T16:21:45.600 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.593+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 45 ==== osd_op_reply(172 gc.16 [call] v32'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 46 ==== osd_op_reply(173 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:174 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 47 ==== osd_op_reply(174 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:175 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 48 ==== osd_op_reply(175 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:176 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 49 ==== osd_op_reply(176 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.597+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:177 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 50 ==== osd_op_reply(177 gc.16 [call] v32'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-02-18T16:21:45.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 44 ==== osd_op_reply(178 gc.17 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 45 ==== osd_op_reply(179 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:180 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 46 ==== osd_op_reply(180 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:181 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 47 ==== osd_op_reply(181 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.601+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:182 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.605+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 48 ==== osd_op_reply(182 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.605+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.605+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:183 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.605+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 49 ==== osd_op_reply(183 gc.17 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.605+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-02-18T16:21:45.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.605+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 47 ==== osd_op_reply(184 gc.18 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 48 ==== osd_op_reply(185 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:186 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 49 ==== osd_op_reply(186 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:187 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 50 ==== osd_op_reply(187 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:188 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 51 ==== osd_op_reply(188 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.609+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:189 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.613+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 52 ==== osd_op_reply(189 gc.18 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.613+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-02-18T16:21:45.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.613+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.613+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 53 ==== osd_op_reply(190 gc.19 [call] v32'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 54 ==== osd_op_reply(191 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:192 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa189fa0 2024-02-18T16:21:45.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 55 ==== osd_op_reply(192 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:193 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 56 ==== osd_op_reply(193 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:194 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 57 ==== osd_op_reply(194 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.617+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:195 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa189fa0 2024-02-18T16:21:45.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.621+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 58 ==== osd_op_reply(195 gc.19 [call] v32'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.621+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-02-18T16:21:45.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.621+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.621+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 50 ==== osd_op_reply(196 gc.20 [call] v32'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.621+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 51 ==== osd_op_reply(197 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:198 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 52 ==== osd_op_reply(198 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:199 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 53 ==== osd_op_reply(199 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:200 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 54 ==== osd_op_reply(200 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.625+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:201 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.629+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 55 ==== osd_op_reply(201 gc.20 [call] v32'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.629+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-02-18T16:21:45.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.629+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 51 ==== osd_op_reply(202 gc.21 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 52 ==== osd_op_reply(203 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:204 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea08027060 2024-02-18T16:21:45.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 53 ==== osd_op_reply(204 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:205 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 54 ==== osd_op_reply(205 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:206 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 55 ==== osd_op_reply(206 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.633+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:207 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea08027060 2024-02-18T16:21:45.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 56 ==== osd_op_reply(207 gc.21 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-02-18T16:21:45.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 56 ==== osd_op_reply(208 gc.22 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 57 ==== osd_op_reply(209 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:210 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 58 ==== osd_op_reply(210 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.637+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:211 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 59 ==== osd_op_reply(211 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.646 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:212 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 60 ==== osd_op_reply(212 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:213 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 61 ==== osd_op_reply(213 gc.22 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-02-18T16:21:45.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.641+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 62 ==== osd_op_reply(214 gc.23 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 63 ==== osd_op_reply(215 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:216 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 64 ==== osd_op_reply(216 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:217 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 65 ==== osd_op_reply(217 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:218 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 66 ==== osd_op_reply(218 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.645+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:219 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.649+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 67 ==== osd_op_reply(219 gc.23 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.649+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-02-18T16:21:45.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.649+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:220 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 68 ==== osd_op_reply(220 gc.24 [call] v32'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:221 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 69 ==== osd_op_reply(221 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:222 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 70 ==== osd_op_reply(222 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:223 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 71 ==== osd_op_reply(223 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:224 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 72 ==== osd_op_reply(224 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.653+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:225 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 73 ==== osd_op_reply(225 gc.24 [call] v32'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-02-18T16:21:45.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:226 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 74 ==== osd_op_reply(226 gc.25 [call] v32'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:227 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 75 ==== osd_op_reply(227 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.657+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:228 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 76 ==== osd_op_reply(228 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:229 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 77 ==== osd_op_reply(229 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:230 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 78 ==== osd_op_reply(230 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.661+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:231 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.665+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 79 ==== osd_op_reply(231 gc.25 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.665+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-02-18T16:21:45.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.665+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:232 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.665+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 39 ==== osd_op_reply(232 gc.26 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.665+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:233 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 40 ==== osd_op_reply(233 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.674 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:234 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x7fea0c028940 2024-02-18T16:21:45.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 41 ==== osd_op_reply(234 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:235 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 42 ==== osd_op_reply(235 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:236 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 43 ==== osd_op_reply(236 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.669+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:237 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x7fea0c028940 2024-02-18T16:21:45.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.673+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 44 ==== osd_op_reply(237 gc.26 [call] v32'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.673+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-02-18T16:21:45.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.673+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:238 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 80 ==== osd_op_reply(238 gc.27 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:239 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 81 ==== osd_op_reply(239 gc.27 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:240 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a24a0 con 0x55dbaa190270 2024-02-18T16:21:45.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 82 ==== osd_op_reply(240 gc.27 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:241 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 83 ==== osd_op_reply(241 gc.27 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.685 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.677+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:242 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c3ce0 con 0x55dbaa190270 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 84 ==== osd_op_reply(242 gc.27 [call out=1701b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 20 garbage collection: RGWGC::process iterating over entry tag='4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9394742697569840280', time=2024-02-18T16:21:45.017863+0000, chain.objs.size()=7 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__1 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:243 3.32s0 3:4d86cbdd:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c4180 con 0x55dbaa190270 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__2 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:244 3.3s0 3:c06430e8:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c6aa0 con 0x7fea08027060 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__3 2024-02-18T16:21:45.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:245 3.ds0 3:b09a7bc3:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c6aa0 con 0x55dbaa190270 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__4 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:246 3.18s0 3:1b57d7a6:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1cba40 con 0x55dbaa190270 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__5 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:247 3.38s0 3:1eb8dcb6:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1cba40 con 0x7fea0c028940 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__6 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:248 3.37s0 3:ecfb8aa5:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0a00 con 0x55dbaa189fa0 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__7 2024-02-18T16:21:45.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.681+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:249 3.29s0 3:97389b08:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0a00 con 0x7fea0c028940 2024-02-18T16:21:45.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.685+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 59 ==== osd_op_reply(248 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__6 [call] v32'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.685+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 45 ==== osd_op_reply(247 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__5 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.689+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 46 ==== osd_op_reply(249 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__7 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.689+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 57 ==== osd_op_reply(244 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__2 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.693+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 85 ==== osd_op_reply(245 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__3 [call] v32'3 uv3 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.693+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 86 ==== osd_op_reply(243 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__1 [call] v32'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.693+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 87 ==== osd_op_reply(246 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.1__shadow_.ydPGYOY0yABvWT3jJciAhbMbEDvDBk__4 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.693+0000 7fea13fc3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-18T16:21:45.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.693+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:250 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.697+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 88 ==== osd_op_reply(250 gc.27 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.697+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:251 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.701+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 89 ==== osd_op_reply(251 gc.27 [call] v32'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.701+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-02-18T16:21:45.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.701+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:252 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.701+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 47 ==== osd_op_reply(252 gc.28 [call] v32'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:253 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 48 ==== osd_op_reply(253 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:254 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 49 ==== osd_op_reply(254 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:255 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 50 ==== osd_op_reply(255 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:256 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 51 ==== osd_op_reply(256 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.705+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:257 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.709+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 52 ==== osd_op_reply(257 gc.28 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.709+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-02-18T16:21:45.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.709+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:258 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 90 ==== osd_op_reply(258 gc.29 [call] v32'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:259 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 91 ==== osd_op_reply(259 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:260 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 92 ==== osd_op_reply(260 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:261 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 93 ==== osd_op_reply(261 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.713+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:262 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.717+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 94 ==== osd_op_reply(262 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.717+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.717+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:263 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x55dbaa190270 2024-02-18T16:21:45.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.717+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 95 ==== osd_op_reply(263 gc.29 [call] v32'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.717+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-02-18T16:21:45.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.717+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:264 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.721+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 53 ==== osd_op_reply(264 gc.30 [call] v32'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.721+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:265 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 54 ==== osd_op_reply(265 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:266 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1d0960 con 0x7fea0c028940 2024-02-18T16:21:45.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 55 ==== osd_op_reply(266 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:267 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 56 ==== osd_op_reply(267 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:268 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 57 ==== osd_op_reply(268 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.725+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:269 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.729+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 58 ==== osd_op_reply(269 gc.30 [call] v32'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.729+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-02-18T16:21:45.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.729+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:270 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea08027060 2024-02-18T16:21:45.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 58 ==== osd_op_reply(270 gc.31 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:271 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea08027060 2024-02-18T16:21:45.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 59 ==== osd_op_reply(271 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:272 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea08027060 2024-02-18T16:21:45.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 60 ==== osd_op_reply(272 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:273 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea08027060 2024-02-18T16:21:45.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.733+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 61 ==== osd_op_reply(273 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:274 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea08027060 2024-02-18T16:21:45.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 62 ==== osd_op_reply(274 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:275 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea08027060 2024-02-18T16:21:45.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 63 ==== osd_op_reply(275 gc.31 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-02-18T16:21:45.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.737+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:276 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa189fa0 2024-02-18T16:21:45.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.741+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 60 ==== osd_op_reply(276 gc.0 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.741+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:277 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa189fa0 2024-02-18T16:21:45.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.741+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 61 ==== osd_op_reply(277 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.741+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.741+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:278 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa189fa0 2024-02-18T16:21:45.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 62 ==== osd_op_reply(278 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:279 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa189fa0 2024-02-18T16:21:45.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 63 ==== osd_op_reply(279 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:280 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa189fa0 2024-02-18T16:21:45.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 64 ==== osd_op_reply(280 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.745+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:281 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa189fa0 2024-02-18T16:21:45.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.749+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 65 ==== osd_op_reply(281 gc.0 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.749+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-02-18T16:21:45.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.749+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:282 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.749+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 59 ==== osd_op_reply(282 gc.1 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.749+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:283 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 60 ==== osd_op_reply(283 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:284 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 61 ==== osd_op_reply(284 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:285 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 62 ==== osd_op_reply(285 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:286 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 63 ==== osd_op_reply(286 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.753+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:287 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x7fea0c028940 2024-02-18T16:21:45.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.757+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 64 ==== osd_op_reply(287 gc.1 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.757+0000 7fea13fc3980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-02-18T16:21:45.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.757+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:288 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa190270 2024-02-18T16:21:45.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 96 ==== osd_op_reply(288 gc.2 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:289 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c9520 con 0x55dbaa190270 2024-02-18T16:21:45.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 97 ==== osd_op_reply(289 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:290 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1a2170 con 0x55dbaa190270 2024-02-18T16:21:45.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 98 ==== osd_op_reply(290 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:291 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c4470 con 0x55dbaa190270 2024-02-18T16:21:45.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 99 ==== osd_op_reply(291 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:21:45.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.761+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:292 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c4470 con 0x55dbaa190270 2024-02-18T16:21:45.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.765+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 100 ==== osd_op_reply(292 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.765+0000 7fea13fc3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:21:45.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.765+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:293 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1c4470 con 0x55dbaa190270 2024-02-18T16:21:45.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.765+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 101 ==== osd_op_reply(293 gc.2 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.769+0000 7fe8c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:45.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.769+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94401940005152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa187630 con 0x55dbaa189fa0 2024-02-18T16:21:45.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.769+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94401940005152] v32'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.769+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94401939981120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19a120 con 0x7fea08027060 2024-02-18T16:21:45.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.773+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94401939981120] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.773+0000 7fea13fc3980 20 remove_watcher() i=0 2024-02-18T16:21:45.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.773+0000 7fea13fc3980 2 removed watcher, disabling cache 2024-02-18T16:21:45.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.773+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94401939986336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19a120 con 0x55dbaa189fa0 2024-02-18T16:21:45.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.777+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94401939986336] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.777+0000 7fea13fc3980 20 remove_watcher() i=1 2024-02-18T16:21:45.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.777+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94401939987392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa1957a0 con 0x55dbaa190270 2024-02-18T16:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.777+0000 7fea112dd640 1 -- 172.21.15.129:0/294333672 <== osd.3 v2:172.21.15.129:6800/2085458436 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94401939987392] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea08037070 con 0x55dbaa190270 2024-02-18T16:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.777+0000 7fea13fc3980 20 remove_watcher() i=2 2024-02-18T16:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.777+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94401939993776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19a120 con 0x7fea08027060 2024-02-18T16:21:45.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.781+0000 7fea122df640 1 -- 172.21.15.129:0/294333672 <== osd.2 v2:172.21.15.129:6808/222672308 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94401939993776] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea0c040040 con 0x7fea08027060 2024-02-18T16:21:45.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.781+0000 7fea13fc3980 20 remove_watcher() i=3 2024-02-18T16:21:45.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.781+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94401939992288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19a120 con 0x55dbaa189fa0 2024-02-18T16:21:45.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.785+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.1 v2:172.21.15.129:6816/834716550 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94401939992288] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x55dbaa189fa0 2024-02-18T16:21:45.790 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.785+0000 7fea13fc3980 20 remove_watcher() i=4 2024-02-18T16:21:45.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.785+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94401939998144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa196ee0 con 0x7fea0c028940 2024-02-18T16:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.785+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94401939998144] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.785+0000 7fea13fc3980 20 remove_watcher() i=5 2024-02-18T16:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.785+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94401940001520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19a120 con 0x7fea0c028940 2024-02-18T16:21:45.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.789+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94401940001520] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.789+0000 7fea13fc3980 20 remove_watcher() i=6 2024-02-18T16:21:45.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.789+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94401940002736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dbaa19a120 con 0x7fea0c028940 2024-02-18T16:21:45.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 <== osd.0 v2:172.21.15.80:6800/4245413050 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94401940002736] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea040d2c70 con 0x7fea0c028940 2024-02-18T16:21:45.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 20 remove_watcher() i=7 2024-02-18T16:21:45.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fea0c028940 msgr2=0x7fea0c012420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fea0c028940 0x7fea0c012420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa189fa0 msgr2=0x55dbaa18c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa189fa0 0x55dbaa18c460 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fea08027060 msgr2=0x7fea0801b520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fea08027060 0x7fea0801b520 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dbaa190270 msgr2=0x55dbaa192700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55dbaa190270 0x55dbaa192700 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8dc0342b0 msgr2=0x7fe8dc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8dc0342b0 0x7fe8dc036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea0c008fd0 tx=0x7fea0c01d070 comp rx=0 tx=0).stop 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 msgr2=0x55dbaa17ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/294333672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa177a80 0x55dbaa17ea20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fea08047be0 tx=0x7fea08048c50 comp rx=0 tx=0).stop 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 reap_dead start 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea11ade640 1 -- 172.21.15.129:0/294333672 reap_dead start 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 shutdown_connections 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 >> 172.21.15.129:0/294333672 conn(0x55dbaa173e10 msgr2=0x55dbaa171470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 shutdown_connections 2024-02-18T16:21:45.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/294333672 wait complete. 2024-02-18T16:21:45.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8ec0342b0 msgr2=0x7fe8ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8ec0342b0 0x7fe8ec036770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55dbaa15bbd0 tx=0x7fea0c003070 comp rx=0 tx=0).stop 2024-02-18T16:21:45.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 msgr2=0x55dbaa16af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 0x55dbaa16af20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fea0800e640 tx=0x7fea0800ea40 comp rx=0 tx=0).stop 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 shutdown_connections 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8ec0342b0 0x7fe8ec036770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 --2- 172.21.15.129:0/3012320272 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dbaa16ab00 0x55dbaa16af20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 >> 172.21.15.129:0/3012320272 conn(0x55dbaa15f910 msgr2=0x55dbaa160420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 shutdown_connections 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.793+0000 7fea13fc3980 1 -- 172.21.15.129:0/3012320272 wait complete. 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa05d0e0 msgr2=0x55dbaa15a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa05d0e0 0x55dbaa15a2a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8f80342b0 msgr2=0x7fe8f8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8f80342b0 0x7fe8f8036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea08001e50 tx=0x7fea080013b0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 msgr2=0x55dbaa153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa153660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fea04000f90 tx=0x7fea04017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:45.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 shutdown_connections 2024-02-18T16:21:45.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55dbaa05d0e0 0x55dbaa15a2a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe8f80342b0 0x7fe8f8036770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 --2- 172.21.15.129:0/2405701308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55dba9fd00b0 0x55dbaa153660 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 >> 172.21.15.129:0/2405701308 conn(0x55dbaa0568d0 msgr2=0x55dbaa146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 shutdown_connections 2024-02-18T16:21:45.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.797+0000 7fea13fc3980 1 -- 172.21.15.129:0/2405701308 wait complete. 2024-02-18T16:21:45.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-18T16:21:45.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-18T16:21:45.824 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-18T16:21:45.903 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:45.903 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:45.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0298cf9980 1 Processor -- start 2024-02-18T16:21:45.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0298cf9980 1 -- start start 2024-02-18T16:21:45.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0298cf9980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5625eff8b850 0x5625eff8dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0298cf9980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5625efed14c0 con 0x5625eff87350 2024-02-18T16:21:45.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0298cf9980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5625efe98180 con 0x5625eff8b850 2024-02-18T16:21:45.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0296013640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5625eff8b850 0x5625eff8dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0296814640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5625eff87350 0x5625eff87730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:36978/0 (socket says 172.21.15.129:36978) 2024-02-18T16:21:45.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0296814640 1 -- 172.21.15.129:0/1826065904 learned_addr learned my addr 172.21.15.129:0/1826065904 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:45.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0296013640 1 -- 172.21.15.129:0/1826065904 >> v1:172.21.15.80:6789/0 conn(0x5625eff87350 legacy=0x5625eff87730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.897+0000 7f0296013640 1 -- 172.21.15.129:0/1826065904 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625eff8f190 con 0x5625eff8b850 2024-02-18T16:21:45.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0296013640 1 --2- 172.21.15.129:0/1826065904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff8b850 0x5625eff8dc40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f028c00a480 tx=0x7f028c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41211246bfea63b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0295812640 1 -- 172.21.15.129:0/1826065904 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0ab540 con 0x5625eff8b850 2024-02-18T16:21:45.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0295812640 1 -- 172.21.15.129:0/1826065904 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c0ab6a0 con 0x5625eff8b850 2024-02-18T16:21:45.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0295812640 1 -- 172.21.15.129:0/1826065904 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0ab960 con 0x5625eff8b850 2024-02-18T16:21:45.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 -- 172.21.15.129:0/1826065904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff8b850 msgr2=0x5625eff8dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 --2- 172.21.15.129:0/1826065904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff8b850 0x5625eff8dc40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f028c00a480 tx=0x7f028c01b280 comp rx=0 tx=0).stop 2024-02-18T16:21:45.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 -- 172.21.15.129:0/1826065904 shutdown_connections 2024-02-18T16:21:45.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 --2- 172.21.15.129:0/1826065904 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff8b850 0x5625eff8dc40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 -- 172.21.15.129:0/1826065904 >> 172.21.15.129:0/1826065904 conn(0x5625efefaa40 msgr2=0x5625efefae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 -- 172.21.15.129:0/1826065904 shutdown_connections 2024-02-18T16:21:45.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.901+0000 7f0298cf9980 1 -- 172.21.15.129:0/1826065904 wait complete. 2024-02-18T16:21:45.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0298cf9980 1 Processor -- start 2024-02-18T16:21:45.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0298cf9980 1 -- start start 2024-02-18T16:21:45.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0298cf9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0298cf9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625efe956b0 con 0x5625eff87350 2024-02-18T16:21:45.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0296814640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0296814640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45736/0 (socket says 172.21.15.129:45736) 2024-02-18T16:21:45.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0296814640 1 -- 172.21.15.129:0/595421511 learned_addr learned my addr 172.21.15.129:0/595421511 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.917+0000 7f0296814640 1 -- 172.21.15.129:0/595421511 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c005d30 con 0x5625eff87350 2024-02-18T16:21:45.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0296814640 1 --2- 172.21.15.129:0/595421511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00712a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0288001c90 tx=0x7f028800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef3625b1db1bff3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0184e09640 1 -- 172.21.15.129:0/595421511 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028800e690 con 0x5625eff87350 2024-02-18T16:21:45.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0184e09640 1 -- 172.21.15.129:0/595421511 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028800e7f0 con 0x5625eff87350 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0184e09640 1 -- 172.21.15.129:0/595421511 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028800eaf0 con 0x5625eff87350 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/595421511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 msgr2=0x5625f00712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 --2- 172.21.15.129:0/595421511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00712a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0288001c90 tx=0x7f028800b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/595421511 shutdown_connections 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 --2- 172.21.15.129:0/595421511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00712a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/595421511 >> 172.21.15.129:0/595421511 conn(0x5625efefaa40 msgr2=0x5625f006ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/595421511 shutdown_connections 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/595421511 wait complete. 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 Processor -- start 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- start start 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00780f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625efe90e90 con 0x5625eff87350 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0296814640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0296814640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00780f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45744/0 (socket says 172.21.15.129:45744) 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0296814640 1 -- 172.21.15.129:0/2469172144 learned_addr learned my addr 172.21.15.129:0/2469172144 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0296814640 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625efed14c0 con 0x5625eff87350 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0296814640 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00780f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0288001ee0 tx=0x7f0288000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0183606640 1 -- 172.21.15.129:0/2469172144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028801f070 con 0x5625eff87350 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625f0078630 con 0x5625eff87350 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0183606640 1 -- 172.21.15.129:0/2469172144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028801a4d0 con 0x5625eff87350 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0183606640 1 -- 172.21.15.129:0/2469172144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028801a770 con 0x5625eff87350 2024-02-18T16:21:45.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.921+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625f0078a80 con 0x5625eff87350 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0183606640 1 -- 172.21.15.129:0/2469172144 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f028800a040 con 0x5625eff87350 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0183606640 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f017c0342b0 0x7f017c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0183606640 1 -- 172.21.15.129:0/2469172144 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0288049780 con 0x5625eff87350 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0296013640 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f017c0342b0 0x7f017c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625eff8b850 0x5625f007ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f007f2b0 con 0x5625eff8b850 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0297015640 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625eff8b850 0x5625f007ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0296013640 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f017c0342b0 0x7f017c036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f028c0ad000 tx=0x7f028c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0297015640 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625eff8b850 0x5625f007ed70 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0297015640 1 -- 172.21.15.129:0/2469172144 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f029000a4d0 con 0x5625eff8b850 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f007f6a0 con 0x5625eff8b850 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0297015640 1 -- 172.21.15.129:0/2469172144 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f029000a4d0 con 0x5625eff8b850 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f0080f50 con 0x5625eff8b850 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0297015640 1 -- 172.21.15.129:0/2469172144 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f029000a4d0 con 0x5625eff8b850 2024-02-18T16:21:45.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f0080150 con 0x5625eff8b850 2024-02-18T16:21:45.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0297015640 1 -- 172.21.15.129:0/2469172144 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f029000a4d0 con 0x5625eff8b850 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.925+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f0080560 con 0x5625eff8b850 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0297015640 1 -- 172.21.15.129:0/2469172144 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f029000a4d0 con 0x5625eff8b850 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0298cf9980 1 Processor -- start 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0298cf9980 1 -- start start 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0298cf9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 0x5625f008fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0298cf9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625efe29f20 con 0x5625f008f5f0 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0296013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 0x5625f008fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0296013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 0x5625f008fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45752/0 (socket says 172.21.15.129:45752) 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0296013640 1 -- 172.21.15.129:0/267559769 learned_addr learned my addr 172.21.15.129:0/267559769 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0296013640 1 -- 172.21.15.129:0/267559769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f008ff50 con 0x5625f008f5f0 2024-02-18T16:21:45.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0296013640 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 0x5625f008fa10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f028c0ab670 tx=0x7f028c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0180e01640 1 -- 172.21.15.129:0/267559769 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0be7c0 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0180e01640 1 -- 172.21.15.129:0/267559769 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c0be920 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625f0090140 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0180e01640 1 -- 172.21.15.129:0/267559769 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0bebc0 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625f0090c90 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0180e01640 1 -- 172.21.15.129:0/267559769 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f028c0bd3e0 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0180e01640 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01700342b0 0x7f0170036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0180e01640 1 -- 172.21.15.129:0/267559769 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f028c0e63a0 con 0x5625f008f5f0 2024-02-18T16:21:45.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.929+0000 7f0297015640 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01700342b0 0x7f0170036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0298cf9980 1 Processor -- start 2024-02-18T16:21:45.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0298cf9980 1 -- start start 2024-02-18T16:21:45.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0297015640 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01700342b0 0x7f0170036770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5625f007fb90 tx=0x7f0290005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0298cf9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0298cf9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625efe1d790 con 0x5625f009c5a0 2024-02-18T16:21:45.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0296013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0296013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45764/0 (socket says 172.21.15.129:45764) 2024-02-18T16:21:45.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0296013640 1 -- 172.21.15.129:0/663426349 learned_addr learned my addr 172.21.15.129:0/663426349 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0296013640 1 -- 172.21.15.129:0/663426349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f009cf90 con 0x5625f009c5a0 2024-02-18T16:21:45.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.933+0000 7f0296013640 1 --2- 172.21.15.129:0/663426349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f009c9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f028c0e4720 tx=0x7f028c0b4de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ba5cdccd655185 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f017a7fc640 1 -- 172.21.15.129:0/663426349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0e3070 con 0x5625f009c5a0 2024-02-18T16:21:45.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f017a7fc640 1 -- 172.21.15.129:0/663426349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c0e3300 con 0x5625f009c5a0 2024-02-18T16:21:45.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f017a7fc640 1 -- 172.21.15.129:0/663426349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0bd7c0 con 0x5625f009c5a0 2024-02-18T16:21:45.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/663426349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 msgr2=0x5625f009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 --2- 172.21.15.129:0/663426349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f009c9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f028c0e4720 tx=0x7f028c0b4de0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/663426349 shutdown_connections 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 --2- 172.21.15.129:0/663426349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f009c9c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/663426349 >> 172.21.15.129:0/663426349 conn(0x5625f0098930 msgr2=0x5625f0096990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/663426349 shutdown_connections 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/663426349 wait complete. 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 Processor -- start 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- start start 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f00a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f00a3a60 con 0x5625f009c5a0 2024-02-18T16:21:45.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0296013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f00a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0296013640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f00a3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45772/0 (socket says 172.21.15.129:45772) 2024-02-18T16:21:45.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 learned_addr learned my addr 172.21.15.129:0/3077804142 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f0090c90 con 0x5625f009c5a0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0296013640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f00a3520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f028c0c58f0 tx=0x7f028c0e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0178ff9640 1 -- 172.21.15.129:0/3077804142 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0aaa30 con 0x5625f009c5a0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625f00a3c60 con 0x5625f009c5a0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0178ff9640 1 -- 172.21.15.129:0/3077804142 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c0aab90 con 0x5625f009c5a0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0178ff9640 1 -- 172.21.15.129:0/3077804142 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f028c0aae30 con 0x5625f009c5a0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.937+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625f00a4090 con 0x5625f009c5a0 2024-02-18T16:21:45.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0178ff9640 1 -- 172.21.15.129:0/3077804142 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f028c0ad980 con 0x5625f009c5a0 2024-02-18T16:21:45.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0178ff9640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0160034210 0x7f01600366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0178ff9640 1 -- 172.21.15.129:0/3077804142 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f028c0f5a80 con 0x5625f009c5a0 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0297015640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0160034210 0x7f01600366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625f00ae900 0x5625f00b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b14f0 con 0x5625f00ae900 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625f00ae900 0x5625f00b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0297015640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0160034210 0x7f01600366d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0290011010 tx=0x7f0290020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625f00ae900 0x5625f00b0da0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 realm 2024-02-18T16:21:45.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b18c0 con 0x5625f00ae900 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b2110 con 0x5625f00ae900 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b2470 con 0x5625f00ae900 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b1db0 con 0x5625f00ae900 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 20 searching for the correct realm 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5625f00b46c0 0x5625f00b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296013640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5625f00b46c0 0x5625f00b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.941+0000 7f0296013640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5625f00b46c0 0x5625f00b6af0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0ec020 con 0x5625f00b46c0 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296013640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f028c0c7070 0x7f028c0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0297015640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f028c0c7070 0x7f028c0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0297015640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f028c0c7070 0x7f028c0ad030 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029000a4d0 con 0x7f028c0c7070 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0297015640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f02900141d0 0x7f0290015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f02900141d0 0x7f0290015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:45.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f02900141d0 0x7f0290015940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.945+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029000a4d0 con 0x7f028c0c7070 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.949+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f02900141d0 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.953+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00b46c0 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x5625f00ae900 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b71c0 con 0x7f028c0c7070 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:45.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b3310 con 0x5625f00ae900 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b2f90 con 0x5625f00ae900 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b3c60 con 0x5625f00ae900 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 zone default found 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 4 Realm: () 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 zonegroup default 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b7aa0 con 0x7f028c0c7070 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b9480 con 0x5625f00b46c0 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados->read ofs=0 len=0 2024-02-18T16:21:45.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b9830 con 0x5625f00b46c0 2024-02-18T16:21:45.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:45.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 started sync module instance, tier type = 2024-02-18T16:21:45.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:45.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.957+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b8a50 con 0x7f028c0c7070 2024-02-18T16:21:45.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720941067776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b8a50 con 0x7f028c0c7070 2024-02-18T16:21:45.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00ba2c0 con 0x5625f00ae900 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720941067776] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720941071808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b8a50 con 0x5625f00ae900 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.961+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bac80 con 0x5625f00b46c0 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720941074400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bb4d0 con 0x5625f00b46c0 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bbf30 con 0x7f028c0c7070 2024-02-18T16:21:45.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720941071808] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720941065648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bc2e0 con 0x7f028c0c7070 2024-02-18T16:21:45.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bcc90 con 0x5625f00ae900 2024-02-18T16:21:45.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.965+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720941074400] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720941065648] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720941076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bc7b0 con 0x5625f00ae900 2024-02-18T16:21:45.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bd4e0 con 0x7f02900141d0 2024-02-18T16:21:45.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720941083952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bd5f0 con 0x7f02900141d0 2024-02-18T16:21:45.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bdf60 con 0x7f02900141d0 2024-02-18T16:21:45.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.969+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720941076528] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720941083952] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720941079072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bdf60 con 0x7f02900141d0 2024-02-18T16:21:45.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bd150 con 0x7f02900141d0 2024-02-18T16:21:45.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720941079072] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720941087424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bdee0 con 0x7f02900141d0 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=0 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=1 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=2 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=3 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=4 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=5 2024-02-18T16:21:45.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.973+0000 7f0298cf9980 20 add_watcher() i=6 2024-02-18T16:21:45.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720941087424] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 20 add_watcher() i=7 2024-02-18T16:21:45.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:45.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c1900 con 0x5625f00ae900 2024-02-18T16:21:45.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720941089840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00becf0 con 0x5625f00ae900 2024-02-18T16:21:45.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720941089840] v32'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f014d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:45.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:45.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:45.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.977+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c9cb0 con 0x5625f00ae900 2024-02-18T16:21:45.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.981+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.981+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c9cb0 con 0x7f02900141d0 2024-02-18T16:21:45.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.981+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.981+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00ca1e0 con 0x5625f00b46c0 2024-02-18T16:21:45.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.981+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.981+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c9c10 con 0x5625f00ae900 2024-02-18T16:21:45.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.985+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.985+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cabb0 con 0x7f028c0c7070 2024-02-18T16:21:45.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.985+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.985+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cafb0 con 0x5625f00b46c0 2024-02-18T16:21:45.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.985+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:45.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.985+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cb980 con 0x5625f00ae900 2024-02-18T16:21:45.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.989+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:45.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.989+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cb980 con 0x7f02900141d0 2024-02-18T16:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.989+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.989+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cb980 con 0x7f028c0c7070 2024-02-18T16:21:45.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.993+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:45.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.993+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cbed0 con 0x5625f00b46c0 2024-02-18T16:21:46.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.993+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.993+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cc8a0 con 0x7f028c0c7070 2024-02-18T16:21:46.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.993+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.993+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7ec0 con 0x7f02900141d0 2024-02-18T16:21:46.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.997+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.997+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7e60 con 0x7f028c0c7070 2024-02-18T16:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.997+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:45.997+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7e60 con 0x7f02900141d0 2024-02-18T16:21:46.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.001+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.001+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7e60 con 0x5625f00ae900 2024-02-18T16:21:46.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.001+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.001+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7e60 con 0x5625f00b46c0 2024-02-18T16:21:46.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.005+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.005+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c8030 con 0x7f028c0c7070 2024-02-18T16:21:46.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.005+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.005+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00b46c0 2024-02-18T16:21:46.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.005+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.005+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00ae900 2024-02-18T16:21:46.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.009+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.009+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00ae900 2024-02-18T16:21:46.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.009+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.009+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00b46c0 2024-02-18T16:21:46.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.013+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.013+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x7f028c0c7070 2024-02-18T16:21:46.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.013+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.013+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00b46c0 2024-02-18T16:21:46.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.013+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.013+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00b46c0 2024-02-18T16:21:46.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.017+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.017+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00b46c0 2024-02-18T16:21:46.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.017+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.017+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x5625f00b46c0 2024-02-18T16:21:46.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.017+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.017+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd240 con 0x7f02900141d0 2024-02-18T16:21:46.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.021+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.021+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd5e0 con 0x5625f00b46c0 2024-02-18T16:21:46.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.021+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.021+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd5e0 con 0x7f02900141d0 2024-02-18T16:21:46.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.025+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.025+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd5e0 con 0x5625f00b46c0 2024-02-18T16:21:46.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.029+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.029+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd5e0 con 0x7f02900141d0 2024-02-18T16:21:46.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.029+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.029+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00cd5e0 con 0x7f028c0c7070 2024-02-18T16:21:46.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f00c7fff640 20 reqs_thread_entry: start 2024-02-18T16:21:46.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:46.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 20 Filter name: none 2024-02-18T16:21:46.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f00c5ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:46.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79f0 con 0x5625f00ae900 2024-02-18T16:21:46.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a50 con 0x7f02900141d0 2024-02-18T16:21:46.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.033+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79b0 con 0x5625f00b46c0 2024-02-18T16:21:46.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c6180 con 0x5625f00ae900 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79b0 con 0x7f028c0c7070 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.037+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00b46c0 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00ae900 2024-02-18T16:21:46.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f02900141d0 2024-02-18T16:21:46.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.041+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f028c0c7070 2024-02-18T16:21:46.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00b46c0 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f028c0c7070 2024-02-18T16:21:46.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.045+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f02900141d0 2024-02-18T16:21:46.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f028c0c7070 2024-02-18T16:21:46.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.049+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f02900141d0 2024-02-18T16:21:46.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00ae900 2024-02-18T16:21:46.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.053+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00b46c0 2024-02-18T16:21:46.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f028c0c7070 2024-02-18T16:21:46.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00b46c0 2024-02-18T16:21:46.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.057+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00ae900 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00b46c0 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x7f028c0c7070 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.061+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x5625f00b46c0 2024-02-18T16:21:46.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x5625f00b46c0 2024-02-18T16:21:46.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.065+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x7f02900141d0 2024-02-18T16:21:46.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.069+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x5625f00b46c0 2024-02-18T16:21:46.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x7f02900141d0 2024-02-18T16:21:46.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 37 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 38 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.073+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x5625f00b46c0 2024-02-18T16:21:46.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x5625f00b46c0 2024-02-18T16:21:46.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x7f02900141d0 2024-02-18T16:21:46.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 40 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f02900141d0 2024-02-18T16:21:46.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 41 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.077+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c79e0 con 0x7f028c0c7070 2024-02-18T16:21:46.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7190 con 0x7f028c0c7070 2024-02-18T16:21:46.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f014d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.081+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720941089840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00c7a10 con 0x5625f00ae900 2024-02-18T16:21:46.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.085+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94720941089840] v32'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.085+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720941067776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00be430 con 0x7f028c0c7070 2024-02-18T16:21:46.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.085+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94720941067776] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.085+0000 7f0298cf9980 20 remove_watcher() i=0 2024-02-18T16:21:46.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.085+0000 7f0298cf9980 2 removed watcher, disabling cache 2024-02-18T16:21:46.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.085+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720941071808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00be430 con 0x5625f00ae900 2024-02-18T16:21:46.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.089+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94720941071808] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.089+0000 7f0298cf9980 20 remove_watcher() i=1 2024-02-18T16:21:46.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.089+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720941074400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b9dc0 con 0x5625f00b46c0 2024-02-18T16:21:46.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.089+0000 7f0296013640 1 -- 172.21.15.129:0/3077804142 <== osd.3 v2:172.21.15.129:6800/2085458436 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94720941074400] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f028c0fe040 con 0x5625f00b46c0 2024-02-18T16:21:46.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.089+0000 7f0298cf9980 20 remove_watcher() i=2 2024-02-18T16:21:46.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.089+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720941065648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00be430 con 0x7f028c0c7070 2024-02-18T16:21:46.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.093+0000 7f0297015640 1 -- 172.21.15.129:0/3077804142 <== osd.2 v2:172.21.15.129:6808/222672308 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94720941065648] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f029003a040 con 0x7f028c0c7070 2024-02-18T16:21:46.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.093+0000 7f0298cf9980 20 remove_watcher() i=3 2024-02-18T16:21:46.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.093+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720941076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b85b0 con 0x5625f00ae900 2024-02-18T16:21:46.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.093+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.1 v2:172.21.15.129:6816/834716550 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94720941076528] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x5625f00ae900 2024-02-18T16:21:46.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.093+0000 7f0298cf9980 20 remove_watcher() i=4 2024-02-18T16:21:46.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.093+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720941083952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00be430 con 0x7f02900141d0 2024-02-18T16:21:46.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.097+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 42 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94720941083952] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.097+0000 7f0298cf9980 20 remove_watcher() i=5 2024-02-18T16:21:46.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.097+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720941079072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00bb030 con 0x7f02900141d0 2024-02-18T16:21:46.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 43 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94720941079072] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 20 remove_watcher() i=6 2024-02-18T16:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720941087424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5625f00b85b0 con 0x7f02900141d0 2024-02-18T16:21:46.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 <== osd.0 v2:172.21.15.80:6800/4245413050 44 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94720941087424] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0288014070 con 0x7f02900141d0 2024-02-18T16:21:46.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 20 remove_watcher() i=7 2024-02-18T16:21:46.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f02900141d0 msgr2=0x7f0290015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f02900141d0 0x7f0290015940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625f00ae900 msgr2=0x5625f00b0da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625f00ae900 0x5625f00b0da0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f028c0c7070 msgr2=0x7f028c0ad030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f028c0c7070 0x7f028c0ad030 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5625f00b46c0 msgr2=0x5625f00b6af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5625f00b46c0 0x5625f00b6af0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0160034210 msgr2=0x7f01600366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0160034210 0x7f01600366d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0290011010 tx=0x7f0290020000 comp rx=0 tx=0).stop 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0296814640 1 -- 172.21.15.129:0/3077804142 reap_dead start 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 msgr2=0x5625f00a3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f00a3520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f028c0c58f0 tx=0x7f028c0e4680 comp rx=0 tx=0).stop 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 shutdown_connections 2024-02-18T16:21:46.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 --2- 172.21.15.129:0/3077804142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f009c5a0 0x5625f00a3520 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 >> 172.21.15.129:0/3077804142 conn(0x5625f0098930 msgr2=0x5625f0095f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 shutdown_connections 2024-02-18T16:21:46.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.101+0000 7f0298cf9980 1 -- 172.21.15.129:0/3077804142 wait complete. 2024-02-18T16:21:46.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01700342b0 msgr2=0x7f0170036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01700342b0 0x7f0170036770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5625f007fb90 tx=0x7f0290005850 comp rx=0 tx=0).stop 2024-02-18T16:21:46.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 msgr2=0x5625f008fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 0x5625f008fa10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f028c0ab670 tx=0x7f028c018020 comp rx=0 tx=0).stop 2024-02-18T16:21:46.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 shutdown_connections 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01700342b0 0x7f0170036770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/267559769 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625f008f5f0 0x5625f008fa10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 >> 172.21.15.129:0/267559769 conn(0x5625f0084400 msgr2=0x5625f0084f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 shutdown_connections 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/267559769 wait complete. 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625eff8b850 msgr2=0x5625f007ed70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625eff8b850 0x5625f007ed70 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f017c0342b0 msgr2=0x7f017c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f017c0342b0 0x7f017c036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f028c0ad000 tx=0x7f028c0a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 msgr2=0x5625f00780f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00780f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0288001ee0 tx=0x7f0288000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 shutdown_connections 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5625eff8b850 0x5625f007ed70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f017c0342b0 0x7f017c036770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 --2- 172.21.15.129:0/2469172144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5625eff87350 0x5625f00780f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 >> 172.21.15.129:0/2469172144 conn(0x5625efefaa40 msgr2=0x5625f006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 shutdown_connections 2024-02-18T16:21:46.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.105+0000 7f0298cf9980 1 -- 172.21.15.129:0/2469172144 wait complete. 2024-02-18T16:21:46.125 INFO:teuthology.orchestra.run.smithi129.stdout:[] 2024-02-18T16:21:46.126 DEBUG:tasks.util.rgw: json result: [] 2024-02-18T16:21:46.126 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-18T16:21:46.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-18T16:21:46.126 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-18T16:21:46.206 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:46.206 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:46.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f6541e29980 1 Processor -- start 2024-02-18T16:21:46.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f6541e29980 1 -- start start 2024-02-18T16:21:46.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f6541e29980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560aceee1510 0x560aceee3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f6541e29980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560acee294c0 con 0x560acee51900 2024-02-18T16:21:46.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f6541e29980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x560acedf0180 con 0x560aceee1510 2024-02-18T16:21:46.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653f143640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560aceee1510 0x560aceee3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653f944640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x560acee51900 0x560aceedfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:36980/0 (socket says 172.21.15.129:36980) 2024-02-18T16:21:46.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653f143640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560aceee1510 0x560aceee3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45778/0 (socket says 172.21.15.129:45778) 2024-02-18T16:21:46.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653f944640 1 -- 172.21.15.129:0/2589845464 learned_addr learned my addr 172.21.15.129:0/2589845464 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:46.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653f143640 1 -- 172.21.15.129:0/2589845464 >> v1:172.21.15.80:6789/0 conn(0x560acee51900 legacy=0x560aceedfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653e942640 1 -- 172.21.15.129:0/2589845464 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651511371 0 0) 0x560acee294c0 con 0x560acee51900 2024-02-18T16:21:46.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.201+0000 7f653f143640 1 -- 172.21.15.129:0/2589845464 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560aceee4ee0 con 0x560aceee1510 2024-02-18T16:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f653f143640 1 --2- 172.21.15.129:0/2589845464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceee1510 0x560aceee3900 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f652800a480 tx=0x7f652801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992f6a8a0b3bd290 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f653e942640 1 -- 172.21.15.129:0/2589845464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280ab540 con 0x560aceee1510 2024-02-18T16:21:46.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f653e942640 1 -- 172.21.15.129:0/2589845464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280ab6a0 con 0x560aceee1510 2024-02-18T16:21:46.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f653e942640 1 -- 172.21.15.129:0/2589845464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280ab960 con 0x560aceee1510 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 -- 172.21.15.129:0/2589845464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceee1510 msgr2=0x560aceee3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 --2- 172.21.15.129:0/2589845464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceee1510 0x560aceee3900 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f652800a480 tx=0x7f652801b280 comp rx=0 tx=0).stop 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 -- 172.21.15.129:0/2589845464 shutdown_connections 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 --2- 172.21.15.129:0/2589845464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceee1510 0x560aceee3900 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 -- 172.21.15.129:0/2589845464 >> 172.21.15.129:0/2589845464 conn(0x560aceed7910 msgr2=0x560aceed9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 -- 172.21.15.129:0/2589845464 shutdown_connections 2024-02-18T16:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.205+0000 7f6541e29980 1 -- 172.21.15.129:0/2589845464 wait complete. 2024-02-18T16:21:46.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f6541e29980 1 Processor -- start 2024-02-18T16:21:46.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f6541e29980 1 -- start start 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f6541e29980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefc6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f6541e29980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aceded6b0 con 0x560acee51900 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f653f944640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefc6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f653f944640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefc6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45788/0 (socket says 172.21.15.129:45788) 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f653f944640 1 -- 172.21.15.129:0/4069895345 learned_addr learned my addr 172.21.15.129:0/4069895345 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f653f944640 1 -- 172.21.15.129:0/4069895345 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528005d30 con 0x560acee51900 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f653f944640 1 --2- 172.21.15.129:0/4069895345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefc6e70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f65380016c0 tx=0x7f6538001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2d0c3306467001 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f642de0b640 1 -- 172.21.15.129:0/4069895345 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6538003460 con 0x560acee51900 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f642de0b640 1 -- 172.21.15.129:0/4069895345 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380035c0 con 0x560acee51900 2024-02-18T16:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.221+0000 7f642de0b640 1 -- 172.21.15.129:0/4069895345 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65380038a0 con 0x560acee51900 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/4069895345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 msgr2=0x560acefc6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 --2- 172.21.15.129:0/4069895345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefc6e70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f65380016c0 tx=0x7f6538001b80 comp rx=0 tx=0).stop 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/4069895345 shutdown_connections 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 --2- 172.21.15.129:0/4069895345 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefc6e70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/4069895345 >> 172.21.15.129:0/4069895345 conn(0x560aceed7910 msgr2=0x560acefc2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/4069895345 shutdown_connections 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/4069895345 wait complete. 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 Processor -- start 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- start start 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefcdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acede8e90 con 0x560acee51900 2024-02-18T16:21:46.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f653f944640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefcdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f653f944640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefcdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45794/0 (socket says 172.21.15.129:45794) 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f653f944640 1 -- 172.21.15.129:0/3036430935 learned_addr learned my addr 172.21.15.129:0/3036430935 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f653f944640 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538006cf0 con 0x560acee51900 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f653f944640 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefcdd90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f65380012f0 tx=0x7f6538001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6427fff640 1 -- 172.21.15.129:0/3036430935 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6538013760 con 0x560acee51900 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6427fff640 1 -- 172.21.15.129:0/3036430935 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380138c0 con 0x560acee51900 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560acefce2d0 con 0x560acee51900 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6427fff640 1 -- 172.21.15.129:0/3036430935 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6538013b60 con 0x560acee51900 2024-02-18T16:21:46.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560acefce720 con 0x560acee51900 2024-02-18T16:21:46.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6427fff640 1 -- 172.21.15.129:0/3036430935 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6538013cc0 con 0x560acee51900 2024-02-18T16:21:46.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6427fff640 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64280342b0 0x7f6428036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.225+0000 7f6427fff640 1 -- 172.21.15.129:0/3036430935 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f6538049760 con 0x560acee51900 2024-02-18T16:21:46.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f653f143640 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64280342b0 0x7f6428036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560aceee1510 0x560acefd4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.237 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acefd4ec0 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560aceee1510 0x560acefd4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f653f143640 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64280342b0 0x7f6428036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65280ad000 tx=0x7f65280a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560aceee1510 0x560acefd4980 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 -- 172.21.15.129:0/3036430935 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65300083f0 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acefd5280 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 -- 172.21.15.129:0/3036430935 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f65300083f0 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acefd6b30 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 -- 172.21.15.129:0/3036430935 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f65300083f0 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acefd5d30 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 -- 172.21.15.129:0/3036430935 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f65300083f0 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acefd6140 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6540145640 1 -- 172.21.15.129:0/3036430935 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6530012040 con 0x560aceee1510 2024-02-18T16:21:46.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 Processor -- start 2024-02-18T16:21:46.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- start start 2024-02-18T16:21:46.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 0x560acefe5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f6541e29980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aced81f20 con 0x560acefe51f0 2024-02-18T16:21:46.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f653f143640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 0x560acefe5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f653f143640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 0x560acefe5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45798/0 (socket says 172.21.15.129:45798) 2024-02-18T16:21:46.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.229+0000 7f653f143640 1 -- 172.21.15.129:0/3070921081 learned_addr learned my addr 172.21.15.129:0/3070921081 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f653f143640 1 -- 172.21.15.129:0/3070921081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560acefe5b50 con 0x560acefe51f0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f653f143640 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 0x560acefe5610 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6528000c10 tx=0x7f6528018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f64257fa640 1 -- 172.21.15.129:0/3070921081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280b71a0 con 0x560acefe51f0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560acefe5d40 con 0x560acefe51f0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f64257fa640 1 -- 172.21.15.129:0/3070921081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280bc040 con 0x560acefe51f0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f64257fa640 1 -- 172.21.15.129:0/3070921081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280aa820 con 0x560acefe51f0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560acefe6830 con 0x560acefe51f0 2024-02-18T16:21:46.242 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f64257fa640 1 -- 172.21.15.129:0/3070921081 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65280aaa50 con 0x560acefe51f0 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f64257fa640 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64180342b0 0x7f6418036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f64257fa640 1 -- 172.21.15.129:0/3070921081 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f65280e5f10 con 0x560acefe51f0 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6540145640 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64180342b0 0x7f6418036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6541e29980 1 Processor -- start 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6541e29980 1 -- start start 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6540145640 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64180342b0 0x7f6418036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x560acefd5770 tx=0x7f6530003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6541e29980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceedd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f6541e29980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aced75790 con 0x560aceedd380 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f653f143640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceedd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f653f143640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceedd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45812/0 (socket says 172.21.15.129:45812) 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f653f143640 1 -- 172.21.15.129:0/1945172831 learned_addr learned my addr 172.21.15.129:0/1945172831 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.233+0000 7f653f143640 1 -- 172.21.15.129:0/1945172831 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560aceedbbd0 con 0x560aceedd380 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f653f143640 1 --2- 172.21.15.129:0/1945172831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceedd7a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65280c8f90 tx=0x7f65280b4ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71e5f40d98842c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f641effd640 1 -- 172.21.15.129:0/1945172831 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280b5930 con 0x560aceedd380 2024-02-18T16:21:46.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f641effd640 1 -- 172.21.15.129:0/1945172831 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280b5a90 con 0x560aceedd380 2024-02-18T16:21:46.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f641effd640 1 -- 172.21.15.129:0/1945172831 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280b5560 con 0x560aceedd380 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/1945172831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 msgr2=0x560aceedd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 --2- 172.21.15.129:0/1945172831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceedd7a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65280c8f90 tx=0x7f65280b4ac0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/1945172831 shutdown_connections 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 --2- 172.21.15.129:0/1945172831 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceedd7a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/1945172831 >> 172.21.15.129:0/1945172831 conn(0x560acefee540 msgr2=0x560acefec5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/1945172831 shutdown_connections 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/1945172831 wait complete. 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 Processor -- start 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- start start 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceffb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aceffb890 con 0x560aceedd380 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f653f143640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceffb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f653f143640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceffb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45826/0 (socket says 172.21.15.129:45826) 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 learned_addr learned my addr 172.21.15.129:0/3062234270 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560acefe6830 con 0x560aceedd380 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f653f143640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceffb350 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f65280c8f30 tx=0x7f65280e4230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f641d7fa640 1 -- 172.21.15.129:0/3062234270 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280e3070 con 0x560aceedd380 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560aceffba90 con 0x560aceedd380 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f641d7fa640 1 -- 172.21.15.129:0/3062234270 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280bfc90 con 0x560aceedd380 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f641d7fa640 1 -- 172.21.15.129:0/3062234270 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65280bfe00 con 0x560aceedd380 2024-02-18T16:21:46.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.237+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560aceffbec0 con 0x560aceedd380 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f641d7fa640 1 -- 172.21.15.129:0/3062234270 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f65280db020 con 0x560aceedd380 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f641d7fa640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6408034260 0x7f6408036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f641d7fa640 1 -- 172.21.15.129:0/3062234270 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f65280f4d60 con 0x560aceedd380 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6540145640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6408034260 0x7f6408036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560acf0067b0 0x560acf008c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0093c0 con 0x560acf0067b0 2024-02-18T16:21:46.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560acf0067b0 0x560acf008c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6540145640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6408034260 0x7f6408036720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6530008fd0 tx=0x7f653001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560acf0067b0 0x560acf008c70 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 realm 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf009790 con 0x560acf0067b0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00a010 con 0x560acf0067b0 2024-02-18T16:21:46.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00a370 con 0x560acf0067b0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00ab70 con 0x560acf0067b0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 20 searching for the correct realm 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560acf00ca00 0x560acf00eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f143640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560acf00ca00 0x560acf00eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.241+0000 7f653f143640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560acf00ca00 0x560acf00eea0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f143640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f65280f3060 0x7f65280e4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f6540145640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f65280f3060 0x7f65280e4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f6540145640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f65280f3060 0x7f65280e4610 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653002c040 con 0x7f65280f3060 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f6540145640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6530027940 0x7f65300333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6530027940 0x7f65300333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6530027940 0x7f65300333c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.245+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653002c040 con 0x7f65280f3060 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f653002c040 con 0x7f65280f3060 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.249+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653002c040 con 0x7f65280f3060 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653002c040 con 0x7f65280f3060 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.253+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f6530027940 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653002c040 con 0x7f65280f3060 2024-02-18T16:21:46.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf00ca00 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x560acf0067b0 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f570 con 0x7f65280f3060 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:46.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00b4d0 con 0x560acf0067b0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00bd20 con 0x560acf0067b0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00f9b0 con 0x560acf0067b0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:46.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 zone default found 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 4 Realm: () 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 zonegroup default 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf00fe50 con 0x7f65280f3060 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf011830 con 0x560acf00ca00 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf011b90 con 0x560acf00ca00 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.257+0000 7f6541e29980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 20 started sync module instance, tier type = 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf010e00 con 0x7f65280f3060 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94604422615472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf010e00 con 0x7f65280f3060 2024-02-18T16:21:46.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf012600 con 0x560acf0067b0 2024-02-18T16:21:46.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94604422615472] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94604422619424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf010e00 con 0x560acf0067b0 2024-02-18T16:21:46.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.261+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf012ff0 con 0x560acf00ca00 2024-02-18T16:21:46.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94604422622032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf013840 con 0x560acf00ca00 2024-02-18T16:21:46.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf014260 con 0x7f65280f3060 2024-02-18T16:21:46.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94604422619424] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94604422626624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf014610 con 0x7f65280f3060 2024-02-18T16:21:46.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.265+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf014fc0 con 0x560acf0067b0 2024-02-18T16:21:46.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94604422622032] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94604422626624] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94604422613344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf014ae0 con 0x560acf0067b0 2024-02-18T16:21:46.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf015810 con 0x7f6530027940 2024-02-18T16:21:46.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94604422613344] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94604422624160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf015500 con 0x7f6530027940 2024-02-18T16:21:46.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.269+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf015d00 con 0x7f6530027940 2024-02-18T16:21:46.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.273+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.273+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94604422632976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf016050 con 0x7f6530027940 2024-02-18T16:21:46.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.273+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf016b20 con 0x7f6530027940 2024-02-18T16:21:46.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.273+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94604422624160] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94604422632976] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94604422637056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf015ab0 con 0x7f6530027940 2024-02-18T16:21:46.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=0 2024-02-18T16:21:46.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=1 2024-02-18T16:21:46.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=2 2024-02-18T16:21:46.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=3 2024-02-18T16:21:46.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=4 2024-02-18T16:21:46.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=5 2024-02-18T16:21:46.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=6 2024-02-18T16:21:46.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94604422637056] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 20 add_watcher() i=7 2024-02-18T16:21:46.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:46.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf019b10 con 0x560acf0067b0 2024-02-18T16:21:46.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.277+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94604422631520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf016f80 con 0x560acf0067b0 2024-02-18T16:21:46.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94604422631520] v32'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f63f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f6541e29980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:46.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f6541e29980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:46.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf022040 con 0x560acf0067b0 2024-02-18T16:21:46.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.281+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf022480 con 0x7f6530027940 2024-02-18T16:21:46.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.285+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.285+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf022920 con 0x560acf00ca00 2024-02-18T16:21:46.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.285+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.285+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf023120 con 0x560acf0067b0 2024-02-18T16:21:46.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.285+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.285+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf020100 con 0x7f65280f3060 2024-02-18T16:21:46.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.289+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.289+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf020100 con 0x560acf00ca00 2024-02-18T16:21:46.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.289+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.289+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf024300 con 0x560acf0067b0 2024-02-18T16:21:46.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.293+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.298 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.293+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf024300 con 0x7f6530027940 2024-02-18T16:21:46.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.293+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.293+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf024300 con 0x7f65280f3060 2024-02-18T16:21:46.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.297+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.297+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf024830 con 0x560acf00ca00 2024-02-18T16:21:46.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.297+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.297+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf024d60 con 0x7f65280f3060 2024-02-18T16:21:46.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.297+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.297+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf025290 con 0x7f6530027940 2024-02-18T16:21:46.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.301+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.301+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf025290 con 0x7f65280f3060 2024-02-18T16:21:46.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.301+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.301+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0253d0 con 0x7f6530027940 2024-02-18T16:21:46.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.305+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.305+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf0067b0 2024-02-18T16:21:46.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.305+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.305+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f650 con 0x560acf00ca00 2024-02-18T16:21:46.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.309+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.309+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f650 con 0x7f65280f3060 2024-02-18T16:21:46.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.309+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.309+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f650 con 0x560acf00ca00 2024-02-18T16:21:46.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.309+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.309+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f650 con 0x560acf0067b0 2024-02-18T16:21:46.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.313+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.313+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01ee90 con 0x560acf0067b0 2024-02-18T16:21:46.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.313+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.313+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01ee90 con 0x560acf00ca00 2024-02-18T16:21:46.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.317+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.317+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01ee90 con 0x7f65280f3060 2024-02-18T16:21:46.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.317+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.317+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf00ca00 2024-02-18T16:21:46.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.317+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.317+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf00ca00 2024-02-18T16:21:46.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.321+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.321+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf00ca00 2024-02-18T16:21:46.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.321+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.321+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf00ca00 2024-02-18T16:21:46.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.325+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.325+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x7f6530027940 2024-02-18T16:21:46.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.325+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.325+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf00ca00 2024-02-18T16:21:46.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.329+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.329+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x7f6530027940 2024-02-18T16:21:46.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.333+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.333+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x560acf00ca00 2024-02-18T16:21:46.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.333+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.333+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x7f6530027940 2024-02-18T16:21:46.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.337+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.337+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01f060 con 0x7f65280f3060 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.337+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f63f4fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 20 Filter name: none 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f636e7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01e390 con 0x560acf0067b0 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:46.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:46.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:46.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01e390 con 0x7f65280f3060 2024-02-18T16:21:46.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.350 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-18T16:21:46.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f63f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.341+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94604422631520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01e390 con 0x560acf0067b0 2024-02-18T16:21:46.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.345+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94604422631520] v32'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.345+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94604422615472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf01e390 con 0x7f65280f3060 2024-02-18T16:21:46.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.345+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94604422615472] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.345+0000 7f6541e29980 20 remove_watcher() i=0 2024-02-18T16:21:46.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.345+0000 7f6541e29980 2 removed watcher, disabling cache 2024-02-18T16:21:46.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.345+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94604422619424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0111b0 con 0x560acf0067b0 2024-02-18T16:21:46.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.349+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94604422619424] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.349+0000 7f6541e29980 20 remove_watcher() i=1 2024-02-18T16:21:46.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.349+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94604422622032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0111b0 con 0x560acf00ca00 2024-02-18T16:21:46.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.349+0000 7f653f143640 1 -- 172.21.15.129:0/3062234270 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94604422622032] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f65280e0ca0 con 0x560acf00ca00 2024-02-18T16:21:46.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.349+0000 7f6541e29980 20 remove_watcher() i=2 2024-02-18T16:21:46.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.349+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94604422626624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0111b0 con 0x7f65280f3060 2024-02-18T16:21:46.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.353+0000 7f6540145640 1 -- 172.21.15.129:0/3062234270 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94604422626624] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f653003f040 con 0x7f65280f3060 2024-02-18T16:21:46.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.353+0000 7f6541e29980 20 remove_watcher() i=3 2024-02-18T16:21:46.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.353+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94604422613344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf013d40 con 0x560acf0067b0 2024-02-18T16:21:46.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.353+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94604422613344] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x560acf0067b0 2024-02-18T16:21:46.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.353+0000 7f6541e29980 20 remove_watcher() i=4 2024-02-18T16:21:46.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.353+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94604422624160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0111b0 con 0x7f6530027940 2024-02-18T16:21:46.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.357+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94604422624160] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.357+0000 7f6541e29980 20 remove_watcher() i=5 2024-02-18T16:21:46.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.357+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94604422632976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf010960 con 0x7f6530027940 2024-02-18T16:21:46.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94604422632976] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 20 remove_watcher() i=6 2024-02-18T16:21:46.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94604422637056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560acf0111b0 con 0x7f6530027940 2024-02-18T16:21:46.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94604422637056] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6538024020 con 0x7f6530027940 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 20 remove_watcher() i=7 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6530027940 msgr2=0x7f65300333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6530027940 0x7f65300333c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560acf0067b0 msgr2=0x560acf008c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560acf0067b0 0x560acf008c70 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f65280f3060 msgr2=0x7f65280e4610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f65280f3060 0x7f65280e4610 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560acf00ca00 msgr2=0x560acf00eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560acf00ca00 0x560acf00eea0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6408034260 msgr2=0x7f6408036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6408034260 0x7f6408036720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6530008fd0 tx=0x7f653001c070 comp rx=0 tx=0).stop 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f653f944640 1 -- 172.21.15.129:0/3062234270 reap_dead start 2024-02-18T16:21:46.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 msgr2=0x560aceffb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceffb350 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f65280c8f30 tx=0x7f65280e4230 comp rx=0 tx=0).stop 2024-02-18T16:21:46.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 shutdown_connections 2024-02-18T16:21:46.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3062234270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560aceedd380 0x560aceffb350 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 >> 172.21.15.129:0/3062234270 conn(0x560acefee540 msgr2=0x560acefebba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 shutdown_connections 2024-02-18T16:21:46.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3062234270 wait complete. 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64180342b0 msgr2=0x7f6418036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64180342b0 0x7f6418036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x560acefd5770 tx=0x7f6530003070 comp rx=0 tx=0).stop 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 msgr2=0x560acefe5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 0x560acefe5610 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6528000c10 tx=0x7f6528018020 comp rx=0 tx=0).stop 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 shutdown_connections 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64180342b0 0x7f6418036770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 --2- 172.21.15.129:0/3070921081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acefe51f0 0x560acefe5610 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 >> 172.21.15.129:0/3070921081 conn(0x560acefda000 msgr2=0x560acefdab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 shutdown_connections 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.361+0000 7f6541e29980 1 -- 172.21.15.129:0/3070921081 wait complete. 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560aceee1510 msgr2=0x560acefd4980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560aceee1510 0x560acefd4980 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64280342b0 msgr2=0x7f6428036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64280342b0 0x7f6428036770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65280ad000 tx=0x7f65280a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 msgr2=0x560acefcdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefcdd90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f65380012f0 tx=0x7f6538001260 comp rx=0 tx=0).stop 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 shutdown_connections 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560aceee1510 0x560acefd4980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f64280342b0 0x7f6428036770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 --2- 172.21.15.129:0/3036430935 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560acee51900 0x560acefcdd90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 >> 172.21.15.129:0/3036430935 conn(0x560aceed7910 msgr2=0x560acefc1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 shutdown_connections 2024-02-18T16:21:46.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.365+0000 7f6541e29980 1 -- 172.21.15.129:0/3036430935 wait complete. 2024-02-18T16:21:46.382 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-18T16:21:46.395 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-02-18T16:21:46.402 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:46.447 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:46.468 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:46.512 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-18T16:21:46.523 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:46.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-18T16:21:46.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-18T16:21:46.524 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-18T16:21:46.563 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:46.563 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:46.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc181bd5980 1 Processor -- start 2024-02-18T16:21:46.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc181bd5980 1 -- start start 2024-02-18T16:21:46.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc181bd5980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5602c5ccc090 0x5602c5d5ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc181bd5980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5602c5ca44d0 con 0x5602c5d5b350 2024-02-18T16:21:46.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc181bd5980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5602c5c6b180 con 0x5602c5ccc090 2024-02-18T16:21:46.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc17f6f0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5602c5ccc090 0x5602c5d5ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc17f6f0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5602c5ccc090 0x5602c5d5ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45836/0 (socket says 172.21.15.129:45836) 2024-02-18T16:21:46.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc17f6f0640 1 -- 172.21.15.129:0/2284931454 learned_addr learned my addr 172.21.15.129:0/2284931454 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc17f6f0640 1 -- 172.21.15.129:0/2284931454 >> v1:172.21.15.80:6789/0 conn(0x5602c5d5b350 legacy=0x5602c5d5d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.557+0000 7fc17f6f0640 1 -- 172.21.15.129:0/2284931454 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602c5d5ff00 con 0x5602c5ccc090 2024-02-18T16:21:46.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/2284931454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d5ae10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc17000a4e0 tx=0x7fc17001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd1bb591d7fb508 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc17e6ee640 1 -- 172.21.15.129:0/2284931454 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1700aa540 con 0x5602c5ccc090 2024-02-18T16:21:46.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc17e6ee640 1 -- 172.21.15.129:0/2284931454 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700a6070 con 0x5602c5ccc090 2024-02-18T16:21:46.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc17e6ee640 1 -- 172.21.15.129:0/2284931454 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1700aa850 con 0x5602c5ccc090 2024-02-18T16:21:46.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 -- 172.21.15.129:0/2284931454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 msgr2=0x5602c5d5ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 --2- 172.21.15.129:0/2284931454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d5ae10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc17000a4e0 tx=0x7fc17001b090 comp rx=0 tx=0).stop 2024-02-18T16:21:46.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 -- 172.21.15.129:0/2284931454 shutdown_connections 2024-02-18T16:21:46.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 --2- 172.21.15.129:0/2284931454 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d5ae10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 -- 172.21.15.129:0/2284931454 >> 172.21.15.129:0/2284931454 conn(0x5602c5d528f0 msgr2=0x5602c5d54d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 -- 172.21.15.129:0/2284931454 shutdown_connections 2024-02-18T16:21:46.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.561+0000 7fc181bd5980 1 -- 172.21.15.129:0/2284931454 wait complete. 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc181bd5980 1 Processor -- start 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc181bd5980 1 -- start start 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc181bd5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5e42100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc181bd5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602c5c686b0 con 0x5602c5ccc090 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc17f6f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5e42100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc17f6f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5e42100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45844/0 (socket says 172.21.15.129:45844) 2024-02-18T16:21:46.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4208217140 learned_addr learned my addr 172.21.15.129:0/4208217140 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.577+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4208217140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17000a1c0 con 0x5602c5ccc090 2024-02-18T16:21:46.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/4208217140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5e42100 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc170018cc0 tx=0x7fc1700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9d84c000785728 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc06d60a640 1 -- 172.21.15.129:0/4208217140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1700aa700 con 0x5602c5ccc090 2024-02-18T16:21:46.586 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc06d60a640 1 -- 172.21.15.129:0/4208217140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700aa860 con 0x5602c5ccc090 2024-02-18T16:21:46.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc06d60a640 1 -- 172.21.15.129:0/4208217140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1700aab20 con 0x5602c5ccc090 2024-02-18T16:21:46.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/4208217140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 msgr2=0x5602c5e42100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4208217140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5e42100 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc170018cc0 tx=0x7fc1700033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/4208217140 shutdown_connections 2024-02-18T16:21:46.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4208217140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5e42100 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/4208217140 >> 172.21.15.129:0/4208217140 conn(0x5602c5d528f0 msgr2=0x5602c5e3dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/4208217140 shutdown_connections 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/4208217140 wait complete. 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 Processor -- start 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- start start 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d58590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602c5c63e90 con 0x5602c5ccc090 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc17f6f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d58590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc17f6f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d58590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45860/0 (socket says 172.21.15.129:45860) 2024-02-18T16:21:46.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc17f6f0640 1 -- 172.21.15.129:0/3585321196 learned_addr learned my addr 172.21.15.129:0/3585321196 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc17f6f0640 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602c5d5ff00 con 0x5602c5ccc090 2024-02-18T16:21:46.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d58590 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc170018cc0 tx=0x7fc170017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc06be07640 1 -- 172.21.15.129:0/3585321196 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1700c4070 con 0x5602c5ccc090 2024-02-18T16:21:46.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc06be07640 1 -- 172.21.15.129:0/3585321196 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700b5780 con 0x5602c5ccc090 2024-02-18T16:21:46.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602c5d58ad0 con 0x5602c5ccc090 2024-02-18T16:21:46.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc06be07640 1 -- 172.21.15.129:0/3585321196 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1700b5a20 con 0x5602c5ccc090 2024-02-18T16:21:46.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.581+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602c5d56fd0 con 0x5602c5ccc090 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc06be07640 1 -- 172.21.15.129:0/3585321196 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc1700a8070 con 0x5602c5ccc090 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc06be07640 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc064034350 0x7fc064036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc06be07640 1 -- 172.21.15.129:0/3585321196 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc1700e3e00 con 0x5602c5ccc090 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5d5b350 0x5602c5e51db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17eeef640 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc064034350 0x7fc064036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e522f0 con 0x5602c5d5b350 2024-02-18T16:21:46.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5d5b350 0x5602c5e51db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17eeef640 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc064034350 0x7fc064036810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc174000f70 tx=0x7fc174001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5d5b350 0x5602c5e51db0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 -- 172.21.15.129:0/3585321196 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1780083f0 con 0x5602c5d5b350 2024-02-18T16:21:46.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e52650 con 0x5602c5d5b350 2024-02-18T16:21:46.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 -- 172.21.15.129:0/3585321196 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc1780083f0 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e53f00 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 -- 172.21.15.129:0/3585321196 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc1780083f0 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e53100 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 -- 172.21.15.129:0/3585321196 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc1780083f0 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e53510 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.585+0000 7fc17fef1640 1 -- 172.21.15.129:0/3585321196 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc178012040 con 0x5602c5d5b350 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc181bd5980 1 Processor -- start 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc181bd5980 1 -- start start 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc181bd5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 0x5602c5e629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc181bd5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602c5bfcf20 con 0x5602c5e625c0 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc17eeef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 0x5602c5e629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc17eeef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 0x5602c5e629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45864/0 (socket says 172.21.15.129:45864) 2024-02-18T16:21:46.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc17eeef640 1 -- 172.21.15.129:0/449781666 learned_addr learned my addr 172.21.15.129:0/449781666 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc17eeef640 1 -- 172.21.15.129:0/449781666 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602c5e62f20 con 0x5602c5e625c0 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc17eeef640 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 0x5602c5e629e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc17400f3d0 tx=0x7fc17400f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc069602640 1 -- 172.21.15.129:0/449781666 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17400e6b0 con 0x5602c5e625c0 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc069602640 1 -- 172.21.15.129:0/449781666 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400e810 con 0x5602c5e625c0 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602c5e63170 con 0x5602c5e625c0 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc069602640 1 -- 172.21.15.129:0/449781666 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17400ead0 con 0x5602c5e625c0 2024-02-18T16:21:46.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602c5e63cc0 con 0x5602c5e625c0 2024-02-18T16:21:46.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc069602640 1 -- 172.21.15.129:0/449781666 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc17400ec30 con 0x5602c5e625c0 2024-02-18T16:21:46.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc069602640 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc058034350 0x7fc058036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc069602640 1 -- 172.21.15.129:0/449781666 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc174018040 con 0x5602c5e625c0 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.589+0000 7fc17fef1640 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc058034350 0x7fc058036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 Processor -- start 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- start start 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e6f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17fef1640 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc058034350 0x7fc058036810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5602c5e52b40 tx=0x7fc178003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602c5bf0790 con 0x5602c5e6f5c0 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e6f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e6f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45870/0 (socket says 172.21.15.129:45870) 2024-02-18T16:21:46.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 -- 172.21.15.129:0/1219617225 learned_addr learned my addr 172.21.15.129:0/1219617225 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 -- 172.21.15.129:0/1219617225 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602c5e6ff70 con 0x5602c5e6f5c0 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 --2- 172.21.15.129:0/1219617225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e6f9a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc17400fd70 tx=0x7fc17400a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32c18025b0c03cb server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc062ffd640 1 -- 172.21.15.129:0/1219617225 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17401a310 con 0x5602c5e6f5c0 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc062ffd640 1 -- 172.21.15.129:0/1219617225 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17401c930 con 0x5602c5e6f5c0 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc062ffd640 1 -- 172.21.15.129:0/1219617225 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17401c410 con 0x5602c5e6f5c0 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- 172.21.15.129:0/1219617225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 msgr2=0x5602c5e6f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 --2- 172.21.15.129:0/1219617225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e6f9a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc17400fd70 tx=0x7fc17400a040 comp rx=0 tx=0).stop 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- 172.21.15.129:0/1219617225 shutdown_connections 2024-02-18T16:21:46.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 --2- 172.21.15.129:0/1219617225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e6f9a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- 172.21.15.129:0/1219617225 >> 172.21.15.129:0/1219617225 conn(0x5602c5e6b900 msgr2=0x5602c5e69960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- 172.21.15.129:0/1219617225 shutdown_connections 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- 172.21.15.129:0/1219617225 wait complete. 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 Processor -- start 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- start start 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e76400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc181bd5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602c5e76940 con 0x5602c5e6f5c0 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e76400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e76400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45882/0 (socket says 172.21.15.129:45882) 2024-02-18T16:21:46.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 learned_addr learned my addr 172.21.15.129:0/4260438707 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.593+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602c5e63cc0 con 0x5602c5e6f5c0 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17eeef640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e76400 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc17401ad50 tx=0x7fc1740493f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc0617fa640 1 -- 172.21.15.129:0/4260438707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1740237c0 con 0x5602c5e6f5c0 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5602c5e76b40 con 0x5602c5e6f5c0 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc0617fa640 1 -- 172.21.15.129:0/4260438707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174023920 con 0x5602c5e6f5c0 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc0617fa640 1 -- 172.21.15.129:0/4260438707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1740496d0 con 0x5602c5e6f5c0 2024-02-18T16:21:46.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602c5e76f10 con 0x5602c5e6f5c0 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc0617fa640 1 -- 172.21.15.129:0/4260438707 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc17404d060 con 0x5602c5e6f5c0 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc0617fa640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc0480342b0 0x7fc048036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc0617fa640 1 -- 172.21.15.129:0/4260438707 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc174030d80 con 0x5602c5e6f5c0 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17fef1640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc0480342b0 0x7fc048036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5e81690 0x5602c5e83b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e842a0 con 0x5602c5e81690 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5e81690 0x5602c5e83b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.605 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17fef1640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc0480342b0 0x7fc048036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc178008fd0 tx=0x7fc17801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5e81690 0x5602c5e83b50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 realm 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e84670 con 0x5602c5e81690 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e84ef0 con 0x5602c5e81690 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e85250 con 0x5602c5e81690 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.597+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e85a50 con 0x5602c5e81690 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc181bd5980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc181bd5980 20 searching for the correct realm 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5602c5e878e0 0x5602c5e89d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17eeef640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5602c5e878e0 0x5602c5e89d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17eeef640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5602c5e878e0 0x5602c5e89d50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17eeef640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc17401c030 0x7fc1740498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17fef1640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc17401c030 0x7fc1740498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17fef1640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc17401c030 0x7fc1740498c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17802c040 con 0x7fc17401c030 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17fef1640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc178027940 0x7fc1780333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc178027940 0x7fc1780333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc178027940 0x7fc1780333c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.601+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17802c040 con 0x7fc17401c030 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.605+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc17802c040 con 0x7fc17401c030 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.619 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17802c040 con 0x7fc17401c030 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.609+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17802c040 con 0x7fc17401c030 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc178027940 2024-02-18T16:21:46.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1700c01e0 con 0x7fc178027940 2024-02-18T16:21:46.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17802c040 con 0x7fc17401c030 2024-02-18T16:21:46.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e878e0 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x5602c5e81690 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a420 con 0x7fc17401c030 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:46.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e86380 con 0x5602c5e81690 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1700c01e0 con 0x5602c5e81690 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e86bd0 con 0x5602c5e81690 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.613+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e86bd0 con 0x5602c5e81690 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:46.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 zone default found 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 4 Realm: () 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 zonegroup default 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8a860 con 0x7fc17401c030 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8c2d0 con 0x5602c5e878e0 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8c780 con 0x5602c5e878e0 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 started sync module instance, tier type = 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8bb20 con 0x7fc17401c030 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569910285952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8bed0 con 0x7fc17401c030 2024-02-18T16:21:46.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8d4e0 con 0x5602c5e81690 2024-02-18T16:21:46.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.617+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569910285952] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569910291360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8bed0 con 0x5602c5e81690 2024-02-18T16:21:46.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8db10 con 0x5602c5e878e0 2024-02-18T16:21:46.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569910291360] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569910292416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8dec0 con 0x5602c5e878e0 2024-02-18T16:21:46.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.621+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8e830 con 0x7fc17401c030 2024-02-18T16:21:46.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569910297792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8f080 con 0x7fc17401c030 2024-02-18T16:21:46.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8fae0 con 0x5602c5e81690 2024-02-18T16:21:46.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569910292416] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569910297792] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569910294016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8ebe0 con 0x5602c5e81690 2024-02-18T16:21:46.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.625+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e90330 con 0x7fc178027940 2024-02-18T16:21:46.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569910294016] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569910302160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8ebe0 con 0x7fc178027940 2024-02-18T16:21:46.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e90820 con 0x7fc178027940 2024-02-18T16:21:46.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569910305568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e90c80 con 0x7fc178027940 2024-02-18T16:21:46.637 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.629+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e91660 con 0x7fc178027940 2024-02-18T16:21:46.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569910302160] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569910305568] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569910309248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8fc90 con 0x7fc178027940 2024-02-18T16:21:46.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=0 2024-02-18T16:21:46.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=1 2024-02-18T16:21:46.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=2 2024-02-18T16:21:46.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=3 2024-02-18T16:21:46.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=4 2024-02-18T16:21:46.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=5 2024-02-18T16:21:46.643 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=6 2024-02-18T16:21:46.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569910309248] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 20 add_watcher() i=7 2024-02-18T16:21:46.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:46.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e94690 con 0x5602c5e81690 2024-02-18T16:21:46.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.637+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569910306784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e91b00 con 0x5602c5e81690 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569910306784] v32'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc035fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 5 note: GC not initialized 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc034fe1640 20 reqs_thread_entry: start 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 Filter name: none 2024-02-18T16:21:46.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fbfae7fc640 20 reqs_thread_entry: start 2024-02-18T16:21:46.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:46.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5eb6a30 con 0x7fc17401c030 2024-02-18T16:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 : miss 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:63 8.1c 8:3e656b3b:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5eb8300 con 0x5602c5e878e0 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(63 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 info.flags=0x17 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 to cache LRU end 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 get_obj_state: octx=0x7fc1700e0040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5602c5eba708 s->prefetch_data=0 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 3.33s0 3:cc4bee8d:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5ebb860 con 0x7fc178027940 2024-02-18T16:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(64 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+864 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 10 manifest: total_size = 5 2024-02-18T16:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.641+0000 7fc181bd5980 20 get_obj_state: setting s->obj_tag to _9JSVlYaCDFoRuKHhDVAnVrcfmbtxu23 2024-02-18T16:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc035fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569910306784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5ebb860 con 0x5602c5e81690 2024-02-18T16:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94569910306784] v32'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569910285952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5ebb860 con 0x7fc17401c030 2024-02-18T16:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94569910285952] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc181bd5980 20 remove_watcher() i=0 2024-02-18T16:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc181bd5980 2 removed watcher, disabling cache 2024-02-18T16:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.645+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569910291360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5ebb860 con 0x5602c5e81690 2024-02-18T16:21:46.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.649+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94569910291360] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.649+0000 7fc181bd5980 20 remove_watcher() i=1 2024-02-18T16:21:46.655 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.649+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569910292416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5ebb860 con 0x5602c5e878e0 2024-02-18T16:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.649+0000 7fc17eeef640 1 -- 172.21.15.129:0/4260438707 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94569910292416] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc174035020 con 0x5602c5e878e0 2024-02-18T16:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.649+0000 7fc181bd5980 20 remove_watcher() i=2 2024-02-18T16:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.649+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569910297792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5ea85d0 con 0x7fc17401c030 2024-02-18T16:21:46.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.653+0000 7fc17fef1640 1 -- 172.21.15.129:0/4260438707 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94569910297792] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc17803f040 con 0x7fc17401c030 2024-02-18T16:21:46.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.653+0000 7fc181bd5980 20 remove_watcher() i=3 2024-02-18T16:21:46.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.653+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569910294016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8b680 con 0x5602c5e81690 2024-02-18T16:21:46.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.653+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94569910294016] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x5602c5e81690 2024-02-18T16:21:46.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.653+0000 7fc181bd5980 20 remove_watcher() i=4 2024-02-18T16:21:46.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.653+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569910302160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8d600 con 0x7fc178027940 2024-02-18T16:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.657+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94569910302160] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.657+0000 7fc181bd5980 20 remove_watcher() i=5 2024-02-18T16:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.657+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569910305568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8b680 con 0x7fc178027940 2024-02-18T16:21:46.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.657+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94569910305568] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.657+0000 7fc181bd5980 20 remove_watcher() i=6 2024-02-18T16:21:46.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.657+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569910309248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5602c5e8b680 con 0x7fc178027940 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94569910309248] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1700fc040 con 0x7fc178027940 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 20 remove_watcher() i=7 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc178027940 msgr2=0x7fc1780333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fc178027940 0x7fc1780333c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5e81690 msgr2=0x5602c5e83b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5e81690 0x5602c5e83b50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc17401c030 msgr2=0x7fc1740498c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fc17401c030 0x7fc1740498c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5602c5e878e0 msgr2=0x5602c5e89d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5602c5e878e0 0x5602c5e89d50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc0480342b0 msgr2=0x7fc048036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc0480342b0 0x7fc048036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc178008fd0 tx=0x7fc17801c070 comp rx=0 tx=0).stop 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 msgr2=0x5602c5e76400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc17f6f0640 1 -- 172.21.15.129:0/4260438707 reap_dead start 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e76400 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc17401ad50 tx=0x7fc1740493f0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 shutdown_connections 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/4260438707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e6f5c0 0x5602c5e76400 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 >> 172.21.15.129:0/4260438707 conn(0x5602c5e6b900 msgr2=0x5602c5e68f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 shutdown_connections 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/4260438707 wait complete. 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc058034350 msgr2=0x7fc058036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc058034350 0x7fc058036810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5602c5e52b40 tx=0x7fc178003070 comp rx=0 tx=0).stop 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 msgr2=0x5602c5e629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 0x5602c5e629e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc17400f3d0 tx=0x7fc17400f7d0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 shutdown_connections 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc058034350 0x7fc058036810 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/449781666 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5e625c0 0x5602c5e629e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 >> 172.21.15.129:0/449781666 conn(0x5602c5e573d0 msgr2=0x5602c5e57ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 shutdown_connections 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/449781666 wait complete. 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5d5b350 msgr2=0x5602c5e51db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5d5b350 0x5602c5e51db0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc064034350 msgr2=0x7fc064036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc064034350 0x7fc064036810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc174000f70 tx=0x7fc174001420 comp rx=0 tx=0).stop 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 msgr2=0x5602c5d58590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d58590 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc170018cc0 tx=0x7fc170017e30 comp rx=0 tx=0).stop 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 shutdown_connections 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5602c5d5b350 0x5602c5e51db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc064034350 0x7fc064036810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 --2- 172.21.15.129:0/3585321196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5602c5ccc090 0x5602c5d58590 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 >> 172.21.15.129:0/3585321196 conn(0x5602c5d528f0 msgr2=0x5602c5e3c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 shutdown_connections 2024-02-18T16:21:46.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.661+0000 7fc181bd5980 1 -- 172.21.15.129:0/3585321196 wait complete. 2024-02-18T16:21:46.679 INFO:teuthology.orchestra.run.smithi129.stdout:fooFoofooFooFULL_CONTROL 2024-02-18T16:21:46.680 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-02-18T16:21:46.683 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-02-18T16:21:46.690 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:46.690 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-18T16:21:46.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-18T16:21:46.690 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-18T16:21:46.756 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:46.756 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:46.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b3bace980 1 Processor -- start 2024-02-18T16:21:46.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b3bace980 1 -- start start 2024-02-18T16:21:46.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b3bace980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560d07ffd860 0x560d07fffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b3bace980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560d07f434d0 con 0x560d07ff9360 2024-02-18T16:21:46.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b3bace980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x560d07f0a180 con 0x560d07ffd860 2024-02-18T16:21:46.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b33fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x560d07ffd860 0x560d07fffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b395e9640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x560d07ff9360 0x560d07ff9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:37004/0 (socket says 172.21.15.129:37004) 2024-02-18T16:21:46.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b395e9640 1 -- 172.21.15.129:0/3381380113 learned_addr learned my addr 172.21.15.129:0/3381380113 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:46.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.749+0000 7f7b33fff640 1 -- 172.21.15.129:0/3381380113 >> v1:172.21.15.80:6789/0 conn(0x560d07ff9360 legacy=0x560d07ff9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b33fff640 1 -- 172.21.15.129:0/3381380113 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d080011a0 con 0x560d07ffd860 2024-02-18T16:21:46.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b33fff640 1 --2- 172.21.15.129:0/3381380113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ffd860 0x560d07fffc50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400a480 tx=0x7f7b2401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4429dd57205eccaa server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b38de8640 1 -- 172.21.15.129:0/3381380113 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240ab540 con 0x560d07ffd860 2024-02-18T16:21:46.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b38de8640 1 -- 172.21.15.129:0/3381380113 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240ab6a0 con 0x560d07ffd860 2024-02-18T16:21:46.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b38de8640 1 -- 172.21.15.129:0/3381380113 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240ab960 con 0x560d07ffd860 2024-02-18T16:21:46.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 -- 172.21.15.129:0/3381380113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ffd860 msgr2=0x560d07fffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3381380113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ffd860 0x560d07fffc50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400a480 tx=0x7f7b2401b280 comp rx=0 tx=0).stop 2024-02-18T16:21:46.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 -- 172.21.15.129:0/3381380113 shutdown_connections 2024-02-18T16:21:46.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3381380113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ffd860 0x560d07fffc50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 -- 172.21.15.129:0/3381380113 >> 172.21.15.129:0/3381380113 conn(0x560d07f6ca50 msgr2=0x560d07f6ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 -- 172.21.15.129:0/3381380113 shutdown_connections 2024-02-18T16:21:46.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.753+0000 7f7b3bace980 1 -- 172.21.15.129:0/3381380113 wait complete. 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b3bace980 1 Processor -- start 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b3bace980 1 -- start start 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b3bace980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b3bace980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d07f076b0 con 0x560d07ff9360 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b395e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b395e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45900/0 (socket says 172.21.15.129:45900) 2024-02-18T16:21:46.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b395e9640 1 -- 172.21.15.129:0/3082893849 learned_addr learned my addr 172.21.15.129:0/3082893849 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.769+0000 7f7b395e9640 1 -- 172.21.15.129:0/3082893849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24005d30 con 0x560d07ff9360 2024-02-18T16:21:46.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b395e9640 1 --2- 172.21.15.129:0/3082893849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080e3310 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c001c90 tx=0x7f7b2c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f197eb1a94869b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7a27606640 1 -- 172.21.15.129:0/3082893849 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b2c00e690 con 0x560d07ff9360 2024-02-18T16:21:46.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7a27606640 1 -- 172.21.15.129:0/3082893849 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00e7f0 con 0x560d07ff9360 2024-02-18T16:21:46.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7a27606640 1 -- 172.21.15.129:0/3082893849 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b2c00eaf0 con 0x560d07ff9360 2024-02-18T16:21:46.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3082893849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 msgr2=0x560d080e3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3082893849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080e3310 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c001c90 tx=0x7f7b2c00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3082893849 shutdown_connections 2024-02-18T16:21:46.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3082893849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080e3310 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3082893849 >> 172.21.15.129:0/3082893849 conn(0x560d07f6ca50 msgr2=0x560d080deea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3082893849 shutdown_connections 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3082893849 wait complete. 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 Processor -- start 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- start start 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d07f02e90 con 0x560d07ff9360 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b395e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b395e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45912/0 (socket says 172.21.15.129:45912) 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b395e9640 1 -- 172.21.15.129:0/3865288361 learned_addr learned my addr 172.21.15.129:0/3865288361 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b395e9640 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d07f434d0 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b395e9640 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080ea160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c001ee0 tx=0x7f7b2c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7a25e03640 1 -- 172.21.15.129:0/3865288361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b2c01f070 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7a25e03640 1 -- 172.21.15.129:0/3865288361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c01a4d0 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d080ea6a0 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7a25e03640 1 -- 172.21.15.129:0/3865288361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b2c01a770 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.773+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d080eaaf0 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7a25e03640 1 -- 172.21.15.129:0/3865288361 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7b2c00a040 con 0x560d07ff9360 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7a25e03640 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a20034300 0x7f7a200367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7a25e03640 1 -- 172.21.15.129:0/3865288361 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7b2c0497a0 con 0x560d07ff9360 2024-02-18T16:21:46.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b33fff640 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a20034300 0x7f7a200367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d07ffd860 0x560d080f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d080f1320 con 0x560d07ffd860 2024-02-18T16:21:46.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d07ffd860 0x560d080f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b33fff640 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a20034300 0x7f7a200367c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7b240ad000 tx=0x7f7b240a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d07ffd860 0x560d080f0de0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 -- 172.21.15.129:0/3865288361 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7b3400a4d0 con 0x560d07ffd860 2024-02-18T16:21:46.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d080f1700 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 -- 172.21.15.129:0/3865288361 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7b3400a4d0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d080f2fb0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 -- 172.21.15.129:0/3865288361 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7b3400a4d0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d080f21b0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 -- 172.21.15.129:0/3865288361 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7b3400a4d0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d080f25c0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b39dea640 1 -- 172.21.15.129:0/3865288361 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7b3400a4d0 con 0x560d07ffd860 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 Processor -- start 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.777+0000 7f7b3bace980 1 -- start start 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 0x560d08101a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d07e9bf20 con 0x560d08101670 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b33fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 0x560d08101a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b33fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 0x560d08101a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45920/0 (socket says 172.21.15.129:45920) 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b33fff640 1 -- 172.21.15.129:0/2267822349 learned_addr learned my addr 172.21.15.129:0/2267822349 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b33fff640 1 -- 172.21.15.129:0/2267822349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d08101fd0 con 0x560d08101670 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b33fff640 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 0x560d08101a90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7b240ab670 tx=0x7f7b24018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7a1effd640 1 -- 172.21.15.129:0/2267822349 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240be7c0 con 0x560d08101670 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7a1effd640 1 -- 172.21.15.129:0/2267822349 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240be920 con 0x560d08101670 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d081021c0 con 0x560d08101670 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7a1effd640 1 -- 172.21.15.129:0/2267822349 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240bebc0 con 0x560d08101670 2024-02-18T16:21:46.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d08102d10 con 0x560d08101670 2024-02-18T16:21:46.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7a1effd640 1 -- 172.21.15.129:0/2267822349 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7b240bd3e0 con 0x560d08101670 2024-02-18T16:21:46.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7a1effd640 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a100342b0 0x7f7a10036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7a1effd640 1 -- 172.21.15.129:0/2267822349 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7b240e63a0 con 0x560d08101670 2024-02-18T16:21:46.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b39dea640 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a100342b0 0x7f7a10036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 Processor -- start 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 -- start start 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b39dea640 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a100342b0 0x7f7a10036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x560d080f1bf0 tx=0x7f7b34005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d0810ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.781+0000 7f7b3bace980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d07e8f790 con 0x560d0810e690 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d0810ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d0810ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45934/0 (socket says 172.21.15.129:45934) 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 -- 172.21.15.129:0/351350145 learned_addr learned my addr 172.21.15.129:0/351350145 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 -- 172.21.15.129:0/351350145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d0810f060 con 0x560d0810e690 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 --2- 172.21.15.129:0/351350145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d0810ea90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7b240e4720 tx=0x7f7b240c5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f660e6a0ce0adc66 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7a1cff9640 1 -- 172.21.15.129:0/351350145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240e60d0 con 0x560d0810e690 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7a1cff9640 1 -- 172.21.15.129:0/351350145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240bccd0 con 0x560d0810e690 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7a1cff9640 1 -- 172.21.15.129:0/351350145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240e31d0 con 0x560d0810e690 2024-02-18T16:21:46.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- 172.21.15.129:0/351350145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 msgr2=0x560d0810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 --2- 172.21.15.129:0/351350145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d0810ea90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7b240e4720 tx=0x7f7b240c5f50 comp rx=0 tx=0).stop 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- 172.21.15.129:0/351350145 shutdown_connections 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 --2- 172.21.15.129:0/351350145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d0810ea90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- 172.21.15.129:0/351350145 >> 172.21.15.129:0/351350145 conn(0x560d0810a9d0 msgr2=0x560d08108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- 172.21.15.129:0/351350145 shutdown_connections 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- 172.21.15.129:0/351350145 wait complete. 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 Processor -- start 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- start start 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d081155f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d08115b30 con 0x560d0810e690 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d081155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d081155f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45942/0 (socket says 172.21.15.129:45942) 2024-02-18T16:21:46.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 learned_addr learned my addr 172.21.15.129:0/1692953073 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:46.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d08102d10 con 0x560d0810e690 2024-02-18T16:21:46.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b33fff640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d081155f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7b240b5ec0 tx=0x7f7b240e4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7a0effd640 1 -- 172.21.15.129:0/1692953073 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240d5040 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7a0effd640 1 -- 172.21.15.129:0/1692953073 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240bd7c0 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d08115d30 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.785+0000 7f7a0effd640 1 -- 172.21.15.129:0/1692953073 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b240bc4b0 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d08116160 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7a0effd640 1 -- 172.21.15.129:0/1692953073 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7b240d8070 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7a0effd640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a04034300 0x7f7a040367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7a0effd640 1 -- 172.21.15.129:0/1692953073 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7b240ac050 con 0x560d0810e690 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b39dea640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a04034300 0x7f7a040367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d08120b70 0x560d08123030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08123780 con 0x560d08120b70 2024-02-18T16:21:46.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d08120b70 0x560d08123030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b39dea640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a04034300 0x7f7a040367c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7b34011010 tx=0x7f7b34020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d08120b70 0x560d08123030 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7b2c014070 con 0x560d08120b70 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 realm 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08123b50 con 0x560d08120b70 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7b2c014070 con 0x560d08120b70 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d081243d0 con 0x560d08120b70 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7b2c014070 con 0x560d08120b70 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08124730 con 0x560d08120b70 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7b2c014070 con 0x560d08120b70 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08124f30 con 0x560d08120b70 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7b2c014070 con 0x560d08120b70 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:46.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 20 searching for the correct realm 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560d08126dc0 0x560d08129280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.789+0000 7f7b33fff640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560d08126dc0 0x560d08129280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b33fff640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560d08126dc0 0x560d08129280 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b33fff640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7b240f0060 0x7f7b240da880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b39dea640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7b240f0060 0x7f7b240da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b39dea640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7b240f0060 0x7f7b240da880 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3400a4d0 con 0x7f7b240f0060 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b39dea640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7b340141d0 0x7f7b34015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7b340141d0 0x7f7b34015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7b340141d0 0x7f7b34015940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x7f7b340141d0 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7b2c035040 con 0x560d08120b70 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x560d08120b70 2024-02-18T16:21:46.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.793+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x7f7b340141d0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x7f7b340141d0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3400a4d0 con 0x7f7b240f0060 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x560d08120b70 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x7f7b340141d0 2024-02-18T16:21:46.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x560d08120b70 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.797+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x7f7b340141d0 2024-02-18T16:21:46.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.811 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c035040 con 0x560d08120b70 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7b2c035040 con 0x560d08120b70 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.801+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b340141d0 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08126dc0 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x560d08120b70 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129950 con 0x7f7b240f0060 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:46.817 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08125830 con 0x560d08120b70 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08126080 con 0x560d08120b70 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129d90 con 0x560d08120b70 2024-02-18T16:21:46.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 zone default found 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 4 Realm: () 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 zonegroup default 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08129d90 con 0x7f7b240f0060 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.805+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812bb50 con 0x560d08126dc0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812bee0 con 0x560d08126dc0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 20 started sync module instance, tier type = 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812b430 con 0x7f7b240f0060 2024-02-18T16:21:46.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94613970005904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812b7e0 con 0x7f7b240f0060 2024-02-18T16:21:46.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812cc20 con 0x560d08120b70 2024-02-18T16:21:46.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.809+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94613970005904] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94613970010848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812cbe0 con 0x560d08120b70 2024-02-18T16:21:46.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812d680 con 0x560d08126dc0 2024-02-18T16:21:46.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94613970010848] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94613970014560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812da30 con 0x560d08126dc0 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.813+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812e3a0 con 0x7f7b240f0060 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94613970018320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812ead0 con 0x7f7b240f0060 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812f580 con 0x560d08120b70 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94613970014560] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94613970018320] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94613970022528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812f540 con 0x560d08120b70 2024-02-18T16:21:46.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.817+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812e6a0 con 0x7f7b340141d0 2024-02-18T16:21:46.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94613970022528] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94613970011904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812fdb0 con 0x7f7b340141d0 2024-02-18T16:21:46.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08130720 con 0x7f7b340141d0 2024-02-18T16:21:46.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94613970011904] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94613970024992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08130720 con 0x7f7b340141d0 2024-02-18T16:21:46.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.821+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08130f60 con 0x7f7b340141d0 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94613970028320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d081315e0 con 0x7f7b340141d0 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=0 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=1 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=2 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=3 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=4 2024-02-18T16:21:46.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=5 2024-02-18T16:21:46.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94613970024992] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=6 2024-02-18T16:21:46.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94613970028320] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 20 add_watcher() i=7 2024-02-18T16:21:46.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:46.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08134500 con 0x560d08120b70 2024-02-18T16:21:46.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.825+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94613970030640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d081318f0 con 0x560d08120b70 2024-02-18T16:21:46.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94613970030640] v32'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f79ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:46.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:46.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 5 note: GC not initialized 2024-02-18T16:21:46.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f79ee7e4640 20 reqs_thread_entry: start 2024-02-18T16:21:46.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:46.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 Filter name: none 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f795ffff640 20 reqs_thread_entry: start 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08156900 con 0x7f7b240f0060 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 : miss 2024-02-18T16:21:46.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 rados->read ofs=0 len=0 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:63 8.1c 8:3e656b3b:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d081581d0 con 0x560d08126dc0 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(63 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 info.flags=0x17 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 to cache LRU end 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 get_obj_state: octx=0x7f7b2c017e80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x560d0815a6c8 s->prefetch_data=0 2024-02-18T16:21:46.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 3.33s0 3:cc4bee8d:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0815b800 con 0x7f7b340141d0 2024-02-18T16:21:46.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(64 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 10 manifest: total_size = 5 2024-02-18T16:21:46.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.829+0000 7f7b3bace980 20 get_obj_state: setting s->obj_tag to _JzBej8sDwTnpP430tDqOaId3UvTWA65 2024-02-18T16:21:46.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f79ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:46.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94613970030640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0815b800 con 0x560d08120b70 2024-02-18T16:21:46.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94613970030640] v32'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94613970005904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0815b800 con 0x7f7b240f0060 2024-02-18T16:21:46.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94613970005904] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b3bace980 20 remove_watcher() i=0 2024-02-18T16:21:46.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b3bace980 2 removed watcher, disabling cache 2024-02-18T16:21:46.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.833+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94613970010848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0815b800 con 0x560d08120b70 2024-02-18T16:21:46.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.837+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94613970010848] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.837+0000 7f7b3bace980 20 remove_watcher() i=1 2024-02-18T16:21:46.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.837+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94613970014560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0815b800 con 0x560d08126dc0 2024-02-18T16:21:46.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.837+0000 7f7b33fff640 1 -- 172.21.15.129:0/1692953073 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94613970014560] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b240f6040 con 0x560d08126dc0 2024-02-18T16:21:46.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.837+0000 7f7b3bace980 20 remove_watcher() i=2 2024-02-18T16:21:46.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.837+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94613970018320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d08148480 con 0x7f7b240f0060 2024-02-18T16:21:46.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.841+0000 7f7b39dea640 1 -- 172.21.15.129:0/1692953073 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94613970018320] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b3403a040 con 0x7f7b240f0060 2024-02-18T16:21:46.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.841+0000 7f7b3bace980 20 remove_watcher() i=3 2024-02-18T16:21:46.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.841+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94613970022528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812af90 con 0x560d08120b70 2024-02-18T16:21:46.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.841+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94613970022528] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x560d08120b70 2024-02-18T16:21:46.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.841+0000 7f7b3bace980 20 remove_watcher() i=4 2024-02-18T16:21:46.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.841+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94613970011904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812c2e0 con 0x7f7b340141d0 2024-02-18T16:21:46.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.845+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94613970011904] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.845+0000 7f7b3bace980 20 remove_watcher() i=5 2024-02-18T16:21:46.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.845+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94613970024992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812d160 con 0x7f7b340141d0 2024-02-18T16:21:46.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.845+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94613970024992] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.845+0000 7f7b3bace980 20 remove_watcher() i=6 2024-02-18T16:21:46.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.845+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94613970028320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560d0812d160 con 0x7f7b340141d0 2024-02-18T16:21:46.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94613970028320] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7b2c04f040 con 0x7f7b340141d0 2024-02-18T16:21:46.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 20 remove_watcher() i=7 2024-02-18T16:21:46.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7b340141d0 msgr2=0x7f7b34015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7b340141d0 0x7f7b34015940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d08120b70 msgr2=0x560d08123030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d08120b70 0x560d08123030 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7b240f0060 msgr2=0x7f7b240da880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7b240f0060 0x7f7b240da880 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560d08126dc0 msgr2=0x560d08129280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x560d08126dc0 0x560d08129280 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a04034300 msgr2=0x7f7a040367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a04034300 0x7f7a040367c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7b34011010 tx=0x7f7b34020000 comp rx=0 tx=0).stop 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 msgr2=0x560d081155f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b395e9640 1 -- 172.21.15.129:0/1692953073 reap_dead start 2024-02-18T16:21:46.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d081155f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7b240b5ec0 tx=0x7f7b240e4680 comp rx=0 tx=0).stop 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 shutdown_connections 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/1692953073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d0810e690 0x560d081155f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 >> 172.21.15.129:0/1692953073 conn(0x560d0810a9d0 msgr2=0x560d08108030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 shutdown_connections 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/1692953073 wait complete. 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a100342b0 msgr2=0x7f7a10036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a100342b0 0x7f7a10036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x560d080f1bf0 tx=0x7f7b34005850 comp rx=0 tx=0).stop 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 msgr2=0x560d08101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 0x560d08101a90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7b240ab670 tx=0x7f7b24018020 comp rx=0 tx=0).stop 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 shutdown_connections 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a100342b0 0x7f7a10036770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/2267822349 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d08101670 0x560d08101a90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 >> 172.21.15.129:0/2267822349 conn(0x560d080f6480 msgr2=0x560d080f6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 shutdown_connections 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/2267822349 wait complete. 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d07ffd860 msgr2=0x560d080f0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d07ffd860 0x560d080f0de0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a20034300 msgr2=0x7f7a200367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a20034300 0x7f7a200367c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7b240ad000 tx=0x7f7b240a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 msgr2=0x560d080ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080ea160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c001ee0 tx=0x7f7b2c000ee0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 shutdown_connections 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x560d07ffd860 0x560d080f0de0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7a20034300 0x7f7a200367c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 --2- 172.21.15.129:0/3865288361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x560d07ff9360 0x560d080ea160 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 >> 172.21.15.129:0/3865288361 conn(0x560d07f6ca50 msgr2=0x560d080dd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:46.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 shutdown_connections 2024-02-18T16:21:46.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.849+0000 7f7b3bace980 1 -- 172.21.15.129:0/3865288361 wait complete. 2024-02-18T16:21:46.868 INFO:teuthology.orchestra.run.smithi129.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-18T16:21:46.868 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-18T16:21:46.871 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-02-18T16:21:46.890 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:46.960 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-18T16:21:46.960 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-18T16:21:46.960 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-18T16:21:46.960 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-18T16:21:46.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-18T16:21:46.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-18T16:21:46.961 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-02-18T16:21:46.998 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:46.999 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107cb8c980 1 Processor -- start 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107cb8c980 1 -- start start 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107cb8c980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55bf09dbe870 0x55bf09dbec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107cb8c980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bf09d074d0 con 0x55bf09dbd330 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107cb8c980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bf09cce180 con 0x55bf09dbe870 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107a6a7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55bf09dbe870 0x55bf09dbec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f1079ea6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55bf09dbd330 0x55bf09dbd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:37008/0 (socket says 172.21.15.129:37008) 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107a6a7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55bf09dbe870 0x55bf09dbec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45950/0 (socket says 172.21.15.129:45950) 2024-02-18T16:21:47.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f1079ea6640 1 -- 172.21.15.129:0/3062688657 learned_addr learned my addr 172.21.15.129:0/3062688657 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:47.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107a6a7640 1 -- 172.21.15.129:0/3062688657 >> v1:172.21.15.80:6789/0 conn(0x55bf09dbd330 legacy=0x55bf09dbd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.993+0000 7f107a6a7640 1 -- 172.21.15.129:0/3062688657 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf09dbf3d0 con 0x55bf09dbe870 2024-02-18T16:21:47.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107a6a7640 1 --2- 172.21.15.129:0/3062688657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbe870 0x55bf09dbec50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f106c00a420 tx=0x7f106c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f33e95dd56e59e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f10796a5640 1 -- 172.21.15.129:0/3062688657 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106c0aa530 con 0x55bf09dbe870 2024-02-18T16:21:47.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f10796a5640 1 -- 172.21.15.129:0/3062688657 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c0a6050 con 0x55bf09dbe870 2024-02-18T16:21:47.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f10796a5640 1 -- 172.21.15.129:0/3062688657 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106c0aa800 con 0x55bf09dbe870 2024-02-18T16:21:47.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 -- 172.21.15.129:0/3062688657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbe870 msgr2=0x55bf09dbec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 --2- 172.21.15.129:0/3062688657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbe870 0x55bf09dbec50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f106c00a420 tx=0x7f106c01afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 -- 172.21.15.129:0/3062688657 shutdown_connections 2024-02-18T16:21:47.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 --2- 172.21.15.129:0/3062688657 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbe870 0x55bf09dbec50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 -- 172.21.15.129:0/3062688657 >> 172.21.15.129:0/3062688657 conn(0x55bf09d30a50 msgr2=0x55bf09d30e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 -- 172.21.15.129:0/3062688657 shutdown_connections 2024-02-18T16:21:47.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:46.997+0000 7f107cb8c980 1 -- 172.21.15.129:0/3062688657 wait complete. 2024-02-18T16:21:47.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107cb8c980 1 Processor -- start 2024-02-18T16:21:47.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107cb8c980 1 -- start start 2024-02-18T16:21:47.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107cb8c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09ea77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107cb8c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf09ccb6b0 con 0x55bf09dbd330 2024-02-18T16:21:47.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107a6a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09ea77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107a6a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09ea77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45954/0 (socket says 172.21.15.129:45954) 2024-02-18T16:21:47.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107a6a7640 1 -- 172.21.15.129:0/260873690 learned_addr learned my addr 172.21.15.129:0/260873690 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107a6a7640 1 -- 172.21.15.129:0/260873690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c00a100 con 0x55bf09dbd330 2024-02-18T16:21:47.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f107a6a7640 1 --2- 172.21.15.129:0/260873690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09ea77b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f106c0ad040 tx=0x7f106c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3767ab4a109f1d85 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f0f68608640 1 -- 172.21.15.129:0/260873690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106c0aa6c0 con 0x55bf09dbd330 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f0f68608640 1 -- 172.21.15.129:0/260873690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c0aa820 con 0x55bf09dbd330 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.013+0000 7f0f68608640 1 -- 172.21.15.129:0/260873690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106c0aaac0 con 0x55bf09dbd330 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/260873690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 msgr2=0x55bf09ea77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 --2- 172.21.15.129:0/260873690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09ea77b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f106c0ad040 tx=0x7f106c0033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/260873690 shutdown_connections 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 --2- 172.21.15.129:0/260873690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09ea77b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/260873690 >> 172.21.15.129:0/260873690 conn(0x55bf09d30a50 msgr2=0x55bf09ea3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/260873690 shutdown_connections 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/260873690 wait complete. 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 Processor -- start 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- start start 2024-02-18T16:21:47.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09eae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf09cc6e90 con 0x55bf09dbd330 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107a6a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09eae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107a6a7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09eae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45960/0 (socket says 172.21.15.129:45960) 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107a6a7640 1 -- 172.21.15.129:0/2482621377 learned_addr learned my addr 172.21.15.129:0/2482621377 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107a6a7640 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf09dbf3d0 con 0x55bf09dbd330 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107a6a7640 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09eae500 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f106c003430 tx=0x7f106c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f0f66e05640 1 -- 172.21.15.129:0/2482621377 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106c0b6920 con 0x55bf09dbd330 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f0f66e05640 1 -- 172.21.15.129:0/2482621377 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c0b6a80 con 0x55bf09dbd330 2024-02-18T16:21:47.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf09eaea40 con 0x55bf09dbd330 2024-02-18T16:21:47.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f0f66e05640 1 -- 172.21.15.129:0/2482621377 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f106c0b6d20 con 0x55bf09dbd330 2024-02-18T16:21:47.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf09eaee70 con 0x55bf09dbd330 2024-02-18T16:21:47.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f0f66e05640 1 -- 172.21.15.129:0/2482621377 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f106c0c0450 con 0x55bf09dbd330 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f0f66e05640 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f600342b0 0x7f0f60036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f0f66e05640 1 -- 172.21.15.129:0/2482621377 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f106c0e4060 con 0x55bf09dbd330 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f1079ea6640 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f600342b0 0x7f0f60036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.017+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09dbe870 0x55bf09eb5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eb5670 con 0x55bf09dbe870 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09dbe870 0x55bf09eb5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f1079ea6640 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f600342b0 0x7f0f60036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1070000f70 tx=0x7f10700012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09dbe870 0x55bf09eb5130 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 -- 172.21.15.129:0/2482621377 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10740083f0 con 0x55bf09dbe870 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eb59f0 con 0x55bf09dbe870 2024-02-18T16:21:47.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 -- 172.21.15.129:0/2482621377 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f10740083f0 con 0x55bf09dbe870 2024-02-18T16:21:47.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eb72a0 con 0x55bf09dbe870 2024-02-18T16:21:47.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 -- 172.21.15.129:0/2482621377 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f10740083f0 con 0x55bf09dbe870 2024-02-18T16:21:47.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eb64a0 con 0x55bf09dbe870 2024-02-18T16:21:47.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 -- 172.21.15.129:0/2482621377 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f10740083f0 con 0x55bf09dbe870 2024-02-18T16:21:47.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eb68b0 con 0x55bf09dbe870 2024-02-18T16:21:47.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107aea8640 1 -- 172.21.15.129:0/2482621377 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1074012040 con 0x55bf09dbe870 2024-02-18T16:21:47.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 Processor -- start 2024-02-18T16:21:47.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- start start 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 0x55bf09ec5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f107cb8c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf09c5ff20 con 0x55bf09ec59b0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f1079ea6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 0x55bf09ec5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f1079ea6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 0x55bf09ec5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45968/0 (socket says 172.21.15.129:45968) 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f1079ea6640 1 -- 172.21.15.129:0/3078668038 learned_addr learned my addr 172.21.15.129:0/3078668038 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.021+0000 7f1079ea6640 1 -- 172.21.15.129:0/3078668038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf09ec6310 con 0x55bf09ec59b0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f1079ea6640 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 0x55bf09ec5dd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1070001ee0 tx=0x7f107000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5ffff640 1 -- 172.21.15.129:0/3078668038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1070020070 con 0x55bf09ec59b0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf09ec6560 con 0x55bf09ec59b0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5ffff640 1 -- 172.21.15.129:0/3078668038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107000c770 con 0x55bf09ec59b0 2024-02-18T16:21:47.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5ffff640 1 -- 172.21.15.129:0/3078668038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1070013040 con 0x55bf09ec59b0 2024-02-18T16:21:47.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf09ec70b0 con 0x55bf09ec59b0 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5ffff640 1 -- 172.21.15.129:0/3078668038 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f107000a040 con 0x55bf09ec59b0 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5ffff640 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f540342b0 0x7f0f54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5ffff640 1 -- 172.21.15.129:0/3078668038 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f107004b750 con 0x55bf09ec59b0 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107aea8640 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f540342b0 0x7f0f54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107cb8c980 1 Processor -- start 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107cb8c980 1 -- start start 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107aea8640 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f540342b0 0x7f0f54036770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55bf09eb5ee0 tx=0x7f1074003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107cb8c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f107cb8c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf09c53790 con 0x55bf09ed2990 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f1079ea6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f1079ea6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45974/0 (socket says 172.21.15.129:45974) 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f1079ea6640 1 -- 172.21.15.129:0/1015506915 learned_addr learned my addr 172.21.15.129:0/1015506915 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f1079ea6640 1 -- 172.21.15.129:0/1015506915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf09ed3360 con 0x55bf09ed2990 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f1079ea6640 1 --2- 172.21.15.129:0/1015506915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed2d90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1070049aa0 tx=0x7f10700198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28ae46a0f0bff27 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5dffb640 1 -- 172.21.15.129:0/1015506915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1070048070 con 0x55bf09ed2990 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5dffb640 1 -- 172.21.15.129:0/1015506915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107003a2b0 con 0x55bf09ed2990 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.025+0000 7f0f5dffb640 1 -- 172.21.15.129:0/1015506915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f107003a440 con 0x55bf09ed2990 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/1015506915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 msgr2=0x55bf09ed2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 --2- 172.21.15.129:0/1015506915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed2d90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1070049aa0 tx=0x7f10700198d0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/1015506915 shutdown_connections 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 --2- 172.21.15.129:0/1015506915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed2d90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/1015506915 >> 172.21.15.129:0/1015506915 conn(0x55bf09ececd0 msgr2=0x55bf09eccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/1015506915 shutdown_connections 2024-02-18T16:21:47.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/1015506915 wait complete. 2024-02-18T16:21:47.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 Processor -- start 2024-02-18T16:21:47.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- start start 2024-02-18T16:21:47.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf09ed9d40 con 0x55bf09ed2990 2024-02-18T16:21:47.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f1079ea6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f1079ea6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:45988/0 (socket says 172.21.15.129:45988) 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 learned_addr learned my addr 172.21.15.129:0/2504454045 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf09ec70b0 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f1079ea6640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed9800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f10700199a0 tx=0x7f1070049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f0f4bfff640 1 -- 172.21.15.129:0/2504454045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f107004b410 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf09ed9f40 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f0f4bfff640 1 -- 172.21.15.129:0/2504454045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107004b570 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f0f4bfff640 1 -- 172.21.15.129:0/2504454045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10700481e0 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.029+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf09eda3d0 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f0f4bfff640 1 -- 172.21.15.129:0/2504454045 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1070048340 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f0f4bfff640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f440342b0 0x7f0f44036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f0f4bfff640 1 -- 172.21.15.129:0/2504454045 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1070039d70 con 0x55bf09ed2990 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107aea8640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f440342b0 0x7f0f44036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09ee4df0 0x55bf09ee72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ee7a00 con 0x55bf09ee4df0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09ee4df0 0x55bf09ee72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107aea8640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f440342b0 0x7f0f44036770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1074008fd0 tx=0x7f107401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09ee4df0 0x55bf09ee72b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 realm 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ee7dd0 con 0x55bf09ee4df0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:47.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ee8620 con 0x55bf09ee4df0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ee8980 con 0x55bf09ee4df0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ee9180 con 0x55bf09ee4df0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 20 searching for the correct realm 2024-02-18T16:21:47.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bf09eeb0d0 0x55bf09eed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f1079ea6640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bf09eeb0d0 0x55bf09eed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f1079ea6640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bf09eeb0d0 0x55bf09eed500 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1070022070 con 0x55bf09eeb0d0 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f1079ea6640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1070038070 0x7f107001f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.033+0000 7f107aea8640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1070038070 0x7f107001f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107aea8640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1070038070 0x7f107001f130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107402c040 con 0x7f1070038070 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107aea8640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1074027940 0x7f10740333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1074027940 0x7f10740333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1074027940 0x7f10740333c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.037+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107402c040 con 0x7f1070038070 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1070022070 con 0x55bf09eeb0d0 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f107402c040 con 0x7f1070038070 2024-02-18T16:21:47.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1070022070 con 0x55bf09eeb0d0 2024-02-18T16:21:47.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.041+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107402c040 con 0x7f1070038070 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107402c040 con 0x7f1070038070 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1074027940 2024-02-18T16:21:47.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f106c0c6070 con 0x7f1074027940 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.045+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107402c040 con 0x7f1070038070 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09eeb0d0 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x55bf09ee4df0 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedb80 con 0x7f1070038070 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:47.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ee9b40 con 0x55bf09ee4df0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f106c0c6070 con 0x55bf09ee4df0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eea390 con 0x55bf09ee4df0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eedfc0 con 0x55bf09ee4df0 2024-02-18T16:21:47.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 zone default found 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 4 Realm: () 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 zonegroup default 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eee030 con 0x7f1070038070 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eefe10 con 0x55bf09eeb0d0 2024-02-18T16:21:47.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef01c0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 started sync module instance, tier type = 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:47.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.049+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eef6f0 con 0x7f1070038070 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278993769040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09eefaa0 con 0x7f1070038070 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef0f20 con 0x55bf09ee4df0 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278993769040] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278993774048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef0ea0 con 0x55bf09ee4df0 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.053+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef18f0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278993777648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef2140 con 0x55bf09eeb0d0 2024-02-18T16:21:47.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef2b60 con 0x7f1070038070 2024-02-18T16:21:47.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278993774048] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278993782336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef2f10 con 0x7f1070038070 2024-02-18T16:21:47.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef38c0 con 0x55bf09ee4df0 2024-02-18T16:21:47.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.057+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278993777648] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278993782336] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278993775104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef33e0 con 0x55bf09ee4df0 2024-02-18T16:21:47.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef4110 con 0x7f1074027940 2024-02-18T16:21:47.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278993787232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef4220 con 0x7f1074027940 2024-02-18T16:21:47.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef4b90 con 0x7f1074027940 2024-02-18T16:21:47.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.061+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278993775104] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278993787232] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278993788288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef41a0 con 0x7f1074027940 2024-02-18T16:21:47.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef5030 con 0x7f1074027940 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278993791888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef5450 con 0x7f1074027940 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=0 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=1 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=2 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=3 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=4 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=5 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278993788288] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.065+0000 7f107cb8c980 20 add_watcher() i=6 2024-02-18T16:21:47.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278993791888] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 20 add_watcher() i=7 2024-02-18T16:21:47.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:47.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef5450 con 0x55bf09ee4df0 2024-02-18T16:21:47.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278993792944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09ef53d0 con 0x55bf09ee4df0 2024-02-18T16:21:47.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278993792944] v32'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f0f30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:47.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:47.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.069+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f00970 con 0x55bf09ee4df0 2024-02-18T16:21:47.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.073+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.073+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f00a20 con 0x7f1074027940 2024-02-18T16:21:47.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.073+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.073+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f01520 con 0x55bf09eeb0d0 2024-02-18T16:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.077+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.077+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f01d20 con 0x55bf09ee4df0 2024-02-18T16:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.077+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.077+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f02120 con 0x7f1070038070 2024-02-18T16:21:47.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.077+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.077+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f02650 con 0x55bf09eeb0d0 2024-02-18T16:21:47.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.081+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.081+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f03020 con 0x55bf09ee4df0 2024-02-18T16:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.081+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.081+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f03020 con 0x7f1074027940 2024-02-18T16:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.085+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.085+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f03020 con 0x7f1070038070 2024-02-18T16:21:47.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.085+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.085+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f03550 con 0x55bf09eeb0d0 2024-02-18T16:21:47.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.089+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.089+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f03d50 con 0x7f1070038070 2024-02-18T16:21:47.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.089+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.089+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efe9b0 con 0x7f1074027940 2024-02-18T16:21:47.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.089+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.089+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1070038070 2024-02-18T16:21:47.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.093+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.093+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1074027940 2024-02-18T16:21:47.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.093+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.093+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09ee4df0 2024-02-18T16:21:47.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.093+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.093+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.097+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.097+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1070038070 2024-02-18T16:21:47.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.097+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.097+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.101+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.101+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09ee4df0 2024-02-18T16:21:47.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.101+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.101+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09ee4df0 2024-02-18T16:21:47.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.101+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.101+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.105+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.105+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1070038070 2024-02-18T16:21:47.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.105+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.105+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.105+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.105+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.109+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.109+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.109+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.109+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.109+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.109+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1074027940 2024-02-18T16:21:47.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.113+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.113+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.113+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.113+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1074027940 2024-02-18T16:21:47.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.117+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.117+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.117+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.117+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1074027940 2024-02-18T16:21:47.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.121+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f106c0f4040 con 0x7f1074027940 2024-02-18T16:21:47.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.121+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efefc0 con 0x7f1070038070 2024-02-18T16:21:47.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f0eab7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:47.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:47.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 20 Filter name: none 2024-02-18T16:21:47.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f0ea97fa640 20 reqs_thread_entry: start 2024-02-18T16:21:47.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:21:47.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efe360 con 0x7f1070038070 2024-02-18T16:21:47.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 : miss 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:95 8.1c 8:3e656b3b:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f1fd90 con 0x55bf09eeb0d0 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(95 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 info.flags=0x17 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 to cache LRU end 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:96 4.0 4:036f9995:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9cfc0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(96 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:97 4.a 4:5110ed4a:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9cfc0 con 0x7f1070038070 2024-02-18T16:21:47.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(97 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:98 4.28 4:16f0ec13:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9cfc0 con 0x55bf09ee4df0 2024-02-18T16:21:47.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(98 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 [call out=424b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+424 (crc 0 0 0) 0x7f106c0f4040 con 0x55bf09ee4df0 2024-02-18T16:21:47.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-02-18T16:21:47.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.125+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:99 4.b 4:d0cb7dd3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x7f1070038070 2024-02-18T16:21:47.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(99 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 4.11 4:88c5e0f9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x7f1074027940 2024-02-18T16:21:47.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(100 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:101 4.2e 4:77e610c7:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x55bf09eeb0d0 2024-02-18T16:21:47.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(101 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:102 4.31 4:8cd647e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x55bf09ee4df0 2024-02-18T16:21:47.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(102 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 [call out=425b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-02-18T16:21:47.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:103 4.14 4:2a5d2fc4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x55bf09eeb0d0 2024-02-18T16:21:47.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(103 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:104 4.39 4:9ff07322:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x55bf09eeb0d0 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(104 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 4.31 4:8feea59c:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x55bf09ee4df0 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(105 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.129+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:106 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9d000 con 0x7f1070038070 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(106 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [call out=698b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:107 3.13s0 3:c84c64b2:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f20620 con 0x55bf09eeb0d0 2024-02-18T16:21:47.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(107 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=875b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+891 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 10 manifest: total_size = 6 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.256364605449010124 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 20 prepare_atomic_modification: state is not atomic. state=0x55bf09f9c488 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:108 4.28 4:16f0ec13:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f24f30 con 0x55bf09ee4df0 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(108 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.133+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:109 3.13s0 3:c84c64b2:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f22ed0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(109 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_9c8454ddf7aa50116496bac348d7550d [call] v32'3 uv3 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:110 4.28 4:16f0ec13:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25350 con 0x55bf09ee4df0 2024-02-18T16:21:47.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:111 3.13s0 3:cbea6de5:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25350 con 0x55bf09eeb0d0 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(111 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 10 manifest: total_size = 3 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7709360270619623344 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 20 prepare_atomic_modification: state is not atomic. state=0x55bf09f9c488 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 2024-02-18T16:21:47.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.137+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:112 4.31 4:8cd647e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f29f60 con 0x55bf09ee4df0 2024-02-18T16:21:47.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(110 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f0f5dffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-02-18T16:21:47.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(112 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:113 3.13s0 3:cbea6de5:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f22ed0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(113 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:114 4.31 4:8cd647e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25f20 con 0x55bf09ee4df0 2024-02-18T16:21:47.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.141+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:115 3.21s0 3:846b7ea4:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25f20 con 0x7f1074027940 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(115 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 10 manifest: total_size = 4 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.2302753186635516524 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 20 prepare_atomic_modification: state is not atomic. state=0x55bf09f9c488 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 2024-02-18T16:21:47.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:116 4.39 4:9ff07322:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25f20 con 0x55bf09eeb0d0 2024-02-18T16:21:47.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(114 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f0f5d7fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-02-18T16:21:47.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 35 ==== osd_op_reply(116 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.145+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:117 3.21s0 3:846b7ea4:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25f20 con 0x7f1074027940 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(117 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:118 4.39 4:9ff07322:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f25e50 con 0x55bf09eeb0d0 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:119 3.35s0 3:ac973b96:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f27230 con 0x55bf09ee4df0 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(119 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 10 manifest: total_size = 5 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.11811890254760529789 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 20 prepare_atomic_modification: state is not atomic. state=0x55bf09f9c488 2024-02-18T16:21:47.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 2024-02-18T16:21:47.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:120 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2b270 con 0x7f1070038070 2024-02-18T16:21:47.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 36 ==== osd_op_reply(118 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f0f5dffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-02-18T16:21:47.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(120 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [stat,call,call] v32'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.149+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:121 3.35s0 3:ac973b96:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f22a30 con 0x55bf09ee4df0 2024-02-18T16:21:47.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(121 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:122 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f27230 con 0x7f1070038070 2024-02-18T16:21:47.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:123 3.33s0 3:cc4bee8d:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f27d80 con 0x7f1074027940 2024-02-18T16:21:47.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(123 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 10 manifest: total_size = 5 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 20 get_obj_state: setting s->obj_tag to _JzBej8sDwTnpP430tDqOaId3UvTWA65 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 20 get_obj_state: octx=0x7f106c0c8f40 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55bf09f9c488 s->prefetch_data=0 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 20 prepare_atomic_modification: state is not atomic. state=0x55bf09f9c488 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:124 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2adb0 con 0x7f1070038070 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(122 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [stat,call,call] v32'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.153+0000 7f0f5d7fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-02-18T16:21:47.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(124 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:125 3.33s0 3:cc4bee8d:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f29900 con 0x7f1074027940 2024-02-18T16:21:47.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(125 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:126 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2adb0 con 0x7f1070038070 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107cb8c980 20 list_objects_ordered: starting attempt 1 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107cb8c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:127 4.0 4:036f9995:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2adb0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.157+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:128 4.a 4:5110ed4a:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9c740 con 0x7f1070038070 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:129 4.28 4:16f0ec13:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2adb0 con 0x55bf09ee4df0 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:130 4.b 4:d0cb7dd3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f31140 con 0x7f1070038070 2024-02-18T16:21:47.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:131 4.11 4:88c5e0f9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f33b60 con 0x7f1074027940 2024-02-18T16:21:47.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:132 4.2e 4:77e610c7:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2adb0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(128 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:133 4.31 4:8cd647e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9c2a0 con 0x55bf09ee4df0 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(129 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 37 ==== osd_op_reply(127 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:134 4.14 4:2a5d2fc4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f38e40 con 0x55bf09eeb0d0 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:135 4.39 4:9ff07322:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f396c0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 29 ==== osd_op_reply(130 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:136 4.31 4:8feea59c:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f3c360 con 0x55bf09ee4df0 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:137 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f3c740 con 0x7f1070038070 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(131 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 38 ==== osd_op_reply(132 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 30 ==== osd_op_reply(126 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f0f5dffb640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(133 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 [call out=124b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 39 ==== osd_op_reply(134 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(136 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 31 ==== osd_op_reply(137 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 40 ==== osd_op_reply(135 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5])"; uploads.size()=0; is_truncated=0 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:138 4.0 4:036f9995:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9ad20 con 0x55bf09eeb0d0 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:139 4.a 4:5110ed4a:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:140 4.28 4:16f0ec13:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f3c450 con 0x55bf09ee4df0 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:141 4.b 4:d0cb7dd3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9ad20 con 0x7f1070038070 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:142 4.11 4:88c5e0f9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2e0d0 con 0x7f1074027940 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:143 4.2e 4:77e610c7:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f3c450 con 0x55bf09eeb0d0 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:144 4.31 4:8cd647e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9ad20 con 0x55bf09ee4df0 2024-02-18T16:21:47.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:145 4.14 4:2a5d2fc4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:146 4.39 4:9ff07322:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f2e0d0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:147 4.31 4:8feea59c:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9ad20 con 0x55bf09ee4df0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:148 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f3f630 con 0x7f1070038070 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 32 ==== osd_op_reply(139 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 41 ==== osd_op_reply(138 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 33 ==== osd_op_reply(141 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(142 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 41 ==== osd_op_reply(144 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 [call out=124b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 34 ==== osd_op_reply(148 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 42 ==== osd_op_reply(140 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 43 ==== osd_op_reply(147 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 42 ==== osd_op_reply(143 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 43 ==== osd_op_reply(145 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 44 ==== osd_op_reply(146 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.161+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f9af50 con 0x7f1070038070 2024-02-18T16:21:47.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 35 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107cb8c980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107cb8c980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107cb8c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94278994097584 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1074027940 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== watch-notify(notify (1) cookie 94278993788288 notify 137438953484 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f106c0e9040 con 0x7f1074027940 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f0f5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94278993788288 notifier 4643 bl.length()=149 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(150 notify.6 [notify cookie 94278994097584 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f0f5d7fa640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f0eb00032c0 con 0x7f1074027940 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== watch-notify(notify_complete (2) cookie 94278994097584 notify 137438953484 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bf09eaee70 con 0x7f1074027940 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.165+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 36 ==== osd_op_reply(152 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 from cache 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5, ofs0, ns] 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:153 7.0 7:05bf5b68:::notify.1:head [notify cookie 94278994027664 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09ee4df0 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 44 ==== watch-notify(notify (1) cookie 94278993774048 notify 137438953505 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55bf09eaee70 con 0x55bf09ee4df0 2024-02-18T16:21:47.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f0f5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94278993774048 notifier 4643 bl.length()=206 2024-02-18T16:21:47.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 45 ==== osd_op_reply(153 notify.1 [notify cookie 94278994027664 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f0f5d7fa640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:154 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f0eb00032c0 con 0x55bf09ee4df0 2024-02-18T16:21:47.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 46 ==== osd_op_reply(154 notify.1 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 47 ==== watch-notify(notify_complete (2) cookie 94278994027664 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bf09eaea40 con 0x55bf09ee4df0 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:155 8.1c 8:3e656b3b:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 45 ==== osd_op_reply(155 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 [call,call,delete] v32'8 uv8 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:156 4.0 4:036f9995:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:157 4.a 4:5110ed4a:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efd650 con 0x7f1070038070 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:158 4.28 4:16f0ec13:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efd9b0 con 0x55bf09ee4df0 2024-02-18T16:21:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:159 4.b 4:d0cb7dd3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f1f220 con 0x7f1070038070 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.169+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:160 4.11 4:88c5e0f9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1074027940 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:161 4.2e 4:77e610c7:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efd650 con 0x55bf09eeb0d0 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:162 4.31 4:8cd647e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09ee4df0 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:163 4.14 4:2a5d2fc4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f1fa60 con 0x55bf09eeb0d0 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:164 4.39 4:9ff07322:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09efd650 con 0x55bf09eeb0d0 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:165 4.31 4:8feea59c:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f32c90 con 0x55bf09ee4df0 2024-02-18T16:21:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:166 4.3e 4:7fac0c25:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f3cb50 con 0x7f1070038070 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 37 ==== osd_op_reply(157 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 48 ==== osd_op_reply(158 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 46 ==== osd_op_reply(164 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.8 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(160 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.4 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 47 ==== osd_op_reply(163 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.7 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 49 ==== osd_op_reply(162 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.6 [delete] v32'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 48 ==== osd_op_reply(156 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.0 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 49 ==== osd_op_reply(161 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.5 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.173+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 38 ==== osd_op_reply(159 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.3 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 39 ==== osd_op_reply(166 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.10 [delete] v32'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 50 ==== osd_op_reply(165 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5.9 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 : miss 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:167 6.15 6:aa6669fa:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 40 ==== osd_op_reply(167 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 info.flags=0x0 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 10 adding default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 to cache LRU end 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 10 removing default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 from cache 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5, ofs0, ns] 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94278993967344 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 41 ==== watch-notify(notify (1) cookie 94278993769040 notify 137438953492 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f1074049040 con 0x7f1070038070 2024-02-18T16:21:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f0f5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94278993769040 notifier 4643 bl.length()=203 2024-02-18T16:21:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 42 ==== osd_op_reply(168 notify.0 [notify cookie 94278993967344 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f0f5d7fa640 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f0eb0003320 con 0x7f1070038070 2024-02-18T16:21:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 43 ==== osd_op_reply(169 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 44 ==== watch-notify(notify_complete (2) cookie 94278993967344 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f10740339b0 con 0x7f1070038070 2024-02-18T16:21:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:170 6.15 6:aa6669fa:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 45 ==== osd_op_reply(170 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5 [delete] v32'25 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.177+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.181+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 46 ==== osd_op_reply(171 foo.buckets [call] v32'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.181+0000 7f0f30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.181+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278993792944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09ee4df0 2024-02-18T16:21:47.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.185+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 51 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94278993792944] v32'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.185+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278993769040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.185+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 47 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94278993769040] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.185+0000 7f107cb8c980 20 remove_watcher() i=0 2024-02-18T16:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.185+0000 7f107cb8c980 2 removed watcher, disabling cache 2024-02-18T16:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.185+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278993774048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09ee4df0 2024-02-18T16:21:47.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.189+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 52 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94278993774048] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.189+0000 7f107cb8c980 20 remove_watcher() i=1 2024-02-18T16:21:47.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.189+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278993777648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09eeb0d0 2024-02-18T16:21:47.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.189+0000 7f1079ea6640 1 -- 172.21.15.129:0/2504454045 <== osd.3 v2:172.21.15.129:6800/2085458436 50 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94278993777648] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107005e040 con 0x55bf09eeb0d0 2024-02-18T16:21:47.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.189+0000 7f107cb8c980 20 remove_watcher() i=2 2024-02-18T16:21:47.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.189+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278993782336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1070038070 2024-02-18T16:21:47.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.193+0000 7f107aea8640 1 -- 172.21.15.129:0/2504454045 <== osd.2 v2:172.21.15.129:6808/222672308 48 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94278993782336] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f107403f040 con 0x7f1070038070 2024-02-18T16:21:47.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.193+0000 7f107cb8c980 20 remove_watcher() i=3 2024-02-18T16:21:47.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.193+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278993775104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x55bf09ee4df0 2024-02-18T16:21:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.193+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.1 v2:172.21.15.129:6816/834716550 53 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94278993775104] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x55bf09ee4df0 2024-02-18T16:21:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.193+0000 7f107cb8c980 20 remove_watcher() i=4 2024-02-18T16:21:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.193+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278993787232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1074027940 2024-02-18T16:21:47.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.197+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94278993787232] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.197+0000 7f107cb8c980 20 remove_watcher() i=5 2024-02-18T16:21:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.197+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278993788288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1074027940 2024-02-18T16:21:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.197+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94278993788288] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.197+0000 7f107cb8c980 20 remove_watcher() i=6 2024-02-18T16:21:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.197+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278993791888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bf09f39ba0 con 0x7f1074027940 2024-02-18T16:21:47.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94278993791888] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f106c0f9060 con 0x7f1074027940 2024-02-18T16:21:47.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 20 remove_watcher() i=7 2024-02-18T16:21:47.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1074027940 msgr2=0x7f10740333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f1074027940 0x7f10740333c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09ee4df0 msgr2=0x55bf09ee72b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09ee4df0 0x55bf09ee72b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1070038070 msgr2=0x7f107001f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f1070038070 0x7f107001f130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bf09eeb0d0 msgr2=0x55bf09eed500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55bf09eeb0d0 0x55bf09eed500 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f440342b0 msgr2=0x7f0f44036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f440342b0 0x7f0f44036770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1074008fd0 tx=0x7f107401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:47.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 msgr2=0x55bf09ed9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107a6a7640 1 -- 172.21.15.129:0/2504454045 reap_dead start 2024-02-18T16:21:47.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed9800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f10700199a0 tx=0x7f1070049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:47.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 shutdown_connections 2024-02-18T16:21:47.213 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2504454045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ed2990 0x55bf09ed9800 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 >> 172.21.15.129:0/2504454045 conn(0x55bf09ececd0 msgr2=0x55bf09ecc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 shutdown_connections 2024-02-18T16:21:47.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2504454045 wait complete. 2024-02-18T16:21:47.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f540342b0 msgr2=0x7f0f54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f540342b0 0x7f0f54036770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55bf09eb5ee0 tx=0x7f1074003070 comp rx=0 tx=0).stop 2024-02-18T16:21:47.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 msgr2=0x55bf09ec5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 0x55bf09ec5dd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1070001ee0 tx=0x7f107000da30 comp rx=0 tx=0).stop 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 shutdown_connections 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f540342b0 0x7f0f54036770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/3078668038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09ec59b0 0x55bf09ec5dd0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 >> 172.21.15.129:0/3078668038 conn(0x55bf09eba7c0 msgr2=0x55bf09ebb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 shutdown_connections 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/3078668038 wait complete. 2024-02-18T16:21:47.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09dbe870 msgr2=0x55bf09eb5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09dbe870 0x55bf09eb5130 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f600342b0 msgr2=0x7f0f60036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f600342b0 0x7f0f60036770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1070000f70 tx=0x7f10700012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 msgr2=0x55bf09eae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09eae500 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f106c003430 tx=0x7f106c019810 comp rx=0 tx=0).stop 2024-02-18T16:21:47.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 shutdown_connections 2024-02-18T16:21:47.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55bf09dbe870 0x55bf09eb5130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0f600342b0 0x7f0f60036770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 --2- 172.21.15.129:0/2482621377 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55bf09dbd330 0x55bf09eae500 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 >> 172.21.15.129:0/2482621377 conn(0x55bf09d30a50 msgr2=0x55bf09ea1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 shutdown_connections 2024-02-18T16:21:47.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.201+0000 7f107cb8c980 1 -- 172.21.15.129:0/2482621377 wait complete. 2024-02-18T16:21:47.222 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-18T16:21:47.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-18T16:21:47.223 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-02-18T16:21:47.306 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:47.306 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:47.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72c971980 1 Processor -- start 2024-02-18T16:21:47.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72c971980 1 -- start start 2024-02-18T16:21:47.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72c971980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x555fe68ba0d0 0x555fe6946bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72c971980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555fe68924d0 con 0x555fe6947100 2024-02-18T16:21:47.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72c971980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x555fe6859180 con 0x555fe68ba0d0 2024-02-18T16:21:47.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72a48c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x555fe68ba0d0 0x555fe6946bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd729c8b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x555fe6947100 0x555fe6949520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:47650/0 (socket says 172.21.15.129:47650) 2024-02-18T16:21:47.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd729c8b640 1 -- 172.21.15.129:0/3142975224 learned_addr learned my addr 172.21.15.129:0/3142975224 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:47.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72a48c640 1 -- 172.21.15.129:0/3142975224 >> v1:172.21.15.80:6789/0 conn(0x555fe6947100 legacy=0x555fe6949520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.301+0000 7fd72a48c640 1 -- 172.21.15.129:0/3142975224 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fe694acd0 con 0x555fe68ba0d0 2024-02-18T16:21:47.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72a48c640 1 --2- 172.21.15.129:0/3142975224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6946bc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00a420 tx=0x7fd71c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96697c45f5182410 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72948a640 1 -- 172.21.15.129:0/3142975224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71c0aa530 con 0x555fe68ba0d0 2024-02-18T16:21:47.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72948a640 1 -- 172.21.15.129:0/3142975224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0a6050 con 0x555fe68ba0d0 2024-02-18T16:21:47.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72948a640 1 -- 172.21.15.129:0/3142975224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71c0aa800 con 0x555fe68ba0d0 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 -- 172.21.15.129:0/3142975224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 msgr2=0x555fe6946bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 --2- 172.21.15.129:0/3142975224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6946bc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00a420 tx=0x7fd71c01afd0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 -- 172.21.15.129:0/3142975224 shutdown_connections 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 --2- 172.21.15.129:0/3142975224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6946bc0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 -- 172.21.15.129:0/3142975224 >> 172.21.15.129:0/3142975224 conn(0x555fe69408f0 msgr2=0x555fe6942d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 -- 172.21.15.129:0/3142975224 shutdown_connections 2024-02-18T16:21:47.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.305+0000 7fd72c971980 1 -- 172.21.15.129:0/3142975224 wait complete. 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 Processor -- start 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- start start 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fe68566b0 con 0x555fe68ba0d0 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72a48c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72a48c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51476/0 (socket says 172.21.15.129:51476) 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72a48c640 1 -- 172.21.15.129:0/1009034254 learned_addr learned my addr 172.21.15.129:0/1009034254 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72a48c640 1 -- 172.21.15.129:0/1009034254 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c00a100 con 0x555fe68ba0d0 2024-02-18T16:21:47.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72a48c640 1 --2- 172.21.15.129:0/1009034254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a369b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00a420 tx=0x7fd71c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae7d19d8749f31e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd618608640 1 -- 172.21.15.129:0/1009034254 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71c0aa6c0 con 0x555fe68ba0d0 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd618608640 1 -- 172.21.15.129:0/1009034254 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0aa820 con 0x555fe68ba0d0 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd618608640 1 -- 172.21.15.129:0/1009034254 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71c0aaae0 con 0x555fe68ba0d0 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- 172.21.15.129:0/1009034254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 msgr2=0x555fe6a369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 --2- 172.21.15.129:0/1009034254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a369b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00a420 tx=0x7fd71c0033b0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- 172.21.15.129:0/1009034254 shutdown_connections 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 --2- 172.21.15.129:0/1009034254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a369b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- 172.21.15.129:0/1009034254 >> 172.21.15.129:0/1009034254 conn(0x555fe69408f0 msgr2=0x555fe6a32540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- 172.21.15.129:0/1009034254 shutdown_connections 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.321+0000 7fd72c971980 1 -- 172.21.15.129:0/1009034254 wait complete. 2024-02-18T16:21:47.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 Processor -- start 2024-02-18T16:21:47.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 -- start start 2024-02-18T16:21:47.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a3d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fe6851e90 con 0x555fe68ba0d0 2024-02-18T16:21:47.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72a48c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a3d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72a48c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a3d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51478/0 (socket says 172.21.15.129:51478) 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72a48c640 1 -- 172.21.15.129:0/618124081 learned_addr learned my addr 172.21.15.129:0/618124081 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72a48c640 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fe694acd0 con 0x555fe68ba0d0 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72a48c640 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a3d720 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00a420 tx=0x7fd71c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd616e05640 1 -- 172.21.15.129:0/618124081 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71c0b6920 con 0x555fe68ba0d0 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd616e05640 1 -- 172.21.15.129:0/618124081 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0b6a80 con 0x555fe68ba0d0 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555fe6a3dc60 con 0x555fe68ba0d0 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd616e05640 1 -- 172.21.15.129:0/618124081 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71c0b6d60 con 0x555fe68ba0d0 2024-02-18T16:21:47.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fe6a3e0b0 con 0x555fe68ba0d0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd616e05640 1 -- 172.21.15.129:0/618124081 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd71c0b4400 con 0x555fe68ba0d0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd616e05640 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6100342b0 0x7fd610036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd616e05640 1 -- 172.21.15.129:0/618124081 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd71c0e38d0 con 0x555fe68ba0d0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd729c8b640 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6100342b0 0x7fd610036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6947100 0x555fe6a44330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.325+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a44870 con 0x555fe6947100 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6947100 0x555fe6a44330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd729c8b640 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6100342b0 0x7fd610036770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd714000f70 tx=0x7fd7140012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6947100 0x555fe6a44330 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 -- 172.21.15.129:0/618124081 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7240083f0 con 0x555fe6947100 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a44c80 con 0x555fe6947100 2024-02-18T16:21:47.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 -- 172.21.15.129:0/618124081 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd7240083f0 con 0x555fe6947100 2024-02-18T16:21:47.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a46530 con 0x555fe6947100 2024-02-18T16:21:47.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 -- 172.21.15.129:0/618124081 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fd7240083f0 con 0x555fe6947100 2024-02-18T16:21:47.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a45670 con 0x555fe6947100 2024-02-18T16:21:47.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 -- 172.21.15.129:0/618124081 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd7240083f0 con 0x555fe6947100 2024-02-18T16:21:47.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a45a80 con 0x555fe6947100 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72ac8d640 1 -- 172.21.15.129:0/618124081 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd724012040 con 0x555fe6947100 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 Processor -- start 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 -- start start 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 0x555fe6a55030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd72c971980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fe67eaf20 con 0x555fe6a54c10 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd729c8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 0x555fe6a55030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd729c8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 0x555fe6a55030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51486/0 (socket says 172.21.15.129:51486) 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd729c8b640 1 -- 172.21.15.129:0/1770515659 learned_addr learned my addr 172.21.15.129:0/1770515659 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.329+0000 7fd729c8b640 1 -- 172.21.15.129:0/1770515659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fe6a55570 con 0x555fe6a54c10 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd729c8b640 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 0x555fe6a55030 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd714001ee0 tx=0x7fd71400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60ffff640 1 -- 172.21.15.129:0/1770515659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd714020070 con 0x555fe6a54c10 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60ffff640 1 -- 172.21.15.129:0/1770515659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71400c770 con 0x555fe6a54c10 2024-02-18T16:21:47.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60ffff640 1 -- 172.21.15.129:0/1770515659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd714013040 con 0x555fe6a54c10 2024-02-18T16:21:47.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555fe6a557c0 con 0x555fe6a54c10 2024-02-18T16:21:47.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fe6a56310 con 0x555fe6a54c10 2024-02-18T16:21:47.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60ffff640 1 -- 172.21.15.129:0/1770515659 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd71400a040 con 0x555fe6a54c10 2024-02-18T16:21:47.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60ffff640 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6040342b0 0x7fd604036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60ffff640 1 -- 172.21.15.129:0/1770515659 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd71404b750 con 0x555fe6a54c10 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6040342b0 0x7fd604036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72c971980 1 Processor -- start 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72c971980 1 -- start start 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6040342b0 0x7fd604036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555fe6a459d0 tx=0x7fd724003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72c971980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a61ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd72c971980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fe67de790 con 0x555fe6a61bf0 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd729c8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a61ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd729c8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a61ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51498/0 (socket says 172.21.15.129:51498) 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd729c8b640 1 -- 172.21.15.129:0/3111505557 learned_addr learned my addr 172.21.15.129:0/3111505557 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd729c8b640 1 -- 172.21.15.129:0/3111505557 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fe6a625c0 con 0x555fe6a61bf0 2024-02-18T16:21:47.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd729c8b640 1 --2- 172.21.15.129:0/3111505557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a61ff0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd714049aa0 tx=0x7fd7140198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd195b67e336325 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60dffb640 1 -- 172.21.15.129:0/3111505557 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd714048070 con 0x555fe6a61bf0 2024-02-18T16:21:47.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60dffb640 1 -- 172.21.15.129:0/3111505557 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71403a2b0 con 0x555fe6a61bf0 2024-02-18T16:21:47.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.333+0000 7fd60dffb640 1 -- 172.21.15.129:0/3111505557 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71403a440 con 0x555fe6a61bf0 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/3111505557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 msgr2=0x555fe6a61ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 --2- 172.21.15.129:0/3111505557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a61ff0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd714049aa0 tx=0x7fd7140198d0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/3111505557 shutdown_connections 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 --2- 172.21.15.129:0/3111505557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a61ff0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/3111505557 >> 172.21.15.129:0/3111505557 conn(0x555fe6a5df30 msgr2=0x555fe6a5bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/3111505557 shutdown_connections 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/3111505557 wait complete. 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 Processor -- start 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- start start 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a68a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fe6a68fa0 con 0x555fe6a61bf0 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd729c8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a68a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd729c8b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a68a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51508/0 (socket says 172.21.15.129:51508) 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 learned_addr learned my addr 172.21.15.129:0/2952767242 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fe6a56310 con 0x555fe6a61bf0 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd729c8b640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a68a60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd7140199a0 tx=0x7fd714049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd5fbfff640 1 -- 172.21.15.129:0/2952767242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd71404b410 con 0x555fe6a61bf0 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd5fbfff640 1 -- 172.21.15.129:0/2952767242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71404b570 con 0x555fe6a61bf0 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555fe6a691a0 con 0x555fe6a61bf0 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd5fbfff640 1 -- 172.21.15.129:0/2952767242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7140481e0 con 0x555fe6a61bf0 2024-02-18T16:21:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fe6a69630 con 0x555fe6a61bf0 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd5fbfff640 1 -- 172.21.15.129:0/2952767242 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd714048340 con 0x555fe6a61bf0 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.337+0000 7fd5fbfff640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5f40342b0 0x7fd5f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd5fbfff640 1 -- 172.21.15.129:0/2952767242 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd714039d70 con 0x555fe6a61bf0 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5f40342b0 0x7fd5f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6a74030 0x555fe6a764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a76c40 con 0x555fe6a74030 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6a74030 0x555fe6a764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5f40342b0 0x7fd5f4036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd724008fd0 tx=0x7fd72401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6a74030 0x555fe6a764f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 realm 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a77010 con 0x555fe6a74030 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a77890 con 0x555fe6a74030 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a77bf0 con 0x555fe6a74030 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a783f0 con 0x555fe6a74030 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 20 searching for the correct realm 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555fe6a7a280 0x555fe6a7c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd729c8b640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555fe6a7a280 0x555fe6a7c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd729c8b640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555fe6a7a280 0x555fe6a7c710 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd714022070 con 0x555fe6a7a280 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd729c8b640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd714038070 0x7fd71401f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.341+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd714038070 0x7fd71401f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd714038070 0x7fd71401f130 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72402c040 con 0x7fd714038070 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72ac8d640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd724027940 0x7fd7240333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd724027940 0x7fd7240333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd724027940 0x7fd7240333c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.345+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72402c040 con 0x7fd714038070 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd714022070 con 0x555fe6a7a280 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd72402c040 con 0x7fd714038070 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd714022070 con 0x555fe6a7a280 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.349+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72402c040 con 0x7fd714038070 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72402c040 con 0x7fd714038070 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd724027940 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72402c040 con 0x7fd714038070 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.353+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a7a280 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x555fe6a74030 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7cde0 con 0x7fd714038070 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a78cf0 con 0x555fe6a74030 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a79540 con 0x555fe6a74030 2024-02-18T16:21:47.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a79540 con 0x555fe6a74030 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 zone default found 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 4 Realm: () 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 zonegroup default 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7d220 con 0x7fd714038070 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7ec30 con 0x555fe6a7a280 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7f100 con 0x555fe6a7a280 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 started sync module instance, tier type = 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.357+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7e4e0 con 0x7fd714038070 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93870380015680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7e890 con 0x7fd714038070 2024-02-18T16:21:47.376 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7fe60 con 0x555fe6a74030 2024-02-18T16:21:47.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93870380015680] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93870380021024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7e890 con 0x555fe6a74030 2024-02-18T16:21:47.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.361+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a80490 con 0x555fe6a7a280 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93870380021024] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93870380022080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a80840 con 0x555fe6a7a280 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a811b0 con 0x7fd714038070 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93870380027456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a81a00 con 0x7fd714038070 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a82460 con 0x555fe6a74030 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93870380022080] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.365+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93870380027456] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93870380023680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a81560 con 0x555fe6a74030 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a82cb0 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93870380023680] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93870380031824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a81560 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.369+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a83180 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93870380035200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a835e0 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a83ff0 con 0x7fd724027940 2024-02-18T16:21:47.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93870380031824] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93870380038880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a83ff0 con 0x7fd724027940 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=0 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=1 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=2 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=3 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=4 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=5 2024-02-18T16:21:47.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93870380035200] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.373+0000 7fd72c971980 20 add_watcher() i=6 2024-02-18T16:21:47.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93870380038880] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 add_watcher() i=7 2024-02-18T16:21:47.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:47.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a83140 con 0x555fe6a74030 2024-02-18T16:21:47.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.384 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93870380033520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a83140 con 0x555fe6a74030 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93870380033520] v32'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd5e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 5 note: GC not initialized 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd55b7fe640 20 reqs_thread_entry: start 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:47.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 Filter name: none 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd5597fa640 20 reqs_thread_entry: start 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6aa8e30 con 0x555fe6a74030 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:47.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:47.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:47.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.377+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6aae7a0 con 0x555fe6a74030 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~369] v32'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72c971980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72c971980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72c971980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93870380212896 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6aab690 con 0x555fe6a74030 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 93870380023680 notify 137438953506 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x7fd71c0e7040 con 0x555fe6a74030 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd60dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 93870380023680 notifier 4650 bl.length()=545 2024-02-18T16:21:47.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd60dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:47.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd60dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 93870380212896 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd60dffb640 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fd5f0003ea0 con 0x555fe6a74030 2024-02-18T16:21:47.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 93870380212896 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555fe6a3e0b0 con 0x555fe6a74030 2024-02-18T16:21:47.389 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:47.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd5e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.381+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93870380033520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6aa7dd0 con 0x555fe6a74030 2024-02-18T16:21:47.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93870380033520] v32'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93870380015680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a825f0 con 0x7fd714038070 2024-02-18T16:21:47.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93870380015680] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72c971980 20 remove_watcher() i=0 2024-02-18T16:21:47.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72c971980 2 removed watcher, disabling cache 2024-02-18T16:21:47.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93870380021024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a825f0 con 0x555fe6a74030 2024-02-18T16:21:47.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93870380021024] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72c971980 20 remove_watcher() i=1 2024-02-18T16:21:47.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.385+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93870380022080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7f520 con 0x555fe6a7a280 2024-02-18T16:21:47.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.389+0000 7fd729c8b640 1 -- 172.21.15.129:0/2952767242 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93870380022080] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71405e040 con 0x555fe6a7a280 2024-02-18T16:21:47.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.389+0000 7fd72c971980 20 remove_watcher() i=2 2024-02-18T16:21:47.396 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.389+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93870380027456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a825f0 con 0x7fd714038070 2024-02-18T16:21:47.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.389+0000 7fd72ac8d640 1 -- 172.21.15.129:0/2952767242 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93870380027456] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd72403f040 con 0x7fd714038070 2024-02-18T16:21:47.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.389+0000 7fd72c971980 20 remove_watcher() i=3 2024-02-18T16:21:47.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.389+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93870380023680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a825f0 con 0x555fe6a74030 2024-02-18T16:21:47.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.393+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93870380023680] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x555fe6a74030 2024-02-18T16:21:47.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.393+0000 7fd72c971980 20 remove_watcher() i=4 2024-02-18T16:21:47.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.393+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93870380031824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7ff80 con 0x7fd724027940 2024-02-18T16:21:47.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.393+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93870380031824] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.393+0000 7fd72c971980 20 remove_watcher() i=5 2024-02-18T16:21:47.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.393+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93870380035200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a81f50 con 0x7fd724027940 2024-02-18T16:21:47.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93870380035200] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 20 remove_watcher() i=6 2024-02-18T16:21:47.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93870380038880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555fe6a7ff80 con 0x7fd724027940 2024-02-18T16:21:47.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93870380038880] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd71c0c5070 con 0x7fd724027940 2024-02-18T16:21:47.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 20 remove_watcher() i=7 2024-02-18T16:21:47.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd724027940 msgr2=0x7fd7240333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd724027940 0x7fd7240333c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6a74030 msgr2=0x555fe6a764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6a74030 0x555fe6a764f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd714038070 msgr2=0x7fd71401f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd714038070 0x7fd71401f130 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555fe6a7a280 msgr2=0x555fe6a7c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x555fe6a7a280 0x555fe6a7c710 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5f40342b0 msgr2=0x7fd5f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5f40342b0 0x7fd5f4036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd724008fd0 tx=0x7fd72401c070 comp rx=0 tx=0).stop 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 msgr2=0x555fe6a68a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72a48c640 1 -- 172.21.15.129:0/2952767242 reap_dead start 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a68a60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd7140199a0 tx=0x7fd714049a30 comp rx=0 tx=0).stop 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 shutdown_connections 2024-02-18T16:21:47.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 --2- 172.21.15.129:0/2952767242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a61bf0 0x555fe6a68a60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 >> 172.21.15.129:0/2952767242 conn(0x555fe6a5df30 msgr2=0x555fe6a5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 shutdown_connections 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.397+0000 7fd72c971980 1 -- 172.21.15.129:0/2952767242 wait complete. 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6040342b0 msgr2=0x7fd604036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6040342b0 0x7fd604036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555fe6a459d0 tx=0x7fd724003070 comp rx=0 tx=0).stop 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 msgr2=0x555fe6a55030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 0x555fe6a55030 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd714001ee0 tx=0x7fd71400da30 comp rx=0 tx=0).stop 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 shutdown_connections 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6040342b0 0x7fd604036770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/1770515659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe6a54c10 0x555fe6a55030 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 >> 172.21.15.129:0/1770515659 conn(0x555fe6a49a20 msgr2=0x555fe6a4a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 shutdown_connections 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/1770515659 wait complete. 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6947100 msgr2=0x555fe6a44330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6947100 0x555fe6a44330 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6100342b0 msgr2=0x7fd610036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6100342b0 0x7fd610036770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd714000f70 tx=0x7fd7140012c0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 msgr2=0x555fe6a3d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a3d720 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00a420 tx=0x7fd71c019810 comp rx=0 tx=0).stop 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 shutdown_connections 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x555fe6947100 0x555fe6a44330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd6100342b0 0x7fd610036770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 --2- 172.21.15.129:0/618124081 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x555fe68ba0d0 0x555fe6a3d720 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 >> 172.21.15.129:0/618124081 conn(0x555fe69408f0 msgr2=0x555fe6a31050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 shutdown_connections 2024-02-18T16:21:47.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.401+0000 7fd72c971980 1 -- 172.21.15.129:0/618124081 wait complete. 2024-02-18T16:21:47.418 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:47.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-18T16:21:47.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-18T16:21:47.418 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-02-18T16:21:47.498 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:47.498 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:47.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd684d8b980 1 Processor -- start 2024-02-18T16:21:47.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd684d8b980 1 -- start start 2024-02-18T16:21:47.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd684d8b980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x556ba9a55560 0x556ba9a57950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd684d8b980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556ba999d4d0 con 0x556ba99c58d0 2024-02-18T16:21:47.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd684d8b980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x556ba9964180 con 0x556ba9a55560 2024-02-18T16:21:47.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd6820a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x556ba9a55560 0x556ba9a57950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd6820a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x556ba9a55560 0x556ba9a57950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51514/0 (socket says 172.21.15.129:51514) 2024-02-18T16:21:47.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd6820a5640 1 -- 172.21.15.129:0/871905986 learned_addr learned my addr 172.21.15.129:0/871905986 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd6820a5640 1 -- 172.21.15.129:0/871905986 >> v1:172.21.15.80:6789/0 conn(0x556ba99c58d0 legacy=0x556ba9a53e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.493+0000 7fd6820a5640 1 -- 172.21.15.129:0/871905986 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba9a58ed0 con 0x556ba9a55560 2024-02-18T16:21:47.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd6820a5640 1 --2- 172.21.15.129:0/871905986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a55560 0x556ba9a57950 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00a5c0 tx=0x7fd66c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc454b85e1e4856 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd6818a4640 1 -- 172.21.15.129:0/871905986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0aa470 con 0x556ba9a55560 2024-02-18T16:21:47.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd6818a4640 1 -- 172.21.15.129:0/871905986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0aa5d0 con 0x556ba9a55560 2024-02-18T16:21:47.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd6818a4640 1 -- 172.21.15.129:0/871905986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0aa890 con 0x556ba9a55560 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 -- 172.21.15.129:0/871905986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a55560 msgr2=0x556ba9a57950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 --2- 172.21.15.129:0/871905986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a55560 0x556ba9a57950 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00a5c0 tx=0x7fd66c01b340 comp rx=0 tx=0).stop 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 -- 172.21.15.129:0/871905986 shutdown_connections 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 --2- 172.21.15.129:0/871905986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a55560 0x556ba9a57950 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 -- 172.21.15.129:0/871905986 >> 172.21.15.129:0/871905986 conn(0x556ba9a4b920 msgr2=0x556ba9a4dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 -- 172.21.15.129:0/871905986 shutdown_connections 2024-02-18T16:21:47.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.497+0000 7fd684d8b980 1 -- 172.21.15.129:0/871905986 wait complete. 2024-02-18T16:21:47.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd684d8b980 1 Processor -- start 2024-02-18T16:21:47.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd684d8b980 1 -- start start 2024-02-18T16:21:47.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd684d8b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b3b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd684d8b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba99616b0 con 0x556ba99c58d0 2024-02-18T16:21:47.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd6828a6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.521 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd6828a6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b3b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51526/0 (socket says 172.21.15.129:51526) 2024-02-18T16:21:47.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd6828a6640 1 -- 172.21.15.129:0/1401101967 learned_addr learned my addr 172.21.15.129:0/1401101967 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd6828a6640 1 -- 172.21.15.129:0/1401101967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c005df0 con 0x556ba99c58d0 2024-02-18T16:21:47.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd6828a6640 1 --2- 172.21.15.129:0/1401101967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b3b080 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd674006f60 tx=0x7fd674006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44240487a0bbf229 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd570e09640 1 -- 172.21.15.129:0/1401101967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd67400f640 con 0x556ba99c58d0 2024-02-18T16:21:47.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd570e09640 1 -- 172.21.15.129:0/1401101967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400f7a0 con 0x556ba99c58d0 2024-02-18T16:21:47.522 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.513+0000 7fd570e09640 1 -- 172.21.15.129:0/1401101967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd67400fac0 con 0x556ba99c58d0 2024-02-18T16:21:47.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/1401101967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 msgr2=0x556ba9b3b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 --2- 172.21.15.129:0/1401101967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b3b080 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd674006f60 tx=0x7fd674006f90 comp rx=0 tx=0).stop 2024-02-18T16:21:47.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/1401101967 shutdown_connections 2024-02-18T16:21:47.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 --2- 172.21.15.129:0/1401101967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b3b080 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/1401101967 >> 172.21.15.129:0/1401101967 conn(0x556ba9a4b920 msgr2=0x556ba9b36c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.523 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/1401101967 shutdown_connections 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/1401101967 wait complete. 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 Processor -- start 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- start start 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b41ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba995ce90 con 0x556ba99c58d0 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd6828a6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b41ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd6828a6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b41ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51542/0 (socket says 172.21.15.129:51542) 2024-02-18T16:21:47.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd6828a6640 1 -- 172.21.15.129:0/864752827 learned_addr learned my addr 172.21.15.129:0/864752827 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd6828a6640 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba999d4d0 con 0x556ba99c58d0 2024-02-18T16:21:47.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd6828a6640 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b41ef0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd674001e70 tx=0x7fd674001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd56f606640 1 -- 172.21.15.129:0/864752827 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd67401e690 con 0x556ba99c58d0 2024-02-18T16:21:47.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd56f606640 1 -- 172.21.15.129:0/864752827 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67401e7f0 con 0x556ba99c58d0 2024-02-18T16:21:47.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ba9b42430 con 0x556ba99c58d0 2024-02-18T16:21:47.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd56f606640 1 -- 172.21.15.129:0/864752827 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd67401ead0 con 0x556ba99c58d0 2024-02-18T16:21:47.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.517+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba9b428e0 con 0x556ba99c58d0 2024-02-18T16:21:47.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd56f606640 1 -- 172.21.15.129:0/864752827 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd67401ed40 con 0x556ba99c58d0 2024-02-18T16:21:47.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd56f606640 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5680342b0 0x7fd568036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd56f606640 1 -- 172.21.15.129:0/864752827 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd674049850 con 0x556ba99c58d0 2024-02-18T16:21:47.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6820a5640 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5680342b0 0x7fd568036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9a55560 0x556ba9b48b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b49090 con 0x556ba9a55560 2024-02-18T16:21:47.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9a55560 0x556ba9b48b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6820a5640 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5680342b0 0x7fd568036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0ae000 tx=0x7fd66c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9a55560 0x556ba9b48b50 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 -- 172.21.15.129:0/864752827 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd67c0083f0 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b46270 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 -- 172.21.15.129:0/864752827 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd67c0083f0 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b4adc0 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 -- 172.21.15.129:0/864752827 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fd67c0083f0 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b49fc0 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 -- 172.21.15.129:0/864752827 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd67c0083f0 con 0x556ba9a55560 2024-02-18T16:21:47.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b4a3d0 con 0x556ba9a55560 2024-02-18T16:21:47.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd6830a7640 1 -- 172.21.15.129:0/864752827 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd67c012040 con 0x556ba9a55560 2024-02-18T16:21:47.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 Processor -- start 2024-02-18T16:21:47.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- start start 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 0x556ba9b59860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.521+0000 7fd684d8b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba98f5f20 con 0x556ba9b59440 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 0x556ba9b59860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 0x556ba9b59860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51544/0 (socket says 172.21.15.129:51544) 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 -- 172.21.15.129:0/3621461071 learned_addr learned my addr 172.21.15.129:0/3621461071 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 -- 172.21.15.129:0/3621461071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba9b59da0 con 0x556ba9b59440 2024-02-18T16:21:47.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 0x556ba9b59860 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd66c018f70 tx=0x7fd66c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd56ce01640 1 -- 172.21.15.129:0/3621461071 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0b3d50 con 0x556ba9b59440 2024-02-18T16:21:47.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd56ce01640 1 -- 172.21.15.129:0/3621461071 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0c3070 con 0x556ba9b59440 2024-02-18T16:21:47.537 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ba9b59f90 con 0x556ba9b59440 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd56ce01640 1 -- 172.21.15.129:0/3621461071 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0c8430 con 0x556ba9b59440 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba9b5aa80 con 0x556ba9b59440 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd56ce01640 1 -- 172.21.15.129:0/3621461071 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd66c0c5030 con 0x556ba9b59440 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd56ce01640 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd55c0342b0 0x7fd55c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd56ce01640 1 -- 172.21.15.129:0/3621461071 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd66c0e69a0 con 0x556ba9b59440 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6830a7640 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd55c0342b0 0x7fd55c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd684d8b980 1 Processor -- start 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd684d8b980 1 -- start start 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6830a7640 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd55c0342b0 0x7fd55c036770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x556ba9b49a00 tx=0x7fd67c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd684d8b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9a517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd684d8b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba98e9790 con 0x556ba9a513f0 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9a517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9a517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51556/0 (socket says 172.21.15.129:51556) 2024-02-18T16:21:47.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.525+0000 7fd6820a5640 1 -- 172.21.15.129:0/2748864855 learned_addr learned my addr 172.21.15.129:0/2748864855 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 -- 172.21.15.129:0/2748864855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba9a4fc20 con 0x556ba9a513f0 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 --2- 172.21.15.129:0/2748864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9a517f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0e4cf0 tx=0x7fd66c0bd840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433c82fc66861c68 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd5667fc640 1 -- 172.21.15.129:0/2748864855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0d6070 con 0x556ba9a513f0 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd5667fc640 1 -- 172.21.15.129:0/2748864855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0d7040 con 0x556ba9a513f0 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd5667fc640 1 -- 172.21.15.129:0/2748864855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0c7d60 con 0x556ba9a513f0 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/2748864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 msgr2=0x556ba9a517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 --2- 172.21.15.129:0/2748864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9a517f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0e4cf0 tx=0x7fd66c0bd840 comp rx=0 tx=0).stop 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/2748864855 shutdown_connections 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 --2- 172.21.15.129:0/2748864855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9a517f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/2748864855 >> 172.21.15.129:0/2748864855 conn(0x556ba9b627d0 msgr2=0x556ba9b60830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/2748864855 shutdown_connections 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/2748864855 wait complete. 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 Processor -- start 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- start start 2024-02-18T16:21:47.539 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9b6f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba9b6fad0 con 0x556ba9a513f0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9b6f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9b6f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51560/0 (socket says 172.21.15.129:51560) 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 learned_addr learned my addr 172.21.15.129:0/4126749867 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba9b5aa80 con 0x556ba9a513f0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd6820a5640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9b6f590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0bd880 tx=0x7fd66c0e4c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd564ff9640 1 -- 172.21.15.129:0/4126749867 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0c7e00 con 0x556ba9a513f0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ba9b5aa80 con 0x556ba9a513f0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd564ff9640 1 -- 172.21.15.129:0/4126749867 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c0d1440 con 0x556ba9a513f0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd564ff9640 1 -- 172.21.15.129:0/4126749867 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0d16e0 con 0x556ba9a513f0 2024-02-18T16:21:47.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.529+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba9b5aa80 con 0x556ba9a513f0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd564ff9640 1 -- 172.21.15.129:0/4126749867 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd66c0c73d0 con 0x556ba9a513f0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd564ff9640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd54c0342b0 0x7fd54c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd564ff9640 1 -- 172.21.15.129:0/4126749867 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd66c0f1d10 con 0x556ba9a513f0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6830a7640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd54c0342b0 0x7fd54c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9b7a730 0x556ba9b7cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7d340 con 0x556ba9b7a730 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9b7a730 0x556ba9b7cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6830a7640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd54c0342b0 0x7fd54c036770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd67c008fd0 tx=0x7fd67c01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9b7a730 0x556ba9b7cbf0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 realm 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7d710 con 0x556ba9b7a730 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7df90 con 0x556ba9b7a730 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7e2f0 con 0x556ba9b7a730 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7eaf0 con 0x556ba9b7a730 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 20 searching for the correct realm 2024-02-18T16:21:47.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x556ba9b80980 0x556ba9b82df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6820a5640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x556ba9b80980 0x556ba9b82df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.533+0000 7fd6820a5640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x556ba9b80980 0x556ba9b82df0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6820a5640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd66c0f9070 0x7fd66c0bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6830a7640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd66c0f9070 0x7fd66c0bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6830a7640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd66c0f9070 0x7fd66c0bfa60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c02c040 con 0x7fd66c0f9070 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6830a7640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd67c027940 0x7fd67c0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd67c027940 0x7fd67c0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd67c027940 0x7fd67c0333c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.537+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c02c040 con 0x7fd66c0f9070 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd67c02c040 con 0x7fd66c0f9070 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.541+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c02c040 con 0x7fd66c0f9070 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c02c040 con 0x7fd66c0f9070 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.545+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd67c027940 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd674018070 con 0x7fd67c027940 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c02c040 con 0x7fd66c0f9070 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b80980 2024-02-18T16:21:47.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x556ba9b7a730 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b834c0 con 0x7fd66c0f9070 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:47.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7f420 con 0x556ba9b7a730 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd674018070 con 0x556ba9b7a730 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b7fc70 con 0x556ba9b7a730 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b83900 con 0x556ba9b7a730 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 zone default found 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 4 Realm: () 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 zonegroup default 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b83970 con 0x7fd66c0f9070 2024-02-18T16:21:47.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b85750 con 0x556ba9b80980 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b85b50 con 0x556ba9b80980 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 started sync module instance, tier type = 2024-02-18T16:21:47.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:47.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.549+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b85030 con 0x7fd66c0f9070 2024-02-18T16:21:47.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920897289104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b853e0 con 0x7fd66c0f9070 2024-02-18T16:21:47.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b868b0 con 0x556ba9b7a730 2024-02-18T16:21:47.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920897289104] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920897294192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b86830 con 0x556ba9b7a730 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.553+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b872a0 con 0x556ba9b80980 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920897294192] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920897295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b867b0 con 0x556ba9b80980 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b87f90 con 0x7fd66c0f9070 2024-02-18T16:21:47.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920897301504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b887e0 con 0x7fd66c0f9070 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.557+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b891d0 con 0x556ba9b7a730 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920897295248] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920897301504] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920897305776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b88340 con 0x556ba9b7a730 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b89a20 con 0x7fd67c027940 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920897307568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b89c70 con 0x7fd67c027940 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a470 con 0x7fd67c027940 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.561+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920897305776] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920897309808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a530 con 0x7fd67c027940 2024-02-18T16:21:47.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8ad70 con 0x7fd67c027940 2024-02-18T16:21:47.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920897307568] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920897308624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8af50 con 0x7fd67c027940 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=0 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=1 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=2 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=3 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=4 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=5 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920897309808] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.565+0000 7fd684d8b980 20 add_watcher() i=6 2024-02-18T16:21:47.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920897308624] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 20 add_watcher() i=7 2024-02-18T16:21:47.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:47.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8de70 con 0x556ba9b7a730 2024-02-18T16:21:47.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920897311360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8b2e0 con 0x556ba9b7a730 2024-02-18T16:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920897311360] v32'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd5397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.569+0000 7fd684d8b980 5 note: GC not initialized 2024-02-18T16:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd4b3fff640 20 reqs_thread_entry: start 2024-02-18T16:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 20 Filter name: none 2024-02-18T16:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd4b1ffb640 20 reqs_thread_entry: start 2024-02-18T16:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9bafbb0 con 0x556ba9b7a730 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+492 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 20 rados_obj.operate() r=0 bl.length=369 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9bb5570 con 0x556ba9b7a730 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v32'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93920897486960 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9bb2410 con 0x556ba9b7a730 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== watch-notify(notify (1) cookie 93920897305776 notify 137438953507 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x556ba9b428e0 con 0x556ba9b7a730 2024-02-18T16:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd5667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 93920897305776 notifier 4657 bl.length()=533 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd5667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd5667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(64 notify.4 [notify cookie 93920897486960 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd5667fc640 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fd548003ea0 con 0x556ba9b7a730 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.573+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== watch-notify(notify_complete (2) cookie 93920897486960 notify 137438953507 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556ba9b42430 con 0x556ba9b7a730 2024-02-18T16:21:47.582 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:21:47.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd5397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920897311360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9baeb10 con 0x556ba9b7a730 2024-02-18T16:21:47.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93920897311360] v32'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920897289104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a280 con 0x7fd66c0f9070 2024-02-18T16:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93920897289104] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd684d8b980 20 remove_watcher() i=0 2024-02-18T16:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd684d8b980 2 removed watcher, disabling cache 2024-02-18T16:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.577+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920897294192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a280 con 0x556ba9b7a730 2024-02-18T16:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.581+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93920897294192] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.581+0000 7fd684d8b980 20 remove_watcher() i=1 2024-02-18T16:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.581+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920897295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b85f70 con 0x556ba9b80980 2024-02-18T16:21:47.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.581+0000 7fd6820a5640 1 -- 172.21.15.129:0/4126749867 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93920897295248] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd66c0f6070 con 0x556ba9b80980 2024-02-18T16:21:47.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.581+0000 7fd684d8b980 20 remove_watcher() i=2 2024-02-18T16:21:47.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.581+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920897301504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a280 con 0x7fd66c0f9070 2024-02-18T16:21:47.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.585+0000 7fd6830a7640 1 -- 172.21.15.129:0/4126749867 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93920897301504] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd67c03f040 con 0x7fd66c0f9070 2024-02-18T16:21:47.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.585+0000 7fd684d8b980 20 remove_watcher() i=3 2024-02-18T16:21:47.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.585+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920897305776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a280 con 0x556ba9b7a730 2024-02-18T16:21:47.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.585+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93920897305776] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x556ba9b7a730 2024-02-18T16:21:47.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.585+0000 7fd684d8b980 20 remove_watcher() i=4 2024-02-18T16:21:47.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.585+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920897307568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b88cb0 con 0x7fd67c027940 2024-02-18T16:21:47.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.589+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93920897307568] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.589+0000 7fd684d8b980 20 remove_watcher() i=5 2024-02-18T16:21:47.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.589+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920897309808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b8a280 con 0x7fd67c027940 2024-02-18T16:21:47.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.589+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93920897309808] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.589+0000 7fd684d8b980 20 remove_watcher() i=6 2024-02-18T16:21:47.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.589+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920897308624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556ba9b893b0 con 0x7fd67c027940 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93920897308624] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd674059040 con 0x7fd67c027940 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 20 remove_watcher() i=7 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd67c027940 msgr2=0x7fd67c0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd67c027940 0x7fd67c0333c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9b7a730 msgr2=0x556ba9b7cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9b7a730 0x556ba9b7cbf0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd66c0f9070 msgr2=0x7fd66c0bfa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd66c0f9070 0x7fd66c0bfa60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x556ba9b80980 msgr2=0x556ba9b82df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x556ba9b80980 0x556ba9b82df0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd54c0342b0 msgr2=0x7fd54c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd54c0342b0 0x7fd54c036770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd67c008fd0 tx=0x7fd67c01c070 comp rx=0 tx=0).stop 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd6828a6640 1 -- 172.21.15.129:0/4126749867 reap_dead start 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 msgr2=0x556ba9b6f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9b6f590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0bd880 tx=0x7fd66c0e4c80 comp rx=0 tx=0).stop 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 shutdown_connections 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/4126749867 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9a513f0 0x556ba9b6f590 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 >> 172.21.15.129:0/4126749867 conn(0x556ba9b627d0 msgr2=0x556ba9b5fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 shutdown_connections 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/4126749867 wait complete. 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd55c0342b0 msgr2=0x7fd55c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd55c0342b0 0x7fd55c036770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x556ba9b49a00 tx=0x7fd67c003070 comp rx=0 tx=0).stop 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 msgr2=0x556ba9b59860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 0x556ba9b59860 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd66c018f70 tx=0x7fd66c0180e0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 shutdown_connections 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd55c0342b0 0x7fd55c036770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/3621461071 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba9b59440 0x556ba9b59860 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 >> 172.21.15.129:0/3621461071 conn(0x556ba9b4e250 msgr2=0x556ba9b4ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 shutdown_connections 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/3621461071 wait complete. 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9a55560 msgr2=0x556ba9b48b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9a55560 0x556ba9b48b50 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5680342b0 msgr2=0x7fd568036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5680342b0 0x7fd568036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0ae000 tx=0x7fd66c0a6000 comp rx=0 tx=0).stop 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 msgr2=0x556ba9b41ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b41ef0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd674001e70 tx=0x7fd674001260 comp rx=0 tx=0).stop 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 shutdown_connections 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x556ba9a55560 0x556ba9b48b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd5680342b0 0x7fd568036770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 --2- 172.21.15.129:0/864752827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x556ba99c58d0 0x556ba9b41ef0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 >> 172.21.15.129:0/864752827 conn(0x556ba9a4b920 msgr2=0x556ba9b35720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 shutdown_connections 2024-02-18T16:21:47.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.593+0000 7fd684d8b980 1 -- 172.21.15.129:0/864752827 wait complete. 2024-02-18T16:21:47.611 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:21:47.626 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:47.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-18T16:21:47.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-18T16:21:47.627 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-18T16:21:47.685 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:21:47.685 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:21:47.686 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7993fe1980 1 Processor -- start 2024-02-18T16:21:47.686 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7993fe1980 1 -- start start 2024-02-18T16:21:47.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7993fe1980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fbe0469870 0x55fbe046bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7993fe1980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fbe03b14c0 con 0x55fbe04668b0 2024-02-18T16:21:47.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7993fe1980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbe0378180 con 0x55fbe0469870 2024-02-18T16:21:47.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f79912fb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fbe0469870 0x55fbe046bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7991afc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55fbe04668b0 0x55fbe0466c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:47658/0 (socket says 172.21.15.129:47658) 2024-02-18T16:21:47.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7991afc640 1 -- 172.21.15.129:0/3968398938 learned_addr learned my addr 172.21.15.129:0/3968398938 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:21:47.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7990afa640 1 -- 172.21.15.129:0/3968398938 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654811265 0 0) 0x55fbe03b14c0 con 0x55fbe04668b0 2024-02-18T16:21:47.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f7990afa640 1 -- 172.21.15.129:0/3968398938 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c001e20 con 0x55fbe04668b0 2024-02-18T16:21:47.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f79912fb640 1 -- 172.21.15.129:0/3968398938 >> v1:172.21.15.80:6789/0 conn(0x55fbe04668b0 legacy=0x55fbe0466c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.681+0000 7f79912fb640 1 -- 172.21.15.129:0/3968398938 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbe04673a0 con 0x55fbe0469870 2024-02-18T16:21:47.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f79912fb640 1 --2- 172.21.15.129:0/3968398938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0469870 0x55fbe046bc60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f798800a480 tx=0x7f798801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942528f956b7e820 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7990afa640 1 -- 172.21.15.129:0/3968398938 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79880ab540 con 0x55fbe0469870 2024-02-18T16:21:47.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7990afa640 1 -- 172.21.15.129:0/3968398938 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880ab6a0 con 0x55fbe0469870 2024-02-18T16:21:47.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7990afa640 1 -- 172.21.15.129:0/3968398938 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79880ab960 con 0x55fbe0469870 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 -- 172.21.15.129:0/3968398938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0469870 msgr2=0x55fbe046bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 --2- 172.21.15.129:0/3968398938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0469870 0x55fbe046bc60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f798800a480 tx=0x7f798801b280 comp rx=0 tx=0).stop 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 -- 172.21.15.129:0/3968398938 shutdown_connections 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 --2- 172.21.15.129:0/3968398938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0469870 0x55fbe046bc60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 -- 172.21.15.129:0/3968398938 >> 172.21.15.129:0/3968398938 conn(0x55fbe045f060 msgr2=0x55fbe0461480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 -- 172.21.15.129:0/3968398938 shutdown_connections 2024-02-18T16:21:47.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.685+0000 7f7993fe1980 1 -- 172.21.15.129:0/3968398938 wait complete. 2024-02-18T16:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 Processor -- start 2024-02-18T16:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- start start 2024-02-18T16:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe054ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe03756b0 con 0x55fbe04668b0 2024-02-18T16:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7991afc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe054ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.708 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7991afc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe054ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51580/0 (socket says 172.21.15.129:51580) 2024-02-18T16:21:47.708 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7991afc640 1 -- 172.21.15.129:0/2323817247 learned_addr learned my addr 172.21.15.129:0/2323817247 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.708 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7991afc640 1 -- 172.21.15.129:0/2323817247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988005d30 con 0x55fbe04668b0 2024-02-18T16:21:47.708 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7991afc640 1 --2- 172.21.15.129:0/2323817247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe054ef60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7984001c30 tx=0x7f798400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408e87ab18a1013f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.708 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f787fe07640 1 -- 172.21.15.129:0/2323817247 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798400e690 con 0x55fbe04668b0 2024-02-18T16:21:47.709 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f787fe07640 1 -- 172.21.15.129:0/2323817247 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400e7f0 con 0x55fbe04668b0 2024-02-18T16:21:47.709 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f787fe07640 1 -- 172.21.15.129:0/2323817247 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798400eb50 con 0x55fbe04668b0 2024-02-18T16:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- 172.21.15.129:0/2323817247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 msgr2=0x55fbe054ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2323817247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe054ef60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7984001c30 tx=0x7f798400b6d0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- 172.21.15.129:0/2323817247 shutdown_connections 2024-02-18T16:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2323817247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe054ef60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- 172.21.15.129:0/2323817247 >> 172.21.15.129:0/2323817247 conn(0x55fbe045f060 msgr2=0x55fbe054aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- 172.21.15.129:0/2323817247 shutdown_connections 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- 172.21.15.129:0/2323817247 wait complete. 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 Processor -- start 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.701+0000 7f7993fe1980 1 -- start start 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7993fe1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe0555e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7993fe1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe0370e90 con 0x55fbe04668b0 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7991afc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe0555e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7991afc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe0555e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51590/0 (socket says 172.21.15.129:51590) 2024-02-18T16:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7991afc640 1 -- 172.21.15.129:0/2379794522 learned_addr learned my addr 172.21.15.129:0/2379794522 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7991afc640 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c001e20 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7991afc640 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe0555e30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f798400b710 tx=0x7f7984000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f787e604640 1 -- 172.21.15.129:0/2379794522 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798401f070 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbe0556370 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f787e604640 1 -- 172.21.15.129:0/2379794522 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798401a2e0 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f787e604640 1 -- 172.21.15.129:0/2379794522 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798401a820 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbe05567c0 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f787e604640 1 -- 172.21.15.129:0/2379794522 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f798400a040 con 0x55fbe04668b0 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f787e604640 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f78780342b0 0x7f7878036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f787e604640 1 -- 172.21.15.129:0/2379794522 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f79840498b0 con 0x55fbe04668b0 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f79912fb640 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f78780342b0 0x7f7878036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe0469870 0x55fbe055ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe055cf80 con 0x55fbe0469870 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f79922fd640 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe0469870 0x55fbe055ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f79912fb640 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f78780342b0 0x7f7878036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f79880ad000 tx=0x7f79880a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.705+0000 7f79922fd640 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe0469870 0x55fbe055ca40 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79922fd640 1 -- 172.21.15.129:0/2379794522 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f798c00a4d0 con 0x55fbe0469870 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe055a120 con 0x55fbe0469870 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79922fd640 1 -- 172.21.15.129:0/2379794522 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f798c00a4d0 con 0x55fbe0469870 2024-02-18T16:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe055e960 con 0x55fbe0469870 2024-02-18T16:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79922fd640 1 -- 172.21.15.129:0/2379794522 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f798c00a4d0 con 0x55fbe0469870 2024-02-18T16:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe055d7c0 con 0x55fbe0469870 2024-02-18T16:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79922fd640 1 -- 172.21.15.129:0/2379794522 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f798c00a4d0 con 0x55fbe0469870 2024-02-18T16:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe055dbd0 con 0x55fbe0469870 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79922fd640 1 -- 172.21.15.129:0/2379794522 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f798c00a4d0 con 0x55fbe0469870 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 Processor -- start 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- start start 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 0x55fbe0464630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe0309f20 con 0x55fbe0466190 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79912fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 0x55fbe0464630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79912fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 0x55fbe0464630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51596/0 (socket says 172.21.15.129:51596) 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79912fb640 1 -- 172.21.15.129:0/2715595801 learned_addr learned my addr 172.21.15.129:0/2715595801 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79912fb640 1 -- 172.21.15.129:0/2715595801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbe0464b70 con 0x55fbe0466190 2024-02-18T16:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f79912fb640 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 0x55fbe0464630 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7988000c10 tx=0x7f7988018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f78777fe640 1 -- 172.21.15.129:0/2715595801 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79880bf410 con 0x55fbe0466190 2024-02-18T16:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f78777fe640 1 -- 172.21.15.129:0/2715595801 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880bf570 con 0x55fbe0466190 2024-02-18T16:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbe0464dc0 con 0x55fbe0466190 2024-02-18T16:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.709+0000 7f78777fe640 1 -- 172.21.15.129:0/2715595801 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79880bf850 con 0x55fbe0466190 2024-02-18T16:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbe0465250 con 0x55fbe0466190 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f78777fe640 1 -- 172.21.15.129:0/2715595801 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79880bf9b0 con 0x55fbe0466190 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f78777fe640 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f786c034300 0x7f786c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f78777fe640 1 -- 172.21.15.129:0/2715595801 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f79880e5da0 con 0x55fbe0466190 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79922fd640 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f786c034300 0x7f786c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 Processor -- start 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 -- start start 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79922fd640 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f786c034300 0x7f786c0367c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55fbe055e370 tx=0x7f798c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe057c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe02fd790 con 0x55fbe057c4e0 2024-02-18T16:21:47.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79912fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe057c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79912fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe057c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51610/0 (socket says 172.21.15.129:51610) 2024-02-18T16:21:47.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79912fb640 1 -- 172.21.15.129:0/3505664840 learned_addr learned my addr 172.21.15.129:0/3505664840 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79912fb640 1 -- 172.21.15.129:0/3505664840 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbe057ceb0 con 0x55fbe057c4e0 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f79912fb640 1 --2- 172.21.15.129:0/3505664840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe057c8e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f79880e4120 tx=0x7f79880cf410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630999fd8a94e99c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f78757fa640 1 -- 172.21.15.129:0/3505664840 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7988006390 con 0x55fbe057c4e0 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f78757fa640 1 -- 172.21.15.129:0/3505664840 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880064f0 con 0x55fbe057c4e0 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f78757fa640 1 -- 172.21.15.129:0/3505664840 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7988006de0 con 0x55fbe057c4e0 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 -- 172.21.15.129:0/3505664840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 msgr2=0x55fbe057c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 --2- 172.21.15.129:0/3505664840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe057c8e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f79880e4120 tx=0x7f79880cf410 comp rx=0 tx=0).stop 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 -- 172.21.15.129:0/3505664840 shutdown_connections 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 --2- 172.21.15.129:0/3505664840 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe057c8e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.713+0000 7f7993fe1980 1 -- 172.21.15.129:0/3505664840 >> 172.21.15.129:0/3505664840 conn(0x55fbe0578820 msgr2=0x55fbe0576880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 -- 172.21.15.129:0/3505664840 shutdown_connections 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 -- 172.21.15.129:0/3505664840 wait complete. 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 Processor -- start 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 -- start start 2024-02-18T16:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe05833e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbe0583920 con 0x55fbe057c4e0 2024-02-18T16:21:47.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f79912fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe05833e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f79912fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe05833e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:51612/0 (socket says 172.21.15.129:51612) 2024-02-18T16:21:47.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 learned_addr learned my addr 172.21.15.129:0/1437060938 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbe0465250 con 0x55fbe057c4e0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f79912fb640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe05833e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f79880cf450 tx=0x7f79880e4080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f78637fe640 1 -- 172.21.15.129:0/1437060938 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7988006b10 con 0x55fbe057c4e0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f78637fe640 1 -- 172.21.15.129:0/1437060938 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880bee70 con 0x55fbe057c4e0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbe0583b20 con 0x55fbe057c4e0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f78637fe640 1 -- 172.21.15.129:0/1437060938 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79880b5be0 con 0x55fbe057c4e0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbe0583ef0 con 0x55fbe057c4e0 2024-02-18T16:21:47.725 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f78637fe640 1 -- 172.21.15.129:0/1437060938 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79880e52b0 con 0x55fbe057c4e0 2024-02-18T16:21:47.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f78637fe640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f785c0342b0 0x7f785c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f78637fe640 1 -- 172.21.15.129:0/1437060938 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f79880e0030 con 0x55fbe057c4e0 2024-02-18T16:21:47.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.717+0000 7f79922fd640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f785c0342b0 0x7f785c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe058e7f0 0x55fbe0590cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0591400 con 0x55fbe058e7f0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe058e7f0 0x55fbe0590cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe058e7f0 0x55fbe0590cb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79922fd640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f785c0342b0 0x7f785c036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f798c011010 tx=0x7f798c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 realm 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05917d0 con 0x55fbe058e7f0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0592050 con 0x55fbe058e7f0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05923b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0592bb0 con 0x55fbe058e7f0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 20 searching for the correct realm 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fbe0594a40 0x55fbe0596ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79912fb640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fbe0594a40 0x55fbe0596ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79912fb640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fbe0594a40 0x55fbe0596ee0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79912fb640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f79880dd040 0x7f79880db610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79922fd640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f79880dd040 0x7f79880db610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.721+0000 7f79922fd640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f79880dd040 0x7f79880db610 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c00a4d0 con 0x7f79880dd040 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79922fd640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f798c0141d0 0x7f798c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f798c0141d0 0x7f798c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f798c0141d0 0x7f798c015940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x7f798c0141d0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x7f798c0141d0 2024-02-18T16:21:47.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x7f798c0141d0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c00a4d0 con 0x7f79880dd040 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.725+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x7f798c0141d0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x7f798c0141d0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.729+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7984014070 con 0x55fbe058e7f0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f798c0141d0 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe0594a40 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.733+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05975b0 con 0x7f79880dd040 2024-02-18T16:21:47.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:21:47.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:21:47.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05934e0 con 0x55fbe058e7f0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0593d30 con 0x55fbe058e7f0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05979f0 con 0x55fbe058e7f0 2024-02-18T16:21:47.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 zone default found 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 4 Realm: () 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 zonegroup default 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0597a40 con 0x7f79880dd040 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0599820 con 0x55fbe0594a40 2024-02-18T16:21:47.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0599c20 con 0x55fbe0594a40 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 started sync module instance, tier type = 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:21:47.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe0599100 con 0x7f79880dd040 2024-02-18T16:21:47.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.737+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540289117280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05994b0 con 0x7f79880dd040 2024-02-18T16:21:47.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059a980 con 0x55fbe058e7f0 2024-02-18T16:21:47.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94540289117280] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94540289122368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059a900 con 0x55fbe058e7f0 2024-02-18T16:21:47.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059b330 con 0x55fbe0594a40 2024-02-18T16:21:47.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.741+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94540289122368] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94540289123424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059a880 con 0x55fbe0594a40 2024-02-18T16:21:47.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059c060 con 0x7f79880dd040 2024-02-18T16:21:47.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540289129344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059c8b0 con 0x7f79880dd040 2024-02-18T16:21:47.752 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059d2b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94540289123424] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94540289129344] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540289134000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059c410 con 0x55fbe058e7f0 2024-02-18T16:21:47.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.745+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059db00 con 0x7f798c0141d0 2024-02-18T16:21:47.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.749+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94540289134000] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.749+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.749+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94540289128160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059c410 con 0x7f798c0141d0 2024-02-18T16:21:47.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.749+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059df80 con 0x7f798c0141d0 2024-02-18T16:21:47.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.749+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94540289128160] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94540289135680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059df40 con 0x7f798c0141d0 2024-02-18T16:21:47.758 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059e8f0 con 0x7f798c0141d0 2024-02-18T16:21:47.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94540289135680] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94540289139728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059ead0 con 0x7f798c0141d0 2024-02-18T16:21:47.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=0 2024-02-18T16:21:47.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=1 2024-02-18T16:21:47.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=2 2024-02-18T16:21:47.760 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=3 2024-02-18T16:21:47.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=4 2024-02-18T16:21:47.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=5 2024-02-18T16:21:47.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.753+0000 7f7993fe1980 20 add_watcher() i=6 2024-02-18T16:21:47.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94540289139728] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 20 add_watcher() i=7 2024-02-18T16:21:47.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 2 all 8 watchers are set, enabling cache 2024-02-18T16:21:47.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a1e90 con 0x55fbe058e7f0 2024-02-18T16:21:47.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540289141184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059f280 con 0x55fbe058e7f0 2024-02-18T16:21:47.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94540289141184] v32'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f78437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:21:47.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:21:47.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05aa330 con 0x55fbe058e7f0 2024-02-18T16:21:47.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.757+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05aa3a0 con 0x7f798c0141d0 2024-02-18T16:21:47.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.761+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.761+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05aa9e0 con 0x55fbe0594a40 2024-02-18T16:21:47.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.761+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.761+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05ab3b0 con 0x55fbe058e7f0 2024-02-18T16:21:47.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.765+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.765+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a84e0 con 0x7f79880dd040 2024-02-18T16:21:47.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.765+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.765+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a84e0 con 0x55fbe0594a40 2024-02-18T16:21:47.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.765+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.765+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05ac590 con 0x55fbe058e7f0 2024-02-18T16:21:47.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.769+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.769+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05ac590 con 0x7f798c0141d0 2024-02-18T16:21:47.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.769+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.769+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05ac590 con 0x7f79880dd040 2024-02-18T16:21:47.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.773+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.773+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05acac0 con 0x55fbe0594a40 2024-02-18T16:21:47.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.773+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.773+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05ad2c0 con 0x7f79880dd040 2024-02-18T16:21:47.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.777+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.777+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a74d0 con 0x7f798c0141d0 2024-02-18T16:21:47.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.777+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.777+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7ae0 con 0x7f79880dd040 2024-02-18T16:21:47.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.777+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.777+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7ae0 con 0x7f798c0141d0 2024-02-18T16:21:47.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.781+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.781+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe058e7f0 2024-02-18T16:21:47.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.781+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.781+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.785+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.785+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x7f79880dd040 2024-02-18T16:21:47.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.785+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.785+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.789+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.789+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe058e7f0 2024-02-18T16:21:47.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.789+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.789+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe058e7f0 2024-02-18T16:21:47.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.793+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.793+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.793+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.793+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x7f79880dd040 2024-02-18T16:21:47.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.797+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.797+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.797+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.797+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.797+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.797+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.801+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.801+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.801+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.801+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x7f798c0141d0 2024-02-18T16:21:47.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.805+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.805+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.805+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.805+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x7f798c0141d0 2024-02-18T16:21:47.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.809+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.809+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x55fbe0594a40 2024-02-18T16:21:47.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.809+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.809+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x7f798c0141d0 2024-02-18T16:21:47.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a7300 con 0x7f79880dd040 2024-02-18T16:21:47.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f78427fc640 20 reqs_thread_entry: start 2024-02-18T16:21:47.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 20 init_complete bucket index max shards: 11 2024-02-18T16:21:47.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 20 Filter name: none 2024-02-18T16:21:47.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f77b3fff640 20 reqs_thread_entry: start 2024-02-18T16:21:47.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:21:47.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 20 rados->read ofs=0 len=0 2024-02-18T16:21:47.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a6f70 con 0x55fbe058e7f0 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.813+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a6f30 con 0x7f79880dd040 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.822 INFO:teuthology.orchestra.run.smithi129.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-18T16:21:47.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f78437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:21:47.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94540289141184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe05a3e30 con 0x55fbe058e7f0 2024-02-18T16:21:47.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94540289141184] v32'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94540289117280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059e9c0 con 0x7f79880dd040 2024-02-18T16:21:47.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94540289117280] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f7993fe1980 20 remove_watcher() i=0 2024-02-18T16:21:47.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f7993fe1980 2 removed watcher, disabling cache 2024-02-18T16:21:47.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.817+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94540289122368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059e9c0 con 0x55fbe058e7f0 2024-02-18T16:21:47.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.821+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94540289122368] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.821+0000 7f7993fe1980 20 remove_watcher() i=1 2024-02-18T16:21:47.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.821+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94540289123424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059a040 con 0x55fbe0594a40 2024-02-18T16:21:47.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f79912fb640 1 -- 172.21.15.129:0/1437060938 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94540289123424] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79880f3070 con 0x55fbe0594a40 2024-02-18T16:21:47.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7993fe1980 20 remove_watcher() i=2 2024-02-18T16:21:47.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94540289129344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059e9c0 con 0x7f79880dd040 2024-02-18T16:21:47.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f79922fd640 1 -- 172.21.15.129:0/1437060938 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94540289129344] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f798c03a040 con 0x7f79880dd040 2024-02-18T16:21:47.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7993fe1980 20 remove_watcher() i=3 2024-02-18T16:21:47.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94540289134000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059e9c0 con 0x55fbe058e7f0 2024-02-18T16:21:47.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94540289134000] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x55fbe058e7f0 2024-02-18T16:21:47.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7993fe1980 20 remove_watcher() i=4 2024-02-18T16:21:47.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.825+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94540289128160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059cdb0 con 0x7f798c0141d0 2024-02-18T16:21:47.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.829+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94540289128160] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.829+0000 7f7993fe1980 20 remove_watcher() i=5 2024-02-18T16:21:47.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.829+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94540289135680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059e9c0 con 0x7f798c0141d0 2024-02-18T16:21:47.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.829+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94540289135680] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 20 remove_watcher() i=6 2024-02-18T16:21:47.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94540289139728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbe059b6e0 con 0x7f798c0141d0 2024-02-18T16:21:47.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94540289139728] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7984059040 con 0x7f798c0141d0 2024-02-18T16:21:47.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 20 remove_watcher() i=7 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f798c0141d0 msgr2=0x7f798c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f798c0141d0 0x7f798c015940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe058e7f0 msgr2=0x55fbe0590cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe058e7f0 0x55fbe0590cb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f79880dd040 msgr2=0x7f79880db610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f79880dd040 0x7f79880db610 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fbe0594a40 msgr2=0x55fbe0596ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fbe0594a40 0x55fbe0596ee0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f785c0342b0 msgr2=0x7f785c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f785c0342b0 0x7f785c036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f798c011010 tx=0x7f798c020000 comp rx=0 tx=0).stop 2024-02-18T16:21:47.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 msgr2=0x55fbe05833e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7991afc640 1 -- 172.21.15.129:0/1437060938 reap_dead start 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe05833e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f79880cf450 tx=0x7f79880e4080 comp rx=0 tx=0).stop 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 shutdown_connections 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/1437060938 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe057c4e0 0x55fbe05833e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 >> 172.21.15.129:0/1437060938 conn(0x55fbe0578820 msgr2=0x55fbe0576850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 shutdown_connections 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/1437060938 wait complete. 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f786c034300 msgr2=0x7f786c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f786c034300 0x7f786c0367c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55fbe055e370 tx=0x7f798c005850 comp rx=0 tx=0).stop 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 msgr2=0x55fbe0464630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 0x55fbe0464630 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7988000c10 tx=0x7f7988018020 comp rx=0 tx=0).stop 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 shutdown_connections 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f786c034300 0x7f786c0367c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2715595801 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe0466190 0x55fbe0464630 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 >> 172.21.15.129:0/2715595801 conn(0x55fbe05620b0 msgr2=0x55fbe0562bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 shutdown_connections 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2715595801 wait complete. 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe0469870 msgr2=0x55fbe055ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe0469870 0x55fbe055ca40 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f78780342b0 msgr2=0x7f7878036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f78780342b0 0x7f7878036770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f79880ad000 tx=0x7f79880a5040 comp rx=0 tx=0).stop 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 msgr2=0x55fbe0555e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.833+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe0555e30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f798400b710 tx=0x7f7984000bd0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 shutdown_connections 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fbe0469870 0x55fbe055ca40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f78780342b0 0x7f7878036770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 --2- 172.21.15.129:0/2379794522 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fbe04668b0 0x55fbe0555e30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:21:47.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 >> 172.21.15.129:0/2379794522 conn(0x55fbe045f060 msgr2=0x55fbe0549600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:21:47.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 shutdown_connections 2024-02-18T16:21:47.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:21:47.837+0000 7f7993fe1980 1 -- 172.21.15.129:0/2379794522 wait complete. 2024-02-18T16:21:47.853 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-18T16:21:47.877 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:21:47.924 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-18T16:22:22.925 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-02-18T16:22:22.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-02-18T16:22:22.926 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-02-18T16:22:22.965 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:22.965 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:22.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.957+0000 7f3cd5b38980 1 Processor -- start 2024-02-18T16:22:22.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.957+0000 7f3cd5b38980 1 -- start start 2024-02-18T16:22:22.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd5b38980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e55f679520 0x55e55f67b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:22.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd5b38980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e55f5c14c0 con 0x55e55f5e9080 2024-02-18T16:22:22.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd5b38980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e55f588180 con 0x55e55f679520 2024-02-18T16:22:22.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd2e52640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e55f679520 0x55e55f67b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:22.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd2e52640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e55f679520 0x55e55f67b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43748/0 (socket says 172.21.15.129:43748) 2024-02-18T16:22:22.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3481213592 learned_addr learned my addr 172.21.15.129:0/3481213592 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:22.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3481213592 >> v1:172.21.15.80:6789/0 conn(0x55e55f5e9080 legacy=0x55e55f677e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:22.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd2651640 1 -- 172.21.15.129:0/3481213592 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057862861 0 0) 0x55e55f5c14c0 con 0x55e55f5e9080 2024-02-18T16:22:22.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.961+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3481213592 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55f67cef0 con 0x55e55f679520 2024-02-18T16:22:22.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3481213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f679520 0x55e55f67b910 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800a5c0 tx=0x7f3cc801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c754012a9ae472bc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:22.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd2651640 1 -- 172.21.15.129:0/3481213592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80aa470 con 0x55e55f679520 2024-02-18T16:22:22.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd2651640 1 -- 172.21.15.129:0/3481213592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80aa5d0 con 0x55e55f679520 2024-02-18T16:22:22.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd2651640 1 -- 172.21.15.129:0/3481213592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80aa890 con 0x55e55f679520 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3481213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f679520 msgr2=0x55e55f67b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3481213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f679520 0x55e55f67b910 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800a5c0 tx=0x7f3cc801b340 comp rx=0 tx=0).stop 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3481213592 shutdown_connections 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3481213592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f679520 0x55e55f67b910 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3481213592 >> 172.21.15.129:0/3481213592 conn(0x55e55f66f8e0 msgr2=0x55e55f671d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3481213592 shutdown_connections 2024-02-18T16:22:22.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.965+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3481213592 wait complete. 2024-02-18T16:22:22.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd5b38980 1 Processor -- start 2024-02-18T16:22:22.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd5b38980 1 -- start start 2024-02-18T16:22:22.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd5b38980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f75ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:22.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd5b38980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55f5856b0 con 0x55e55f5e9080 2024-02-18T16:22:22.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd3653640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f75ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:22.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd3653640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f75ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43758/0 (socket says 172.21.15.129:43758) 2024-02-18T16:22:22.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd3653640 1 -- 172.21.15.129:0/1649367029 learned_addr learned my addr 172.21.15.129:0/1649367029 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:22.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd3653640 1 -- 172.21.15.129:0/1649367029 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8005df0 con 0x55e55f5e9080 2024-02-18T16:22:22.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3cd3653640 1 --2- 172.21.15.129:0/1649367029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f75ef40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4001670 tx=0x7f3cc4001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a79540d7d2242d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:22.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3bc160a640 1 -- 172.21.15.129:0/1649367029 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc40025d0 con 0x55e55f5e9080 2024-02-18T16:22:22.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3bc160a640 1 -- 172.21.15.129:0/1649367029 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4002730 con 0x55e55f5e9080 2024-02-18T16:22:22.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.981+0000 7f3bc160a640 1 -- 172.21.15.129:0/1649367029 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc4002a30 con 0x55e55f5e9080 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1649367029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 msgr2=0x55e55f75ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1649367029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f75ef40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4001670 tx=0x7f3cc4001b30 comp rx=0 tx=0).stop 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1649367029 shutdown_connections 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1649367029 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f75ef40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1649367029 >> 172.21.15.129:0/1649367029 conn(0x55e55f66f8e0 msgr2=0x55e55f75aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1649367029 shutdown_connections 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1649367029 wait complete. 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 Processor -- start 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- start start 2024-02-18T16:22:22.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f765e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:22.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55f580e90 con 0x55e55f5e9080 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd3653640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f765e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd3653640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f765e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43760/0 (socket says 172.21.15.129:43760) 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd3653640 1 -- 172.21.15.129:0/3837414126 learned_addr learned my addr 172.21.15.129:0/3837414126 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd3653640 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4006cc0 con 0x55e55f5e9080 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd3653640 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f765e10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006fb0 tx=0x7f3cc4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3bbfe07640 1 -- 172.21.15.129:0/3837414126 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc4012860 con 0x55e55f5e9080 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3bbfe07640 1 -- 172.21.15.129:0/3837414126 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40129c0 con 0x55e55f5e9080 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e55f766350 con 0x55e55f5e9080 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3bbfe07640 1 -- 172.21.15.129:0/3837414126 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc4012c60 con 0x55e55f5e9080 2024-02-18T16:22:22.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e55f7667a0 con 0x55e55f5e9080 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.985+0000 7f3bbfe07640 1 -- 172.21.15.129:0/3837414126 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3cc4019070 con 0x55e55f5e9080 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3bbfe07640 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bb80342b0 0x7f3bb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3bbfe07640 1 -- 172.21.15.129:0/3837414126 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3cc4049370 con 0x55e55f5e9080 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bb80342b0 0x7f3bb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f679520 0x55e55f76ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f76cf60 con 0x55e55f679520 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f679520 0x55e55f76ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bb80342b0 0x7f3bb8036770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80ae000 tx=0x7f3cc80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:22.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f679520 0x55e55f76ca20 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3837414126 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ccc0083f0 con 0x55e55f679520 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f76d2e0 con 0x55e55f679520 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3837414126 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3ccc0083f0 con 0x55e55f679520 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f76eb90 con 0x55e55f679520 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3837414126 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3ccc0083f0 con 0x55e55f679520 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f76dd90 con 0x55e55f679520 2024-02-18T16:22:22.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3837414126 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3ccc0083f0 con 0x55e55f679520 2024-02-18T16:22:22.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f76e1a0 con 0x55e55f679520 2024-02-18T16:22:22.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3837414126 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3ccc012040 con 0x55e55f679520 2024-02-18T16:22:22.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 Processor -- start 2024-02-18T16:22:22.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- start start 2024-02-18T16:22:22.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 0x55e55f77d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:22.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd5b38980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55f519f20 con 0x55e55f77d2a0 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.989+0000 7f3cd2e52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 0x55e55f77d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd2e52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 0x55e55f77d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43768/0 (socket says 172.21.15.129:43768) 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd2e52640 1 -- 172.21.15.129:0/1395691242 learned_addr learned my addr 172.21.15.129:0/1395691242 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd2e52640 1 -- 172.21.15.129:0/1395691242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55f77dc00 con 0x55e55f77d2a0 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 0x55e55f77d6c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3cc801b380 tx=0x7f3cc80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3bbd602640 1 -- 172.21.15.129:0/1395691242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80b3ca0 con 0x55e55f77d2a0 2024-02-18T16:22:22.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3bbd602640 1 -- 172.21.15.129:0/1395691242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80c3070 con 0x55e55f77d2a0 2024-02-18T16:22:23.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3bbd602640 1 -- 172.21.15.129:0/1395691242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80c8430 con 0x55e55f77d2a0 2024-02-18T16:22:23.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e55f77ddf0 con 0x55e55f77d2a0 2024-02-18T16:22:23.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e55f77e8e0 con 0x55e55f77d2a0 2024-02-18T16:22:23.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3bbd602640 1 -- 172.21.15.129:0/1395691242 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3cc80c5030 con 0x55e55f77d2a0 2024-02-18T16:22:23.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3bbd602640 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bac038760 0x7f3bac03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3bbd602640 1 -- 172.21.15.129:0/1395691242 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3cc80e6880 con 0x55e55f77d2a0 2024-02-18T16:22:23.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bac038760 0x7f3bac03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd5b38980 1 Processor -- start 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bac038760 0x7f3bac03ac20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55e55f76d7d0 tx=0x7f3ccc003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd5b38980 1 -- start start 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd5b38980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f788430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.993+0000 7f3cd5b38980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55f50d790 con 0x55e55f788010 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f788430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f788430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43778/0 (socket says 172.21.15.129:43778) 2024-02-18T16:22:23.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 -- 172.21.15.129:0/1708856229 learned_addr learned my addr 172.21.15.129:0/1708856229 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 -- 172.21.15.129:0/1708856229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55f788a00 con 0x55e55f788010 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/1708856229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f788430 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80cdff0 tx=0x7f3cc80bd4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2318b30dcb89e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3bb6ffd640 1 -- 172.21.15.129:0/1708856229 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80d6040 con 0x55e55f788010 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3bb6ffd640 1 -- 172.21.15.129:0/1708856229 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80c7b00 con 0x55e55f788010 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3bb6ffd640 1 -- 172.21.15.129:0/1708856229 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80d1e70 con 0x55e55f788010 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1708856229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 msgr2=0x55e55f788430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1708856229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f788430 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80cdff0 tx=0x7f3cc80bd4c0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1708856229 shutdown_connections 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1708856229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f788430 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1708856229 >> 172.21.15.129:0/1708856229 conn(0x55e55f7843a0 msgr2=0x55e55f782400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1708856229 shutdown_connections 2024-02-18T16:22:23.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1708856229 wait complete. 2024-02-18T16:22:23.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 Processor -- start 2024-02-18T16:22:23.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- start start 2024-02-18T16:22:23.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f78eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55f78f430 con 0x55e55f788010 2024-02-18T16:22:23.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f78eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f78eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43782/0 (socket says 172.21.15.129:43782) 2024-02-18T16:22:23.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 learned_addr learned my addr 172.21.15.129:0/3706857381 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55f77e8e0 con 0x55e55f788010 2024-02-18T16:22:23.006 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f78eef0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80bd500 tx=0x7f3cc80e4aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3bb57fa640 1 -- 172.21.15.129:0/3706857381 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80d1e70 con 0x55e55f788010 2024-02-18T16:22:23.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3bb57fa640 1 -- 172.21.15.129:0/3706857381 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80e6ae0 con 0x55e55f788010 2024-02-18T16:22:23.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e55f78f630 con 0x55e55f788010 2024-02-18T16:22:23.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:22.997+0000 7f3bb57fa640 1 -- 172.21.15.129:0/3706857381 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc80e6da0 con 0x55e55f788010 2024-02-18T16:22:23.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e55f78f630 con 0x55e55f788010 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3bb57fa640 1 -- 172.21.15.129:0/3706857381 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3cc80e2040 con 0x55e55f788010 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3bb57fa640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b9c034300 0x7f3b9c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3bb57fa640 1 -- 172.21.15.129:0/3706857381 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3cc80efd20 con 0x55e55f788010 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b9c034300 0x7f3b9c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f79a120 0x55e55f79c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79cd00 con 0x55e55f79a120 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f79a120 0x55e55f79c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b9c034300 0x7f3b9c0367c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc008fd0 tx=0x7f3ccc01c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f79a120 0x55e55f79c5b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 realm 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79d0d0 con 0x55e55f79a120 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79d950 con 0x55e55f79a120 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79dcb0 con 0x55e55f79a120 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79d5f0 con 0x55e55f79a120 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 20 searching for the correct realm 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e55f79ff00 0x55e55f7a2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.001+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a2a00 con 0x55e55f79ff00 2024-02-18T16:22:23.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e55f79ff00 0x55e55f7a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e55f79ff00 0x55e55f7a2330 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd2e52640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3cc80fb040 0x7f3cc80c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a2a00 con 0x7f3cc80fb040 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3cc80fb040 0x7f3cc80c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3cc80fb040 0x7f3cc80c18f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc02c040 con 0x7f3cc80fb040 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3e54640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3ccc027940 0x7f3ccc0333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a2a00 con 0x7f3ccc027940 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3ccc027940 0x7f3ccc0333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3ccc027940 0x7f3ccc0333c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a2a00 con 0x55e55f79a120 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a2a00 con 0x55e55f79a120 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.005+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3ccc027940 2024-02-18T16:22:23.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3ccc027940 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc02c040 con 0x7f3cc80fb040 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79a120 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3ccc027940 2024-02-18T16:22:23.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79a120 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3ccc02c040 con 0x7f3cc80fb040 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.009+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3ccc027940 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79a120 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79a120 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3ccc027940 2024-02-18T16:22:23.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc02c040 con 0x7f3cc80fb040 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79a120 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc02c040 con 0x7f3cc80fb040 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.013+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3ccc027940 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc4049050 con 0x7f3ccc027940 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc02c040 con 0x7f3cc80fb040 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79ff00 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x55e55f79a120 2024-02-18T16:22:23.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3cc403b040 con 0x7f3cc80fb040 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79eb10 con 0x55e55f79a120 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79e760 con 0x55e55f79a120 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3cc4049050 con 0x55e55f79a120 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f79e770 con 0x55e55f79a120 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 zone default found 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 4 Realm: () 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 zonegroup default 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.017+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a2e40 con 0x7f3cc80fb040 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a4820 con 0x55e55f79ff00 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a4cc0 con 0x55e55f79ff00 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 started sync module instance, tier type = 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:23.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a4100 con 0x7f3cc80fb040 2024-02-18T16:22:23.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443637718112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a44b0 con 0x7f3cc80fb040 2024-02-18T16:22:23.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a5a20 con 0x55e55f79a120 2024-02-18T16:22:23.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.021+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443637718112] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443637723360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a59a0 con 0x55e55f79a120 2024-02-18T16:22:23.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a63f0 con 0x55e55f79ff00 2024-02-18T16:22:23.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443637723360] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443637724416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a5920 con 0x55e55f79ff00 2024-02-18T16:22:23.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.025+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a70e0 con 0x7f3cc80fb040 2024-02-18T16:22:23.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443637730672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a7930 con 0x7f3cc80fb040 2024-02-18T16:22:23.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a8390 con 0x55e55f79a120 2024-02-18T16:22:23.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443637724416] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443637730672] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443637729184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a7490 con 0x55e55f79a120 2024-02-18T16:22:23.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.029+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a8be0 con 0x7f3ccc027940 2024-02-18T16:22:23.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443637729184] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x7f3ccc027940 2024-02-18T16:22:23.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443637735040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a7490 con 0x7f3ccc027940 2024-02-18T16:22:23.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a90b0 con 0x7f3ccc027940 2024-02-18T16:22:23.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443637735040] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x7f3ccc027940 2024-02-18T16:22:23.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x7f3ccc027940 2024-02-18T16:22:23.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443637738416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a9070 con 0x7f3ccc027940 2024-02-18T16:22:23.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.033+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a9a70 con 0x7f3ccc027940 2024-02-18T16:22:23.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x7f3ccc027940 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443637740912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a9ed0 con 0x7f3ccc027940 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=0 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=1 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=2 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=3 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=4 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=5 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443637738416] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x7f3ccc027940 2024-02-18T16:22:23.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=6 2024-02-18T16:22:23.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443637740912] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x7f3ccc027940 2024-02-18T16:22:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 20 add_watcher() i=7 2024-02-18T16:22:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a8570 con 0x55e55f79a120 2024-02-18T16:22:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.037+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443637742128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a8570 con 0x55e55f79a120 2024-02-18T16:22:23.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443637742128] v32'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 5 note: GC not initialized 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3b88fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 20 Filter name: none 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3b027fc640 20 reqs_thread_entry: start 2024-02-18T16:22:23.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cf560 con 0x55e55f79a120 2024-02-18T16:22:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cf920 con 0x7f3cc80fb040 2024-02-18T16:22:23.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cf920 con 0x55e55f79a120 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cf920 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x55e55f79a120 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc404f1a0 con 0x55e55f79a120 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x55e55f79a120 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x55e55f79ff00 2024-02-18T16:22:23.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.041+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x55e55f79ff00 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cfc80 con 0x7f3ccc027940 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1520 con 0x55e55f79a120 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1520 con 0x7f3cc80fb040 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1520 con 0x55e55f79ff00 2024-02-18T16:22:23.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1520 con 0x7f3ccc027940 2024-02-18T16:22:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1500 con 0x7f3ccc027940 2024-02-18T16:22:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1480 con 0x55e55f79ff00 2024-02-18T16:22:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.045+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1480 con 0x7f3ccc027940 2024-02-18T16:22:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79a120 2024-02-18T16:22:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79ff00 2024-02-18T16:22:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x7f3ccc027940 2024-02-18T16:22:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x7f3cc80fb040 2024-02-18T16:22:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x7f3ccc027940 2024-02-18T16:22:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79a120 2024-02-18T16:22:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79a120 2024-02-18T16:22:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.049+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79ff00 2024-02-18T16:22:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79a120 2024-02-18T16:22:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79a120 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79ff00 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79ff00 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x55e55f79ff00 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7d1460 con 0x7f3ccc027940 2024-02-18T16:22:23.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.053+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443637742128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7cd1e0 con 0x55e55f79a120 2024-02-18T16:22:23.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.057+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94443637742128] v32'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.057+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443637718112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a9a30 con 0x7f3cc80fb040 2024-02-18T16:22:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.057+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94443637718112] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.057+0000 7f3cd5b38980 20 remove_watcher() i=0 2024-02-18T16:22:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.057+0000 7f3cd5b38980 2 removed watcher, disabling cache 2024-02-18T16:22:23.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.057+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443637723360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x55e55f79a120 2024-02-18T16:22:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94443637723360] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd5b38980 20 remove_watcher() i=1 2024-02-18T16:22:23.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443637724416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x55e55f79ff00 2024-02-18T16:22:23.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd2e52640 1 -- 172.21.15.129:0/3706857381 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94443637724416] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc80b0020 con 0x55e55f79ff00 2024-02-18T16:22:23.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd5b38980 20 remove_watcher() i=2 2024-02-18T16:22:23.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443637730672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x7f3cc80fb040 2024-02-18T16:22:23.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd3e54640 1 -- 172.21.15.129:0/3706857381 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94443637730672] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ccc03f040 con 0x7f3cc80fb040 2024-02-18T16:22:23.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd5b38980 20 remove_watcher() i=3 2024-02-18T16:22:23.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.061+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443637729184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x55e55f79a120 2024-02-18T16:22:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.065+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94443637729184] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x55e55f79a120 2024-02-18T16:22:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.065+0000 7f3cd5b38980 20 remove_watcher() i=4 2024-02-18T16:22:23.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.065+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443637735040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x7f3ccc027940 2024-02-18T16:22:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.065+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94443637735040] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.065+0000 7f3cd5b38980 20 remove_watcher() i=5 2024-02-18T16:22:23.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.065+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443637738416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x7f3ccc027940 2024-02-18T16:22:23.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.069+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94443637738416] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.069+0000 7f3cd5b38980 20 remove_watcher() i=6 2024-02-18T16:22:23.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.069+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443637740912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e55f7a3c60 con 0x7f3ccc027940 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94443637740912] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3cc4055040 con 0x7f3ccc027940 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 20 remove_watcher() i=7 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3ccc027940 msgr2=0x7f3ccc0333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3ccc027940 0x7f3ccc0333c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f79a120 msgr2=0x55e55f79c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f79a120 0x55e55f79c5b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3cc80fb040 msgr2=0x7f3cc80c18f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3cc80fb040 0x7f3cc80c18f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e55f79ff00 msgr2=0x55e55f7a2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55e55f79ff00 0x55e55f7a2330 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b9c034300 msgr2=0x7f3b9c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b9c034300 0x7f3b9c0367c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc008fd0 tx=0x7f3ccc01c070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 msgr2=0x55e55f78eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd3653640 1 -- 172.21.15.129:0/3706857381 reap_dead start 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f78eef0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80bd500 tx=0x7f3cc80e4aa0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 shutdown_connections 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3706857381 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f788010 0x55e55f78eef0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 >> 172.21.15.129:0/3706857381 conn(0x55e55f7843a0 msgr2=0x55e55f7823d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 shutdown_connections 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3706857381 wait complete. 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bac038760 msgr2=0x7f3bac03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bac038760 0x7f3bac03ac20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55e55f76d7d0 tx=0x7f3ccc003070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 msgr2=0x55e55f77d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 0x55e55f77d6c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3cc801b380 tx=0x7f3cc80180e0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 shutdown_connections 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bac038760 0x7f3bac03ac20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/1395691242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f77d2a0 0x55e55f77d6c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 >> 172.21.15.129:0/1395691242 conn(0x55e55f7720b0 msgr2=0x55e55f772bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 shutdown_connections 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/1395691242 wait complete. 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f679520 msgr2=0x55e55f76ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f679520 0x55e55f76ca20 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bb80342b0 msgr2=0x7f3bb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bb80342b0 0x7f3bb8036770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80ae000 tx=0x7f3cc80a6000 comp rx=0 tx=0).stop 2024-02-18T16:22:23.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 msgr2=0x55e55f765e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f765e10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006fb0 tx=0x7f3cc4001260 comp rx=0 tx=0).stop 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 shutdown_connections 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e55f679520 0x55e55f76ca20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3bb80342b0 0x7f3bb8036770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 --2- 172.21.15.129:0/3837414126 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e55f5e9080 0x55e55f765e10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 >> 172.21.15.129:0/3837414126 conn(0x55e55f66f8e0 msgr2=0x55e55f7595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 shutdown_connections 2024-02-18T16:22:23.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.073+0000 7f3cd5b38980 1 -- 172.21.15.129:0/3837414126 wait complete. 2024-02-18T16:22:23.090 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-18T16:22:23.091 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-18T16:22:23.091 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-18T16:22:23.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-18T16:22:23.091 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-18T16:22:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:23.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635e333980 1 Processor -- start 2024-02-18T16:22:23.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635e333980 1 -- start start 2024-02-18T16:22:23.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635e333980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fc0da21560 0x55fc0da23950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635e333980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fc0d96a4b0 con 0x55fc0da1d000 2024-02-18T16:22:23.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635e333980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fc0d931180 con 0x55fc0da21560 2024-02-18T16:22:23.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635b64d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fc0da21560 0x55fc0da23950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635be4e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55fc0da1d000 0x55fc0da1d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43170/0 (socket says 172.21.15.129:43170) 2024-02-18T16:22:23.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635be4e640 1 -- 172.21.15.129:0/361398900 learned_addr learned my addr 172.21.15.129:0/361398900 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:23.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635b64d640 1 -- 172.21.15.129:0/361398900 >> v1:172.21.15.80:6789/0 conn(0x55fc0da1d000 legacy=0x55fc0da1d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635ae4c640 1 -- 172.21.15.129:0/361398900 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761722535 0 0) 0x55fc0d96a4b0 con 0x55fc0da1d000 2024-02-18T16:22:23.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.157+0000 7f635b64d640 1 -- 172.21.15.129:0/361398900 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc0da24ea0 con 0x55fc0da21560 2024-02-18T16:22:23.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635b64d640 1 --2- 172.21.15.129:0/361398900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da21560 0x55fc0da23950 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f634400a480 tx=0x7f634401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c35e7405cf507d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635ae4c640 1 -- 172.21.15.129:0/361398900 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440ab540 con 0x55fc0da21560 2024-02-18T16:22:23.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635ae4c640 1 -- 172.21.15.129:0/361398900 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63440ab6a0 con 0x55fc0da21560 2024-02-18T16:22:23.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635ae4c640 1 -- 172.21.15.129:0/361398900 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440ab960 con 0x55fc0da21560 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 -- 172.21.15.129:0/361398900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da21560 msgr2=0x55fc0da23950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 --2- 172.21.15.129:0/361398900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da21560 0x55fc0da23950 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f634400a480 tx=0x7f634401b280 comp rx=0 tx=0).stop 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 -- 172.21.15.129:0/361398900 shutdown_connections 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 --2- 172.21.15.129:0/361398900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da21560 0x55fc0da23950 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 -- 172.21.15.129:0/361398900 >> 172.21.15.129:0/361398900 conn(0x55fc0da188d0 msgr2=0x55fc0da1acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 -- 172.21.15.129:0/361398900 shutdown_connections 2024-02-18T16:22:23.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.161+0000 7f635e333980 1 -- 172.21.15.129:0/361398900 wait complete. 2024-02-18T16:22:23.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.177+0000 7f635e333980 1 Processor -- start 2024-02-18T16:22:23.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.177+0000 7f635e333980 1 -- start start 2024-02-18T16:22:23.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.177+0000 7f635e333980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db06dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0d92e6b0 con 0x55fc0da1d000 2024-02-18T16:22:23.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db06dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db06dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43786/0 (socket says 172.21.15.129:43786) 2024-02-18T16:22:23.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 -- 172.21.15.129:0/1544851156 learned_addr learned my addr 172.21.15.129:0/1544851156 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 -- 172.21.15.129:0/1544851156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344005d30 con 0x55fc0da1d000 2024-02-18T16:22:23.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 --2- 172.21.15.129:0/1544851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db06dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f634c0016c0 tx=0x7f634c001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e83900f64c15cff server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f6249e0b640 1 -- 172.21.15.129:0/1544851156 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f634c003460 con 0x55fc0da1d000 2024-02-18T16:22:23.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f6249e0b640 1 -- 172.21.15.129:0/1544851156 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c0035c0 con 0x55fc0da1d000 2024-02-18T16:22:23.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f6249e0b640 1 -- 172.21.15.129:0/1544851156 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f634c0038a0 con 0x55fc0da1d000 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- 172.21.15.129:0/1544851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 msgr2=0x55fc0db06dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 --2- 172.21.15.129:0/1544851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db06dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f634c0016c0 tx=0x7f634c001b80 comp rx=0 tx=0).stop 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- 172.21.15.129:0/1544851156 shutdown_connections 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 --2- 172.21.15.129:0/1544851156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db06dd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- 172.21.15.129:0/1544851156 >> 172.21.15.129:0/1544851156 conn(0x55fc0da188d0 msgr2=0x55fc0db02960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- 172.21.15.129:0/1544851156 shutdown_connections 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- 172.21.15.129:0/1544851156 wait complete. 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 Processor -- start 2024-02-18T16:22:23.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- start start 2024-02-18T16:22:23.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db0dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635e333980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0d929e90 con 0x55fc0da1d000 2024-02-18T16:22:23.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db0dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db0dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43802/0 (socket says 172.21.15.129:43802) 2024-02-18T16:22:23.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.181+0000 7f635be4e640 1 -- 172.21.15.129:0/1920441013 learned_addr learned my addr 172.21.15.129:0/1920441013 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635be4e640 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c006cf0 con 0x55fc0da1d000 2024-02-18T16:22:23.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635be4e640 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db0dcc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f634c0012f0 tx=0x7f634c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f6243fff640 1 -- 172.21.15.129:0/1920441013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f634c013760 con 0x55fc0da1d000 2024-02-18T16:22:23.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f6243fff640 1 -- 172.21.15.129:0/1920441013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c0138c0 con 0x55fc0da1d000 2024-02-18T16:22:23.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f6243fff640 1 -- 172.21.15.129:0/1920441013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f634c013b60 con 0x55fc0da1d000 2024-02-18T16:22:23.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc0db0e200 con 0x55fc0da1d000 2024-02-18T16:22:23.192 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc0db0e6b0 con 0x55fc0da1d000 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f6243fff640 1 -- 172.21.15.129:0/1920441013 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f634c013cc0 con 0x55fc0da1d000 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f6243fff640 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6244034300 0x7f62440367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f6243fff640 1 -- 172.21.15.129:0/1920441013 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f634c0496b0 con 0x55fc0da1d000 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635b64d640 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6244034300 0x7f62440367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0da21560 0x55fc0db14900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db14e40 con 0x55fc0da21560 2024-02-18T16:22:23.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635c64f640 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0da21560 0x55fc0db14900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635b64d640 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6244034300 0x7f62440367c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63440ad000 tx=0x7f63440a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635c64f640 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0da21560 0x55fc0db14900 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635c64f640 1 -- 172.21.15.129:0/1920441013 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63540083f0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.185+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db15200 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635c64f640 1 -- 172.21.15.129:0/1920441013 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f63540083f0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db16ab0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635c64f640 1 -- 172.21.15.129:0/1920441013 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f63540083f0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db15cb0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635c64f640 1 -- 172.21.15.129:0/1920441013 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f63540083f0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db160c0 con 0x55fc0da21560 2024-02-18T16:22:23.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635c64f640 1 -- 172.21.15.129:0/1920441013 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6354012040 con 0x55fc0da21560 2024-02-18T16:22:23.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 Processor -- start 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- start start 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 0x55fc0db25590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0d8c2f20 con 0x55fc0db25170 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635b64d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 0x55fc0db25590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635b64d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 0x55fc0db25590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43812/0 (socket says 172.21.15.129:43812) 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635b64d640 1 -- 172.21.15.129:0/108106835 learned_addr learned my addr 172.21.15.129:0/108106835 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635b64d640 1 -- 172.21.15.129:0/108106835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc0db25ad0 con 0x55fc0db25170 2024-02-18T16:22:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635b64d640 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 0x55fc0db25590 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f63440ab670 tx=0x7f6344018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f62417fa640 1 -- 172.21.15.129:0/108106835 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440bb600 con 0x55fc0db25170 2024-02-18T16:22:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f62417fa640 1 -- 172.21.15.129:0/108106835 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63440bb760 con 0x55fc0db25170 2024-02-18T16:22:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc0db25cc0 con 0x55fc0db25170 2024-02-18T16:22:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f62417fa640 1 -- 172.21.15.129:0/108106835 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440bba00 con 0x55fc0db25170 2024-02-18T16:22:23.198 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.189+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc0db26810 con 0x55fc0db25170 2024-02-18T16:22:23.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f62417fa640 1 -- 172.21.15.129:0/108106835 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f63440bbb60 con 0x55fc0db25170 2024-02-18T16:22:23.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f62417fa640 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62340342b0 0x7f6234036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f62417fa640 1 -- 172.21.15.129:0/108106835 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f63440e7a80 con 0x55fc0db25170 2024-02-18T16:22:23.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635c64f640 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62340342b0 0x7f6234036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 Processor -- start 2024-02-18T16:22:23.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- start start 2024-02-18T16:22:23.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635c64f640 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62340342b0 0x7f6234036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55fc0db156f0 tx=0x7f6354003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db31460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0d8b6790 con 0x55fc0db31080 2024-02-18T16:22:23.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635b64d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db31460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635b64d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db31460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43824/0 (socket says 172.21.15.129:43824) 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635b64d640 1 -- 172.21.15.129:0/2820045011 learned_addr learned my addr 172.21.15.129:0/2820045011 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635b64d640 1 -- 172.21.15.129:0/2820045011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc0db31a30 con 0x55fc0db31080 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635b64d640 1 --2- 172.21.15.129:0/2820045011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db31460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f63440e5e10 tx=0x7f63440baf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62582d078c8c9ba server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f623affd640 1 -- 172.21.15.129:0/2820045011 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440aacd0 con 0x55fc0db31080 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f623affd640 1 -- 172.21.15.129:0/2820045011 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63440aae30 con 0x55fc0db31080 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f623affd640 1 -- 172.21.15.129:0/2820045011 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440c35f0 con 0x55fc0db31080 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- 172.21.15.129:0/2820045011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 msgr2=0x55fc0db31460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 --2- 172.21.15.129:0/2820045011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db31460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f63440e5e10 tx=0x7f63440baf70 comp rx=0 tx=0).stop 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- 172.21.15.129:0/2820045011 shutdown_connections 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 --2- 172.21.15.129:0/2820045011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db31460 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- 172.21.15.129:0/2820045011 >> 172.21.15.129:0/2820045011 conn(0x55fc0db2d3c0 msgr2=0x55fc0db2b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- 172.21.15.129:0/2820045011 shutdown_connections 2024-02-18T16:22:23.203 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.193+0000 7f635e333980 1 -- 172.21.15.129:0/2820045011 wait complete. 2024-02-18T16:22:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 Processor -- start 2024-02-18T16:22:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 -- start start 2024-02-18T16:22:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db3c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0db3c8d0 con 0x55fc0db31080 2024-02-18T16:22:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635b64d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db3c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.204 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635b64d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db3c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43832/0 (socket says 172.21.15.129:43832) 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 learned_addr learned my addr 172.21.15.129:0/1208338620 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc0db26810 con 0x55fc0db31080 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635b64d640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db3c390 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f63440cc780 tx=0x7f63440e5da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f62397fa640 1 -- 172.21.15.129:0/1208338620 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440aacd0 con 0x55fc0db31080 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc0db3cad0 con 0x55fc0db31080 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f62397fa640 1 -- 172.21.15.129:0/1208338620 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63440ba1f0 con 0x55fc0db31080 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f62397fa640 1 -- 172.21.15.129:0/1208338620 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63440aa4e0 con 0x55fc0db31080 2024-02-18T16:22:23.205 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc0db3cf00 con 0x55fc0db31080 2024-02-18T16:22:23.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f62397fa640 1 -- 172.21.15.129:0/1208338620 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f63440c2890 con 0x55fc0db31080 2024-02-18T16:22:23.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f62397fa640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62240342b0 0x7f6224036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f62397fa640 1 -- 172.21.15.129:0/1208338620 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f63440f1d20 con 0x55fc0db31080 2024-02-18T16:22:23.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635c64f640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62240342b0 0x7f6224036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0db47730 0x55fc0db49bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4a340 con 0x55fc0db47730 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.197+0000 7f635be4e640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0db47730 0x55fc0db49bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635c64f640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62240342b0 0x7f6224036770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6354008fd0 tx=0x7f635401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635be4e640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0db47730 0x55fc0db49bf0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f634c024020 con 0x55fc0db47730 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 realm 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4a710 con 0x55fc0db47730 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f634c024020 con 0x55fc0db47730 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:23.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4af60 con 0x55fc0db47730 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f634c024020 con 0x55fc0db47730 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4b2c0 con 0x55fc0db47730 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f634c024020 con 0x55fc0db47730 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4ac00 con 0x55fc0db47730 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f634c024020 con 0x55fc0db47730 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 20 searching for the correct realm 2024-02-18T16:22:23.211 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fc0db4d510 0x55fc0db4f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635b64d640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fc0db4d510 0x55fc0db4f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635b64d640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fc0db4d510 0x55fc0db4f940 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635b64d640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f63440f0020 0x7f63440db440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635c64f640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f63440f0020 0x7f63440db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.212 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635c64f640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f63440f0020 0x7f63440db440 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635402c040 con 0x7f63440f0020 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635c64f640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6354027940 0x7f63540333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.201+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6354027940 0x7f63540333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6354027940 0x7f63540333c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c024020 con 0x7f6354027940 2024-02-18T16:22:23.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f634c03d080 con 0x55fc0db47730 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x55fc0db47730 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x7f6354027940 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x7f6354027940 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635402c040 con 0x7f63440f0020 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.205+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x55fc0db47730 2024-02-18T16:22:23.216 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x7f6354027940 2024-02-18T16:22:23.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x55fc0db47730 2024-02-18T16:22:23.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f635402c040 con 0x7f63440f0020 2024-02-18T16:22:23.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x7f6354027940 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.209+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c03d080 con 0x55fc0db47730 2024-02-18T16:22:23.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f634c03d080 con 0x55fc0db47730 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635402c040 con 0x7f63440f0020 2024-02-18T16:22:23.221 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635402c040 con 0x7f63440f0020 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f6354027940 2024-02-18T16:22:23.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.213+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635402c040 con 0x7f63440f0020 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db4d510 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x55fc0db47730 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db50010 con 0x7f63440f0020 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:23.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4c160 con 0x55fc0db47730 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4bde0 con 0x55fc0db47730 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db4cab0 con 0x55fc0db47730 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 zone default found 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 4 Realm: () 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 zonegroup default 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db508f0 con 0x7f63440f0020 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db522d0 con 0x55fc0db4d510 2024-02-18T16:22:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db52660 con 0x55fc0db4d510 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 started sync module instance, tier type = 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.217+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db518a0 con 0x7f63440f0020 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94541050092624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db518a0 con 0x7f63440f0020 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db53120 con 0x55fc0db47730 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94541050092624] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94541050096640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db518a0 con 0x55fc0db47730 2024-02-18T16:22:23.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.221+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db53ae0 con 0x55fc0db4d510 2024-02-18T16:22:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94541050096640] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94541050090496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db51820 con 0x55fc0db4d510 2024-02-18T16:22:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db547d0 con 0x7f63440f0020 2024-02-18T16:22:23.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94541050102880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db55020 con 0x7f63440f0020 2024-02-18T16:22:23.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db55a10 con 0x55fc0db47730 2024-02-18T16:22:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94541050090496] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.233 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.225+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94541050102880] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94541050107120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db54b80 con 0x55fc0db47730 2024-02-18T16:22:23.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db56260 con 0x7f6354027940 2024-02-18T16:22:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94541050107120] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94541050101392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db54b80 con 0x7f6354027940 2024-02-18T16:22:23.236 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.229+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db56720 con 0x7f6354027940 2024-02-18T16:22:23.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94541050101392] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94541050110464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db566e0 con 0x7f6354027940 2024-02-18T16:22:23.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db570e0 con 0x7f6354027940 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94541050112992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db57540 con 0x7f6354027940 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=0 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=1 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=2 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=3 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=4 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=5 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94541050110464] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.233+0000 7f635e333980 20 add_watcher() i=6 2024-02-18T16:22:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94541050112992] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 20 add_watcher() i=7 2024-02-18T16:22:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db55bf0 con 0x55fc0db47730 2024-02-18T16:22:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94541050114208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db55bf0 con 0x55fc0db47730 2024-02-18T16:22:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94541050114208] v32'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f6211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:23.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 5 note: GC not initialized 2024-02-18T16:22:23.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f6210fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:23.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:23.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 20 Filter name: none 2024-02-18T16:22:23.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f618a7fc640 20 reqs_thread_entry: start 2024-02-18T16:22:23.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7cc30 con 0x55fc0db47730 2024-02-18T16:22:23.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.237+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7cff0 con 0x7f63440f0020 2024-02-18T16:22:23.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7cff0 con 0x55fc0db47730 2024-02-18T16:22:23.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7cff0 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7d350 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7d6b0 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7da10 con 0x55fc0db47730 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7da10 con 0x55fc0db47730 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7da10 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7da10 con 0x55fc0db4d510 2024-02-18T16:22:23.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7da10 con 0x7f6354027940 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f310 con 0x55fc0db47730 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.241+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f310 con 0x7f63440f0020 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f310 con 0x55fc0db4d510 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f310 con 0x7f6354027940 2024-02-18T16:22:23.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f2c0 con 0x7f6354027940 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f2c0 con 0x55fc0db4d510 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f2c0 con 0x7f6354027940 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f270 con 0x55fc0db47730 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f250 con 0x55fc0db4d510 2024-02-18T16:22:23.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.245+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f230 con 0x7f6354027940 2024-02-18T16:22:23.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x7f63440f0020 2024-02-18T16:22:23.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x7f6354027940 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db47730 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db47730 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db4d510 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db47730 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db47730 2024-02-18T16:22:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db4d510 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db4d510 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x55fc0db4d510 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7f210 con 0x7f6354027940 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.249+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f6211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.259 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94541050114208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db7b240 con 0x55fc0db47730 2024-02-18T16:22:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94541050114208] v32'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.260 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94541050092624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db570a0 con 0x7f63440f0020 2024-02-18T16:22:23.261 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94541050092624] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635e333980 20 remove_watcher() i=0 2024-02-18T16:22:23.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635e333980 2 removed watcher, disabling cache 2024-02-18T16:22:23.262 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.253+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94541050096640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db51c50 con 0x55fc0db47730 2024-02-18T16:22:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.257+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94541050096640] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.263 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.257+0000 7f635e333980 20 remove_watcher() i=1 2024-02-18T16:22:23.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.257+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94541050090496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db51c50 con 0x55fc0db4d510 2024-02-18T16:22:23.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.257+0000 7f635b64d640 1 -- 172.21.15.129:0/1208338620 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94541050090496] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63440ed070 con 0x55fc0db4d510 2024-02-18T16:22:23.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.257+0000 7f635e333980 20 remove_watcher() i=2 2024-02-18T16:22:23.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.257+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94541050102880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db51c50 con 0x7f63440f0020 2024-02-18T16:22:23.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.261+0000 7f635c64f640 1 -- 172.21.15.129:0/1208338620 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94541050102880] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f635403f040 con 0x7f63440f0020 2024-02-18T16:22:23.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.261+0000 7f635e333980 20 remove_watcher() i=3 2024-02-18T16:22:23.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.261+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94541050107120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db54460 con 0x55fc0db47730 2024-02-18T16:22:23.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.261+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94541050107120] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x55fc0db47730 2024-02-18T16:22:23.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.261+0000 7f635e333980 20 remove_watcher() i=4 2024-02-18T16:22:23.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.261+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94541050101392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db51c50 con 0x7f6354027940 2024-02-18T16:22:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.265+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94541050101392] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.265+0000 7f635e333980 20 remove_watcher() i=5 2024-02-18T16:22:23.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.265+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94541050110464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db554f0 con 0x7f6354027940 2024-02-18T16:22:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.265+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94541050110464] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.265+0000 7f635e333980 20 remove_watcher() i=6 2024-02-18T16:22:23.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.265+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94541050112992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fc0db54460 con 0x7f6354027940 2024-02-18T16:22:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94541050112992] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f634c04f040 con 0x7f6354027940 2024-02-18T16:22:23.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 20 remove_watcher() i=7 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6354027940 msgr2=0x7f63540333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f6354027940 0x7f63540333c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0db47730 msgr2=0x55fc0db49bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0db47730 0x55fc0db49bf0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f63440f0020 msgr2=0x7f63440db440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f63440f0020 0x7f63440db440 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fc0db4d510 msgr2=0x55fc0db4f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55fc0db4d510 0x55fc0db4f940 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62240342b0 msgr2=0x7f6224036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62240342b0 0x7f6224036770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6354008fd0 tx=0x7f635401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635be4e640 1 -- 172.21.15.129:0/1208338620 reap_dead start 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 msgr2=0x55fc0db3c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db3c390 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f63440cc780 tx=0x7f63440e5da0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 shutdown_connections 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1208338620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db31080 0x55fc0db3c390 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 >> 172.21.15.129:0/1208338620 conn(0x55fc0db2d3c0 msgr2=0x55fc0db2b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 shutdown_connections 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1208338620 wait complete. 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62340342b0 msgr2=0x7f6234036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62340342b0 0x7f6234036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55fc0db156f0 tx=0x7f6354003070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 msgr2=0x55fc0db25590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 0x55fc0db25590 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f63440ab670 tx=0x7f6344018020 comp rx=0 tx=0).stop 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 shutdown_connections 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f62340342b0 0x7f6234036770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/108106835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0db25170 0x55fc0db25590 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 >> 172.21.15.129:0/108106835 conn(0x55fc0db19f80 msgr2=0x55fc0db1aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 shutdown_connections 2024-02-18T16:22:23.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/108106835 wait complete. 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0da21560 msgr2=0x55fc0db14900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0da21560 0x55fc0db14900 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6244034300 msgr2=0x7f62440367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6244034300 0x7f62440367c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63440ad000 tx=0x7f63440a5040 comp rx=0 tx=0).stop 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 msgr2=0x55fc0db0dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db0dcc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f634c0012f0 tx=0x7f634c001260 comp rx=0 tx=0).stop 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 shutdown_connections 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fc0da21560 0x55fc0db14900 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6244034300 0x7f62440367c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 --2- 172.21.15.129:0/1920441013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fc0da1d000 0x55fc0db0dcc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 >> 172.21.15.129:0/1920441013 conn(0x55fc0da188d0 msgr2=0x55fc0db01470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 shutdown_connections 2024-02-18T16:22:23.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.269+0000 7f635e333980 1 -- 172.21.15.129:0/1920441013 wait complete. 2024-02-18T16:22:23.287 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-18T16:22:23.287 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-18T16:22:23.288 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-18T16:22:23.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-18T16:22:23.288 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-18T16:22:23.367 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:23.367 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:23.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff70804980 1 Processor -- start 2024-02-18T16:22:23.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff70804980 1 -- start start 2024-02-18T16:22:23.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff70804980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a6f785c8c0 0x55a6f78eae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff70804980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a6f78344c0 con 0x55a6f78eb370 2024-02-18T16:22:23.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff70804980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a6f77fb180 con 0x55a6f785c8c0 2024-02-18T16:22:23.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff6e31f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a6f785c8c0 0x55a6f78eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff6e31f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a6f785c8c0 0x55a6f78eae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43846/0 (socket says 172.21.15.129:43846) 2024-02-18T16:22:23.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff6e31f640 1 -- 172.21.15.129:0/904532898 learned_addr learned my addr 172.21.15.129:0/904532898 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff6db1e640 1 --1- 172.21.15.129:0/904532898 >> v1:172.21.15.80:6789/0 conn(0x55a6f78eb370 0x55a6f78ed760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43180/0 (socket says 172.21.15.129:43180) 2024-02-18T16:22:23.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff6e31f640 1 -- 172.21.15.129:0/904532898 >> v1:172.21.15.80:6789/0 conn(0x55a6f78eb370 legacy=0x55a6f78ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.361+0000 7eff6e31f640 1 -- 172.21.15.129:0/904532898 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6f78efec0 con 0x55a6f785c8c0 2024-02-18T16:22:23.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff6e31f640 1 --2- 172.21.15.129:0/904532898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f78eae30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7eff6000a4e0 tx=0x7eff6001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de015954dd1dc5c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff6d31d640 1 -- 172.21.15.129:0/904532898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff600aa540 con 0x55a6f785c8c0 2024-02-18T16:22:23.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff6d31d640 1 -- 172.21.15.129:0/904532898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600a6070 con 0x55a6f785c8c0 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff6d31d640 1 -- 172.21.15.129:0/904532898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff600aa850 con 0x55a6f785c8c0 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 -- 172.21.15.129:0/904532898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 msgr2=0x55a6f78eae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 --2- 172.21.15.129:0/904532898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f78eae30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7eff6000a4e0 tx=0x7eff6001b090 comp rx=0 tx=0).stop 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 -- 172.21.15.129:0/904532898 shutdown_connections 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 --2- 172.21.15.129:0/904532898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f78eae30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 -- 172.21.15.129:0/904532898 >> 172.21.15.129:0/904532898 conn(0x55a6f78e2910 msgr2=0x55a6f78e4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 -- 172.21.15.129:0/904532898 shutdown_connections 2024-02-18T16:22:23.373 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.365+0000 7eff70804980 1 -- 172.21.15.129:0/904532898 wait complete. 2024-02-18T16:22:23.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff70804980 1 Processor -- start 2024-02-18T16:22:23.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff70804980 1 -- start start 2024-02-18T16:22:23.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff70804980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff70804980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6f77f86b0 con 0x55a6f785c8c0 2024-02-18T16:22:23.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff6e31f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff6e31f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43854/0 (socket says 172.21.15.129:43854) 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff6e31f640 1 -- 172.21.15.129:0/2830569180 learned_addr learned my addr 172.21.15.129:0/2830569180 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff6e31f640 1 -- 172.21.15.129:0/2830569180 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6000a1c0 con 0x55a6f785c8c0 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7eff6e31f640 1 --2- 172.21.15.129:0/2830569180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d20b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7eff60017ca0 tx=0x7eff600033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64beee28d33bd27 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7efe5c608640 1 -- 172.21.15.129:0/2830569180 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff600aa780 con 0x55a6f785c8c0 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7efe5c608640 1 -- 172.21.15.129:0/2830569180 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600aa8e0 con 0x55a6f785c8c0 2024-02-18T16:22:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.381+0000 7efe5c608640 1 -- 172.21.15.129:0/2830569180 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff600aab80 con 0x55a6f785c8c0 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/2830569180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 msgr2=0x55a6f79d20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 --2- 172.21.15.129:0/2830569180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d20b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7eff60017ca0 tx=0x7eff600033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/2830569180 shutdown_connections 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 --2- 172.21.15.129:0/2830569180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d20b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/2830569180 >> 172.21.15.129:0/2830569180 conn(0x55a6f78e2910 msgr2=0x55a6f79cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/2830569180 shutdown_connections 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/2830569180 wait complete. 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 Processor -- start 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- start start 2024-02-18T16:22:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6f77f3e90 con 0x55a6f785c8c0 2024-02-18T16:22:23.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff6e31f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff6e31f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43862/0 (socket says 172.21.15.129:43862) 2024-02-18T16:22:23.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff6e31f640 1 -- 172.21.15.129:0/4112755828 learned_addr learned my addr 172.21.15.129:0/4112755828 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff6e31f640 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6f78efec0 con 0x55a6f785c8c0 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff6e31f640 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d8d90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7eff6001aec0 tx=0x7eff60017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7efe5ae05640 1 -- 172.21.15.129:0/4112755828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff600c4070 con 0x55a6f785c8c0 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7efe5ae05640 1 -- 172.21.15.129:0/4112755828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60005150 con 0x55a6f785c8c0 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7efe5ae05640 1 -- 172.21.15.129:0/4112755828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff600053f0 con 0x55a6f785c8c0 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6f79d92d0 con 0x55a6f785c8c0 2024-02-18T16:22:23.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.385+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6f79d9700 con 0x55a6f785c8c0 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7efe5ae05640 1 -- 172.21.15.129:0/4112755828 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff600a8070 con 0x55a6f785c8c0 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7efe5ae05640 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe540342b0 0x7efe54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7efe5ae05640 1 -- 172.21.15.129:0/4112755828 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7eff600e33e0 con 0x55a6f785c8c0 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6db1e640 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe540342b0 0x7efe54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f78eb370 0x55a6f79dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f79dff50 con 0x55a6f78eb370 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f78eb370 0x55a6f79dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6db1e640 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe540342b0 0x7efe54036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff64000f70 tx=0x7eff64001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f78eb370 0x55a6f79dfa10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 -- 172.21.15.129:0/4112755828 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff680083f0 con 0x55a6f78eb370 2024-02-18T16:22:23.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f79e0310 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 -- 172.21.15.129:0/4112755828 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff680083f0 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f79e1bc0 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 -- 172.21.15.129:0/4112755828 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7eff680083f0 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f79e0dc0 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 -- 172.21.15.129:0/4112755828 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff680083f0 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f79e11d0 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6eb20640 1 -- 172.21.15.129:0/4112755828 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7eff68012040 con 0x55a6f78eb370 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 Processor -- start 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- start start 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 0x55a6f78e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff70804980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6f778cf20 con 0x55a6f78e8970 2024-02-18T16:22:23.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6db1e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 0x55a6f78e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6db1e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 0x55a6f78e6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43866/0 (socket says 172.21.15.129:43866) 2024-02-18T16:22:23.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.389+0000 7eff6db1e640 1 -- 172.21.15.129:0/2606577255 learned_addr learned my addr 172.21.15.129:0/2606577255 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6db1e640 1 -- 172.21.15.129:0/2606577255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6f78e7350 con 0x55a6f78e8970 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6db1e640 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 0x55a6f78e6e10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7eff64001ee0 tx=0x7eff6400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7efe53fff640 1 -- 172.21.15.129:0/2606577255 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff64007040 con 0x55a6f78e8970 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7efe53fff640 1 -- 172.21.15.129:0/2606577255 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6400d660 con 0x55a6f78e8970 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6f78e7600 con 0x55a6f78e8970 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7efe53fff640 1 -- 172.21.15.129:0/2606577255 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6400d900 con 0x55a6f78e8970 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6f78e7a90 con 0x55a6f78e8970 2024-02-18T16:22:23.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7efe53fff640 1 -- 172.21.15.129:0/2606577255 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff6401a070 con 0x55a6f78e8970 2024-02-18T16:22:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7efe53fff640 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe480342b0 0x7efe48036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7efe53fff640 1 -- 172.21.15.129:0/2606577255 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7eff64017050 con 0x55a6f78e8970 2024-02-18T16:22:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6eb20640 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe480342b0 0x7efe48036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff70804980 1 Processor -- start 2024-02-18T16:22:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff70804980 1 -- start start 2024-02-18T16:22:23.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6eb20640 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe480342b0 0x7efe48036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a6f79e0800 tx=0x7eff68003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff70804980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f79ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff70804980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6f7780790 con 0x55a6f79ff5a0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6db1e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f79ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6db1e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f79ff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43872/0 (socket says 172.21.15.129:43872) 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6db1e640 1 -- 172.21.15.129:0/2698185333 learned_addr learned my addr 172.21.15.129:0/2698185333 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.393+0000 7eff6db1e640 1 -- 172.21.15.129:0/2698185333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6f79fff90 con 0x55a6f79ff5a0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff6db1e640 1 --2- 172.21.15.129:0/2698185333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f79ff9c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7eff6401bfd0 tx=0x7eff64024380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbcc8939336cb79 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7efe51ffb640 1 -- 172.21.15.129:0/2698185333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6401a4e0 con 0x55a6f79ff5a0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7efe51ffb640 1 -- 172.21.15.129:0/2698185333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64048e90 con 0x55a6f79ff5a0 2024-02-18T16:22:23.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7efe51ffb640 1 -- 172.21.15.129:0/2698185333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6401a770 con 0x55a6f79ff5a0 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/2698185333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 msgr2=0x55a6f79ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 --2- 172.21.15.129:0/2698185333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f79ff9c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7eff6401bfd0 tx=0x7eff64024380 comp rx=0 tx=0).stop 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/2698185333 shutdown_connections 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 --2- 172.21.15.129:0/2698185333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f79ff9c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/2698185333 >> 172.21.15.129:0/2698185333 conn(0x55a6f79fb930 msgr2=0x55a6f79f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/2698185333 shutdown_connections 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/2698185333 wait complete. 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 Processor -- start 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- start start 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f7a06500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6f7a06a40 con 0x55a6f79ff5a0 2024-02-18T16:22:23.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff6db1e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f7a06500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff6db1e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f7a06500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43874/0 (socket says 172.21.15.129:43874) 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 learned_addr learned my addr 172.21.15.129:0/1227758233 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6f78e7a90 con 0x55a6f79ff5a0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff6db1e640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f7a06500 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7eff6403d040 tx=0x7eff64048ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7efe3ffff640 1 -- 172.21.15.129:0/1227758233 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff64024d40 con 0x55a6f79ff5a0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6f7a06c40 con 0x55a6f79ff5a0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7efe3ffff640 1 -- 172.21.15.129:0/1227758233 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64025790 con 0x55a6f79ff5a0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7efe3ffff640 1 -- 172.21.15.129:0/1227758233 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff64024ea0 con 0x55a6f79ff5a0 2024-02-18T16:22:23.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.397+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6f7a070d0 con 0x55a6f79ff5a0 2024-02-18T16:22:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7efe3ffff640 1 -- 172.21.15.129:0/1227758233 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7eff64041050 con 0x55a6f79ff5a0 2024-02-18T16:22:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7efe3ffff640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe380342b0 0x7efe38036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7efe3ffff640 1 -- 172.21.15.129:0/1227758233 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7eff64006070 con 0x55a6f79ff5a0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6eb20640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe380342b0 0x7efe38036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f7a11a80 0x55a6f7a13f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a14660 con 0x55a6f7a11a80 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f7a11a80 0x55a6f7a13f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6eb20640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe380342b0 0x7efe38036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff68008fd0 tx=0x7eff6801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f7a11a80 0x55a6f7a13f10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 realm 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a14a30 con 0x55a6f7a11a80 2024-02-18T16:22:23.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a15280 con 0x55a6f7a11a80 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a155e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a14f20 con 0x55a6f7a11a80 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 20 searching for the correct realm 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a6f7a17830 0x55a6f7a19c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6db1e640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a6f7a17830 0x55a6f7a19c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6db1e640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a6f7a17830 0x55a6f7a19c20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6db1e640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7eff64027060 0x7eff6401b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.401+0000 7eff6eb20640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7eff64027060 0x7eff6401b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6eb20640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7eff64027060 0x7eff6401b520 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6802c040 con 0x7eff64027060 2024-02-18T16:22:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6eb20640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7eff68027940 0x7eff680333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7eff68027940 0x7eff680333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7eff68027940 0x7eff680333c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.405+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.420 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6802c040 con 0x7eff64027060 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7eff6802c040 con 0x7eff64027060 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.409+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6802c040 con 0x7eff64027060 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6802c040 con 0x7eff64027060 2024-02-18T16:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff68027940 2024-02-18T16:22:23.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff600a97e0 con 0x7eff68027940 2024-02-18T16:22:23.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6802c040 con 0x7eff64027060 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a17830 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.413+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1a2f0 con 0x7eff64027060 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:23.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a16450 con 0x55a6f7a11a80 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff600a97e0 con 0x55a6f7a11a80 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a16070 con 0x55a6f7a11a80 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a16ca0 con 0x55a6f7a11a80 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:23.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 zone default found 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 4 Realm: () 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 zonegroup default 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a16ca0 con 0x7eff64027060 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1c190 con 0x55a6f7a17830 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1c590 con 0x55a6f7a17830 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 started sync module instance, tier type = 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1ba70 con 0x7eff64027060 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94175607502288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1be20 con 0x7eff64027060 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.417+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1d2f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.421+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94175607502288] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.432 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.421+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.421+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94175607507376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1d2b0 con 0x55a6f7a11a80 2024-02-18T16:22:23.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.421+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1dd80 con 0x55a6f7a17830 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.421+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94175607507376] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94175607511136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1e130 con 0x55a6f7a17830 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1eaa0 con 0x7eff64027060 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94175607511136] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94175607514624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1ea20 con 0x7eff64027060 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.425+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1f790 con 0x55a6f7a11a80 2024-02-18T16:22:23.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94175607514624] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94175607516752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1f710 con 0x55a6f7a11a80 2024-02-18T16:22:23.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a20150 con 0x7eff68027940 2024-02-18T16:22:23.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94175607516752] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.437 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94175607520704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1f710 con 0x7eff68027940 2024-02-18T16:22:23.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.429+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a20b10 con 0x7eff68027940 2024-02-18T16:22:23.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94175607520704] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94175607518288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a20b10 con 0x7eff68027940 2024-02-18T16:22:23.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a21480 con 0x7eff68027940 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94175607525344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a218a0 con 0x7eff68027940 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 20 add_watcher() i=0 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 20 add_watcher() i=1 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 20 add_watcher() i=2 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 20 add_watcher() i=3 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 20 add_watcher() i=4 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.433+0000 7eff70804980 20 add_watcher() i=5 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94175607518288] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 add_watcher() i=6 2024-02-18T16:22:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94175607525344] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 add_watcher() i=7 2024-02-18T16:22:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:23.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a20670 con 0x55a6f7a11a80 2024-02-18T16:22:23.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94175607526400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a20670 con 0x55a6f7a11a80 2024-02-18T16:22:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94175607526400] v32'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7efe24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 5 note: GC not initialized 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7efd9f7fe640 20 reqs_thread_entry: start 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 Filter name: none 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7efd9d7fa640 20 reqs_thread_entry: start 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.437+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a463f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff70804980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a463f0 con 0x7eff68027940 2024-02-18T16:22:23.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7efe24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94175607526400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a463f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94175607526400] v32'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.441+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94175607502288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a463f0 con 0x7eff64027060 2024-02-18T16:22:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94175607502288] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff70804980 20 remove_watcher() i=0 2024-02-18T16:22:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff70804980 2 removed watcher, disabling cache 2024-02-18T16:22:23.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94175607507376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a463f0 con 0x55a6f7a11a80 2024-02-18T16:22:23.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94175607507376] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff70804980 20 remove_watcher() i=1 2024-02-18T16:22:23.452 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.445+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94175607511136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a463f0 con 0x55a6f7a17830 2024-02-18T16:22:23.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff6db1e640 1 -- 172.21.15.129:0/1227758233 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94175607511136] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6401bc30 con 0x55a6f7a17830 2024-02-18T16:22:23.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff70804980 20 remove_watcher() i=2 2024-02-18T16:22:23.454 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94175607514624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1c9b0 con 0x7eff64027060 2024-02-18T16:22:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff6eb20640 1 -- 172.21.15.129:0/1227758233 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94175607514624] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6803f040 con 0x7eff64027060 2024-02-18T16:22:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff70804980 20 remove_watcher() i=3 2024-02-18T16:22:23.455 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94175607516752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1d860 con 0x55a6f7a11a80 2024-02-18T16:22:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94175607516752] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x55a6f7a11a80 2024-02-18T16:22:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff70804980 20 remove_watcher() i=4 2024-02-18T16:22:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.449+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94175607520704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1e600 con 0x7eff68027940 2024-02-18T16:22:23.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.453+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94175607520704] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.453+0000 7eff70804980 20 remove_watcher() i=5 2024-02-18T16:22:23.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.453+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94175607518288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1c9b0 con 0x7eff68027940 2024-02-18T16:22:23.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.453+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94175607518288] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.453+0000 7eff70804980 20 remove_watcher() i=6 2024-02-18T16:22:23.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.453+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94175607525344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a6f7a1c9b0 con 0x7eff68027940 2024-02-18T16:22:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94175607525344] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff600eb040 con 0x7eff68027940 2024-02-18T16:22:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 20 remove_watcher() i=7 2024-02-18T16:22:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7eff68027940 msgr2=0x7eff680333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7eff68027940 0x7eff680333c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f7a11a80 msgr2=0x55a6f7a13f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f7a11a80 0x55a6f7a13f10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7eff64027060 msgr2=0x7eff6401b520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7eff64027060 0x7eff6401b520 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a6f7a17830 msgr2=0x55a6f7a19c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a6f7a17830 0x55a6f7a19c20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe380342b0 msgr2=0x7efe38036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe380342b0 0x7efe38036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff68008fd0 tx=0x7eff6801c070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 msgr2=0x55a6f7a06500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/1227758233 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f79ff5a0 0x55a6f7a06500 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7eff6403d040 tx=0x7eff64048ce0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 reap_dead start 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff6e31f640 1 -- 172.21.15.129:0/1227758233 reap_dead start 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 shutdown_connections 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 >> 172.21.15.129:0/1227758233 conn(0x55a6f79fb930 msgr2=0x55a6f79f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 shutdown_connections 2024-02-18T16:22:23.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/1227758233 wait complete. 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe480342b0 msgr2=0x7efe48036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe480342b0 0x7efe48036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a6f79e0800 tx=0x7eff68003070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 msgr2=0x55a6f78e6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 0x55a6f78e6e10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7eff64001ee0 tx=0x7eff6400ea10 comp rx=0 tx=0).stop 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 shutdown_connections 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe480342b0 0x7efe48036770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/2606577255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f78e8970 0x55a6f78e6e10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 >> 172.21.15.129:0/2606577255 conn(0x55a6f79e5090 msgr2=0x55a6f79e5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 shutdown_connections 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/2606577255 wait complete. 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f78eb370 msgr2=0x55a6f79dfa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f78eb370 0x55a6f79dfa10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe540342b0 msgr2=0x7efe54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe540342b0 0x7efe54036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff64000f70 tx=0x7eff64001380 comp rx=0 tx=0).stop 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 msgr2=0x55a6f79d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d8d90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7eff6001aec0 tx=0x7eff60017e30 comp rx=0 tx=0).stop 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 shutdown_connections 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a6f78eb370 0x55a6f79dfa10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efe540342b0 0x7efe54036770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 --2- 172.21.15.129:0/4112755828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a6f785c8c0 0x55a6f79d8d90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 >> 172.21.15.129:0/4112755828 conn(0x55a6f78e2910 msgr2=0x55a6f79cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 shutdown_connections 2024-02-18T16:22:23.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.457+0000 7eff70804980 1 -- 172.21.15.129:0/4112755828 wait complete. 2024-02-18T16:22:23.473 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-02-18T16:22:23.473 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-02-18T16:22:23.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-18T16:22:23.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-18T16:22:23.474 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-02-18T16:22:23.547 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:23.547 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:23.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f3685d34980 1 Processor -- start 2024-02-18T16:22:23.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f3685d34980 1 -- start start 2024-02-18T16:22:23.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f3685d34980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ebd21118c0 0x55ebd2111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f3685d34980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ebd205c4d0 con 0x55ebd21121e0 2024-02-18T16:22:23.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f3685d34980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ebd2023180 con 0x55ebd21118c0 2024-02-18T16:22:23.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f368384f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ebd21118c0 0x55ebd2111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f368384f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ebd21118c0 0x55ebd2111ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43888/0 (socket says 172.21.15.129:43888) 2024-02-18T16:22:23.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f368384f640 1 -- 172.21.15.129:0/3084369573 learned_addr learned my addr 172.21.15.129:0/3084369573 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f368304e640 1 --1- 172.21.15.129:0/3084369573 >> v1:172.21.15.80:6789/0 conn(0x55ebd21121e0 0x55ebd210e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43194/0 (socket says 172.21.15.129:43194) 2024-02-18T16:22:23.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f368384f640 1 -- 172.21.15.129:0/3084369573 >> v1:172.21.15.80:6789/0 conn(0x55ebd21121e0 legacy=0x55ebd210e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.541+0000 7f368384f640 1 -- 172.21.15.129:0/3084369573 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd210ea40 con 0x55ebd21118c0 2024-02-18T16:22:23.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f368384f640 1 --2- 172.21.15.129:0/3084369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2111ca0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f367c00a4e0 tx=0x7f367c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9587fda2d01c1f0b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f368284d640 1 -- 172.21.15.129:0/3084369573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0aa540 con 0x55ebd21118c0 2024-02-18T16:22:23.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f368284d640 1 -- 172.21.15.129:0/3084369573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0a6070 con 0x55ebd21118c0 2024-02-18T16:22:23.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f368284d640 1 -- 172.21.15.129:0/3084369573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0aa850 con 0x55ebd21118c0 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 -- 172.21.15.129:0/3084369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 msgr2=0x55ebd2111ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 --2- 172.21.15.129:0/3084369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2111ca0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f367c00a4e0 tx=0x7f367c01b090 comp rx=0 tx=0).stop 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 -- 172.21.15.129:0/3084369573 shutdown_connections 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 --2- 172.21.15.129:0/3084369573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2111ca0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 -- 172.21.15.129:0/3084369573 >> 172.21.15.129:0/3084369573 conn(0x55ebd210a070 msgr2=0x55ebd210c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 -- 172.21.15.129:0/3084369573 shutdown_connections 2024-02-18T16:22:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.545+0000 7f3685d34980 1 -- 172.21.15.129:0/3084369573 wait complete. 2024-02-18T16:22:23.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 Processor -- start 2024-02-18T16:22:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- start start 2024-02-18T16:22:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2110dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd20206b0 con 0x55ebd21118c0 2024-02-18T16:22:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f368384f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2110dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f368384f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2110dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43890/0 (socket says 172.21.15.129:43890) 2024-02-18T16:22:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f368384f640 1 -- 172.21.15.129:0/3620624803 learned_addr learned my addr 172.21.15.129:0/3620624803 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f368384f640 1 -- 172.21.15.129:0/3620624803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c00a1c0 con 0x55ebd21118c0 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f368384f640 1 --2- 172.21.15.129:0/3620624803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2110dc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f367c018cc0 tx=0x7f367c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dceb7f44de368c0b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3571e0b640 1 -- 172.21.15.129:0/3620624803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0aa700 con 0x55ebd21118c0 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3571e0b640 1 -- 172.21.15.129:0/3620624803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0aa860 con 0x55ebd21118c0 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3571e0b640 1 -- 172.21.15.129:0/3620624803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0aab20 con 0x55ebd21118c0 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- 172.21.15.129:0/3620624803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 msgr2=0x55ebd2110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 --2- 172.21.15.129:0/3620624803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2110dc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f367c018cc0 tx=0x7f367c0033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- 172.21.15.129:0/3620624803 shutdown_connections 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 --2- 172.21.15.129:0/3620624803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21118c0 0x55ebd2110dc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- 172.21.15.129:0/3620624803 >> 172.21.15.129:0/3620624803 conn(0x55ebd210a070 msgr2=0x55ebd21f6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- 172.21.15.129:0/3620624803 shutdown_connections 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.561+0000 7f3685d34980 1 -- 172.21.15.129:0/3620624803 wait complete. 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 Processor -- start 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 -- start start 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 0x55ebd2203890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd201be90 con 0x55ebd21121e0 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368384f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 0x55ebd2203890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368384f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 0x55ebd2203890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43904/0 (socket says 172.21.15.129:43904) 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368384f640 1 -- 172.21.15.129:0/1087668616 learned_addr learned my addr 172.21.15.129:0/1087668616 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368384f640 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd210ea40 con 0x55ebd21121e0 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368384f640 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 0x55ebd2203890 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f367c018cc0 tx=0x7f367c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f356bfff640 1 -- 172.21.15.129:0/1087668616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0c3070 con 0x55ebd21121e0 2024-02-18T16:22:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ebd2203dd0 con 0x55ebd21121e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f356bfff640 1 -- 172.21.15.129:0/1087668616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0b5780 con 0x55ebd21121e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f356bfff640 1 -- 172.21.15.129:0/1087668616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0b5a20 con 0x55ebd21121e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebd2204220 con 0x55ebd21121e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f356bfff640 1 -- 172.21.15.129:0/1087668616 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f367c0a8070 con 0x55ebd21121e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f356bfff640 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f356c0342b0 0x7f356c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f356bfff640 1 -- 172.21.15.129:0/1087668616 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f367c0e34e0 con 0x55ebd21121e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368304e640 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f356c0342b0 0x7f356c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd22084e0 0x55ebd220a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd220ae10 con 0x55ebd22084e0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3684050640 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd22084e0 0x55ebd220a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f368304e640 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f356c0342b0 0x7f356c036770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3678001e50 tx=0x7f36780013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.565+0000 7f3684050640 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd22084e0 0x55ebd220a8d0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3684050640 1 -- 172.21.15.129:0/1087668616 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36740083f0 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2207c10 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3684050640 1 -- 172.21.15.129:0/1087668616 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f36740083f0 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd220cb40 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3684050640 1 -- 172.21.15.129:0/1087668616 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f36740083f0 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd220bc80 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3684050640 1 -- 172.21.15.129:0/1087668616 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f36740083f0 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd220c090 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3684050640 1 -- 172.21.15.129:0/1087668616 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3674012040 con 0x55ebd22084e0 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 Processor -- start 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- start start 2024-02-18T16:22:23.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 0x55ebd221b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd1fb4f20 con 0x55ebd221b1e0 2024-02-18T16:22:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f368304e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 0x55ebd221b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f368304e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 0x55ebd221b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43906/0 (socket says 172.21.15.129:43906) 2024-02-18T16:22:23.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f368304e640 1 -- 172.21.15.129:0/660343058 learned_addr learned my addr 172.21.15.129:0/660343058 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f368304e640 1 -- 172.21.15.129:0/660343058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd221bb40 con 0x55ebd221b1e0 2024-02-18T16:22:23.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f368304e640 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 0x55ebd221b600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f367800e640 tx=0x7f367800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.588 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f35697fa640 1 -- 172.21.15.129:0/660343058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3678007040 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f35697fa640 1 -- 172.21.15.129:0/660343058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367800d660 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f35697fa640 1 -- 172.21.15.129:0/660343058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367800d920 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ebd221bd90 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.569+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebd221c8e0 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f35697fa640 1 -- 172.21.15.129:0/660343058 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f367801a070 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f35697fa640 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f355c034350 0x7f355c036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f35697fa640 1 -- 172.21.15.129:0/660343058 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3678017050 con 0x55ebd221b1e0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3684050640 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f355c034350 0x7f355c036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 Processor -- start 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- start start 2024-02-18T16:22:23.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd2228540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd1fa8790 con 0x55ebd2228160 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3684050640 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f355c034350 0x7f355c036810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55ebd220b6c0 tx=0x7f3674003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f368304e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd2228540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f368304e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd2228540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43918/0 (socket says 172.21.15.129:43918) 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f368304e640 1 -- 172.21.15.129:0/564925622 learned_addr learned my addr 172.21.15.129:0/564925622 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f368304e640 1 -- 172.21.15.129:0/564925622 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd2228b10 con 0x55ebd2228160 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f368304e640 1 --2- 172.21.15.129:0/564925622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd2228540 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3678048c10 tx=0x7f367801ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1703802575995d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3562ffd640 1 -- 172.21.15.129:0/564925622 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3678046030 con 0x55ebd2228160 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3562ffd640 1 -- 172.21.15.129:0/564925622 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678025360 con 0x55ebd2228160 2024-02-18T16:22:23.590 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3562ffd640 1 -- 172.21.15.129:0/564925622 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367800de00 con 0x55ebd2228160 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- 172.21.15.129:0/564925622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 msgr2=0x55ebd2228540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 --2- 172.21.15.129:0/564925622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd2228540 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3678048c10 tx=0x7f367801ae40 comp rx=0 tx=0).stop 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- 172.21.15.129:0/564925622 shutdown_connections 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 --2- 172.21.15.129:0/564925622 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd2228540 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- 172.21.15.129:0/564925622 >> 172.21.15.129:0/564925622 conn(0x55ebd22244a0 msgr2=0x55ebd2222500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- 172.21.15.129:0/564925622 shutdown_connections 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- 172.21.15.129:0/564925622 wait complete. 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 Processor -- start 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- start start 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd222efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.573+0000 7f3685d34980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd222f4e0 con 0x55ebd2228160 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368304e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd222efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368304e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd222efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43928/0 (socket says 172.21.15.129:43928) 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 learned_addr learned my addr 172.21.15.129:0/1824315158 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd221c8e0 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368304e640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd222efa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f36780254d0 tx=0x7f3678048ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f35617fa640 1 -- 172.21.15.129:0/1824315158 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3678046040 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ebd222f6e0 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f35617fa640 1 -- 172.21.15.129:0/1824315158 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367803f050 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebd222fb70 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f35617fa640 1 -- 172.21.15.129:0/1824315158 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3678024d40 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f35617fa640 1 -- 172.21.15.129:0/1824315158 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3678048d50 con 0x55ebd2228160 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f35617fa640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f354c0342b0 0x7f354c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f35617fa640 1 -- 172.21.15.129:0/1824315158 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f367803ae40 con 0x55ebd2228160 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3684050640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f354c0342b0 0x7f354c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd223a520 0x55ebd223c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223d130 con 0x55ebd223a520 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368384f640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd223a520 0x55ebd223c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368384f640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd223a520 0x55ebd223c9e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3684050640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f354c0342b0 0x7f354c036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3674008fd0 tx=0x7f367401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 realm 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223d550 con 0x55ebd223a520 2024-02-18T16:22:23.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223dda0 con 0x55ebd223a520 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.577+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223e100 con 0x55ebd223a520 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.594 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223e900 con 0x55ebd223a520 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 20 searching for the correct realm 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ebd2240620 0x55ebd2242a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2242f50 con 0x55ebd2240620 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368304e640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ebd2240620 0x55ebd2242a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368304e640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ebd2240620 0x55ebd2242a10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368304e640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3678027060 0x7f367804a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2242f50 con 0x7f3678027060 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3684050640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3678027060 0x7f367804a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3684050640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3678027060 0x7f367804a410 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367402c040 con 0x7f3678027060 2024-02-18T16:22:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3684050640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3674027940 0x7f36740333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2242f50 con 0x7f3674027940 2024-02-18T16:22:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3674027940 0x7f36740333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3674027940 0x7f36740333c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x7f3674027940 2024-02-18T16:22:23.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.581+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3674027940 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x7f3674027940 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3674027940 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x7f3674027940 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367402c040 con 0x7f3678027060 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3674027940 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x7f3674027940 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f367402c040 con 0x7f3678027060 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.608 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.585+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3674027940 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x7f3674027940 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f367c0b4c10 con 0x55ebd223a520 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3674027940 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367803a770 con 0x55ebd2240620 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367402c040 con 0x7f3678027060 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367402c040 con 0x7f3678027060 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3674027940 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.589+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367402c040 con 0x7f3678027060 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd2240620 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x55ebd223a520 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f367c0cf040 con 0x7f3678027060 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:23.611 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223f230 con 0x55ebd223a520 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223eeb0 con 0x55ebd223a520 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.612 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd223fb00 con 0x55ebd223a520 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 zone default found 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 4 Realm: () 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 zonegroup default 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2242f50 con 0x7f3678027060 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.613 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2244930 con 0x55ebd2240620 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2244dd0 con 0x55ebd2240620 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 started sync module instance, tier type = 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2244210 con 0x7f3678027060 2024-02-18T16:22:23.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471331265904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd22445c0 con 0x7f3678027060 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.593+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2245b30 con 0x55ebd223a520 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.597+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471331265904] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.597+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.597+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471331271152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2245af0 con 0x55ebd223a520 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.597+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2246590 con 0x55ebd2240620 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471331274864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2246de0 con 0x55ebd2240620 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd22477e0 con 0x7f3678027060 2024-02-18T16:22:23.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471331271152] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471331279584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2247b90 con 0x7f3678027060 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2248500 con 0x55ebd223a520 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471331274864] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471331279584] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471331272208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2248060 con 0x55ebd223a520 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.601+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2248d50 con 0x7f3674027940 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471331272208] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.620 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471331277120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2248a80 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2249280 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471331277120] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471331284720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2249110 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.605+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2249be0 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471331288768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd224a040 con 0x7f3674027940 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=0 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=1 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=2 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=3 2024-02-18T16:22:23.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=4 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=5 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471331284720] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=6 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471331288768] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 20 add_watcher() i=7 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2248bb0 con 0x55ebd223a520 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.609+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471331285872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd224a5e0 con 0x55ebd223a520 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471331285872] v32'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:23.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 5 note: GC not initialized 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3538fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 20 Filter name: none 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f34b27fc640 20 reqs_thread_entry: start 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd226ea80 con 0x55ebd223a520 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:23.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd226ea80 con 0x7f3674027940 2024-02-18T16:22:23.624 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.613+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471331285872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd226ea80 con 0x55ebd223a520 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94471331285872] v32'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471331265904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd226ea80 con 0x7f3678027060 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94471331265904] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3685d34980 20 remove_watcher() i=0 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3685d34980 2 removed watcher, disabling cache 2024-02-18T16:22:23.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471331271152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd226ea80 con 0x55ebd223a520 2024-02-18T16:22:23.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94471331271152] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3685d34980 20 remove_watcher() i=1 2024-02-18T16:22:23.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.617+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471331274864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd226ea80 con 0x55ebd2240620 2024-02-18T16:22:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.621+0000 7f368304e640 1 -- 172.21.15.129:0/1824315158 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94471331274864] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3678060040 con 0x55ebd2240620 2024-02-18T16:22:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.621+0000 7f3685d34980 20 remove_watcher() i=2 2024-02-18T16:22:23.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.621+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471331279584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2243d70 con 0x7f3678027060 2024-02-18T16:22:23.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.621+0000 7f3684050640 1 -- 172.21.15.129:0/1824315158 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94471331279584] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367403f040 con 0x7f3678027060 2024-02-18T16:22:23.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.621+0000 7f3685d34980 20 remove_watcher() i=3 2024-02-18T16:22:23.629 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.621+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471331272208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd22451f0 con 0x55ebd223a520 2024-02-18T16:22:23.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.625+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94471331272208] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x55ebd223a520 2024-02-18T16:22:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.625+0000 7f3685d34980 20 remove_watcher() i=4 2024-02-18T16:22:23.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.625+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471331277120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2245690 con 0x7f3674027940 2024-02-18T16:22:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.625+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94471331277120] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.625+0000 7f3685d34980 20 remove_watcher() i=5 2024-02-18T16:22:23.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.625+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471331284720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd2245690 con 0x7f3674027940 2024-02-18T16:22:23.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94471331284720] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 20 remove_watcher() i=6 2024-02-18T16:22:23.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471331288768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ebd22472e0 con 0x7f3674027940 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94471331288768] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f367c0e9040 con 0x7f3674027940 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 20 remove_watcher() i=7 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3674027940 msgr2=0x7f36740333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3674027940 0x7f36740333c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd223a520 msgr2=0x55ebd223c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd223a520 0x55ebd223c9e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3678027060 msgr2=0x7f367804a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3678027060 0x7f367804a410 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ebd2240620 msgr2=0x55ebd2242a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55ebd2240620 0x55ebd2242a10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f354c0342b0 msgr2=0x7f354c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f354c0342b0 0x7f354c036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3674008fd0 tx=0x7f367401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 msgr2=0x55ebd222efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/1824315158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd2228160 0x55ebd222efa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f36780254d0 tx=0x7f3678048ba0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f368384f640 1 -- 172.21.15.129:0/1824315158 reap_dead start 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 shutdown_connections 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 >> 172.21.15.129:0/1824315158 conn(0x55ebd22244a0 msgr2=0x55ebd2221b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 shutdown_connections 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/1824315158 wait complete. 2024-02-18T16:22:23.640 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f355c034350 msgr2=0x7f355c036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f355c034350 0x7f355c036810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55ebd220b6c0 tx=0x7f3674003070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 msgr2=0x55ebd221b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 0x55ebd221b600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f367800e640 tx=0x7f367800ea40 comp rx=0 tx=0).stop 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 shutdown_connections 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f355c034350 0x7f355c036810 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 --2- 172.21.15.129:0/660343058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd221b1e0 0x55ebd221b600 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 >> 172.21.15.129:0/660343058 conn(0x55ebd220fff0 msgr2=0x55ebd2210b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 shutdown_connections 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.629+0000 7f3685d34980 1 -- 172.21.15.129:0/660343058 wait complete. 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd22084e0 msgr2=0x55ebd220a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd22084e0 0x55ebd220a8d0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f356c0342b0 msgr2=0x7f356c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f356c0342b0 0x7f356c036770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3678001e50 tx=0x7f36780013b0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 msgr2=0x55ebd2203890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 0x55ebd2203890 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f367c018cc0 tx=0x7f367c017e30 comp rx=0 tx=0).stop 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 shutdown_connections 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ebd22084e0 0x55ebd220a8d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f356c0342b0 0x7f356c036770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 --2- 172.21.15.129:0/1087668616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ebd21121e0 0x55ebd2203890 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 >> 172.21.15.129:0/1087668616 conn(0x55ebd210a070 msgr2=0x55ebd210f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 shutdown_connections 2024-02-18T16:22:23.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.633+0000 7f3685d34980 1 -- 172.21.15.129:0/1087668616 wait complete. 2024-02-18T16:22:23.646 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-02-18T16:22:23.647 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-02-18T16:22:23.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-18T16:22:23.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-18T16:22:23.647 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-02-18T16:22:23.720 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:23.720 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:23.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.713+0000 7fa113c61980 1 Processor -- start 2024-02-18T16:22:23.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.713+0000 7fa113c61980 1 -- start start 2024-02-18T16:22:23.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.713+0000 7fa113c61980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5576e5851910 0x5576e58e2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.713+0000 7fa113c61980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5576e58294d0 con 0x5576e58e2740 2024-02-18T16:22:23.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.713+0000 7fa113c61980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5576e57f0180 con 0x5576e5851910 2024-02-18T16:22:23.722 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa11177c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5576e5851910 0x5576e58e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa110f7b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5576e58e2740 0x5576e58e4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43198/0 (socket says 172.21.15.129:43198) 2024-02-18T16:22:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa110f7b640 1 -- 172.21.15.129:0/2023895287 learned_addr learned my addr 172.21.15.129:0/2023895287 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa11177c640 1 -- 172.21.15.129:0/2023895287 >> v1:172.21.15.80:6789/0 conn(0x5576e58e2740 legacy=0x5576e58e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa11177c640 1 -- 172.21.15.129:0/2023895287 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e58e7260 con 0x5576e5851910 2024-02-18T16:22:23.724 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa11177c640 1 --2- 172.21.15.129:0/2023895287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e58e2200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a420 tx=0x7fa10c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4391933a066c88ac server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa103fff640 1 -- 172.21.15.129:0/2023895287 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0aa530 con 0x5576e5851910 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa103fff640 1 -- 172.21.15.129:0/2023895287 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c0a6050 con 0x5576e5851910 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa103fff640 1 -- 172.21.15.129:0/2023895287 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0aa800 con 0x5576e5851910 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa113c61980 1 -- 172.21.15.129:0/2023895287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 msgr2=0x5576e58e2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.717+0000 7fa113c61980 1 --2- 172.21.15.129:0/2023895287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e58e2200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a420 tx=0x7fa10c01afd0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.721+0000 7fa113c61980 1 -- 172.21.15.129:0/2023895287 shutdown_connections 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.721+0000 7fa113c61980 1 --2- 172.21.15.129:0/2023895287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e58e2200 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.721+0000 7fa113c61980 1 -- 172.21.15.129:0/2023895287 >> 172.21.15.129:0/2023895287 conn(0x5576e58d7920 msgr2=0x5576e58d9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.726 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.721+0000 7fa113c61980 1 -- 172.21.15.129:0/2023895287 shutdown_connections 2024-02-18T16:22:23.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.721+0000 7fa113c61980 1 -- 172.21.15.129:0/2023895287 wait complete. 2024-02-18T16:22:23.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 Processor -- start 2024-02-18T16:22:23.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- start start 2024-02-18T16:22:23.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e57ed6b0 con 0x5576e5851910 2024-02-18T16:22:23.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa11177c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa11177c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43942/0 (socket says 172.21.15.129:43942) 2024-02-18T16:22:23.740 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa11177c640 1 -- 172.21.15.129:0/2482122330 learned_addr learned my addr 172.21.15.129:0/2482122330 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa11177c640 1 -- 172.21.15.129:0/2482122330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c00a100 con 0x5576e5851910 2024-02-18T16:22:23.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa11177c640 1 --2- 172.21.15.129:0/2482122330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59c93a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a420 tx=0x7fa10c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae24b75b20d441 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7f9fff606640 1 -- 172.21.15.129:0/2482122330 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0aa6c0 con 0x5576e5851910 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7f9fff606640 1 -- 172.21.15.129:0/2482122330 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c0aa820 con 0x5576e5851910 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7f9fff606640 1 -- 172.21.15.129:0/2482122330 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0aaae0 con 0x5576e5851910 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- 172.21.15.129:0/2482122330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 msgr2=0x5576e59c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 --2- 172.21.15.129:0/2482122330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59c93a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a420 tx=0x7fa10c0033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- 172.21.15.129:0/2482122330 shutdown_connections 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 --2- 172.21.15.129:0/2482122330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59c93a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- 172.21.15.129:0/2482122330 >> 172.21.15.129:0/2482122330 conn(0x5576e58d7920 msgr2=0x5576e59c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- 172.21.15.129:0/2482122330 shutdown_connections 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- 172.21.15.129:0/2482122330 wait complete. 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 Processor -- start 2024-02-18T16:22:23.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- start start 2024-02-18T16:22:23.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.733+0000 7fa113c61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e57e8e90 con 0x5576e5851910 2024-02-18T16:22:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa11177c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa11177c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43948/0 (socket says 172.21.15.129:43948) 2024-02-18T16:22:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa11177c640 1 -- 172.21.15.129:0/1283979054 learned_addr learned my addr 172.21.15.129:0/1283979054 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa11177c640 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e58e7260 con 0x5576e5851910 2024-02-18T16:22:23.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa11177c640 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59d0050 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a420 tx=0x7fa10c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7f9ffde03640 1 -- 172.21.15.129:0/1283979054 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0b6b60 con 0x5576e5851910 2024-02-18T16:22:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7f9ffde03640 1 -- 172.21.15.129:0/1283979054 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c0b6cc0 con 0x5576e5851910 2024-02-18T16:22:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7f9ffde03640 1 -- 172.21.15.129:0/1283979054 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0b4400 con 0x5576e5851910 2024-02-18T16:22:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576e59d0590 con 0x5576e5851910 2024-02-18T16:22:23.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e59d0a20 con 0x5576e5851910 2024-02-18T16:22:23.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7f9ffde03640 1 -- 172.21.15.129:0/1283979054 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa10c0b45b0 con 0x5576e5851910 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7f9ffde03640 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9ff80342b0 0x7f9ff8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7f9ffde03640 1 -- 172.21.15.129:0/1283979054 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa10c0e3e60 con 0x5576e5851910 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa110f7b640 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9ff80342b0 0x7f9ff8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e58e2740 0x5576e59d6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e59d7170 con 0x5576e58e2740 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa111f7d640 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e58e2740 0x5576e59d6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa110f7b640 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9ff80342b0 0x7f9ff8036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa108001da0 tx=0x7fa108001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.737+0000 7fa111f7d640 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e58e2740 0x5576e59d6c30 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa111f7d640 1 -- 172.21.15.129:0/1283979054 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1040083f0 con 0x5576e58e2740 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e59d7510 con 0x5576e58e2740 2024-02-18T16:22:23.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa111f7d640 1 -- 172.21.15.129:0/1283979054 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1040083f0 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e59d8dc0 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa111f7d640 1 -- 172.21.15.129:0/1283979054 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa1040083f0 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e59d7fc0 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa111f7d640 1 -- 172.21.15.129:0/1283979054 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1040083f0 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e59d83d0 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa111f7d640 1 -- 172.21.15.129:0/1283979054 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa104012040 con 0x5576e58e2740 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 Processor -- start 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- start start 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 0x5576e59e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e5781f20 con 0x5576e59e74a0 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa110f7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 0x5576e59e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa110f7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 0x5576e59e78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43964/0 (socket says 172.21.15.129:43964) 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa110f7b640 1 -- 172.21.15.129:0/452838722 learned_addr learned my addr 172.21.15.129:0/452838722 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa110f7b640 1 -- 172.21.15.129:0/452838722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e59e7e00 con 0x5576e59e74a0 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa110f7b640 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 0x5576e59e78c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa10800d660 tx=0x7fa10800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7f9ff6ffd640 1 -- 172.21.15.129:0/452838722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa108020070 con 0x5576e59e74a0 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576e59e8050 con 0x5576e59e74a0 2024-02-18T16:22:23.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7f9ff6ffd640 1 -- 172.21.15.129:0/452838722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10800c770 con 0x5576e59e74a0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7f9ff6ffd640 1 -- 172.21.15.129:0/452838722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa108013040 con 0x5576e59e74a0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.741+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e59e8ba0 con 0x5576e59e74a0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7f9ff6ffd640 1 -- 172.21.15.129:0/452838722 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa10800a040 con 0x5576e59e74a0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7f9ff6ffd640 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fec0342b0 0x7f9fec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7f9ff6ffd640 1 -- 172.21.15.129:0/452838722 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa10804b670 con 0x5576e59e74a0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa111f7d640 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fec0342b0 0x7f9fec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 Processor -- start 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- start start 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa111f7d640 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fec0342b0 0x7f9fec036770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5576e59d7a00 tx=0x7fa104003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59f4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e5775790 con 0x5576e59f4470 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43966/0 (socket says 172.21.15.129:43966) 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 -- 172.21.15.129:0/3995871300 learned_addr learned my addr 172.21.15.129:0/3995871300 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 -- 172.21.15.129:0/3995871300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e59f4e60 con 0x5576e59f4470 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 --2- 172.21.15.129:0/3995871300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59f4890 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa1080499c0 tx=0x7fa108019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84212b212ad47a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7f9ff4ff9640 1 -- 172.21.15.129:0/3995871300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10801aac0 con 0x5576e59f4470 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7f9ff4ff9640 1 -- 172.21.15.129:0/3995871300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108040030 con 0x5576e59f4470 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7f9ff4ff9640 1 -- 172.21.15.129:0/3995871300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10801acc0 con 0x5576e59f4470 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- 172.21.15.129:0/3995871300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 msgr2=0x5576e59f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 --2- 172.21.15.129:0/3995871300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59f4890 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa1080499c0 tx=0x7fa108019f10 comp rx=0 tx=0).stop 2024-02-18T16:22:23.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- 172.21.15.129:0/3995871300 shutdown_connections 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 --2- 172.21.15.129:0/3995871300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59f4890 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- 172.21.15.129:0/3995871300 >> 172.21.15.129:0/3995871300 conn(0x5576e59f0800 msgr2=0x5576e59ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- 172.21.15.129:0/3995871300 shutdown_connections 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- 172.21.15.129:0/3995871300 wait complete. 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 Processor -- start 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- start start 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa113c61980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e59fb930 con 0x5576e59f4470 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59fb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43976/0 (socket says 172.21.15.129:43976) 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.745+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 learned_addr learned my addr 172.21.15.129:0/89214425 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e59e8ba0 con 0x5576e59f4470 2024-02-18T16:22:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa110f7b640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59fb3f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa108048930 tx=0x7fa108049950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7f9fe2ffd640 1 -- 172.21.15.129:0/89214425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa10801aac0 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7f9fe2ffd640 1 -- 172.21.15.129:0/89214425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108033070 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576e59fbb30 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7f9fe2ffd640 1 -- 172.21.15.129:0/89214425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa108024850 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e59fbf60 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7f9fe2ffd640 1 -- 172.21.15.129:0/89214425 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa108048290 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7f9fe2ffd640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fdc034300 0x7f9fdc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7f9fe2ffd640 1 -- 172.21.15.129:0/89214425 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa10803ad50 con 0x5576e59f4470 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa111f7d640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fdc034300 0x7f9fdc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e5a06960 0x5576e5a08e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a09570 con 0x5576e5a06960 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa11177c640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e5a06960 0x5576e5a08e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa111f7d640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fdc034300 0x7f9fdc0367c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa104008fd0 tx=0x7fa10401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa11177c640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e5a06960 0x5576e5a08e20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 realm 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a09940 con 0x5576e5a06960 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0a190 con 0x5576e5a06960 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.749+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0a4f0 con 0x5576e5a06960 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a09e30 con 0x5576e5a06960 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 20 searching for the correct realm 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5576e5a0c740 0x5576e5a0eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f240 con 0x5576e5a0c740 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa110f7b640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5576e5a0c740 0x5576e5a0eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa110f7b640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5576e5a0c740 0x5576e5a0eb70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa110f7b640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa10804b980 0x7fa10801d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f240 con 0x7fa10804b980 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa111f7d640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa10804b980 0x7fa10801d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa111f7d640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa10804b980 0x7fa10801d0e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10402c040 con 0x7fa10804b980 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa111f7d640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa104027940 0x7fa1040333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f240 con 0x7fa104027940 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa104027940 0x7fa1040333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa104027940 0x7fa1040333c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x7fa104027940 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f240 con 0x5576e5a06960 2024-02-18T16:22:23.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.753+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f240 con 0x5576e5a06960 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f240 con 0x7fa104027940 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x7fa104027940 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa104027940 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x7fa104027940 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10402c040 con 0x7fa10804b980 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a06960 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa104027940 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x7fa104027940 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a06960 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa10402c040 con 0x7fa10804b980 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.757+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa104027940 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x7fa104027940 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a06960 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a06960 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa10c0c5070 con 0x5576e5a06960 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa104027940 2024-02-18T16:22:23.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10402c040 con 0x7fa10804b980 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a06960 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10402c040 con 0x7fa10804b980 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.761+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa104027940 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.782 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10402c040 con 0x7fa10804b980 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a0c740 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x5576e5a06960 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa10c0e9040 con 0x7fa10804b980 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:23.783 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0b390 con 0x5576e5a06960 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0b010 con 0x5576e5a06960 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0bc60 con 0x5576e5a06960 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 zone default found 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 4 Realm: () 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 zonegroup default 2024-02-18T16:22:23.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a0f680 con 0x7fa10804b980 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a110c0 con 0x5576e5a0c740 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a11530 con 0x5576e5a0c740 2024-02-18T16:22:23.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 started sync module instance, tier type = 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.765+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a10940 con 0x7fa10804b980 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969147036832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a10cf0 con 0x7fa10804b980 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a12290 con 0x5576e5a06960 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969147036832] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969147042128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a12250 con 0x5576e5a06960 2024-02-18T16:22:23.787 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.769+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a12cf0 con 0x5576e5a0c740 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969147042128] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969147045840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a13050 con 0x5576e5a0c740 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a13a00 con 0x7fa10804b980 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969147049248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a14250 con 0x7fa10804b980 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a14c70 con 0x5576e5a06960 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969147045840] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969147049248] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969147053904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a13db0 con 0x5576e5a06960 2024-02-18T16:22:23.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.773+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a154c0 con 0x7fa104027940 2024-02-18T16:22:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969147053904] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969147043184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a13db0 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a159b0 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969147043184] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969147057328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a15970 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.777+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a16390 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969147059824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a167f0 con 0x7fa104027940 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=0 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=1 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=2 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=3 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=4 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=5 2024-02-18T16:22:23.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969147057328] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=6 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969147059824] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 20 add_watcher() i=7 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a14e70 con 0x5576e5a06960 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.781+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969147061072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a14e70 con 0x5576e5a06960 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969147061072] v32'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7f9fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 5 note: GC not initialized 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7f9fc67e4640 20 reqs_thread_entry: start 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 20 Filter name: none 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7f9f37fff640 20 reqs_thread_entry: start 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a3b330 con 0x5576e5a06960 2024-02-18T16:22:23.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:23.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a3b330 con 0x7fa104027940 2024-02-18T16:22:23.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7f9fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.785+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969147061072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a3b330 con 0x5576e5a06960 2024-02-18T16:22:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93969147061072] v32'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969147036832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a3b330 con 0x7fa10804b980 2024-02-18T16:22:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93969147036832] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.800 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa113c61980 20 remove_watcher() i=0 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa113c61980 2 removed watcher, disabling cache 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969147042128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a3b330 con 0x5576e5a06960 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93969147042128] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa113c61980 20 remove_watcher() i=1 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.789+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969147045840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a3b330 con 0x5576e5a0c740 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.793+0000 7fa110f7b640 1 -- 172.21.15.129:0/89214425 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93969147045840] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa108022070 con 0x5576e5a0c740 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.793+0000 7fa113c61980 20 remove_watcher() i=2 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.793+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969147049248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a104a0 con 0x7fa10804b980 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.793+0000 7fa111f7d640 1 -- 172.21.15.129:0/89214425 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93969147049248] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10403f040 con 0x7fa10804b980 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.793+0000 7fa113c61980 20 remove_watcher() i=3 2024-02-18T16:22:23.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.793+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969147053904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a11950 con 0x5576e5a06960 2024-02-18T16:22:23.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.797+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93969147053904] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x5576e5a06960 2024-02-18T16:22:23.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.797+0000 7fa113c61980 20 remove_watcher() i=4 2024-02-18T16:22:23.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.797+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969147043184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a127d0 con 0x7fa104027940 2024-02-18T16:22:23.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.797+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93969147043184] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.797+0000 7fa113c61980 20 remove_watcher() i=5 2024-02-18T16:22:23.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.797+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969147057328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a127d0 con 0x7fa104027940 2024-02-18T16:22:23.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93969147057328] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 20 remove_watcher() i=6 2024-02-18T16:22:23.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969147059824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5576e5a127d0 con 0x7fa104027940 2024-02-18T16:22:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93969147059824] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa10c0f0040 con 0x7fa104027940 2024-02-18T16:22:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 20 remove_watcher() i=7 2024-02-18T16:22:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa104027940 msgr2=0x7fa1040333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa104027940 0x7fa1040333c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e5a06960 msgr2=0x5576e5a08e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e5a06960 0x5576e5a08e20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa10804b980 msgr2=0x7fa10801d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa10804b980 0x7fa10801d0e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5576e5a0c740 msgr2=0x5576e5a0eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5576e5a0c740 0x5576e5a0eb70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fdc034300 msgr2=0x7f9fdc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fdc034300 0x7f9fdc0367c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa104008fd0 tx=0x7fa10401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa11177c640 1 -- 172.21.15.129:0/89214425 reap_dead start 2024-02-18T16:22:23.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 msgr2=0x5576e59fb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59fb3f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa108048930 tx=0x7fa108049950 comp rx=0 tx=0).stop 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 shutdown_connections 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/89214425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59f4470 0x5576e59fb3f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 >> 172.21.15.129:0/89214425 conn(0x5576e59f0800 msgr2=0x5576e59ede60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 shutdown_connections 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/89214425 wait complete. 2024-02-18T16:22:23.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fec0342b0 msgr2=0x7f9fec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fec0342b0 0x7f9fec036770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5576e59d7a00 tx=0x7fa104003070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 msgr2=0x5576e59e78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 0x5576e59e78c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa10800d660 tx=0x7fa10800da60 comp rx=0 tx=0).stop 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 shutdown_connections 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9fec0342b0 0x7f9fec036770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/452838722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e59e74a0 0x5576e59e78c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 >> 172.21.15.129:0/452838722 conn(0x5576e59dc2b0 msgr2=0x5576e59dcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 shutdown_connections 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/452838722 wait complete. 2024-02-18T16:22:23.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e58e2740 msgr2=0x5576e59d6c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e58e2740 0x5576e59d6c30 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9ff80342b0 msgr2=0x7f9ff8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9ff80342b0 0x7f9ff8036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa108001da0 tx=0x7fa108001300 comp rx=0 tx=0).stop 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 msgr2=0x5576e59d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59d0050 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a420 tx=0x7fa10c019810 comp rx=0 tx=0).stop 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 shutdown_connections 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5576e58e2740 0x5576e59d6c30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9ff80342b0 0x7f9ff8036770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 --2- 172.21.15.129:0/1283979054 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5576e5851910 0x5576e59d0050 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 >> 172.21.15.129:0/1283979054 conn(0x5576e58d7920 msgr2=0x5576e59c3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 shutdown_connections 2024-02-18T16:22:23.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.801+0000 7fa113c61980 1 -- 172.21.15.129:0/1283979054 wait complete. 2024-02-18T16:22:23.818 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-02-18T16:22:23.818 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-02-18T16:22:23.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-18T16:22:23.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-18T16:22:23.819 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-02-18T16:22:23.896 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:23.897 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:23.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.889+0000 7fa236ce4980 1 Processor -- start 2024-02-18T16:22:23.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.889+0000 7fa236ce4980 1 -- start start 2024-02-18T16:22:23.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa236ce4980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x558d8770f650 0x558d87711a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa236ce4980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558d876574d0 con 0x558d8770b140 2024-02-18T16:22:23.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa236ce4980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x558d8761e180 con 0x558d8770f650 2024-02-18T16:22:23.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa233ffe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x558d8770f650 0x558d87711a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa2347ff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x558d8770b140 0x558d8770b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43200/0 (socket says 172.21.15.129:43200) 2024-02-18T16:22:23.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa2347ff640 1 -- 172.21.15.129:0/3712652826 learned_addr learned my addr 172.21.15.129:0/3712652826 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:23.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa233ffe640 1 -- 172.21.15.129:0/3712652826 >> v1:172.21.15.80:6789/0 conn(0x558d8770b140 legacy=0x558d8770b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa233ffe640 1 -- 172.21.15.129:0/3712652826 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d87712f90 con 0x558d8770f650 2024-02-18T16:22:23.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa233ffe640 1 --2- 172.21.15.129:0/3712652826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770f650 0x558d87711a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a480 tx=0x7fa22801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1b5d49caa7f007 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa2337fd640 1 -- 172.21.15.129:0/3712652826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280ab540 con 0x558d8770f650 2024-02-18T16:22:23.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa2337fd640 1 -- 172.21.15.129:0/3712652826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280ab6a0 con 0x558d8770f650 2024-02-18T16:22:23.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.893+0000 7fa2337fd640 1 -- 172.21.15.129:0/3712652826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280ab960 con 0x558d8770f650 2024-02-18T16:22:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 -- 172.21.15.129:0/3712652826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770f650 msgr2=0x558d87711a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3712652826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770f650 0x558d87711a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a480 tx=0x7fa22801b280 comp rx=0 tx=0).stop 2024-02-18T16:22:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 -- 172.21.15.129:0/3712652826 shutdown_connections 2024-02-18T16:22:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3712652826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770f650 0x558d87711a40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 -- 172.21.15.129:0/3712652826 >> 172.21.15.129:0/3712652826 conn(0x558d87706a10 msgr2=0x558d87708e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 -- 172.21.15.129:0/3712652826 shutdown_connections 2024-02-18T16:22:23.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.897+0000 7fa236ce4980 1 -- 172.21.15.129:0/3712652826 wait complete. 2024-02-18T16:22:23.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 Processor -- start 2024-02-18T16:22:23.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- start start 2024-02-18T16:22:23.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8761b6b0 con 0x558d8770b140 2024-02-18T16:22:23.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa2347ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa2347ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43986/0 (socket says 172.21.15.129:43986) 2024-02-18T16:22:23.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa2347ff640 1 -- 172.21.15.129:0/2545404073 learned_addr learned my addr 172.21.15.129:0/2545404073 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa2347ff640 1 -- 172.21.15.129:0/2545404073 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228005d30 con 0x558d8770b140 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa2347ff640 1 --2- 172.21.15.129:0/2545404073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877f5090 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa22c006fb0 tx=0x7fa22c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb9ea39269b8c67 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa12260c640 1 -- 172.21.15.129:0/2545404073 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa22c004530 con 0x558d8770b140 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa12260c640 1 -- 172.21.15.129:0/2545404073 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c004690 con 0x558d8770b140 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa12260c640 1 -- 172.21.15.129:0/2545404073 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa22c0049b0 con 0x558d8770b140 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- 172.21.15.129:0/2545404073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 msgr2=0x558d877f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 --2- 172.21.15.129:0/2545404073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877f5090 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa22c006fb0 tx=0x7fa22c001940 comp rx=0 tx=0).stop 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- 172.21.15.129:0/2545404073 shutdown_connections 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 --2- 172.21.15.129:0/2545404073 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877f5090 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- 172.21.15.129:0/2545404073 >> 172.21.15.129:0/2545404073 conn(0x558d87706a10 msgr2=0x558d877f0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- 172.21.15.129:0/2545404073 shutdown_connections 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.909+0000 7fa236ce4980 1 -- 172.21.15.129:0/2545404073 wait complete. 2024-02-18T16:22:23.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 Processor -- start 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 -- start start 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d87616e90 con 0x558d8770b140 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa2347ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa2347ff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877fbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:43992/0 (socket says 172.21.15.129:43992) 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa2347ff640 1 -- 172.21.15.129:0/3020387703 learned_addr learned my addr 172.21.15.129:0/3020387703 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa2347ff640 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d876574d0 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa2347ff640 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877fbf20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x558d877f5f20 tx=0x7fa22c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa120e09640 1 -- 172.21.15.129:0/3020387703 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa22c013760 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa120e09640 1 -- 172.21.15.129:0/3020387703 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0138c0 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d877fc460 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa120e09640 1 -- 172.21.15.129:0/3020387703 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa22c013b60 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d877fc910 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa120e09640 1 -- 172.21.15.129:0/3020387703 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa22c028460 con 0x558d8770b140 2024-02-18T16:22:23.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa120e09640 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa11c0342b0 0x7fa11c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa120e09640 1 -- 172.21.15.129:0/3020387703 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa22c049690 con 0x558d8770b140 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa233ffe640 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa11c0342b0 0x7fa11c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d8770f650 0x558d87802bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878030f0 con 0x558d8770f650 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa235000640 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d8770f650 0x558d87802bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.913+0000 7fa233ffe640 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa11c0342b0 0x7fa11c036770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa2280ad000 tx=0x7fa2280a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa235000640 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d8770f650 0x558d87802bb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa235000640 1 -- 172.21.15.129:0/3020387703 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa2240083f0 con 0x558d8770f650 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87803500 con 0x558d8770f650 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa235000640 1 -- 172.21.15.129:0/3020387703 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa2240083f0 con 0x558d8770f650 2024-02-18T16:22:23.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87804db0 con 0x558d8770f650 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa235000640 1 -- 172.21.15.129:0/3020387703 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa2240083f0 con 0x558d8770f650 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87803ef0 con 0x558d8770f650 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa235000640 1 -- 172.21.15.129:0/3020387703 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa2240083f0 con 0x558d8770f650 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87804300 con 0x558d8770f650 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa235000640 1 -- 172.21.15.129:0/3020387703 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa224012040 con 0x558d8770f650 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 Processor -- start 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- start start 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 0x558d878138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d875aff20 con 0x558d87813490 2024-02-18T16:22:23.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa233ffe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 0x558d878138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa233ffe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 0x558d878138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44000/0 (socket says 172.21.15.129:44000) 2024-02-18T16:22:23.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa233ffe640 1 -- 172.21.15.129:0/359859813 learned_addr learned my addr 172.21.15.129:0/359859813 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa233ffe640 1 -- 172.21.15.129:0/359859813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d87813df0 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa233ffe640 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 0x558d878138b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa228096e80 tx=0x7fa228018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa119ffb640 1 -- 172.21.15.129:0/359859813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280bd8a0 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa119ffb640 1 -- 172.21.15.129:0/359859813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280bda00 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d87813fe0 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa119ffb640 1 -- 172.21.15.129:0/359859813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280bdca0 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.917+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d87814b30 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa119ffb640 1 -- 172.21.15.129:0/359859813 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa2280be480 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa119ffb640 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa10c0342b0 0x7fa10c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa119ffb640 1 -- 172.21.15.129:0/359859813 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa2280e6400 con 0x558d87813490 2024-02-18T16:22:23.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa235000640 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa10c0342b0 0x7fa10c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 Processor -- start 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- start start 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa235000640 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa10c0342b0 0x7fa10c036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x558d87804250 tx=0x7fa224003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87820890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d875a3790 con 0x558d87820470 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa233ffe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87820890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa233ffe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87820890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44010/0 (socket says 172.21.15.129:44010) 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa233ffe640 1 -- 172.21.15.129:0/935655969 learned_addr learned my addr 172.21.15.129:0/935655969 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa233ffe640 1 -- 172.21.15.129:0/935655969 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d87820e60 con 0x558d87820470 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa233ffe640 1 --2- 172.21.15.129:0/935655969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87820890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa2280e4780 tx=0x7fa2280aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23c06de5ce0ede5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa1137fe640 1 -- 172.21.15.129:0/935655969 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280064c0 con 0x558d87820470 2024-02-18T16:22:23.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa1137fe640 1 -- 172.21.15.129:0/935655969 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280be730 con 0x558d87820470 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa1137fe640 1 -- 172.21.15.129:0/935655969 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280b4c50 con 0x558d87820470 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- 172.21.15.129:0/935655969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 msgr2=0x558d87820890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 --2- 172.21.15.129:0/935655969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87820890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa2280e4780 tx=0x7fa2280aae30 comp rx=0 tx=0).stop 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- 172.21.15.129:0/935655969 shutdown_connections 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 --2- 172.21.15.129:0/935655969 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87820890 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- 172.21.15.129:0/935655969 >> 172.21.15.129:0/935655969 conn(0x558d8781c800 msgr2=0x558d8781a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- 172.21.15.129:0/935655969 shutdown_connections 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- 172.21.15.129:0/935655969 wait complete. 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 Processor -- start 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.921+0000 7fa236ce4980 1 -- start start 2024-02-18T16:22:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87827380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d878278c0 con 0x558d87820470 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa233ffe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87827380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa233ffe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87827380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44026/0 (socket says 172.21.15.129:44026) 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 learned_addr learned my addr 172.21.15.129:0/877763289 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d87814b30 con 0x558d87820470 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa233ffe640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87827380 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa2280aae70 tx=0x7fa2280e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa111ffb640 1 -- 172.21.15.129:0/877763289 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280d5050 con 0x558d87820470 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa111ffb640 1 -- 172.21.15.129:0/877763289 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280d6040 con 0x558d87820470 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d87827ac0 con 0x558d87820470 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa111ffb640 1 -- 172.21.15.129:0/877763289 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2280068e0 con 0x558d87820470 2024-02-18T16:22:23.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d87827ef0 con 0x558d87820470 2024-02-18T16:22:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa111ffb640 1 -- 172.21.15.129:0/877763289 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa2280b4c50 con 0x558d87820470 2024-02-18T16:22:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa111ffb640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa104034300 0x7fa1040367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa111ffb640 1 -- 172.21.15.129:0/877763289 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa2280ac050 con 0x558d87820470 2024-02-18T16:22:23.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa235000640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa104034300 0x7fa1040367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d878328f0 0x558d87834db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87835500 con 0x558d878328f0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa2347ff640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d878328f0 0x558d87834db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa235000640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa104034300 0x7fa1040367c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa224008fd0 tx=0x7fa22401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.925+0000 7fa2347ff640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d878328f0 0x558d87834db0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa22c024020 con 0x558d878328f0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 realm 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878358d0 con 0x558d878328f0 2024-02-18T16:22:23.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa22c024020 con 0x558d878328f0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87836120 con 0x558d878328f0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa22c024020 con 0x558d878328f0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87836480 con 0x558d878328f0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa22c024020 con 0x558d878328f0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87835dc0 con 0x558d878328f0 2024-02-18T16:22:23.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa22c024020 con 0x558d878328f0 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 20 searching for the correct realm 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558d878386d0 0x558d8783ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa233ffe640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558d878386d0 0x558d8783ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa233ffe640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558d878386d0 0x558d8783ab00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa233ffe640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa2280f0060 0x7fa2280a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa235000640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa2280f0060 0x7fa2280a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa235000640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa2280f0060 0x7fa2280a4900 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22402c040 con 0x7fa2280f0060 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa235000640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa224027940 0x7fa2240333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa224027940 0x7fa2240333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.929+0000 7fa2347ff640 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa224027940 0x7fa2240333c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c024020 con 0x7fa224027940 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa22c024020 con 0x558d878328f0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22402c040 con 0x7fa2280f0060 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.933+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa22402c040 con 0x7fa2280f0060 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22402c040 con 0x7fa2280f0060 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.937+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22402c040 con 0x7fa2280f0060 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa224027940 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22402c040 con 0x7fa2280f0060 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878386d0 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x558d878328f0 2024-02-18T16:22:23.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783b1d0 con 0x7fa2280f0060 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87837320 con 0x558d878328f0 2024-02-18T16:22:23.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87836fa0 con 0x558d878328f0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87837c70 con 0x558d878328f0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 zone default found 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 4 Realm: () 2024-02-18T16:22:23.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 zonegroup default 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783bab0 con 0x7fa2280f0060 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.941+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783d490 con 0x558d878386d0 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783d860 con 0x558d878386d0 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 20 started sync module instance, tier type = 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ca60 con 0x7fa2280f0060 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94066352311824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ca60 con 0x7fa2280f0060 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783e310 con 0x558d878328f0 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.945+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94066352311824] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94066352315888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ca60 con 0x558d878328f0 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ecd0 con 0x558d878386d0 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94066352315888] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94066352309696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783c9e0 con 0x558d878386d0 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783fa00 con 0x7fa2280f0060 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94066352321824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87840250 con 0x7fa2280f0060 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.949+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87840c20 con 0x558d878328f0 2024-02-18T16:22:23.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94066352309696] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.966 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94066352321824] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94066352326432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783fdb0 con 0x558d878328f0 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87841470 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94066352326432] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94066352320640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783fdb0 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.953+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87841a20 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.957+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94066352320640] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.957+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.957+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94066352329984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878419e0 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.957+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878423d0 con 0x7fa224027940 2024-02-18T16:22:23.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.957+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94066352329984] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94066352332464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87842390 con 0x7fa224027940 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=0 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=1 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=2 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=3 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=4 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=5 2024-02-18T16:22:23.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=6 2024-02-18T16:22:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94066352332464] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 20 add_watcher() i=7 2024-02-18T16:22:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87845810 con 0x558d878328f0 2024-02-18T16:22:23.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.961+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94066352328176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d87842cf0 con 0x558d878328f0 2024-02-18T16:22:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94066352328176] v32'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa0ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 5 note: GC not initialized 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa0e97e2640 20 reqs_thread_entry: start 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 20 Filter name: none 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa05affd640 20 reqs_thread_entry: start 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 20 rados->read ofs=0 len=0 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878672f0 con 0x558d878328f0 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:23.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878672f0 con 0x7fa224027940 2024-02-18T16:22:23.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa0ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:23.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.965+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94066352328176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878672f0 con 0x558d878328f0 2024-02-18T16:22:23.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94066352328176] v32'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94066352311824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878672f0 con 0x7fa2280f0060 2024-02-18T16:22:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94066352311824] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa236ce4980 20 remove_watcher() i=0 2024-02-18T16:22:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa236ce4980 2 removed watcher, disabling cache 2024-02-18T16:22:23.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94066352315888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878672f0 con 0x558d878328f0 2024-02-18T16:22:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94066352315888] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.969+0000 7fa236ce4980 20 remove_watcher() i=1 2024-02-18T16:22:23.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94066352309696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d878672f0 con 0x558d878386d0 2024-02-18T16:22:23.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa233ffe640 1 -- 172.21.15.129:0/877763289 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94066352309696] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2280d8070 con 0x558d878386d0 2024-02-18T16:22:23.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa236ce4980 20 remove_watcher() i=2 2024-02-18T16:22:23.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94066352321824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ce10 con 0x7fa2280f0060 2024-02-18T16:22:23.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa235000640 1 -- 172.21.15.129:0/877763289 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94066352321824] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22403f040 con 0x7fa2280f0060 2024-02-18T16:22:23.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa236ce4980 20 remove_watcher() i=3 2024-02-18T16:22:23.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.973+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94066352326432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783c5c0 con 0x558d878328f0 2024-02-18T16:22:23.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.977+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94066352326432] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x558d878328f0 2024-02-18T16:22:23.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.977+0000 7fa236ce4980 20 remove_watcher() i=4 2024-02-18T16:22:23.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.977+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94066352320640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ce10 con 0x7fa224027940 2024-02-18T16:22:23.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.977+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94066352320640] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.977+0000 7fa236ce4980 20 remove_watcher() i=5 2024-02-18T16:22:23.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.977+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94066352329984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783f080 con 0x7fa224027940 2024-02-18T16:22:23.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.981+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94066352329984] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.981+0000 7fa236ce4980 20 remove_watcher() i=6 2024-02-18T16:22:23.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.981+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94066352332464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558d8783ce10 con 0x7fa224027940 2024-02-18T16:22:23.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.981+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94066352332464] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa22c03f040 con 0x7fa224027940 2024-02-18T16:22:23.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.981+0000 7fa236ce4980 20 remove_watcher() i=7 2024-02-18T16:22:23.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa224027940 msgr2=0x7fa2240333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fa224027940 0x7fa2240333c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d878328f0 msgr2=0x558d87834db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d878328f0 0x558d87834db0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa2280f0060 msgr2=0x7fa2280a4900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fa2280f0060 0x7fa2280a4900 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558d878386d0 msgr2=0x558d8783ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x558d878386d0 0x558d8783ab00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa104034300 msgr2=0x7fa1040367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa104034300 0x7fa1040367c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa224008fd0 tx=0x7fa22401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 msgr2=0x558d87827380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa2347ff640 1 -- 172.21.15.129:0/877763289 reap_dead start 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87827380 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa2280aae70 tx=0x7fa2280e46e0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 shutdown_connections 2024-02-18T16:22:23.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/877763289 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87820470 0x558d87827380 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 >> 172.21.15.129:0/877763289 conn(0x558d8781c800 msgr2=0x558d87819e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 shutdown_connections 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/877763289 wait complete. 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa10c0342b0 msgr2=0x7fa10c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa10c0342b0 0x7fa10c036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x558d87804250 tx=0x7fa224003070 comp rx=0 tx=0).stop 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 msgr2=0x558d878138b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 0x558d878138b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa228096e80 tx=0x7fa228018020 comp rx=0 tx=0).stop 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 shutdown_connections 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa10c0342b0 0x7fa10c036770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/359859813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d87813490 0x558d878138b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 >> 172.21.15.129:0/359859813 conn(0x558d878082a0 msgr2=0x558d87808db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 shutdown_connections 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/359859813 wait complete. 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d8770f650 msgr2=0x558d87802bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d8770f650 0x558d87802bb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa11c0342b0 msgr2=0x7fa11c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa11c0342b0 0x7fa11c036770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa2280ad000 tx=0x7fa2280a5040 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 msgr2=0x558d877fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877fbf20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x558d877f5f20 tx=0x7fa22c000f50 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 shutdown_connections 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x558d8770f650 0x558d87802bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa11c0342b0 0x7fa11c036770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 --2- 172.21.15.129:0/3020387703 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x558d8770b140 0x558d877fbf20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:23.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 >> 172.21.15.129:0/3020387703 conn(0x558d87706a10 msgr2=0x558d877ef730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 shutdown_connections 2024-02-18T16:22:23.999 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:23.985+0000 7fa236ce4980 1 -- 172.21.15.129:0/3020387703 wait complete. 2024-02-18T16:22:24.001 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-02-18T16:22:24.001 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-02-18T16:22:24.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-18T16:22:24.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-18T16:22:24.002 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-02-18T16:22:24.079 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:24.079 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf7a290980 1 Processor -- start 2024-02-18T16:22:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf7a290980 1 -- start start 2024-02-18T16:22:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf7a290980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55c71f4616b0 0x55c71f4f5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf7a290980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c71f4384d0 con 0x55c71f4629f0 2024-02-18T16:22:24.080 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf7a290980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c71f3ff180 con 0x55c71f4616b0 2024-02-18T16:22:24.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf77dab640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55c71f4629f0 0x55c71f460fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43206/0 (socket says 172.21.15.129:43206) 2024-02-18T16:22:24.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf77dab640 1 -- 172.21.15.129:0/2111630241 learned_addr learned my addr 172.21.15.129:0/2111630241 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:24.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf775aa640 1 --2- 172.21.15.129:0/2111630241 >> v2:172.21.15.80:3300/0 conn(0x55c71f4616b0 0x55c71f4f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf76da9640 1 -- 172.21.15.129:0/2111630241 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613116812 0 0) 0x55c71f4384d0 con 0x55c71f4629f0 2024-02-18T16:22:24.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf76da9640 1 -- 172.21.15.129:0/2111630241 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf60001e20 con 0x55c71f4629f0 2024-02-18T16:22:24.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf775aa640 1 -- 172.21.15.129:0/2111630241 >> v1:172.21.15.80:6789/0 conn(0x55c71f4629f0 legacy=0x55c71f460fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.073+0000 7fdf775aa640 1 -- 172.21.15.129:0/2111630241 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c71f461ac0 con 0x55c71f4616b0 2024-02-18T16:22:24.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf775aa640 1 --2- 172.21.15.129:0/2111630241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f4f5150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00a480 tx=0x7fdf6c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdde036c9df0e685 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf76da9640 1 -- 172.21.15.129:0/2111630241 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0aa530 con 0x55c71f4616b0 2024-02-18T16:22:24.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf76da9640 1 -- 172.21.15.129:0/2111630241 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0a6050 con 0x55c71f4616b0 2024-02-18T16:22:24.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf76da9640 1 -- 172.21.15.129:0/2111630241 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0aa7e0 con 0x55c71f4616b0 2024-02-18T16:22:24.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 -- 172.21.15.129:0/2111630241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 msgr2=0x55c71f4f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 --2- 172.21.15.129:0/2111630241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f4f5150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00a480 tx=0x7fdf6c01b280 comp rx=0 tx=0).stop 2024-02-18T16:22:24.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 -- 172.21.15.129:0/2111630241 shutdown_connections 2024-02-18T16:22:24.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 --2- 172.21.15.129:0/2111630241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f4f5150 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 -- 172.21.15.129:0/2111630241 >> 172.21.15.129:0/2111630241 conn(0x55c71f4e7a10 msgr2=0x55c71f4e9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 -- 172.21.15.129:0/2111630241 shutdown_connections 2024-02-18T16:22:24.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.077+0000 7fdf7a290980 1 -- 172.21.15.129:0/2111630241 wait complete. 2024-02-18T16:22:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf7a290980 1 Processor -- start 2024-02-18T16:22:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf7a290980 1 -- start start 2024-02-18T16:22:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf7a290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf7a290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71f3fc6b0 con 0x55c71f4616b0 2024-02-18T16:22:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf77dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf77dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5d83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44044/0 (socket says 172.21.15.129:44044) 2024-02-18T16:22:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf77dab640 1 -- 172.21.15.129:0/3167155678 learned_addr learned my addr 172.21.15.129:0/3167155678 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf77dab640 1 -- 172.21.15.129:0/3167155678 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c005d30 con 0x55c71f4616b0 2024-02-18T16:22:24.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.093+0000 7fdf77dab640 1 --2- 172.21.15.129:0/3167155678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5d83d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdf68001c30 tx=0x7fdf6800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceee9fe06ccd7d25 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fde65e0b640 1 -- 172.21.15.129:0/3167155678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6800e690 con 0x55c71f4616b0 2024-02-18T16:22:24.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fde65e0b640 1 -- 172.21.15.129:0/3167155678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800e7f0 con 0x55c71f4616b0 2024-02-18T16:22:24.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fde65e0b640 1 -- 172.21.15.129:0/3167155678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6800eb50 con 0x55c71f4616b0 2024-02-18T16:22:24.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/3167155678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 msgr2=0x55c71f5d83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 --2- 172.21.15.129:0/3167155678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5d83d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdf68001c30 tx=0x7fdf6800b6d0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/3167155678 shutdown_connections 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 --2- 172.21.15.129:0/3167155678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5d83d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/3167155678 >> 172.21.15.129:0/3167155678 conn(0x55c71f4e7a10 msgr2=0x55c71f5d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/3167155678 shutdown_connections 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/3167155678 wait complete. 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 Processor -- start 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- start start 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71f3f7e90 con 0x55c71f4616b0 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf77dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf77dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5df2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44054/0 (socket says 172.21.15.129:44054) 2024-02-18T16:22:24.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf77dab640 1 -- 172.21.15.129:0/392858684 learned_addr learned my addr 172.21.15.129:0/392858684 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf77dab640 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60001e20 con 0x55c71f4616b0 2024-02-18T16:22:24.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf77dab640 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5df2c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b710 tx=0x7fdf68000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fde5ffff640 1 -- 172.21.15.129:0/392858684 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6801f070 con 0x55c71f4616b0 2024-02-18T16:22:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c71f5df800 con 0x55c71f4616b0 2024-02-18T16:22:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fde5ffff640 1 -- 172.21.15.129:0/392858684 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6801a2e0 con 0x55c71f4616b0 2024-02-18T16:22:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fde5ffff640 1 -- 172.21.15.129:0/392858684 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6801a820 con 0x55c71f4616b0 2024-02-18T16:22:24.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.097+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c71f5dfcb0 con 0x55c71f4616b0 2024-02-18T16:22:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fde5ffff640 1 -- 172.21.15.129:0/392858684 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf6800a040 con 0x55c71f4616b0 2024-02-18T16:22:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fde5ffff640 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde600342b0 0x7fde60036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fde5ffff640 1 -- 172.21.15.129:0/392858684 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdf68049970 con 0x55c71f4616b0 2024-02-18T16:22:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf775aa640 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde600342b0 0x7fde60036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f4629f0 0x55c71f5e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f5e6490 con 0x55c71f4629f0 2024-02-18T16:22:24.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f4629f0 0x55c71f5e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf775aa640 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde600342b0 0x7fde60036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0ac000 tx=0x7fdf6c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f4629f0 0x55c71f5e5f50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 -- 172.21.15.129:0/392858684 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf7000a4d0 con 0x55c71f4629f0 2024-02-18T16:22:24.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f5e68a0 con 0x55c71f4629f0 2024-02-18T16:22:24.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 -- 172.21.15.129:0/392858684 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdf7000a4d0 con 0x55c71f4629f0 2024-02-18T16:22:24.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f5e8150 con 0x55c71f4629f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 -- 172.21.15.129:0/392858684 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fdf7000a4d0 con 0x55c71f4629f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f5e7350 con 0x55c71f4629f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 -- 172.21.15.129:0/392858684 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdf7000a4d0 con 0x55c71f4629f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f5e7760 con 0x55c71f4629f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf785ac640 1 -- 172.21.15.129:0/392858684 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdf7000a4d0 con 0x55c71f4629f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 Processor -- start 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- start start 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 0x55c71f5f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf7a290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71f390f20 con 0x55c71f5f67f0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.101+0000 7fdf775aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 0x55c71f5f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 0x55c71f5f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44070/0 (socket says 172.21.15.129:44070) 2024-02-18T16:22:24.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 -- 172.21.15.129:0/1170082064 learned_addr learned my addr 172.21.15.129:0/1170082064 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 -- 172.21.15.129:0/1170082064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c71f5f7150 con 0x55c71f5f67f0 2024-02-18T16:22:24.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 0x55c71f5f6c10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c096d70 tx=0x7fdf6c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fde5d7fa640 1 -- 172.21.15.129:0/1170082064 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0b4b10 con 0x55c71f5f67f0 2024-02-18T16:22:24.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fde5d7fa640 1 -- 172.21.15.129:0/1170082064 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0b4c70 con 0x55c71f5f67f0 2024-02-18T16:22:24.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c71f5f7340 con 0x55c71f5f67f0 2024-02-18T16:22:24.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fde5d7fa640 1 -- 172.21.15.129:0/1170082064 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0bd480 con 0x55c71f5f67f0 2024-02-18T16:22:24.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c71f5f7e90 con 0x55c71f5f67f0 2024-02-18T16:22:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fde5d7fa640 1 -- 172.21.15.129:0/1170082064 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf6c0bd6b0 con 0x55c71f5f67f0 2024-02-18T16:22:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fde5d7fa640 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde500342b0 0x7fde50036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fde5d7fa640 1 -- 172.21.15.129:0/1170082064 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdf6c0e5a50 con 0x55c71f5f67f0 2024-02-18T16:22:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf785ac640 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde500342b0 0x7fde50036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf7a290980 1 Processor -- start 2024-02-18T16:22:24.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf7a290980 1 -- start start 2024-02-18T16:22:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf7a290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f603c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf7a290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71f384790 con 0x55c71f603850 2024-02-18T16:22:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf785ac640 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde500342b0 0x7fde50036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55c71f5e6d90 tx=0x7fdf70005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f603c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f603c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44076/0 (socket says 172.21.15.129:44076) 2024-02-18T16:22:24.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 -- 172.21.15.129:0/3643277999 learned_addr learned my addr 172.21.15.129:0/3643277999 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.105+0000 7fdf775aa640 1 -- 172.21.15.129:0/3643277999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c71f604200 con 0x55c71f603850 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf775aa640 1 --2- 172.21.15.129:0/3643277999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f603c30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0bdfd0 tx=0x7fdf6c0b34e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a211c445f0950005 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fde56ffd640 1 -- 172.21.15.129:0/3643277999 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0bb360 con 0x55c71f603850 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fde56ffd640 1 -- 172.21.15.129:0/3643277999 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0bb4c0 con 0x55c71f603850 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fde56ffd640 1 -- 172.21.15.129:0/3643277999 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0b36c0 con 0x55c71f603850 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/3643277999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 msgr2=0x55c71f603c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 --2- 172.21.15.129:0/3643277999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f603c30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0bdfd0 tx=0x7fdf6c0b34e0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/3643277999 shutdown_connections 2024-02-18T16:22:24.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 --2- 172.21.15.129:0/3643277999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f603c30 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/3643277999 >> 172.21.15.129:0/3643277999 conn(0x55c71f5ffb90 msgr2=0x55c71f5fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/3643277999 shutdown_connections 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/3643277999 wait complete. 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 Processor -- start 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- start start 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f60a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71f60ac10 con 0x55c71f603850 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf775aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f60a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf775aa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f60a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44088/0 (socket says 172.21.15.129:44088) 2024-02-18T16:22:24.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 learned_addr learned my addr 172.21.15.129:0/29323854 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c71f5f7e90 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf775aa640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f60a6d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0bdfd0 tx=0x7fdf6c0e3d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fde557fa640 1 -- 172.21.15.129:0/29323854 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0bb360 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c71f60ae10 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fde557fa640 1 -- 172.21.15.129:0/29323854 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0e55b0 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fde557fa640 1 -- 172.21.15.129:0/29323854 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0e5740 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.109+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c71f60b240 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fde557fa640 1 -- 172.21.15.129:0/29323854 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf6c0e2350 con 0x55c71f603850 2024-02-18T16:22:24.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fde557fa640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde400342b0 0x7fde40036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fde557fa640 1 -- 172.21.15.129:0/29323854 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdf6c0f0d60 con 0x55c71f603850 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf785ac640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde400342b0 0x7fde40036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f615c50 0x55c71f6180f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f618840 con 0x55c71f615c50 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f615c50 0x55c71f6180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf785ac640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde400342b0 0x7fde40036770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf70011010 tx=0x7fdf70020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f615c50 0x55c71f6180f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf68014070 con 0x55c71f615c50 2024-02-18T16:22:24.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 realm 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f618c10 con 0x55c71f615c50 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf68014070 con 0x55c71f615c50 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f619460 con 0x55c71f615c50 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf68014070 con 0x55c71f615c50 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f6197c0 con 0x55c71f615c50 2024-02-18T16:22:24.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdf68014070 con 0x55c71f615c50 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f619100 con 0x55c71f615c50 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdf68014070 con 0x55c71f615c50 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 20 searching for the correct realm 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c71f61ba10 0x55c71f61de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf775aa640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c71f61ba10 0x55c71f61de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf775aa640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c71f61ba10 0x55c71f61de20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf775aa640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdf6c0ef060 0x7fdf6c006590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.113+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf785ac640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdf6c0ef060 0x7fdf6c006590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf785ac640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdf6c0ef060 0x7fdf6c006590 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7000a4d0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf785ac640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdf700141d0 0x7fdf70015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdf700141d0 0x7fdf70015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdf700141d0 0x7fdf70015940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68014070 con 0x7fdf700141d0 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.117+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7000a4d0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.121+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf700141d0 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.125+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f61ba10 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x55c71f615c50 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61e4f0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:24.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61a660 con 0x55c71f615c50 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61a2e0 con 0x55c71f615c50 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61afb0 con 0x55c71f615c50 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 zone default found 2024-02-18T16:22:24.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 4 Realm: () 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 zonegroup default 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61edd0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f6207b0 con 0x55c71f61ba10 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f620b40 con 0x55c71f61ba10 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 started sync module instance, tier type = 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.129+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61fd80 con 0x7fdf6c0ef060 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94313713369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61fd80 con 0x7fdf6c0ef060 2024-02-18T16:22:24.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f6215e0 con 0x55c71f615c50 2024-02-18T16:22:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94313713369392] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94313713373440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61fd80 con 0x55c71f615c50 2024-02-18T16:22:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.133+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f621fd0 con 0x55c71f61ba10 2024-02-18T16:22:24.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94313713373440] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94313713367264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61fd00 con 0x55c71f61ba10 2024-02-18T16:22:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f622cc0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94313713379632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f623510 con 0x7fdf6c0ef060 2024-02-18T16:22:24.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f623f10 con 0x55c71f615c50 2024-02-18T16:22:24.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94313713367264] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.137+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94313713379632] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94313713383952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f623070 con 0x55c71f615c50 2024-02-18T16:22:24.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f624760 con 0x7fdf700141d0 2024-02-18T16:22:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94313713383952] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94313713378176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f623070 con 0x7fdf700141d0 2024-02-18T16:22:24.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.141+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f624c30 con 0x7fdf700141d0 2024-02-18T16:22:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94313713378176] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94313713387312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f624bf0 con 0x7fdf700141d0 2024-02-18T16:22:24.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f625660 con 0x7fdf700141d0 2024-02-18T16:22:24.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94313713387312] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94313713385632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f625620 con 0x7fdf700141d0 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=0 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=1 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=2 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=3 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=4 2024-02-18T16:22:24.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=5 2024-02-18T16:22:24.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.145+0000 7fdf7a290980 20 add_watcher() i=6 2024-02-18T16:22:24.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94313713385632] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 20 add_watcher() i=7 2024-02-18T16:22:24.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:24.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f628a40 con 0x55c71f615c50 2024-02-18T16:22:24.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94313713390416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f625f10 con 0x55c71f615c50 2024-02-18T16:22:24.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94313713390416] v32'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fde2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 5 note: GC not initialized 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fde2cfe1640 20 reqs_thread_entry: start 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 20 Filter name: none 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdda67fc640 20 reqs_thread_entry: start 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.149+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f64a4e0 con 0x55c71f615c50 2024-02-18T16:22:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf7a290980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f64a4e0 con 0x7fdf700141d0 2024-02-18T16:22:24.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fde2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:24.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94313713390416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f64a4e0 con 0x55c71f615c50 2024-02-18T16:22:24.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94313713390416] v32'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.161 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.153+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94313713369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f64a4e0 con 0x7fdf6c0ef060 2024-02-18T16:22:24.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94313713369392] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf7a290980 20 remove_watcher() i=0 2024-02-18T16:22:24.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf7a290980 2 removed watcher, disabling cache 2024-02-18T16:22:24.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94313713373440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f64a4e0 con 0x55c71f615c50 2024-02-18T16:22:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94313713373440] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf7a290980 20 remove_watcher() i=1 2024-02-18T16:22:24.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.157+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94313713367264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f64a4e0 con 0x55c71f61ba10 2024-02-18T16:22:24.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.161+0000 7fdf775aa640 1 -- 172.21.15.129:0/29323854 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94313713367264] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b2300 con 0x55c71f61ba10 2024-02-18T16:22:24.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.161+0000 7fdf7a290980 20 remove_watcher() i=2 2024-02-18T16:22:24.167 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.161+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94313713379632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f621100 con 0x7fdf6c0ef060 2024-02-18T16:22:24.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.161+0000 7fdf785ac640 1 -- 172.21.15.129:0/29323854 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94313713379632] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7003a040 con 0x7fdf6c0ef060 2024-02-18T16:22:24.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.161+0000 7fdf7a290980 20 remove_watcher() i=3 2024-02-18T16:22:24.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.161+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94313713383952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61f8e0 con 0x55c71f615c50 2024-02-18T16:22:24.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.165+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94313713383952] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x55c71f615c50 2024-02-18T16:22:24.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.165+0000 7fdf7a290980 20 remove_watcher() i=4 2024-02-18T16:22:24.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.165+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94313713378176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f621100 con 0x7fdf700141d0 2024-02-18T16:22:24.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.165+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94313713378176] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.165+0000 7fdf7a290980 20 remove_watcher() i=5 2024-02-18T16:22:24.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.165+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94313713387312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f623a10 con 0x7fdf700141d0 2024-02-18T16:22:24.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94313713387312] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 20 remove_watcher() i=6 2024-02-18T16:22:24.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94313713385632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c71f61f8e0 con 0x7fdf700141d0 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94313713385632] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf68039080 con 0x7fdf700141d0 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 20 remove_watcher() i=7 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdf700141d0 msgr2=0x7fdf70015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdf700141d0 0x7fdf70015940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f615c50 msgr2=0x55c71f6180f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f615c50 0x55c71f6180f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdf6c0ef060 msgr2=0x7fdf6c006590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdf6c0ef060 0x7fdf6c006590 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c71f61ba10 msgr2=0x55c71f61de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55c71f61ba10 0x55c71f61de20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde400342b0 msgr2=0x7fde40036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde400342b0 0x7fde40036770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf70011010 tx=0x7fdf70020000 comp rx=0 tx=0).stop 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 msgr2=0x55c71f60a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf77dab640 1 -- 172.21.15.129:0/29323854 reap_dead start 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f60a6d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0bdfd0 tx=0x7fdf6c0e3d70 comp rx=0 tx=0).stop 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 shutdown_connections 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 --2- 172.21.15.129:0/29323854 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f603850 0x55c71f60a6d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 >> 172.21.15.129:0/29323854 conn(0x55c71f5ffb90 msgr2=0x55c71f5fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 shutdown_connections 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.169+0000 7fdf7a290980 1 -- 172.21.15.129:0/29323854 wait complete. 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde500342b0 msgr2=0x7fde50036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde500342b0 0x7fde50036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55c71f5e6d90 tx=0x7fdf70005850 comp rx=0 tx=0).stop 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 msgr2=0x55c71f5f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 0x55c71f5f6c10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c096d70 tx=0x7fdf6c018020 comp rx=0 tx=0).stop 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 shutdown_connections 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde500342b0 0x7fde50036770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/1170082064 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f5f67f0 0x55c71f5f6c10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 >> 172.21.15.129:0/1170082064 conn(0x55c71f5eb600 msgr2=0x55c71f5ec110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 shutdown_connections 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/1170082064 wait complete. 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f4629f0 msgr2=0x55c71f5e5f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f4629f0 0x55c71f5e5f50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde600342b0 msgr2=0x7fde60036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde600342b0 0x7fde60036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0ac000 tx=0x7fdf6c0a5000 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 msgr2=0x55c71f5df2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5df2c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b710 tx=0x7fdf68000bd0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 shutdown_connections 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55c71f4629f0 0x55c71f5e5f50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fde600342b0 0x7fde60036770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 --2- 172.21.15.129:0/392858684 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55c71f4616b0 0x55c71f5df2c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 >> 172.21.15.129:0/392858684 conn(0x55c71f4e7a10 msgr2=0x55c71f5d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 shutdown_connections 2024-02-18T16:22:24.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.173+0000 7fdf7a290980 1 -- 172.21.15.129:0/392858684 wait complete. 2024-02-18T16:22:24.188 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-02-18T16:00:00.000000Z","epoch":1708272000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-02-18T16:22:24.189 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-02-18T16:00:00.000000Z', 'epoch': 1708272000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-02-18T16:22:24.189 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-18T16:22:24.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-18T16:22:24.189 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-02-18T16:22:24.270 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:24.270 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70bcc26980 1 Processor -- start 2024-02-18T16:22:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70bcc26980 1 -- start start 2024-02-18T16:22:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70bcc26980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5647d5006390 0x5647d5006770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70bcc26980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5647d4f50460 con 0x5647d5006cb0 2024-02-18T16:22:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70bcc26980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5647d4f17180 con 0x5647d5006390 2024-02-18T16:22:24.271 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70ba741640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5647d5006390 0x5647d5006770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70b9f40640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5647d5006cb0 0x5647d5007660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43208/0 (socket says 172.21.15.129:43208) 2024-02-18T16:22:24.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70b9f40640 1 -- 172.21.15.129:0/2723971491 learned_addr learned my addr 172.21.15.129:0/2723971491 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:24.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70ba741640 1 -- 172.21.15.129:0/2723971491 >> v1:172.21.15.80:6789/0 conn(0x5647d5006cb0 legacy=0x5647d5007660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.272 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.265+0000 7f70ba741640 1 -- 172.21.15.129:0/2723971491 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d5007e90 con 0x5647d5006390 2024-02-18T16:22:24.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70ba741640 1 --2- 172.21.15.129:0/2723971491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d5006770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a420 tx=0x7f70ac01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4734e2e5a566567a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70b973f640 1 -- 172.21.15.129:0/2723971491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0aa530 con 0x5647d5006390 2024-02-18T16:22:24.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70b973f640 1 -- 172.21.15.129:0/2723971491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0a6050 con 0x5647d5006390 2024-02-18T16:22:24.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70b973f640 1 -- 172.21.15.129:0/2723971491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0aa800 con 0x5647d5006390 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 -- 172.21.15.129:0/2723971491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 msgr2=0x5647d5006770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2723971491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d5006770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a420 tx=0x7f70ac01afd0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 -- 172.21.15.129:0/2723971491 shutdown_connections 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2723971491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d5006770 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 -- 172.21.15.129:0/2723971491 >> 172.21.15.129:0/2723971491 conn(0x5647d4f79a80 msgr2=0x5647d4f79e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 -- 172.21.15.129:0/2723971491 shutdown_connections 2024-02-18T16:22:24.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.269+0000 7f70bcc26980 1 -- 172.21.15.129:0/2723971491 wait complete. 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 Processor -- start 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- start start 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d4f146b0 con 0x5647d5006390 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44120/0 (socket says 172.21.15.129:44120) 2024-02-18T16:22:24.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 -- 172.21.15.129:0/1660134194 learned_addr learned my addr 172.21.15.129:0/1660134194 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 -- 172.21.15.129:0/1660134194 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac00a100 con 0x5647d5006390 2024-02-18T16:22:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 --2- 172.21.15.129:0/1660134194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f0990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a420 tx=0x7f70ac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8ec9ad9c7ab645 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f6fa8608640 1 -- 172.21.15.129:0/1660134194 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0aa6c0 con 0x5647d5006390 2024-02-18T16:22:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f6fa8608640 1 -- 172.21.15.129:0/1660134194 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0aa820 con 0x5647d5006390 2024-02-18T16:22:24.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f6fa8608640 1 -- 172.21.15.129:0/1660134194 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0aaae0 con 0x5647d5006390 2024-02-18T16:22:24.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- 172.21.15.129:0/1660134194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 msgr2=0x5647d50f0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 --2- 172.21.15.129:0/1660134194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f0990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a420 tx=0x7f70ac0033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- 172.21.15.129:0/1660134194 shutdown_connections 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 --2- 172.21.15.129:0/1660134194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f0990 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- 172.21.15.129:0/1660134194 >> 172.21.15.129:0/1660134194 conn(0x5647d4f79a80 msgr2=0x5647d50ec520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- 172.21.15.129:0/1660134194 shutdown_connections 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- 172.21.15.129:0/1660134194 wait complete. 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 Processor -- start 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- start start 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70bcc26980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d4f0fe90 con 0x5647d5006390 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44126/0 (socket says 172.21.15.129:44126) 2024-02-18T16:22:24.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.285+0000 7f70ba741640 1 -- 172.21.15.129:0/2074227155 learned_addr learned my addr 172.21.15.129:0/2074227155 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70ba741640 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d5007e90 con 0x5647d5006390 2024-02-18T16:22:24.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70ba741640 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f7640 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f70ac003430 tx=0x7f70ac019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f6fa6e05640 1 -- 172.21.15.129:0/2074227155 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0b6950 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647d50f7b80 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647d50f7fb0 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f6fa6e05640 1 -- 172.21.15.129:0/2074227155 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0b6ab0 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f6fa6e05640 1 -- 172.21.15.129:0/2074227155 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0b6d50 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f6fa6e05640 1 -- 172.21.15.129:0/2074227155 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70ac0b4400 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f6fa6e05640 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6fa0034300 0x7f6fa00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f6fa6e05640 1 -- 172.21.15.129:0/2074227155 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70ac0e38d0 con 0x5647d5006390 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6fa0034300 0x7f6fa00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d5006cb0 0x5647d50fe270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d50fe7b0 con 0x5647d5006cb0 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70baf42640 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d5006cb0 0x5647d50fe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6fa0034300 0x7f6fa00367c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000f70 tx=0x7f70a40012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70baf42640 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d5006cb0 0x5647d50fe270 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70baf42640 1 -- 172.21.15.129:0/2074227155 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70b40083f0 con 0x5647d5006cb0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d50feb30 con 0x5647d5006cb0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70baf42640 1 -- 172.21.15.129:0/2074227155 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f70b40083f0 con 0x5647d5006cb0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.289+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d51003e0 con 0x5647d5006cb0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70baf42640 1 -- 172.21.15.129:0/2074227155 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f70b40083f0 con 0x5647d5006cb0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d50ff5e0 con 0x5647d5006cb0 2024-02-18T16:22:24.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70baf42640 1 -- 172.21.15.129:0/2074227155 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f70b40083f0 con 0x5647d5006cb0 2024-02-18T16:22:24.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d50ff9f0 con 0x5647d5006cb0 2024-02-18T16:22:24.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70baf42640 1 -- 172.21.15.129:0/2074227155 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f70b4012040 con 0x5647d5006cb0 2024-02-18T16:22:24.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 Processor -- start 2024-02-18T16:22:24.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 -- start start 2024-02-18T16:22:24.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 0x5647d510ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d4ea8f20 con 0x5647d510eae0 2024-02-18T16:22:24.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70b9f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 0x5647d510ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70b9f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 0x5647d510ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44142/0 (socket says 172.21.15.129:44142) 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70b9f40640 1 -- 172.21.15.129:0/2680599651 learned_addr learned my addr 172.21.15.129:0/2680599651 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70b9f40640 1 -- 172.21.15.129:0/2680599651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d510f440 con 0x5647d510eae0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 0x5647d510ef00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f70a4001ee0 tx=0x7f70a400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f6f9ffff640 1 -- 172.21.15.129:0/2680599651 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70a4020070 con 0x5647d510eae0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f6f9ffff640 1 -- 172.21.15.129:0/2680599651 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400c770 con 0x5647d510eae0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f6f9ffff640 1 -- 172.21.15.129:0/2680599651 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70a4013040 con 0x5647d510eae0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647d510f690 con 0x5647d510eae0 2024-02-18T16:22:24.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.293+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647d51101e0 con 0x5647d510eae0 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f6f9ffff640 1 -- 172.21.15.129:0/2680599651 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70a400a040 con 0x5647d510eae0 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f6f9ffff640 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f94034370 0x7f6f94036830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f6f9ffff640 1 -- 172.21.15.129:0/2680599651 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70a404b750 con 0x5647d510eae0 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70baf42640 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f94034370 0x7f6f94036830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 Processor -- start 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- start start 2024-02-18T16:22:24.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d511bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d4e9c790 con 0x5647d511bb20 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70baf42640 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f94034370 0x7f6f94036830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5647d50ff020 tx=0x7f70b4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d511bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d511bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44150/0 (socket says 172.21.15.129:44150) 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 -- 172.21.15.129:0/4170250672 learned_addr learned my addr 172.21.15.129:0/4170250672 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 -- 172.21.15.129:0/4170250672 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d511c4d0 con 0x5647d511bb20 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 --2- 172.21.15.129:0/4170250672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d511bf00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f70a4049ad0 tx=0x7f70a4019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1c2513bb1f7883 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f6f9dffb640 1 -- 172.21.15.129:0/4170250672 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70a4048070 con 0x5647d511bb20 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f6f9dffb640 1 -- 172.21.15.129:0/4170250672 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a401b7a0 con 0x5647d511bb20 2024-02-18T16:22:24.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f6f9dffb640 1 -- 172.21.15.129:0/4170250672 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70a4019320 con 0x5647d511bb20 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- 172.21.15.129:0/4170250672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 msgr2=0x5647d511bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 --2- 172.21.15.129:0/4170250672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d511bf00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f70a4049ad0 tx=0x7f70a4019a70 comp rx=0 tx=0).stop 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- 172.21.15.129:0/4170250672 shutdown_connections 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 --2- 172.21.15.129:0/4170250672 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d511bf00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- 172.21.15.129:0/4170250672 >> 172.21.15.129:0/4170250672 conn(0x5647d5117e60 msgr2=0x5647d5115ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- 172.21.15.129:0/4170250672 shutdown_connections 2024-02-18T16:22:24.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- 172.21.15.129:0/4170250672 wait complete. 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 Processor -- start 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- start start 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d5122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70bcc26980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d5122f70 con 0x5647d511bb20 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d5122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d5122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44156/0 (socket says 172.21.15.129:44156) 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.297+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 learned_addr learned my addr 172.21.15.129:0/2923533936 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d51101e0 con 0x5647d511bb20 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d5122a30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f70a4019b40 tx=0x7f70a4049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f6f8bfff640 1 -- 172.21.15.129:0/2923533936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70a4024ea0 con 0x5647d511bb20 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647d5123170 con 0x5647d511bb20 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f6f8bfff640 1 -- 172.21.15.129:0/2923533936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4025cd0 con 0x5647d511bb20 2024-02-18T16:22:24.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f6f8bfff640 1 -- 172.21.15.129:0/2923533936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70a400ca50 con 0x5647d511bb20 2024-02-18T16:22:24.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647d51235a0 con 0x5647d511bb20 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f6f8bfff640 1 -- 172.21.15.129:0/2923533936 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70a4042050 con 0x5647d511bb20 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f6f8bfff640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f840342b0 0x7f6f84036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f6f8bfff640 1 -- 172.21.15.129:0/2923533936 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f70a4038d20 con 0x5647d511bb20 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70baf42640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f840342b0 0x7f6f84036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d512df70 0x5647d5130430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5130b80 con 0x5647d512df70 2024-02-18T16:22:24.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70ba741640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d512df70 0x5647d5130430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70baf42640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f840342b0 0x7f6f84036770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70b4008fd0 tx=0x7f70b401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70ba741640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d512df70 0x5647d5130430 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 realm 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5130f50 con 0x5647d512df70 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d51317d0 con 0x5647d512df70 2024-02-18T16:22:24.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.301+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5131b30 con 0x5647d512df70 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5132330 con 0x5647d512df70 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:24.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 20 searching for the correct realm 2024-02-18T16:22:24.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5647d51341c0 0x5647d5136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5647d51341c0 0x5647d5136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5647d51341c0 0x5647d5136630 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70b9f40640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f70a4037020 0x7f70a401d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70baf42640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f70a4037020 0x7f70a401d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70baf42640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f70a4037020 0x7f70a401d0d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b402c040 con 0x7f70a4037020 2024-02-18T16:22:24.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70baf42640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f70b4027940 0x7f70b40333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70ba741640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f70b4027940 0x7f70b40333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.305+0000 7f70ba741640 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f70b4027940 0x7f70b40333c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x7f70b4027940 2024-02-18T16:22:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x7f70b4027940 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x7f70b4027940 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b402c040 con 0x7f70a4037020 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x7f70b4027940 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.309+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f70b402c040 con 0x7f70a4037020 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x7f70b4027940 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f70ac0c5070 con 0x5647d512df70 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.333 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.313+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b402c040 con 0x7f70a4037020 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b402c040 con 0x7f70a4037020 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70b4027940 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b402c040 con 0x7f70a4037020 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d51341c0 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x5647d512df70 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5136d00 con 0x7f70a4037020 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:24.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5132c30 con 0x5647d512df70 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5133480 con 0x5647d512df70 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.317+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5137140 con 0x5647d512df70 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 zone default found 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 4 Realm: () 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 zonegroup default 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5137180 con 0x7f70a4037020 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5138f60 con 0x5647d51341c0 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.337 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5139360 con 0x5647d51341c0 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 started sync module instance, tier type = 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5138840 con 0x7f70a4037020 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94866517492640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5138bf0 con 0x7f70a4037020 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513a0c0 con 0x5647d512df70 2024-02-18T16:22:24.338 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.321+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94866517492640] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94866517497728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513a040 con 0x5647d512df70 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513aa90 con 0x5647d51341c0 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94866517497728] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94866517498784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5139fc0 con 0x5647d51341c0 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.325+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513b780 con 0x7f70a4037020 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94866517505040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513c000 con 0x7f70a4037020 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513ca30 con 0x5647d512df70 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94866517498784] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94866517505040] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94866517509424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513bb60 con 0x5647d512df70 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.329+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513d280 con 0x7f70b4027940 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94866517509424] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94866517503552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513bb60 con 0x7f70b4027940 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513d760 con 0x7f70b4027940 2024-02-18T16:22:24.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94866517503552] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94866517512768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513d720 con 0x7f70b4027940 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.333+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e090 con 0x7f70b4027940 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94866517515248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e4f0 con 0x7f70b4027940 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=0 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=1 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=2 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=3 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=4 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=5 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94866517512768] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.344 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=6 2024-02-18T16:22:24.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94866517515248] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 20 add_watcher() i=7 2024-02-18T16:22:24.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:24.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513cc30 con 0x5647d512df70 2024-02-18T16:22:24.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.337+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94866517516304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513cc30 con 0x5647d512df70 2024-02-18T16:22:24.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94866517516304] v32'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f6f70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:24.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:24.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:24.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 5 note: GC not initialized 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f6eeb7fe640 20 reqs_thread_entry: start 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 Filter name: none 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f6ee97fa640 20 reqs_thread_entry: start 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d51634f0 con 0x7f70b4027940 2024-02-18T16:22:24.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5161cc0 con 0x5647d512df70 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-18T16:22:24.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.341+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d51620c0 con 0x7f70b4027940 2024-02-18T16:22:24.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~346] v32'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70bcc26980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-18T16:22:24.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70bcc26980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-18T16:22:24.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70bcc26980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-18T16:22:24.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94866517667664 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5162920 con 0x7f70b4027940 2024-02-18T16:22:24.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== watch-notify(notify (1) cookie 94866517515248 notify 137438953486 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x5647d50f7fb0 con 0x7f70b4027940 2024-02-18T16:22:24.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(65 notify.7 [notify cookie 94866517667664 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f6f9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94866517515248 notifier 4720 bl.length()=522 2024-02-18T16:22:24.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f6f9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-18T16:22:24.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f6f9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-18T16:22:24.353 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.345+0000 7f6f9dffb640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6f80003ea0 con 0x7f70b4027940 2024-02-18T16:22:24.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== watch-notify(notify_complete (2) cookie 94866517667664 notify 137438953486 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5647d50f7b80 con 0x7f70b4027940 2024-02-18T16:22:24.354 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5162920 con 0x5647d512df70 2024-02-18T16:22:24.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70bcc26980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-18T16:22:24.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70bcc26980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-18T16:22:24.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70bcc26980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-18T16:22:24.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94866517667664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5166940 con 0x7f70b4027940 2024-02-18T16:22:24.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== watch-notify(notify (1) cookie 94866517503552 notify 137438953487 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5647d50f7b80 con 0x7f70b4027940 2024-02-18T16:22:24.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f6f9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94866517503552 notifier 4720 bl.length()=177 2024-02-18T16:22:24.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f6f9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-18T16:22:24.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f6f9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-18T16:22:24.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f6f9dffb640 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6f80003ea0 con 0x7f70b4027940 2024-02-18T16:22:24.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(68 notify.5 [notify cookie 94866517667664 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== watch-notify(notify_complete (2) cookie 94866517667664 notify 137438953487 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5647d5007e90 con 0x7f70b4027940 2024-02-18T16:22:24.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.349+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.358 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:22:24.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f6f70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:24.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94866517516304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d51438c0 con 0x5647d512df70 2024-02-18T16:22:24.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94866517516304] v32'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94866517492640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e010 con 0x7f70a4037020 2024-02-18T16:22:24.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94866517492640] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70bcc26980 20 remove_watcher() i=0 2024-02-18T16:22:24.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70bcc26980 2 removed watcher, disabling cache 2024-02-18T16:22:24.361 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.353+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94866517497728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e010 con 0x5647d512df70 2024-02-18T16:22:24.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.357+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94866517497728] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.357+0000 7f70bcc26980 20 remove_watcher() i=1 2024-02-18T16:22:24.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.357+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94866517498784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d5139780 con 0x5647d51341c0 2024-02-18T16:22:24.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.357+0000 7f70b9f40640 1 -- 172.21.15.129:0/2923533936 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94866517498784] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70a4034070 con 0x5647d51341c0 2024-02-18T16:22:24.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.357+0000 7f70bcc26980 20 remove_watcher() i=2 2024-02-18T16:22:24.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.357+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94866517505040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e010 con 0x7f70a4037020 2024-02-18T16:22:24.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.361+0000 7f70baf42640 1 -- 172.21.15.129:0/2923533936 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94866517505040] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70b403f040 con 0x7f70a4037020 2024-02-18T16:22:24.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.361+0000 7f70bcc26980 20 remove_watcher() i=3 2024-02-18T16:22:24.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.361+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94866517509424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e010 con 0x5647d512df70 2024-02-18T16:22:24.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.361+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94866517509424] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x5647d512df70 2024-02-18T16:22:24.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.361+0000 7f70bcc26980 20 remove_watcher() i=4 2024-02-18T16:22:24.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.361+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94866517503552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513c530 con 0x7f70b4027940 2024-02-18T16:22:24.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.365+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94866517503552] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.365+0000 7f70bcc26980 20 remove_watcher() i=5 2024-02-18T16:22:24.371 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.365+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94866517512768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513e010 con 0x7f70b4027940 2024-02-18T16:22:24.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.365+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94866517512768] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.365+0000 7f70bcc26980 20 remove_watcher() i=6 2024-02-18T16:22:24.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.365+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94866517515248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5647d513c530 con 0x7f70b4027940 2024-02-18T16:22:24.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94866517515248] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f70ac0e9040 con 0x7f70b4027940 2024-02-18T16:22:24.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 20 remove_watcher() i=7 2024-02-18T16:22:24.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f70b4027940 msgr2=0x7f70b40333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f70b4027940 0x7f70b40333c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d512df70 msgr2=0x5647d5130430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d512df70 0x5647d5130430 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f70a4037020 msgr2=0x7f70a401d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f70a4037020 0x7f70a401d0d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5647d51341c0 msgr2=0x5647d5136630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5647d51341c0 0x5647d5136630 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f840342b0 msgr2=0x7f6f84036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f840342b0 0x7f6f84036770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70b4008fd0 tx=0x7f70b401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 msgr2=0x5647d5122a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70ba741640 1 -- 172.21.15.129:0/2923533936 reap_dead start 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d5122a30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f70a4019b40 tx=0x7f70a4049a30 comp rx=0 tx=0).stop 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 shutdown_connections 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2923533936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d511bb20 0x5647d5122a30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 >> 172.21.15.129:0/2923533936 conn(0x5647d5117e60 msgr2=0x5647d51154c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 shutdown_connections 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2923533936 wait complete. 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f94034370 msgr2=0x7f6f94036830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f94034370 0x7f6f94036830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5647d50ff020 tx=0x7f70b4003070 comp rx=0 tx=0).stop 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 msgr2=0x5647d510ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 0x5647d510ef00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f70a4001ee0 tx=0x7f70a400da30 comp rx=0 tx=0).stop 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 shutdown_connections 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6f94034370 0x7f6f94036830 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2680599651 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d510eae0 0x5647d510ef00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 >> 172.21.15.129:0/2680599651 conn(0x5647d51038f0 msgr2=0x5647d5104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 shutdown_connections 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2680599651 wait complete. 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d5006cb0 msgr2=0x5647d50fe270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d5006cb0 0x5647d50fe270 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6fa0034300 msgr2=0x7f6fa00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6fa0034300 0x7f6fa00367c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000f70 tx=0x7f70a40012c0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 msgr2=0x5647d50f7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f7640 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f70ac003430 tx=0x7f70ac019810 comp rx=0 tx=0).stop 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 shutdown_connections 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5647d5006cb0 0x5647d50fe270 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6fa0034300 0x7f6fa00367c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 --2- 172.21.15.129:0/2074227155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5647d5006390 0x5647d50f7640 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 >> 172.21.15.129:0/2074227155 conn(0x5647d4f79a80 msgr2=0x5647d50eb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 shutdown_connections 2024-02-18T16:22:24.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.369+0000 7f70bcc26980 1 -- 172.21.15.129:0/2074227155 wait complete. 2024-02-18T16:22:24.388 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:22:24.407 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:22:24.415 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-02-18T16:22:24.415 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-18T16:22:24.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-18T16:22:24.416 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-02-18T16:22:24.464 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:24.464 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:24.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.457+0000 7f3c30653980 1 Processor -- start 2024-02-18T16:22:24.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.457+0000 7f3c30653980 1 -- start start 2024-02-18T16:22:24.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.457+0000 7f3c30653980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5622db400360 0x5622db400740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.457+0000 7f3c30653980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5622db34a4d0 con 0x5622db400c80 2024-02-18T16:22:24.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.457+0000 7f3c30653980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5622db311180 con 0x5622db400360 2024-02-18T16:22:24.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2e16e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5622db400360 0x5622db400740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2d96d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5622db400c80 0x5622db401630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:43222/0 (socket says 172.21.15.129:43222) 2024-02-18T16:22:24.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2d96d640 1 -- 172.21.15.129:0/4126598288 learned_addr learned my addr 172.21.15.129:0/4126598288 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:24.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2e16e640 1 -- 172.21.15.129:0/4126598288 >> v1:172.21.15.80:6789/0 conn(0x5622db400c80 legacy=0x5622db401630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2e16e640 1 -- 172.21.15.129:0/4126598288 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622db401e60 con 0x5622db400360 2024-02-18T16:22:24.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/4126598288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db400740 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800a480 tx=0x7f3c2801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9673e25cca576bc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2d16c640 1 -- 172.21.15.129:0/4126598288 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c280ab540 con 0x5622db400360 2024-02-18T16:22:24.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2d16c640 1 -- 172.21.15.129:0/4126598288 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c280ab6a0 con 0x5622db400360 2024-02-18T16:22:24.469 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c2d16c640 1 -- 172.21.15.129:0/4126598288 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c280ab960 con 0x5622db400360 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c30653980 1 -- 172.21.15.129:0/4126598288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 msgr2=0x5622db400740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c30653980 1 --2- 172.21.15.129:0/4126598288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db400740 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800a480 tx=0x7f3c2801b280 comp rx=0 tx=0).stop 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c30653980 1 -- 172.21.15.129:0/4126598288 shutdown_connections 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c30653980 1 --2- 172.21.15.129:0/4126598288 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db400740 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c30653980 1 -- 172.21.15.129:0/4126598288 >> 172.21.15.129:0/4126598288 conn(0x5622db373a50 msgr2=0x5622db373e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.461+0000 7f3c30653980 1 -- 172.21.15.129:0/4126598288 shutdown_connections 2024-02-18T16:22:24.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.465+0000 7f3c30653980 1 -- 172.21.15.129:0/4126598288 wait complete. 2024-02-18T16:22:24.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c30653980 1 Processor -- start 2024-02-18T16:22:24.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c30653980 1 -- start start 2024-02-18T16:22:24.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c30653980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c30653980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622db30e6b0 con 0x5622db400360 2024-02-18T16:22:24.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c2e16e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c2e16e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44180/0 (socket says 172.21.15.129:44180) 2024-02-18T16:22:24.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.477+0000 7f3c2e16e640 1 -- 172.21.15.129:0/2596834603 learned_addr learned my addr 172.21.15.129:0/2596834603 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 -- 172.21.15.129:0/2596834603 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28005d30 con 0x5622db400360 2024-02-18T16:22:24.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/2596834603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4ea8a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3c28018eb0 tx=0x7f3c28003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb65936305cc0736 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3b1c608640 1 -- 172.21.15.129:0/2596834603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c280ab810 con 0x5622db400360 2024-02-18T16:22:24.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3b1c608640 1 -- 172.21.15.129:0/2596834603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c280ab970 con 0x5622db400360 2024-02-18T16:22:24.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3b1c608640 1 -- 172.21.15.129:0/2596834603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c280abc30 con 0x5622db400360 2024-02-18T16:22:24.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- 172.21.15.129:0/2596834603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 msgr2=0x5622db4ea8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 --2- 172.21.15.129:0/2596834603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4ea8a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3c28018eb0 tx=0x7f3c28003030 comp rx=0 tx=0).stop 2024-02-18T16:22:24.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- 172.21.15.129:0/2596834603 shutdown_connections 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 --2- 172.21.15.129:0/2596834603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4ea8a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- 172.21.15.129:0/2596834603 >> 172.21.15.129:0/2596834603 conn(0x5622db373a50 msgr2=0x5622db4e6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- 172.21.15.129:0/2596834603 shutdown_connections 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- 172.21.15.129:0/2596834603 wait complete. 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 Processor -- start 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- start start 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622db309e90 con 0x5622db400360 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44192/0 (socket says 172.21.15.129:44192) 2024-02-18T16:22:24.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 -- 172.21.15.129:0/807057763 learned_addr learned my addr 172.21.15.129:0/807057763 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622db401e60 con 0x5622db400360 2024-02-18T16:22:24.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4f1550 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3c2801b2c0 tx=0x7f3c28018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3b1ae05640 1 -- 172.21.15.129:0/807057763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c280c3070 con 0x5622db400360 2024-02-18T16:22:24.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622db4f1a90 con 0x5622db400360 2024-02-18T16:22:24.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3b1ae05640 1 -- 172.21.15.129:0/807057763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c280beaa0 con 0x5622db400360 2024-02-18T16:22:24.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.481+0000 7f3b1ae05640 1 -- 172.21.15.129:0/807057763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c280bed40 con 0x5622db400360 2024-02-18T16:22:24.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622db4f1ec0 con 0x5622db400360 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3b1ae05640 1 -- 172.21.15.129:0/807057763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c280b2070 con 0x5622db400360 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3b1ae05640 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b140342b0 0x7f3b14036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3b1ae05640 1 -- 172.21.15.129:0/807057763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3c280e39f0 con 0x5622db400360 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b140342b0 0x7f3b14036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db400c80 0x5622db4f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db4f86c0 con 0x5622db400c80 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db400c80 0x5622db4f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b140342b0 0x7f3b14036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000f70 tx=0x7f3c240012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db400c80 0x5622db4f8180 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 -- 172.21.15.129:0/807057763 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c2000a4d0 con 0x5622db400c80 2024-02-18T16:22:24.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db4f8a20 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 -- 172.21.15.129:0/807057763 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c2000a4d0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db4fa2a0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 -- 172.21.15.129:0/807057763 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3c2000a4d0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db4f94a0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 -- 172.21.15.129:0/807057763 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c2000a4d0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db4f98b0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.485+0000 7f3c2e96f640 1 -- 172.21.15.129:0/807057763 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3c2000a4d0 con 0x5622db400c80 2024-02-18T16:22:24.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c30653980 1 Processor -- start 2024-02-18T16:22:24.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c30653980 1 -- start start 2024-02-18T16:22:24.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c30653980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 0x5622db508da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c30653980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622db2a2f20 con 0x5622db508980 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c2d96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 0x5622db508da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c2d96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 0x5622db508da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44206/0 (socket says 172.21.15.129:44206) 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c2d96d640 1 -- 172.21.15.129:0/2494772593 learned_addr learned my addr 172.21.15.129:0/2494772593 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c2d96d640 1 -- 172.21.15.129:0/2494772593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622db5092e0 con 0x5622db508980 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 0x5622db508da0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3c24001ee0 tx=0x7f3c2400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3b13fff640 1 -- 172.21.15.129:0/2494772593 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24020070 con 0x5622db508980 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3b13fff640 1 -- 172.21.15.129:0/2494772593 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2400c770 con 0x5622db508980 2024-02-18T16:22:24.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3b13fff640 1 -- 172.21.15.129:0/2494772593 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24013040 con 0x5622db508980 2024-02-18T16:22:24.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622db509530 con 0x5622db508980 2024-02-18T16:22:24.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622db50a080 con 0x5622db508980 2024-02-18T16:22:24.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.489+0000 7f3b13fff640 1 -- 172.21.15.129:0/2494772593 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c2400a040 con 0x5622db508980 2024-02-18T16:22:24.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3b13fff640 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b080342b0 0x7f3b08036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3b13fff640 1 -- 172.21.15.129:0/2494772593 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3c2404b750 con 0x5622db508980 2024-02-18T16:22:24.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b080342b0 0x7f3b08036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 Processor -- start 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- start start 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b080342b0 0x7f3b08036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5622db4f8ee0 tx=0x7f3c20005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db515d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622db296790 con 0x5622db515900 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db515d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db515d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44216/0 (socket says 172.21.15.129:44216) 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 -- 172.21.15.129:0/2965782890 learned_addr learned my addr 172.21.15.129:0/2965782890 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 -- 172.21.15.129:0/2965782890 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622db5162f0 con 0x5622db515900 2024-02-18T16:22:24.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/2965782890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db515d20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3c24049aa0 tx=0x7f3c240198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8d9573ea67ed72 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3b11ffb640 1 -- 172.21.15.129:0/2965782890 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c24048070 con 0x5622db515900 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3b11ffb640 1 -- 172.21.15.129:0/2965782890 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2403a2b0 con 0x5622db515900 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3b11ffb640 1 -- 172.21.15.129:0/2965782890 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2403a440 con 0x5622db515900 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- 172.21.15.129:0/2965782890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 msgr2=0x5622db515d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 --2- 172.21.15.129:0/2965782890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db515d20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3c24049aa0 tx=0x7f3c240198d0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- 172.21.15.129:0/2965782890 shutdown_connections 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 --2- 172.21.15.129:0/2965782890 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db515d20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- 172.21.15.129:0/2965782890 >> 172.21.15.129:0/2965782890 conn(0x5622db511c90 msgr2=0x5622db50fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- 172.21.15.129:0/2965782890 shutdown_connections 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- 172.21.15.129:0/2965782890 wait complete. 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 Processor -- start 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- start start 2024-02-18T16:22:24.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db51c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c30653980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622db51cd10 con 0x5622db515900 2024-02-18T16:22:24.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db51c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db51c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:44224/0 (socket says 172.21.15.129:44224) 2024-02-18T16:22:24.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.493+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 learned_addr learned my addr 172.21.15.129:0/1819580612 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:24.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622db50a080 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db51c7d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3c240199a0 tx=0x7f3c24049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3afffff640 1 -- 172.21.15.129:0/1819580612 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c2404b410 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3afffff640 1 -- 172.21.15.129:0/1819580612 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2404b570 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622db51cf10 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3afffff640 1 -- 172.21.15.129:0/1819580612 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c240481e0 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622db51d3a0 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3afffff640 1 -- 172.21.15.129:0/1819580612 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3c24048340 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3afffff640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3af80342b0 0x7f3af8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3afffff640 1 -- 172.21.15.129:0/1819580612 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f3c24039d70 con 0x5622db515900 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3af80342b0 0x7f3af8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db527da0 0x5622db52a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52a9b0 con 0x5622db527da0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db527da0 0x5622db52a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3af80342b0 0x7f3af8036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3c20011010 tx=0x7f3c20020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db527da0 0x5622db52a260 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 realm 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52ad80 con 0x5622db527da0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:24.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52b600 con 0x5622db527da0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.497+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52b960 con 0x5622db527da0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52c160 con 0x5622db527da0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 20 searching for the correct realm 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622db52e010 0x5622db5304d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622db52e010 0x5622db5304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622db52e010 0x5622db5304d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2d96d640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3c24038070 0x7f3c2401f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3c24038070 0x7f3c2401f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3c24038070 0x7f3c2401f130 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2000a4d0 con 0x7f3c24038070 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e96f640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3c200141d0 0x7f3c20015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:24.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3c200141d0 0x7f3c20015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.501+0000 7f3c2e16e640 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3c200141d0 0x7f3c20015940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2000a4d0 con 0x7f3c24038070 2024-02-18T16:22:24.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.505+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.509+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.520 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c200141d0 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c280aabd0 con 0x7f3c200141d0 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db52e010 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x5622db527da0 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.524 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530ba0 con 0x7f3c24038070 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52ca60 con 0x5622db527da0 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c280aabd0 con 0x5622db527da0 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.513+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52d2b0 con 0x5622db527da0 2024-02-18T16:22:24.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db530fe0 con 0x5622db527da0 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 zone default found 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 4 Realm: () 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 zonegroup default 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db531000 con 0x7f3c24038070 2024-02-18T16:22:24.526 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db532de0 con 0x5622db52e010 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5331e0 con 0x5622db52e010 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 started sync module instance, tier type = 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:24.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5326c0 con 0x7f3c24038070 2024-02-18T16:22:24.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94707708535328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db532a70 con 0x7f3c24038070 2024-02-18T16:22:24.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.517+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db533f40 con 0x5622db527da0 2024-02-18T16:22:24.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94707708535328] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94707708540416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db533ec0 con 0x5622db527da0 2024-02-18T16:22:24.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5348e0 con 0x5622db52e010 2024-02-18T16:22:24.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94707708540416] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94707708541472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db533e40 con 0x5622db52e010 2024-02-18T16:22:24.530 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.521+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db535610 con 0x7f3c24038070 2024-02-18T16:22:24.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94707708547376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db535e60 con 0x7f3c24038070 2024-02-18T16:22:24.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db536860 con 0x5622db527da0 2024-02-18T16:22:24.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94707708541472] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94707708547376] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94707708552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5359c0 con 0x5622db527da0 2024-02-18T16:22:24.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.525+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5370b0 con 0x7f3c200141d0 2024-02-18T16:22:24.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.529+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94707708552032] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.529+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.529+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94707708546192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5359c0 con 0x7f3c200141d0 2024-02-18T16:22:24.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.529+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5375a0 con 0x7f3c200141d0 2024-02-18T16:22:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94707708555424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db537a00 con 0x7f3c200141d0 2024-02-18T16:22:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5383f0 con 0x7f3c200141d0 2024-02-18T16:22:24.538 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94707708546192] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94707708559056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5383b0 con 0x7f3c200141d0 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=0 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=1 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=2 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=3 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=4 2024-02-18T16:22:24.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=5 2024-02-18T16:22:24.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94707708555424] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=6 2024-02-18T16:22:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94707708559056] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 20 add_watcher() i=7 2024-02-18T16:22:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.533+0000 7f3c30653980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db537560 con 0x5622db527da0 2024-02-18T16:22:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.542 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94707708553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db537560 con 0x5622db527da0 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94707708553744] v32'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3ae4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 5 note: GC not initialized 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3a5f7fe640 20 reqs_thread_entry: start 2024-02-18T16:22:24.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:24.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 20 Filter name: none 2024-02-18T16:22:24.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3a5d7fa640 20 reqs_thread_entry: start 2024-02-18T16:22:24.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-18T16:22:24.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db55d2b0 con 0x7f3c200141d0 2024-02-18T16:22:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.537+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(62 bar [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:22:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-02-18T16:22:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-18T16:22:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:24.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db560e20 con 0x7f3c24038070 2024-02-18T16:22:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v32'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-18T16:22:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:22:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-18T16:22:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94707708722176 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db561940 con 0x7f3c200141d0 2024-02-18T16:22:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== watch-notify(notify (1) cookie 94707708546192 notify 137438953488 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7f3c280e7040 con 0x7f3c200141d0 2024-02-18T16:22:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3b11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94707708546192 notifier 4727 bl.length()=357 2024-02-18T16:22:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3b11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-18T16:22:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3b11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:22:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(64 notify.5 [notify cookie 94707708722176 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3b11ffb640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3af4003ea0 con 0x7f3c200141d0 2024-02-18T16:22:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== watch-notify(notify_complete (2) cookie 94707708722176 notify 137438953488 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622db4f1ec0 con 0x7f3c200141d0 2024-02-18T16:22:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.541+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db561840 con 0x5622db527da0 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 : miss 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 8.a 8:523c68c7:root::.bucket.meta.myfoo6%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db55f220 con 0x5622db527da0 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(67 .bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=353 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 info.flags=0x17 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 to cache LRU end 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 2024-02-18T16:22:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 8.a 8:523c68c7:root::.bucket.meta.myfoo6%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db568910 con 0x5622db527da0 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 .bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'3 uv3 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 info.flags=0x17 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 to cache LRU end 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9, ofs0, ns] 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify cookie 94707708720784 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562d40 con 0x5622db527da0 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== watch-notify(notify (1) cookie 94707708552032 notify 137438953512 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x5622db4f1ec0 con 0x5622db527da0 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3b11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94707708552032 notifier 4727 bl.length()=721 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(69 notify.4 [notify cookie 94707708720784 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3b11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 info.flags=0x17 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3b11ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 to cache LRU end 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3b11ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-02-18T16:22:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3b11ffb640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3af4003ea0 con 0x5622db527da0 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(70 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== watch-notify(notify_complete (2) cookie 94707708720784 notify 137438953512 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622db4f1a90 con 0x5622db527da0 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 20 handle_bi_update(): bucket=:myfoo6[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9]): orig_sources= new_sources= 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 20 handle_bi_update(): bucket=:myfoo6[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9]): potential sources added=[] removed=[] 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 20 handle_bi_update(): bucket=:myfoo6[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9]): orig_dests= new_dests= 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 20 handle_bi_update(): bucket=:myfoo6[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9]): potential dests added=[] removed=[] 2024-02-18T16:22:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.545+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db568110 con 0x5622db527da0 2024-02-18T16:22:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-02-18T16:22:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 20 rados->read ofs=0 len=0 2024-02-18T16:22:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db567100 con 0x5622db527da0 2024-02-18T16:22:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 20 rados_obj.operate() r=0 bl.length=166 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 4.25 4:a73253d1:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db567100 con 0x5622db52e010 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(73 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 4.e 4:70a926ef:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562d40 con 0x7f3c24038070 2024-02-18T16:22:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(74 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:75 4.3e 4:7d13b6c4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562d40 con 0x7f3c24038070 2024-02-18T16:22:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(75 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.2 [call out=85b] v0'0 uv16 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 4.2b 4:d6bc991c:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562d40 con 0x5622db527da0 2024-02-18T16:22:24.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(76 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:77 4.12 4:494cbb0f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562cf0 con 0x5622db527da0 2024-02-18T16:22:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(77 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 4.16 4:68d99a50:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562cf0 con 0x7f3c24038070 2024-02-18T16:22:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(78 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.549+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 4.14 4:2adbcd59:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db562cf0 con 0x5622db52e010 2024-02-18T16:22:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(79 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:80 4.34 4:2f149c7d:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db563120 con 0x7f3c24038070 2024-02-18T16:22:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(80 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:81 4.0 4:00065fb2:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db563120 con 0x5622db52e010 2024-02-18T16:22:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(81 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:82 4.16 4:68de397e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db563570 con 0x7f3c24038070 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(82 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9 [call out=377b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 10 cls_bucket_list_unordered: got thirteen 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:83 4.27 4:e437215e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db563570 con 0x5622db527da0 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(83 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.10 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 get_obj_state: octx=0x5622db5610f0 obj=myfoo6:thirteen state=0x5622db562388 s->prefetch_data=0 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 3.22s0 3:46e1e212:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db563570 con 0x5622db52e010 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(84 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 10 manifest: total_size = 8 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.5569033207741695570 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.acl 2024-02-18T16:22:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.content_type 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.etag 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.idtag 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.manifest 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 get_obj_state: octx=0x5622db5610f0 obj=myfoo6:thirteen state=0x5622db562388 s->prefetch_data=0 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 : hit (requested=0x17, cached=0x17) 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9 2024-02-18T16:22:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.553+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:85 4.16 4:68de397e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5667e0 con 0x7f3c24038070 2024-02-18T16:22:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.557+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(85 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.557+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 3.22s0 3:46e1e212:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db56b050 con 0x5622db52e010 2024-02-18T16:22:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.557+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(86 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.557+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:87 4.16 4:68de397e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db56c500 con 0x7f3c24038070 2024-02-18T16:22:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:1 objects processed in :myfoo6[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9]). Next marker thirteen 2024-02-18T16:22:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.557+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db56c500 con 0x7f3c24038070 2024-02-18T16:22:24.566 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~346] v32'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-18T16:22:24.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:22:24.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-18T16:22:24.567 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94707708728160 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db569680 con 0x7f3c200141d0 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(87 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9.9 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3b11ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== watch-notify(notify (1) cookie 94707708546192 notify 137438953489 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x5622db4f1a90 con 0x7f3c200141d0 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3b117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94707708546192 notifier 4727 bl.length()=522 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3b117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3b117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3b117fa640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3a64003430 con 0x7f3c200141d0 2024-02-18T16:22:24.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(89 notify.5 [notify cookie 94707708728160 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== watch-notify(notify_complete (2) cookie 94707708728160 notify 137438953489 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c280cb030 con 0x7f3c200141d0 2024-02-18T16:22:24.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5674a0 con 0x5622db527da0 2024-02-18T16:22:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-18T16:22:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-18T16:22:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-18T16:22:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.561+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94707708728160 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db561780 con 0x7f3c200141d0 2024-02-18T16:22:24.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== watch-notify(notify (1) cookie 94707708546192 notify 137438953490 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f3c280cb030 con 0x7f3c200141d0 2024-02-18T16:22:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3b11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94707708546192 notifier 4727 bl.length()=177 2024-02-18T16:22:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3b11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-18T16:22:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3b11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-18T16:22:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(92 notify.5 [notify cookie 94707708728160 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3b11ffb640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3af4004200 con 0x7f3c200141d0 2024-02-18T16:22:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== watch-notify(notify_complete (2) cookie 94707708728160 notify 137438953490 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622db401e60 con 0x7f3c200141d0 2024-02-18T16:22:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c30653980 10 removing user index: bar 2024-02-18T16:22:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c30653980 10 removing default.rgw.meta+users.uid+bar from cache 2024-02-18T16:22:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c30653980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-18T16:22:24.572 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94707708728160 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db561780 con 0x7f3c200141d0 2024-02-18T16:22:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== watch-notify(notify (1) cookie 94707708559056 notify 137438953491 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5622db401e60 con 0x7f3c200141d0 2024-02-18T16:22:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3b117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94707708559056 notifier 4727 bl.length()=152 2024-02-18T16:22:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3b117fa640 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3a640033f0 con 0x7f3c200141d0 2024-02-18T16:22:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(94 notify.7 [notify cookie 94707708728160 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== watch-notify(notify_complete (2) cookie 94707708728160 notify 137438953491 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c28005d30 con 0x7f3c200141d0 2024-02-18T16:22:24.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db5674a0 con 0x7f3c200141d0 2024-02-18T16:22:24.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.565+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.569+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(96 bar [delete] v32'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.575 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:22:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.569+0000 7f3ae4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:24.576 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.569+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94707708553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db54f310 con 0x5622db527da0 2024-02-18T16:22:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.569+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94707708553744] v32'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.577 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.569+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94707708535328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db54f310 con 0x7f3c24038070 2024-02-18T16:22:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94707708535328] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c30653980 20 remove_watcher() i=0 2024-02-18T16:22:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c30653980 2 removed watcher, disabling cache 2024-02-18T16:22:24.579 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94707708540416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52d2b0 con 0x5622db527da0 2024-02-18T16:22:24.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94707708540416] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c30653980 20 remove_watcher() i=1 2024-02-18T16:22:24.581 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.573+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94707708541472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52d270 con 0x5622db52e010 2024-02-18T16:22:24.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.577+0000 7f3c2d96d640 1 -- 172.21.15.129:0/1819580612 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94707708541472] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c24022070 con 0x5622db52e010 2024-02-18T16:22:24.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.577+0000 7f3c30653980 20 remove_watcher() i=2 2024-02-18T16:22:24.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.577+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94707708547376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52d270 con 0x7f3c24038070 2024-02-18T16:22:24.584 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.577+0000 7f3c2e96f640 1 -- 172.21.15.129:0/1819580612 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94707708547376] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c2003a040 con 0x7f3c24038070 2024-02-18T16:22:24.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.577+0000 7f3c30653980 20 remove_watcher() i=3 2024-02-18T16:22:24.585 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.577+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94707708552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52d270 con 0x5622db527da0 2024-02-18T16:22:24.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.581+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94707708552032] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x5622db527da0 2024-02-18T16:22:24.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.581+0000 7f3c30653980 20 remove_watcher() i=4 2024-02-18T16:22:24.587 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.581+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94707708546192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db52d270 con 0x7f3c200141d0 2024-02-18T16:22:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.581+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94707708546192] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.581+0000 7f3c30653980 20 remove_watcher() i=5 2024-02-18T16:22:24.589 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.581+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94707708555424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db54f310 con 0x7f3c200141d0 2024-02-18T16:22:24.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94707708555424] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 20 remove_watcher() i=6 2024-02-18T16:22:24.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94707708559056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622db54f310 con 0x7f3c200141d0 2024-02-18T16:22:24.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94707708559056] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c280f2040 con 0x7f3c200141d0 2024-02-18T16:22:24.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 20 remove_watcher() i=7 2024-02-18T16:22:24.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3c200141d0 msgr2=0x7f3c20015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f3c200141d0 0x7f3c20015940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db527da0 msgr2=0x5622db52a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db527da0 0x5622db52a260 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3c24038070 msgr2=0x7f3c2401f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f3c24038070 0x7f3c2401f130 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622db52e010 msgr2=0x5622db5304d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622db52e010 0x5622db5304d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3af80342b0 msgr2=0x7f3af8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3af80342b0 0x7f3af8036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3c20011010 tx=0x7f3c20020000 comp rx=0 tx=0).stop 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 msgr2=0x5622db51c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c2e16e640 1 -- 172.21.15.129:0/1819580612 reap_dead start 2024-02-18T16:22:24.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.585+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db51c7d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3c240199a0 tx=0x7f3c24049a30 comp rx=0 tx=0).stop 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 shutdown_connections 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/1819580612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db515900 0x5622db51c7d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 >> 172.21.15.129:0/1819580612 conn(0x5622db511c90 msgr2=0x5622db50f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 shutdown_connections 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/1819580612 wait complete. 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b080342b0 msgr2=0x7f3b08036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b080342b0 0x7f3b08036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5622db4f8ee0 tx=0x7f3c20005850 comp rx=0 tx=0).stop 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 msgr2=0x5622db508da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 0x5622db508da0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3c24001ee0 tx=0x7f3c2400da30 comp rx=0 tx=0).stop 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 shutdown_connections 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b080342b0 0x7f3b08036770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/2494772593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db508980 0x5622db508da0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 >> 172.21.15.129:0/2494772593 conn(0x5622db4fd790 msgr2=0x5622db4fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 shutdown_connections 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/2494772593 wait complete. 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db400c80 msgr2=0x5622db4f8180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db400c80 0x5622db4f8180 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b140342b0 msgr2=0x7f3b14036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b140342b0 0x7f3b14036770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000f70 tx=0x7f3c240012c0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 msgr2=0x5622db4f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4f1550 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3c2801b2c0 tx=0x7f3c28018020 comp rx=0 tx=0).stop 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 shutdown_connections 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622db400c80 0x5622db4f8180 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3b140342b0 0x7f3b14036770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 --2- 172.21.15.129:0/807057763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622db400360 0x5622db4f1550 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 >> 172.21.15.129:0/807057763 conn(0x5622db373a50 msgr2=0x5622db4e4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 shutdown_connections 2024-02-18T16:22:24.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:24.589+0000 7f3c30653980 1 -- 172.21.15.129:0/807057763 wait complete. 2024-02-18T16:22:24.605 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:22:29.617 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:22:29.618 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-18T16:22:29.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-18T16:22:29.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-18T16:22:29.618 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-02-18T16:22:29.665 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:29.665 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:29.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0246c0e980 1 Processor -- start 2024-02-18T16:22:29.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0246c0e980 1 -- start start 2024-02-18T16:22:29.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0246c0e980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x561f55825890 0x561f55827c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0246c0e980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561f5576b460 con 0x561f55821390 2024-02-18T16:22:29.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0246c0e980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x561f55732180 con 0x561f55825890 2024-02-18T16:22:29.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0243f28640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x561f55825890 0x561f55827c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0244729640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x561f55821390 0x561f55821770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40412/0 (socket says 172.21.15.129:40412) 2024-02-18T16:22:29.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0243f28640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x561f55825890 0x561f55827c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55850/0 (socket says 172.21.15.129:55850) 2024-02-18T16:22:29.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0244729640 1 -- 172.21.15.129:0/3756251901 learned_addr learned my addr 172.21.15.129:0/3756251901 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:29.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0243f28640 1 -- 172.21.15.129:0/3756251901 >> v1:172.21.15.80:6789/0 conn(0x561f55821390 legacy=0x561f55821770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.660+0000 7f0243f28640 1 -- 172.21.15.129:0/3756251901 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f558291d0 con 0x561f55825890 2024-02-18T16:22:29.669 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0243f28640 1 --2- 172.21.15.129:0/3756251901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55825890 0x561f55827c80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f023800a480 tx=0x7f023801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f09e2ce67ec92dd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0243727640 1 -- 172.21.15.129:0/3756251901 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380ab540 con 0x561f55825890 2024-02-18T16:22:29.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0243727640 1 -- 172.21.15.129:0/3756251901 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380ab6a0 con 0x561f55825890 2024-02-18T16:22:29.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0243727640 1 -- 172.21.15.129:0/3756251901 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380ab960 con 0x561f55825890 2024-02-18T16:22:29.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 -- 172.21.15.129:0/3756251901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55825890 msgr2=0x561f55827c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3756251901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55825890 0x561f55827c80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f023800a480 tx=0x7f023801b280 comp rx=0 tx=0).stop 2024-02-18T16:22:29.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 -- 172.21.15.129:0/3756251901 shutdown_connections 2024-02-18T16:22:29.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3756251901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55825890 0x561f55827c80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 -- 172.21.15.129:0/3756251901 >> 172.21.15.129:0/3756251901 conn(0x561f55794a80 msgr2=0x561f55794e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 -- 172.21.15.129:0/3756251901 shutdown_connections 2024-02-18T16:22:29.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.664+0000 7f0246c0e980 1 -- 172.21.15.129:0/3756251901 wait complete. 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 Processor -- start 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- start start 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f5590b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f5572f6b0 con 0x561f55821390 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0244729640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f5590b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0244729640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f5590b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55864/0 (socket says 172.21.15.129:55864) 2024-02-18T16:22:29.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0244729640 1 -- 172.21.15.129:0/4033811303 learned_addr learned my addr 172.21.15.129:0/4033811303 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0244729640 1 -- 172.21.15.129:0/4033811303 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0238005d30 con 0x561f55821390 2024-02-18T16:22:29.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0244729640 1 --2- 172.21.15.129:0/4033811303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f5590b350 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f023c006fb0 tx=0x7f023c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a78f3828b949537 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f013260c640 1 -- 172.21.15.129:0/4033811303 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f023c004530 con 0x561f55821390 2024-02-18T16:22:29.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f013260c640 1 -- 172.21.15.129:0/4033811303 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c004690 con 0x561f55821390 2024-02-18T16:22:29.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f013260c640 1 -- 172.21.15.129:0/4033811303 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f023c0049b0 con 0x561f55821390 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- 172.21.15.129:0/4033811303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 msgr2=0x561f5590b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 --2- 172.21.15.129:0/4033811303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f5590b350 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f023c006fb0 tx=0x7f023c001940 comp rx=0 tx=0).stop 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- 172.21.15.129:0/4033811303 shutdown_connections 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 --2- 172.21.15.129:0/4033811303 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f5590b350 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- 172.21.15.129:0/4033811303 >> 172.21.15.129:0/4033811303 conn(0x561f55794a80 msgr2=0x561f55906ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- 172.21.15.129:0/4033811303 shutdown_connections 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- 172.21.15.129:0/4033811303 wait complete. 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 Processor -- start 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- start start 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f559121a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.690 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.680+0000 7f0246c0e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f5572ae90 con 0x561f55821390 2024-02-18T16:22:29.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244729640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f559121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244729640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f559121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55874/0 (socket says 172.21.15.129:55874) 2024-02-18T16:22:29.691 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244729640 1 -- 172.21.15.129:0/2169958860 learned_addr learned my addr 172.21.15.129:0/2169958860 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244729640 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f5576b460 con 0x561f55821390 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244729640 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f559121a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x561f5590c1e0 tx=0x7f023c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0130e09640 1 -- 172.21.15.129:0/2169958860 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f023c013760 con 0x561f55821390 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561f559126e0 con 0x561f55821390 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0130e09640 1 -- 172.21.15.129:0/2169958860 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c0138c0 con 0x561f55821390 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0130e09640 1 -- 172.21.15.129:0/2169958860 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f023c013b60 con 0x561f55821390 2024-02-18T16:22:29.692 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f55912b30 con 0x561f55821390 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0130e09640 1 -- 172.21.15.129:0/2169958860 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f023c028460 con 0x561f55821390 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0130e09640 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f012c0342b0 0x7f012c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0130e09640 1 -- 172.21.15.129:0/2169958860 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f023c0495e0 con 0x561f55821390 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0243f28640 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f012c0342b0 0x7f012c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f55825890 0x561f55918e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55919360 con 0x561f55825890 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244f2a640 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f55825890 0x561f55918e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0243f28640 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f012c0342b0 0x7f012c036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f02380ad000 tx=0x7f02380a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244f2a640 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f55825890 0x561f55918e20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.684+0000 7f0244f2a640 1 -- 172.21.15.129:0/2169958860 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f02340083f0 con 0x561f55825890 2024-02-18T16:22:29.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55919740 con 0x561f55825890 2024-02-18T16:22:29.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0244f2a640 1 -- 172.21.15.129:0/2169958860 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f02340083f0 con 0x561f55825890 2024-02-18T16:22:29.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5591aff0 con 0x561f55825890 2024-02-18T16:22:29.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0244f2a640 1 -- 172.21.15.129:0/2169958860 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f02340083f0 con 0x561f55825890 2024-02-18T16:22:29.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5591a1f0 con 0x561f55825890 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0244f2a640 1 -- 172.21.15.129:0/2169958860 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f02340083f0 con 0x561f55825890 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5591a600 con 0x561f55825890 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0244f2a640 1 -- 172.21.15.129:0/2169958860 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0234012040 con 0x561f55825890 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 Processor -- start 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- start start 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 0x561f55929af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f556c3f20 con 0x561f559296d0 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0243f28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 0x561f55929af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0243f28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 0x561f55929af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55886/0 (socket says 172.21.15.129:55886) 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0243f28640 1 -- 172.21.15.129:0/2307955660 learned_addr learned my addr 172.21.15.129:0/2307955660 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0243f28640 1 -- 172.21.15.129:0/2307955660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f5592a030 con 0x561f559296d0 2024-02-18T16:22:29.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0243f28640 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 0x561f55929af0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0238096e80 tx=0x7f0238018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0129ffb640 1 -- 172.21.15.129:0/2307955660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380bd8a0 con 0x561f559296d0 2024-02-18T16:22:29.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561f5592a220 con 0x561f559296d0 2024-02-18T16:22:29.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0129ffb640 1 -- 172.21.15.129:0/2307955660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380bda00 con 0x561f559296d0 2024-02-18T16:22:29.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0129ffb640 1 -- 172.21.15.129:0/2307955660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380bdca0 con 0x561f559296d0 2024-02-18T16:22:29.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.688+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f5592ad70 con 0x561f559296d0 2024-02-18T16:22:29.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0129ffb640 1 -- 172.21.15.129:0/2307955660 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f02380be480 con 0x561f559296d0 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0129ffb640 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f011c034300 0x7f011c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0129ffb640 1 -- 172.21.15.129:0/2307955660 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f02380e64c0 con 0x561f559296d0 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0244f2a640 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f011c034300 0x7f011c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 Processor -- start 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- start start 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0244f2a640 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f011c034300 0x7f011c0367c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x561f55919c30 tx=0x7f0234003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f55936ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f556b7790 con 0x561f559366b0 2024-02-18T16:22:29.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0243f28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f55936ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0243f28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f55936ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55900/0 (socket says 172.21.15.129:55900) 2024-02-18T16:22:29.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0243f28640 1 -- 172.21.15.129:0/2268754516 learned_addr learned my addr 172.21.15.129:0/2268754516 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.701 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0243f28640 1 -- 172.21.15.129:0/2268754516 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f559370a0 con 0x561f559366b0 2024-02-18T16:22:29.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0243f28640 1 --2- 172.21.15.129:0/2268754516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f55936ad0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f02380e4780 tx=0x7f0238006390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd4f2632d9a1c36 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f01237fe640 1 -- 172.21.15.129:0/2268754516 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380e3250 con 0x561f559366b0 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f01237fe640 1 -- 172.21.15.129:0/2268754516 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380e33b0 con 0x561f559366b0 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f01237fe640 1 -- 172.21.15.129:0/2268754516 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380b4c50 con 0x561f559366b0 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- 172.21.15.129:0/2268754516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 msgr2=0x561f55936ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2268754516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f55936ad0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f02380e4780 tx=0x7f0238006390 comp rx=0 tx=0).stop 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- 172.21.15.129:0/2268754516 shutdown_connections 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2268754516 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f55936ad0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- 172.21.15.129:0/2268754516 >> 172.21.15.129:0/2268754516 conn(0x561f55932a40 msgr2=0x561f55930aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- 172.21.15.129:0/2268754516 shutdown_connections 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.692+0000 7f0246c0e980 1 -- 172.21.15.129:0/2268754516 wait complete. 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 Processor -- start 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 -- start start 2024-02-18T16:22:29.703 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f5593d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f5593db30 con 0x561f559366b0 2024-02-18T16:22:29.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0243f28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f5593d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0243f28640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f5593d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55906/0 (socket says 172.21.15.129:55906) 2024-02-18T16:22:29.704 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 learned_addr learned my addr 172.21.15.129:0/3194518178 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f5592ad70 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0243f28640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f5593d5f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f02380ab5a0 tx=0x7f02380e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0121ffb640 1 -- 172.21.15.129:0/3194518178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380e3250 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0121ffb640 1 -- 172.21.15.129:0/3194518178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0238006700 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561f5593dd30 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0121ffb640 1 -- 172.21.15.129:0/3194518178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02380b4580 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f5593e160 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0121ffb640 1 -- 172.21.15.129:0/3194518178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f02380b47a0 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0121ffb640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01140342b0 0x7f0114036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0121ffb640 1 -- 172.21.15.129:0/3194518178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f02380bf070 con 0x561f559366b0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0244f2a640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01140342b0 0x7f0114036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f559489e0 0x561f5594aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.696+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594b5f0 con 0x561f559489e0 2024-02-18T16:22:29.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f559489e0 0x561f5594aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244f2a640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01140342b0 0x7f0114036770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0234008fd0 tx=0x7f023401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f559489e0 0x561f5594aea0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f023c024020 con 0x561f559489e0 2024-02-18T16:22:29.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 realm 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594b9c0 con 0x561f559489e0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f023c024020 con 0x561f559489e0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594c240 con 0x561f559489e0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f023c024020 con 0x561f559489e0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594c5a0 con 0x561f559489e0 2024-02-18T16:22:29.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f023c024020 con 0x561f559489e0 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594cda0 con 0x561f559489e0 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f023c024020 con 0x561f559489e0 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 20 searching for the correct realm 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x561f5594ec30 0x561f559510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0243f28640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x561f5594ec30 0x561f559510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0243f28640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x561f5594ec30 0x561f559510c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0243f28640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f02380ef070 0x7f02380e7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244f2a640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f02380ef070 0x7f02380e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244f2a640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f02380ef070 0x7f02380e7070 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023402c040 con 0x7f02380ef070 2024-02-18T16:22:29.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244f2a640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0234027940 0x7f02340333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.700+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0234027940 0x7f02340333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0234027940 0x7f02340333c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c024020 con 0x7f0234027940 2024-02-18T16:22:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f023c03d080 con 0x561f559489e0 2024-02-18T16:22:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x561f559489e0 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x7f0234027940 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x7f0234027940 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023402c040 con 0x7f02380ef070 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.704+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x561f559489e0 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x7f0234027940 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x561f559489e0 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f023402c040 con 0x7f02380ef070 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x7f0234027940 2024-02-18T16:22:29.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.708+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c03d080 con 0x561f559489e0 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f023c03d080 con 0x561f559489e0 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023402c040 con 0x7f02380ef070 2024-02-18T16:22:29.728 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023402c040 con 0x7f02380ef070 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f0234027940 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023402c040 con 0x7f02380ef070 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.712+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f5594ec30 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.729 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x561f559489e0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951790 con 0x7f02380ef070 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594d6d0 con 0x561f559489e0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5594df20 con 0x561f559489e0 2024-02-18T16:22:29.730 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951bd0 con 0x561f559489e0 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 zone default found 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 4 Realm: () 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 zonegroup default 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55951c40 con 0x7f02380ef070 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.731 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55953a20 con 0x561f5594ec30 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55953e20 con 0x561f5594ec30 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 started sync module instance, tier type = 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.716+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55953300 con 0x7f02380ef070 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94692579815008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f559536b0 con 0x7f02380ef070 2024-02-18T16:22:29.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55954b80 con 0x561f559489e0 2024-02-18T16:22:29.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94692579815008] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94692579820096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55954b00 con 0x561f559489e0 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.720+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55955570 con 0x561f5594ec30 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94692579823792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55955df0 con 0x561f5594ec30 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f559567c0 con 0x7f02380ef070 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94692579820096] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94692579828416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55956ba0 con 0x7f02380ef070 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957510 con 0x561f559489e0 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94692579823792] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.724+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94692579828416] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94692579821152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957070 con 0x561f559489e0 2024-02-18T16:22:29.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957d60 con 0x7f0234027940 2024-02-18T16:22:29.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94692579821152] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94692579826000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957a70 con 0x7f0234027940 2024-02-18T16:22:29.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.728+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55958270 con 0x7f0234027940 2024-02-18T16:22:29.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94692579826000] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94692579833568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55958040 con 0x7f0234027940 2024-02-18T16:22:29.739 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55958af0 con 0x7f0234027940 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94692579833568] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94692579837424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55958ab0 con 0x7f0234027940 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=0 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=1 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=2 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=3 2024-02-18T16:22:29.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=4 2024-02-18T16:22:29.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=5 2024-02-18T16:22:29.742 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.732+0000 7f0246c0e980 20 add_watcher() i=6 2024-02-18T16:22:29.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94692579837424] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 20 add_watcher() i=7 2024-02-18T16:22:29.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:29.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5595bf60 con 0x561f559489e0 2024-02-18T16:22:29.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.744 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94692579834624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55959440 con 0x561f559489e0 2024-02-18T16:22:29.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94692579834624] v32'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f00fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:29.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:29.745 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 5 note: GC not initialized 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f00f97e2640 20 reqs_thread_entry: start 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 20 Filter name: none 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f006affd640 20 reqs_thread_entry: start 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.746 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.736+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5597df60 con 0x7f0234027940 2024-02-18T16:22:29.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-18T16:22:29.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:22:29.747 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5597c730 con 0x7f0234027940 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-18T16:22:29.748 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5597cb30 con 0x7f0234027940 2024-02-18T16:22:29.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v32'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-18T16:22:29.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:22:29.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-18T16:22:29.749 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94692579989952 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5597d370 con 0x7f0234027940 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== watch-notify(notify (1) cookie 94692579826000 notify 137438953492 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x561f55912b30 con 0x7f0234027940 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f01237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94692579826000 notifier 4734 bl.length()=522 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(65 notify.5 [notify cookie 94692579989952 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f01237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f01237fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.740+0000 7f01237fe640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f0108003ea0 con 0x7f0234027940 2024-02-18T16:22:29.750 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== watch-notify(notify_complete (2) cookie 94692579989952 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f023c02d070 con 0x7f0234027940 2024-02-18T16:22:29.751 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5597d370 con 0x7f0234027940 2024-02-18T16:22:29.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0246c0e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:22:29.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0246c0e980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:22:29.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0246c0e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:22:29.753 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94692579989952 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f559813b0 con 0x561f5594ec30 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== watch-notify(notify (1) cookie 94692579823792 notify 137438953478 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f02380f4070 con 0x561f5594ec30 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f01237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94692579823792 notifier 4734 bl.length()=177 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f01237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f01237fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(68 notify.2 [notify cookie 94692579989952 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f01237fe640 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f0108003ea0 con 0x561f5594ec30 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.744+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== watch-notify(notify_complete (2) cookie 94692579989952 notify 137438953478 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561f5593dd30 con 0x561f5594ec30 2024-02-18T16:22:29.754 INFO:teuthology.orchestra.run.smithi129.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-18T16:22:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f00fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94692579834624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f5597f390 con 0x561f559489e0 2024-02-18T16:22:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94692579834624] v32'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94692579815008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957b00 con 0x7f02380ef070 2024-02-18T16:22:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94692579815008] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0246c0e980 20 remove_watcher() i=0 2024-02-18T16:22:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0246c0e980 2 removed watcher, disabling cache 2024-02-18T16:22:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.748+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94692579820096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957b00 con 0x561f559489e0 2024-02-18T16:22:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.752+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94692579820096] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.752+0000 7f0246c0e980 20 remove_watcher() i=1 2024-02-18T16:22:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.752+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94692579823792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55954240 con 0x561f5594ec30 2024-02-18T16:22:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.752+0000 7f0243f28640 1 -- 172.21.15.129:0/3194518178 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94692579823792] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02380e6750 con 0x561f5594ec30 2024-02-18T16:22:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.752+0000 7f0246c0e980 20 remove_watcher() i=2 2024-02-18T16:22:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.752+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94692579828416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957b00 con 0x7f02380ef070 2024-02-18T16:22:29.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.756+0000 7f0244f2a640 1 -- 172.21.15.129:0/3194518178 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94692579828416] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023403f040 con 0x7f02380ef070 2024-02-18T16:22:29.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.756+0000 7f0246c0e980 20 remove_watcher() i=3 2024-02-18T16:22:29.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.756+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94692579821152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f559550b0 con 0x561f559489e0 2024-02-18T16:22:29.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.756+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94692579821152] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x561f559489e0 2024-02-18T16:22:29.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.756+0000 7f0246c0e980 20 remove_watcher() i=4 2024-02-18T16:22:29.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.756+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94692579826000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f55957b00 con 0x7f0234027940 2024-02-18T16:22:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.760+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94692579826000] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.760+0000 7f0246c0e980 20 remove_watcher() i=5 2024-02-18T16:22:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.760+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94692579833568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f559550b0 con 0x7f0234027940 2024-02-18T16:22:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.760+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94692579833568] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.760+0000 7f0246c0e980 20 remove_watcher() i=6 2024-02-18T16:22:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.760+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94692579837424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561f559550b0 con 0x7f0234027940 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94692579837424] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f023c04f040 con 0x7f0234027940 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 20 remove_watcher() i=7 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0234027940 msgr2=0x7f02340333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f0234027940 0x7f02340333c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f559489e0 msgr2=0x561f5594aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f559489e0 0x561f5594aea0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f02380ef070 msgr2=0x7f02380e7070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f02380ef070 0x7f02380e7070 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x561f5594ec30 msgr2=0x561f559510c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x561f5594ec30 0x561f559510c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01140342b0 msgr2=0x7f0114036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f01140342b0 0x7f0114036770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0234008fd0 tx=0x7f023401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 msgr2=0x561f5593d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0244729640 1 -- 172.21.15.129:0/3194518178 reap_dead start 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f5593d5f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f02380ab5a0 tx=0x7f02380e46e0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 shutdown_connections 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/3194518178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559366b0 0x561f5593d5f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 >> 172.21.15.129:0/3194518178 conn(0x561f55932a40 msgr2=0x561f559300a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 shutdown_connections 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/3194518178 wait complete. 2024-02-18T16:22:29.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f011c034300 msgr2=0x7f011c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f011c034300 0x7f011c0367c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x561f55919c30 tx=0x7f0234003070 comp rx=0 tx=0).stop 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 msgr2=0x561f55929af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 0x561f55929af0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0238096e80 tx=0x7f0238018020 comp rx=0 tx=0).stop 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 shutdown_connections 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f011c034300 0x7f011c0367c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2307955660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f559296d0 0x561f55929af0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 >> 172.21.15.129:0/2307955660 conn(0x561f5591e4e0 msgr2=0x561f5591eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 shutdown_connections 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2307955660 wait complete. 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f55825890 msgr2=0x561f55918e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f55825890 0x561f55918e20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f012c0342b0 msgr2=0x7f012c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f012c0342b0 0x7f012c036770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f02380ad000 tx=0x7f02380a5040 comp rx=0 tx=0).stop 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 msgr2=0x561f559121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f559121a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x561f5590c1e0 tx=0x7f023c000f50 comp rx=0 tx=0).stop 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 shutdown_connections 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x561f55825890 0x561f55918e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f012c0342b0 0x7f012c036770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 --2- 172.21.15.129:0/2169958860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561f55821390 0x561f559121a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 >> 172.21.15.129:0/2169958860 conn(0x561f55794a80 msgr2=0x561f559059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 shutdown_connections 2024-02-18T16:22:29.776 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.764+0000 7f0246c0e980 1 -- 172.21.15.129:0/2169958860 wait complete. 2024-02-18T16:22:29.783 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-18T16:22:29.803 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:22:29.811 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-02-18T16:22:29.811 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-18T16:22:29.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-18T16:22:29.811 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-02-18T16:22:29.845 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:29.845 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:29.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.836+0000 7f7bf1c95980 1 Processor -- start 2024-02-18T16:22:29.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bf1c95980 1 -- start start 2024-02-18T16:22:29.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bf1c95980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x562bd9709360 0x562bd9709740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bf1c95980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562bd96534d0 con 0x562bd9709c80 2024-02-18T16:22:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bf1c95980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x562bd961a180 con 0x562bd9709360 2024-02-18T16:22:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bef7b0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x562bd9709360 0x562bd9709740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7be7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x562bd9709c80 0x562bd970a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40420/0 (socket says 172.21.15.129:40420) 2024-02-18T16:22:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7be7fff640 1 -- 172.21.15.129:0/1584487813 learned_addr learned my addr 172.21.15.129:0/1584487813 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bef7b0640 1 -- 172.21.15.129:0/1584487813 >> v1:172.21.15.80:6789/0 conn(0x562bd9709c80 legacy=0x562bd970a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bef7b0640 1 -- 172.21.15.129:0/1584487813 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd970ae60 con 0x562bd9709360 2024-02-18T16:22:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.840+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/1584487813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd9709740 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7be000a480 tx=0x7f7be001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1cfbeea14cdeff server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7beefaf640 1 -- 172.21.15.129:0/1584487813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be00ab540 con 0x562bd9709360 2024-02-18T16:22:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7beefaf640 1 -- 172.21.15.129:0/1584487813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00ab6a0 con 0x562bd9709360 2024-02-18T16:22:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7beefaf640 1 -- 172.21.15.129:0/1584487813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be00ab960 con 0x562bd9709360 2024-02-18T16:22:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1584487813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 msgr2=0x562bd9709740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1584487813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd9709740 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7be000a480 tx=0x7f7be001b280 comp rx=0 tx=0).stop 2024-02-18T16:22:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1584487813 shutdown_connections 2024-02-18T16:22:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1584487813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd9709740 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1584487813 >> 172.21.15.129:0/1584487813 conn(0x562bd967ca50 msgr2=0x562bd967ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1584487813 shutdown_connections 2024-02-18T16:22:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.844+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1584487813 wait complete. 2024-02-18T16:22:29.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bf1c95980 1 Processor -- start 2024-02-18T16:22:29.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bf1c95980 1 -- start start 2024-02-18T16:22:29.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bf1c95980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bf1c95980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd96176b0 con 0x562bd9709360 2024-02-18T16:22:29.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bef7b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bef7b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55928/0 (socket says 172.21.15.129:55928) 2024-02-18T16:22:29.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bef7b0640 1 -- 172.21.15.129:0/2028852176 learned_addr learned my addr 172.21.15.129:0/2028852176 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bef7b0640 1 -- 172.21.15.129:0/2028852176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0005d30 con 0x562bd9709360 2024-02-18T16:22:29.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/2028852176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97f38a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7be0018eb0 tx=0x7f7be0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4988a74a2f1c8b6a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7add60a640 1 -- 172.21.15.129:0/2028852176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be00ab810 con 0x562bd9709360 2024-02-18T16:22:29.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7add60a640 1 -- 172.21.15.129:0/2028852176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00ab970 con 0x562bd9709360 2024-02-18T16:22:29.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7add60a640 1 -- 172.21.15.129:0/2028852176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be00abc30 con 0x562bd9709360 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2028852176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 msgr2=0x562bd97f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.860+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2028852176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97f38a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7be0018eb0 tx=0x7f7be0003030 comp rx=0 tx=0).stop 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2028852176 shutdown_connections 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2028852176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97f38a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2028852176 >> 172.21.15.129:0/2028852176 conn(0x562bd967ca50 msgr2=0x562bd97ef430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2028852176 shutdown_connections 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2028852176 wait complete. 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 Processor -- start 2024-02-18T16:22:29.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- start start 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97fa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd9612e90 con 0x562bd9709360 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bef7b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bef7b0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97fa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55934/0 (socket says 172.21.15.129:55934) 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bef7b0640 1 -- 172.21.15.129:0/1811052431 learned_addr learned my addr 172.21.15.129:0/1811052431 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bef7b0640 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd970ae60 con 0x562bd9709360 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97fa520 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7be001b2c0 tx=0x7f7be0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7adbe07640 1 -- 172.21.15.129:0/1811052431 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be00c3070 con 0x562bd9709360 2024-02-18T16:22:29.872 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562bd97faa60 con 0x562bd9709360 2024-02-18T16:22:29.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bd97fae90 con 0x562bd9709360 2024-02-18T16:22:29.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7adbe07640 1 -- 172.21.15.129:0/1811052431 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00beaa0 con 0x562bd9709360 2024-02-18T16:22:29.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7adbe07640 1 -- 172.21.15.129:0/1811052431 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7be00bed40 con 0x562bd9709360 2024-02-18T16:22:29.873 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7adbe07640 1 -- 172.21.15.129:0/1811052431 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7be00b2070 con 0x562bd9709360 2024-02-18T16:22:29.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.864+0000 7f7adbe07640 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ad4034300 0x7f7ad40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7adbe07640 1 -- 172.21.15.129:0/1811052431 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7be00e3aa0 con 0x562bd9709360 2024-02-18T16:22:29.874 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7be7fff640 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ad4034300 0x7f7ad40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9709c80 0x562bd9801150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9801690 con 0x562bd9709c80 2024-02-18T16:22:29.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9709c80 0x562bd9801150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7be7fff640 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ad4034300 0x7f7ad40367c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8000f70 tx=0x7f7bd80012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9709c80 0x562bd9801150 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 -- 172.21.15.129:0/1811052431 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7be800a4d0 con 0x562bd9709c80 2024-02-18T16:22:29.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd98019f0 con 0x562bd9709c80 2024-02-18T16:22:29.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 -- 172.21.15.129:0/1811052431 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7be800a4d0 con 0x562bd9709c80 2024-02-18T16:22:29.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9803270 con 0x562bd9709c80 2024-02-18T16:22:29.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 -- 172.21.15.129:0/1811052431 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7be800a4d0 con 0x562bd9709c80 2024-02-18T16:22:29.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9802470 con 0x562bd9709c80 2024-02-18T16:22:29.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 -- 172.21.15.129:0/1811052431 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7be800a4d0 con 0x562bd9709c80 2024-02-18T16:22:29.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9802880 con 0x562bd9709c80 2024-02-18T16:22:29.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7beffb1640 1 -- 172.21.15.129:0/1811052431 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7be800a4d0 con 0x562bd9709c80 2024-02-18T16:22:29.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 Processor -- start 2024-02-18T16:22:29.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- start start 2024-02-18T16:22:29.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 0x562bd9811d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7bf1c95980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd95abf20 con 0x562bd9811970 2024-02-18T16:22:29.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7be7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 0x562bd9811d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7be7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 0x562bd9811d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55936/0 (socket says 172.21.15.129:55936) 2024-02-18T16:22:29.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.868+0000 7f7be7fff640 1 -- 172.21.15.129:0/2371297078 learned_addr learned my addr 172.21.15.129:0/2371297078 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7be7fff640 1 -- 172.21.15.129:0/2371297078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd98122d0 con 0x562bd9811970 2024-02-18T16:22:29.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7be7fff640 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 0x562bd9811d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8001ee0 tx=0x7f7bd800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7ad9602640 1 -- 172.21.15.129:0/2371297078 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd8020070 con 0x562bd9811970 2024-02-18T16:22:29.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562bd9812520 con 0x562bd9811970 2024-02-18T16:22:29.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7ad9602640 1 -- 172.21.15.129:0/2371297078 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800c770 con 0x562bd9811970 2024-02-18T16:22:29.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7ad9602640 1 -- 172.21.15.129:0/2371297078 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd8013040 con 0x562bd9811970 2024-02-18T16:22:29.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bd9813070 con 0x562bd9811970 2024-02-18T16:22:29.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7ad9602640 1 -- 172.21.15.129:0/2371297078 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7bd800a040 con 0x562bd9811970 2024-02-18T16:22:29.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7ad9602640 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ac8034300 0x7f7ac80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7ad9602640 1 -- 172.21.15.129:0/2371297078 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7bd804b810 con 0x562bd9811970 2024-02-18T16:22:29.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7beffb1640 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ac8034300 0x7f7ac80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7bf1c95980 1 Processor -- start 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7bf1c95980 1 -- start start 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7beffb1640 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ac8034300 0x7f7ac80367c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562bd9801eb0 tx=0x7f7be8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7bf1c95980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd981ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7bf1c95980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd959f790 con 0x562bd981e8f0 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7be7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd981ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7be7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd981ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55946/0 (socket says 172.21.15.129:55946) 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.872+0000 7f7be7fff640 1 -- 172.21.15.129:0/2953895695 learned_addr learned my addr 172.21.15.129:0/2953895695 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 -- 172.21.15.129:0/2953895695 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd981f2e0 con 0x562bd981e8f0 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 --2- 172.21.15.129:0/2953895695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd981ed10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8049aa0 tx=0x7f7bd80198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7514a44f68e450 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7ad2ffd640 1 -- 172.21.15.129:0/2953895695 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd8048070 con 0x562bd981e8f0 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7ad2ffd640 1 -- 172.21.15.129:0/2953895695 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd803a2b0 con 0x562bd981e8f0 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7ad2ffd640 1 -- 172.21.15.129:0/2953895695 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd803a440 con 0x562bd981e8f0 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2953895695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 msgr2=0x562bd981ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2953895695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd981ed10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8049aa0 tx=0x7f7bd80198d0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2953895695 shutdown_connections 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2953895695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd981ed10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2953895695 >> 172.21.15.129:0/2953895695 conn(0x562bd981ac80 msgr2=0x562bd9818ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2953895695 shutdown_connections 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2953895695 wait complete. 2024-02-18T16:22:29.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 Processor -- start 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- start start 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd9825780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7bf1c95980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd9825cc0 con 0x562bd981e8f0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd9825780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd9825780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55962/0 (socket says 172.21.15.129:55962) 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 learned_addr learned my addr 172.21.15.129:0/360270279 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd9813070 con 0x562bd981e8f0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.876+0000 7f7be7fff640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd9825780 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800df80 tx=0x7f7bd8049a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7ad17fa640 1 -- 172.21.15.129:0/360270279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd804b2e0 con 0x562bd981e8f0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7ad17fa640 1 -- 172.21.15.129:0/360270279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd804b440 con 0x562bd981e8f0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7ad17fa640 1 -- 172.21.15.129:0/360270279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd8048070 con 0x562bd981e8f0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562bd9825ec0 con 0x562bd981e8f0 2024-02-18T16:22:29.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bd9826350 con 0x562bd981e8f0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7ad17fa640 1 -- 172.21.15.129:0/360270279 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7bd80481d0 con 0x562bd981e8f0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7ad17fa640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ab80342b0 0x7f7ab8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7ad17fa640 1 -- 172.21.15.129:0/360270279 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f7bd8039d70 con 0x562bd981e8f0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7beffb1640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ab80342b0 0x7f7ab8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9830d70 0x562bd9833230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9833980 con 0x562bd9830d70 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9830d70 0x562bd9833230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7beffb1640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ab80342b0 0x7f7ab8036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7be8011010 tx=0x7f7be8020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9830d70 0x562bd9833230 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 20 realm 2024-02-18T16:22:29.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9833d50 con 0x562bd9830d70 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.880+0000 7f7bf1c95980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd98345d0 con 0x562bd9830d70 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9834930 con 0x562bd9830d70 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:29.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9835130 con 0x562bd9830d70 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 20 searching for the correct realm 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562bd9836fc0 0x562bd98393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7be7fff640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562bd9836fc0 0x562bd98393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7be7fff640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562bd9836fc0 0x562bd98393b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7be7fff640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7bd8038070 0x7f7bd802e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7beffb1640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7bd8038070 0x7f7bd802e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7beffb1640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7bd8038070 0x7f7bd802e5d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be800a4d0 con 0x7f7bd8038070 2024-02-18T16:22:29.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7beffb1640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7be80141d0 0x7f7be8015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:29.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.884+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7be80141d0 0x7f7be8015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:29.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7be80141d0 0x7f7be8015940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:29.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be800a4d0 con 0x7f7bd8038070 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.888+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.892+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7be80141d0 2024-02-18T16:22:29.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9836fc0 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x562bd9830d70 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839a80 con 0x7f7bd8038070 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:29.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9835a90 con 0x562bd9830d70 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.896+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd98362e0 con 0x562bd9830d70 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:29.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9839ec0 con 0x562bd9830d70 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 zone default found 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 4 Realm: () 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 zonegroup default 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983a360 con 0x7f7bd8038070 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983bd40 con 0x562bd9836fc0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983c110 con 0x562bd9836fc0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 started sync module instance, tier type = 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983b310 con 0x7f7bd8038070 2024-02-18T16:22:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94746332870336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983b310 con 0x7f7bd8038070 2024-02-18T16:22:29.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.900+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983cb40 con 0x562bd9830d70 2024-02-18T16:22:29.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94746332870336] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94746332874704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983b310 con 0x562bd9830d70 2024-02-18T16:22:29.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983d500 con 0x562bd9836fc0 2024-02-18T16:22:29.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94746332874704] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94746332868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983b290 con 0x562bd9836fc0 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.904+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983e1f0 con 0x7f7bd8038070 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94746332880480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983ea40 con 0x7f7bd8038070 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983f410 con 0x562bd9830d70 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94746332868208] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94746332880480] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94746332884752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983e5a0 con 0x562bd9830d70 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.908+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983fc60 con 0x7f7be80141d0 2024-02-18T16:22:29.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94746332884752] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94746332879024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983e5a0 con 0x7f7be80141d0 2024-02-18T16:22:29.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9840110 con 0x7f7be80141d0 2024-02-18T16:22:29.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94746332879024] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94746332888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd98400d0 con 0x7f7be80141d0 2024-02-18T16:22:29.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.912+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9840ae0 con 0x7f7be80141d0 2024-02-18T16:22:29.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94746332888048] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94746332890576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9840ae0 con 0x7f7be80141d0 2024-02-18T16:22:29.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=0 2024-02-18T16:22:29.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=1 2024-02-18T16:22:29.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=2 2024-02-18T16:22:29.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=3 2024-02-18T16:22:29.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=4 2024-02-18T16:22:29.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=5 2024-02-18T16:22:29.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.916+0000 7f7bf1c95980 20 add_watcher() i=6 2024-02-18T16:22:29.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94746332890576] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 add_watcher() i=7 2024-02-18T16:22:29.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:29.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9843f30 con 0x562bd9830d70 2024-02-18T16:22:29.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94746332886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9841410 con 0x562bd9830d70 2024-02-18T16:22:29.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94746332886368] v32'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7aa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:29.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 5 note: GC not initialized 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7aa4fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 Filter name: none 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7a1e7fc640 20 reqs_thread_entry: start 2024-02-18T16:22:29.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-18T16:22:29.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 rados->read ofs=0 len=0 2024-02-18T16:22:29.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9865ea0 con 0x7f7bd8038070 2024-02-18T16:22:29.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:22:29.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-18T16:22:29.939 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.920+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9869a10 con 0x7f7be80141d0 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.924+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v32'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.924+0000 7f7aa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.924+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94746332886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd9846740 con 0x562bd9830d70 2024-02-18T16:22:29.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.924+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94746332886368] v32'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.924+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94746332870336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983f560 con 0x7f7bd8038070 2024-02-18T16:22:29.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94746332870336] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7bf1c95980 20 remove_watcher() i=0 2024-02-18T16:22:29.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7bf1c95980 2 removed watcher, disabling cache 2024-02-18T16:22:29.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94746332874704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983f560 con 0x562bd9830d70 2024-02-18T16:22:29.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94746332874704] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7bf1c95980 20 remove_watcher() i=1 2024-02-18T16:22:29.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.928+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94746332868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983f560 con 0x562bd9836fc0 2024-02-18T16:22:29.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.932+0000 7f7be7fff640 1 -- 172.21.15.129:0/360270279 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94746332868208] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd8022070 con 0x562bd9836fc0 2024-02-18T16:22:29.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.932+0000 7f7bf1c95980 20 remove_watcher() i=2 2024-02-18T16:22:29.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.932+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94746332880480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983ae70 con 0x7f7bd8038070 2024-02-18T16:22:29.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.932+0000 7f7beffb1640 1 -- 172.21.15.129:0/360270279 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94746332880480] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be803a040 con 0x7f7bd8038070 2024-02-18T16:22:29.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.932+0000 7f7bf1c95980 20 remove_watcher() i=3 2024-02-18T16:22:29.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.932+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94746332884752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983ae70 con 0x562bd9830d70 2024-02-18T16:22:29.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.936+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94746332884752] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x562bd9830d70 2024-02-18T16:22:29.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.936+0000 7f7bf1c95980 20 remove_watcher() i=4 2024-02-18T16:22:29.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.936+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94746332879024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983ef10 con 0x7f7be80141d0 2024-02-18T16:22:29.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.936+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94746332879024] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.936+0000 7f7bf1c95980 20 remove_watcher() i=5 2024-02-18T16:22:29.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.936+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94746332888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983ae70 con 0x7f7be80141d0 2024-02-18T16:22:29.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94746332888048] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 20 remove_watcher() i=6 2024-02-18T16:22:29.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94746332890576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562bd983fbf0 con 0x7f7be80141d0 2024-02-18T16:22:29.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94746332890576] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7be00c7930 con 0x7f7be80141d0 2024-02-18T16:22:29.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 20 remove_watcher() i=7 2024-02-18T16:22:29.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7be80141d0 msgr2=0x7f7be8015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f7be80141d0 0x7f7be8015940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9830d70 msgr2=0x562bd9833230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9830d70 0x562bd9833230 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7bd8038070 msgr2=0x7f7bd802e5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f7bd8038070 0x7f7bd802e5d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562bd9836fc0 msgr2=0x562bd98393b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x562bd9836fc0 0x562bd98393b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ab80342b0 msgr2=0x7f7ab8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ab80342b0 0x7f7ab8036770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7be8011010 tx=0x7f7be8020000 comp rx=0 tx=0).stop 2024-02-18T16:22:29.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bef7b0640 1 -- 172.21.15.129:0/360270279 reap_dead start 2024-02-18T16:22:29.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 msgr2=0x562bd9825780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd9825780 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800df80 tx=0x7f7bd8049a30 comp rx=0 tx=0).stop 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 shutdown_connections 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/360270279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd981e8f0 0x562bd9825780 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 >> 172.21.15.129:0/360270279 conn(0x562bd981ac80 msgr2=0x562bd98182e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 shutdown_connections 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/360270279 wait complete. 2024-02-18T16:22:29.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ac8034300 msgr2=0x7f7ac80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ac8034300 0x7f7ac80367c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562bd9801eb0 tx=0x7f7be8005850 comp rx=0 tx=0).stop 2024-02-18T16:22:29.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 msgr2=0x562bd9811d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 0x562bd9811d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8001ee0 tx=0x7f7bd800da30 comp rx=0 tx=0).stop 2024-02-18T16:22:29.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 shutdown_connections 2024-02-18T16:22:29.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ac8034300 0x7f7ac80367c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/2371297078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9811970 0x562bd9811d90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.940+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 >> 172.21.15.129:0/2371297078 conn(0x562bd9806780 msgr2=0x562bd9807290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 shutdown_connections 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/2371297078 wait complete. 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9709c80 msgr2=0x562bd9801150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9709c80 0x562bd9801150 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ad4034300 msgr2=0x7f7ad40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ad4034300 0x7f7ad40367c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8000f70 tx=0x7f7bd80012c0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 msgr2=0x562bd97fa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97fa520 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7be001b2c0 tx=0x7f7be0018020 comp rx=0 tx=0).stop 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 shutdown_connections 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x562bd9709c80 0x562bd9801150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7ad4034300 0x7f7ad40367c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 --2- 172.21.15.129:0/1811052431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x562bd9709360 0x562bd97fa520 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 >> 172.21.15.129:0/1811052431 conn(0x562bd967ca50 msgr2=0x562bd97edf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 shutdown_connections 2024-02-18T16:22:29.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:29.944+0000 7f7bf1c95980 1 -- 172.21.15.129:0/1811052431 wait complete. 2024-02-18T16:22:29.961 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-18T16:22:29.967 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:22:29.967 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-18T16:22:29.975 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-18T16:22:29.976 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-02-18T16:22:29.976 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-18T16:22:29.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-18T16:22:29.976 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-02-18T16:22:30.035 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:30.035 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:30.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe53b63980 1 Processor -- start 2024-02-18T16:22:30.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe53b63980 1 -- start start 2024-02-18T16:22:30.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe53b63980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5638d8b46580 0x5638d8b48970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe53b63980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5638d8a8f4d0 con 0x5638d8b42020 2024-02-18T16:22:30.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe53b63980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638d8a56180 con 0x5638d8b46580 2024-02-18T16:22:30.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe50e7d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5638d8b46580 0x5638d8b48970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe5167e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5638d8b42020 0x5638d8b42400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40424/0 (socket says 172.21.15.129:40424) 2024-02-18T16:22:30.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe50e7d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5638d8b46580 0x5638d8b48970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55974/0 (socket says 172.21.15.129:55974) 2024-02-18T16:22:30.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe5167e640 1 -- 172.21.15.129:0/2397251194 learned_addr learned my addr 172.21.15.129:0/2397251194 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:30.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe50e7d640 1 -- 172.21.15.129:0/2397251194 >> v1:172.21.15.80:6789/0 conn(0x5638d8b42020 legacy=0x5638d8b42400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.028+0000 7efe50e7d640 1 -- 172.21.15.129:0/2397251194 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638d8b49ec0 con 0x5638d8b46580 2024-02-18T16:22:30.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe50e7d640 1 --2- 172.21.15.129:0/2397251194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b46580 0x5638d8b48970 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efe4800a480 tx=0x7efe4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2344f7e8fccc8bd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe43fff640 1 -- 172.21.15.129:0/2397251194 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480ab540 con 0x5638d8b46580 2024-02-18T16:22:30.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe43fff640 1 -- 172.21.15.129:0/2397251194 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe480ab6a0 con 0x5638d8b46580 2024-02-18T16:22:30.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe43fff640 1 -- 172.21.15.129:0/2397251194 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480ab960 con 0x5638d8b46580 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 -- 172.21.15.129:0/2397251194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b46580 msgr2=0x5638d8b48970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 --2- 172.21.15.129:0/2397251194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b46580 0x5638d8b48970 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efe4800a480 tx=0x7efe4801b280 comp rx=0 tx=0).stop 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 -- 172.21.15.129:0/2397251194 shutdown_connections 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 --2- 172.21.15.129:0/2397251194 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b46580 0x5638d8b48970 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 -- 172.21.15.129:0/2397251194 >> 172.21.15.129:0/2397251194 conn(0x5638d8b3d8f0 msgr2=0x5638d8b3fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 -- 172.21.15.129:0/2397251194 shutdown_connections 2024-02-18T16:22:30.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.032+0000 7efe53b63980 1 -- 172.21.15.129:0/2397251194 wait complete. 2024-02-18T16:22:30.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe53b63980 1 Processor -- start 2024-02-18T16:22:30.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe53b63980 1 -- start start 2024-02-18T16:22:30.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe53b63980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe53b63980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638d8a536b0 con 0x5638d8b42020 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe5167e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe5167e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c2bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55984/0 (socket says 172.21.15.129:55984) 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe5167e640 1 -- 172.21.15.129:0/3191436305 learned_addr learned my addr 172.21.15.129:0/3191436305 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.048+0000 7efe5167e640 1 -- 172.21.15.129:0/3191436305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48005d30 con 0x5638d8b42020 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe5167e640 1 --2- 172.21.15.129:0/3191436305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c2bf90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efe44001c00 tx=0x7efe4400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e72a1efd6378f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efd3f606640 1 -- 172.21.15.129:0/3191436305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4400e690 con 0x5638d8b42020 2024-02-18T16:22:30.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efd3f606640 1 -- 172.21.15.129:0/3191436305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4400e810 con 0x5638d8b42020 2024-02-18T16:22:30.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efd3f606640 1 -- 172.21.15.129:0/3191436305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4400eb30 con 0x5638d8b42020 2024-02-18T16:22:30.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- 172.21.15.129:0/3191436305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 msgr2=0x5638d8c2bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 --2- 172.21.15.129:0/3191436305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c2bf90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efe44001c00 tx=0x7efe4400b6d0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- 172.21.15.129:0/3191436305 shutdown_connections 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 --2- 172.21.15.129:0/3191436305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c2bf90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- 172.21.15.129:0/3191436305 >> 172.21.15.129:0/3191436305 conn(0x5638d8b3d8f0 msgr2=0x5638d8c27b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- 172.21.15.129:0/3191436305 shutdown_connections 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- 172.21.15.129:0/3191436305 wait complete. 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 Processor -- start 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- start start 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c33f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe53b63980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638d8a4ee90 con 0x5638d8b42020 2024-02-18T16:22:30.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe5167e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c33f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe5167e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c33f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:55996/0 (socket says 172.21.15.129:55996) 2024-02-18T16:22:30.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe5167e640 1 -- 172.21.15.129:0/2609652360 learned_addr learned my addr 172.21.15.129:0/2609652360 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe5167e640 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638d8a8f4d0 con 0x5638d8b42020 2024-02-18T16:22:30.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efe5167e640 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c33f50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efe4400b710 tx=0x7efe44000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efd3de03640 1 -- 172.21.15.129:0/2609652360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4401f070 con 0x5638d8b42020 2024-02-18T16:22:30.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efd3de03640 1 -- 172.21.15.129:0/2609652360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4401a910 con 0x5638d8b42020 2024-02-18T16:22:30.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.052+0000 7efd3de03640 1 -- 172.21.15.129:0/2609652360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4401abf0 con 0x5638d8b42020 2024-02-18T16:22:30.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638d8c34490 con 0x5638d8b42020 2024-02-18T16:22:30.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638d8c348c0 con 0x5638d8b42020 2024-02-18T16:22:30.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efd3de03640 1 -- 172.21.15.129:0/2609652360 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efe4400a040 con 0x5638d8b42020 2024-02-18T16:22:30.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efd3de03640 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd380342b0 0x7efd38036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efd3de03640 1 -- 172.21.15.129:0/2609652360 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efe4404a0b0 con 0x5638d8b42020 2024-02-18T16:22:30.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe50e7d640 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd380342b0 0x7efd38036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8b46580 0x5638d8c3abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c3b110 con 0x5638d8b46580 2024-02-18T16:22:30.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe51e7f640 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8b46580 0x5638d8c3abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe50e7d640 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd380342b0 0x7efd38036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efe480ad000 tx=0x7efe480a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe51e7f640 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8b46580 0x5638d8c3abd0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe51e7f640 1 -- 172.21.15.129:0/2609652360 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efe4c00a4d0 con 0x5638d8b46580 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c3b470 con 0x5638d8b46580 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe51e7f640 1 -- 172.21.15.129:0/2609652360 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efe4c00a4d0 con 0x5638d8b46580 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c3ccf0 con 0x5638d8b46580 2024-02-18T16:22:30.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe51e7f640 1 -- 172.21.15.129:0/2609652360 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7efe4c00a4d0 con 0x5638d8b46580 2024-02-18T16:22:30.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c3bef0 con 0x5638d8b46580 2024-02-18T16:22:30.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe51e7f640 1 -- 172.21.15.129:0/2609652360 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efe4c00a4d0 con 0x5638d8b46580 2024-02-18T16:22:30.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.056+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c3c300 con 0x5638d8b46580 2024-02-18T16:22:30.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe51e7f640 1 -- 172.21.15.129:0/2609652360 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7efe4c00a4d0 con 0x5638d8b46580 2024-02-18T16:22:30.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe53b63980 1 Processor -- start 2024-02-18T16:22:30.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe53b63980 1 -- start start 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe53b63980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 0x5638d8c4b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe53b63980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638d89e7f20 con 0x5638d8c4b3f0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe50e7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 0x5638d8c4b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe50e7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 0x5638d8c4b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56006/0 (socket says 172.21.15.129:56006) 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe50e7d640 1 -- 172.21.15.129:0/2207640844 learned_addr learned my addr 172.21.15.129:0/2207640844 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe50e7d640 1 -- 172.21.15.129:0/2207640844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638d8c4bd50 con 0x5638d8c4b3f0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe50e7d640 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 0x5638d8c4b810 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efe48096e80 tx=0x7efe48018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efd36ffd640 1 -- 172.21.15.129:0/2207640844 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480bd8a0 con 0x5638d8c4b3f0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efd36ffd640 1 -- 172.21.15.129:0/2207640844 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe480bda00 con 0x5638d8c4b3f0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638d8c4bf40 con 0x5638d8c4b3f0 2024-02-18T16:22:30.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efd36ffd640 1 -- 172.21.15.129:0/2207640844 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480bdca0 con 0x5638d8c4b3f0 2024-02-18T16:22:30.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638d8c4ca90 con 0x5638d8c4b3f0 2024-02-18T16:22:30.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efd36ffd640 1 -- 172.21.15.129:0/2207640844 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efe480be480 con 0x5638d8c4b3f0 2024-02-18T16:22:30.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efd36ffd640 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd2c0342b0 0x7efd2c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efd36ffd640 1 -- 172.21.15.129:0/2207640844 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efe480e6400 con 0x5638d8c4b3f0 2024-02-18T16:22:30.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.060+0000 7efe51e7f640 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd2c0342b0 0x7efd2c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 Processor -- start 2024-02-18T16:22:30.071 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- start start 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe51e7f640 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd2c0342b0 0x7efd2c036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5638d8c3b930 tx=0x7efe4c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c58820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638d89db790 con 0x5638d8c58400 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c58820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c58820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56024/0 (socket says 172.21.15.129:56024) 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 -- 172.21.15.129:0/1477260783 learned_addr learned my addr 172.21.15.129:0/1477260783 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 -- 172.21.15.129:0/1477260783 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638d8c58df0 con 0x5638d8c58400 2024-02-18T16:22:30.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 --2- 172.21.15.129:0/1477260783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c58820 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efe480e4780 tx=0x7efe480aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c8c3b79032d903 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efd34ff9640 1 -- 172.21.15.129:0/1477260783 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480064c0 con 0x5638d8c58400 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efd34ff9640 1 -- 172.21.15.129:0/1477260783 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe480be730 con 0x5638d8c58400 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efd34ff9640 1 -- 172.21.15.129:0/1477260783 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480b4c50 con 0x5638d8c58400 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- 172.21.15.129:0/1477260783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 msgr2=0x5638d8c58820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 --2- 172.21.15.129:0/1477260783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c58820 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efe480e4780 tx=0x7efe480aae30 comp rx=0 tx=0).stop 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- 172.21.15.129:0/1477260783 shutdown_connections 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 --2- 172.21.15.129:0/1477260783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c58820 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- 172.21.15.129:0/1477260783 >> 172.21.15.129:0/1477260783 conn(0x5638d8c54790 msgr2=0x5638d8c527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- 172.21.15.129:0/1477260783 shutdown_connections 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- 172.21.15.129:0/1477260783 wait complete. 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 Processor -- start 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- start start 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c2a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe53b63980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638d8c2acb0 con 0x5638d8c58400 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c2a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c2a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56026/0 (socket says 172.21.15.129:56026) 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.064+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 learned_addr learned my addr 172.21.15.129:0/1273766024 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638d8c4ca90 con 0x5638d8c58400 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe50e7d640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c2a770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efe480aae70 tx=0x7efe480e46e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efd22ffd640 1 -- 172.21.15.129:0/1273766024 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480d5050 con 0x5638d8c58400 2024-02-18T16:22:30.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638d8c28e90 con 0x5638d8c58400 2024-02-18T16:22:30.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efd22ffd640 1 -- 172.21.15.129:0/1273766024 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe480d6040 con 0x5638d8c58400 2024-02-18T16:22:30.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efd22ffd640 1 -- 172.21.15.129:0/1273766024 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe480068e0 con 0x5638d8c58400 2024-02-18T16:22:30.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638d8c292c0 con 0x5638d8c58400 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efd22ffd640 1 -- 172.21.15.129:0/1273766024 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efe480b4c50 con 0x5638d8c58400 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efd22ffd640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd1c0342b0 0x7efd1c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efd22ffd640 1 -- 172.21.15.129:0/1273766024 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7efe480b6160 con 0x5638d8c58400 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe51e7f640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd1c0342b0 0x7efd1c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8c6cb60 0x5638d8c6f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c6f770 con 0x5638d8c6cb60 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe5167e640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8c6cb60 0x5638d8c6f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe51e7f640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd1c0342b0 0x7efd1c036770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efe4c011010 tx=0x7efe4c020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe5167e640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8c6cb60 0x5638d8c6f020 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 realm 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c6fb40 con 0x5638d8c6cb60 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c703c0 con 0x5638d8c6cb60 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.068+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c70720 con 0x5638d8c6cb60 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c70f20 con 0x5638d8c6cb60 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 20 searching for the correct realm 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5638d8c72db0 0x5638d8c751a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe50e7d640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5638d8c72db0 0x5638d8c751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe50e7d640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5638d8c72db0 0x5638d8c751a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe50e7d640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7efe480ef070 0x7efe480ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe51e7f640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7efe480ef070 0x7efe480ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe51e7f640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7efe480ef070 0x7efe480ef7b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c00a4d0 con 0x7efe480ef070 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe51e7f640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7efe4c0141d0 0x7efe4c015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe5167e640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7efe4c0141d0 0x7efe4c015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe5167e640 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7efe4c0141d0 0x7efe4c015940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.072+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c00a4d0 con 0x7efe480ef070 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.076+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.096 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x5638d8c6cb60 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.080+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe4c0141d0 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe44024cd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c72db0 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x5638d8c6cb60 2024-02-18T16:22:30.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75850 con 0x7efe480ef070 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c71880 con 0x5638d8c6cb60 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c720d0 con 0x5638d8c6cb60 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c75c70 con 0x5638d8c6cb60 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 zone default found 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 4 Realm: () 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 zonegroup default 2024-02-18T16:22:30.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c76110 con 0x7efe480ef070 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.084+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c77af0 con 0x5638d8c72db0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c77f50 con 0x5638d8c72db0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 20 started sync module instance, tier type = 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:30.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c770c0 con 0x7efe480ef070 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94802155107440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c770c0 con 0x7efe480ef070 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c78980 con 0x5638d8c6cb60 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94802155107440] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94802155111920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c770c0 con 0x5638d8c6cb60 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.088+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c79340 con 0x5638d8c72db0 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.092+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94802155111920] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.092+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.092+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94802155114144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c796a0 con 0x5638d8c72db0 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.092+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7a010 con 0x7efe480ef070 2024-02-18T16:22:30.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.092+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.092+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94802155117696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7a890 con 0x7efe480ef070 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7b260 con 0x5638d8c6cb60 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94802155114144] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94802155117696] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94802155122016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7a3f0 con 0x5638d8c6cb60 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7bab0 con 0x7efe4c0141d0 2024-02-18T16:22:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.096+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94802155122016] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94802155105312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7a3f0 con 0x7efe4c0141d0 2024-02-18T16:22:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7bf90 con 0x7efe4c0141d0 2024-02-18T16:22:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94802155105312] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94802155125392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7bf50 con 0x7efe4c0141d0 2024-02-18T16:22:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.100+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7c930 con 0x7efe4c0141d0 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94802155127888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7cdd0 con 0x7efe4c0141d0 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=0 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=1 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=2 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=3 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=4 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=5 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94802155125392] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=6 2024-02-18T16:22:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94802155127888] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 20 add_watcher() i=7 2024-02-18T16:22:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7b3d0 con 0x5638d8c6cb60 2024-02-18T16:22:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.104+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94802155128944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7b3d0 con 0x5638d8c6cb60 2024-02-18T16:22:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94802155128944] v32'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efd07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efe53b63980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efe53b63980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c88420 con 0x5638d8c6cb60 2024-02-18T16:22:30.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.108+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c88480 con 0x7efe4c0141d0 2024-02-18T16:22:30.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.112+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.112+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c88b10 con 0x5638d8c72db0 2024-02-18T16:22:30.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.112+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.112+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c894e0 con 0x5638d8c6cb60 2024-02-18T16:22:30.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.112+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.112+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c865c0 con 0x7efe480ef070 2024-02-18T16:22:30.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.116+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.116+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c865c0 con 0x5638d8c72db0 2024-02-18T16:22:30.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.116+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.116+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8a6c0 con 0x5638d8c6cb60 2024-02-18T16:22:30.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.120+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.120+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c854c0 con 0x7efe4c0141d0 2024-02-18T16:22:30.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.120+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.120+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c85ab0 con 0x7efe480ef070 2024-02-18T16:22:30.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.124+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.124+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c85ab0 con 0x5638d8c72db0 2024-02-18T16:22:30.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.124+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.124+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8b8a0 con 0x7efe480ef070 2024-02-18T16:22:30.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.124+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.124+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c84540 con 0x7efe4c0141d0 2024-02-18T16:22:30.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.128+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.135 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.128+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c84540 con 0x7efe480ef070 2024-02-18T16:22:30.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.128+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.137 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.128+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c84540 con 0x7efe4c0141d0 2024-02-18T16:22:30.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.132+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.132+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c84540 con 0x5638d8c6cb60 2024-02-18T16:22:30.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.132+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.132+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c84540 con 0x5638d8c72db0 2024-02-18T16:22:30.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.136+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.136+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x7efe480ef070 2024-02-18T16:22:30.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.136+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.136+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.140+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.140+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c6cb60 2024-02-18T16:22:30.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.140+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.140+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c6cb60 2024-02-18T16:22:30.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.144+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.144+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.144+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.144+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x7efe480ef070 2024-02-18T16:22:30.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.144+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.144+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.148+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.148+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.148+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.148+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.152+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.152+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.152+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.152+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x7efe4c0141d0 2024-02-18T16:22:30.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.156+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.162 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.156+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.156+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.163 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.156+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x7efe4c0141d0 2024-02-18T16:22:30.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.156+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.160+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c72db0 2024-02-18T16:22:30.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.160+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.160+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x7efe4c0141d0 2024-02-18T16:22:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x7efe480ef070 2024-02-18T16:22:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efd06fe5640 20 reqs_thread_entry: start 2024-02-18T16:22:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe53b63980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe53b63980 20 Filter name: none 2024-02-18T16:22:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efd04fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe53b63980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-18T16:22:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe53b63980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.164+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c87b60 con 0x7efe480ef070 2024-02-18T16:22:30.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(94 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:22:30.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-18T16:22:30.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8c240 con 0x5638d8c6cb60 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94802155173600 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c87b00 con 0x7efe4c0141d0 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== watch-notify(notify (1) cookie 94802155105312 notify 137438953494 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5638d8c348c0 con 0x7efe4c0141d0 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efd34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94802155105312 notifier 4748 bl.length()=170 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efd34ff9640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efd14003d60 con 0x7efe4c0141d0 2024-02-18T16:22:30.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(96 notify.5 [notify cookie 94802155173600 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== watch-notify(notify_complete (2) cookie 94802155173600 notify 137438953494 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5638d8c34490 con 0x7efe4c0141d0 2024-02-18T16:22:30.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8b230 con 0x5638d8c6cb60 2024-02-18T16:22:30.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v32'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 removing email index: 2024-02-18T16:22:30.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 removing user buckets index 2024-02-18T16:22:30.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-02-18T16:22:30.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.168+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94802155173552 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c87ad0 con 0x7efe4c0141d0 2024-02-18T16:22:30.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== watch-notify(notify (1) cookie 94802155125392 notify 137438953495 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x5638d8c34490 con 0x7efe4c0141d0 2024-02-18T16:22:30.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efd23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94802155125392 notifier 4748 bl.length()=160 2024-02-18T16:22:30.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(99 notify.6 [notify cookie 94802155173552 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efd23fff640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efc780032c0 con 0x7efe4c0141d0 2024-02-18T16:22:30.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== watch-notify(notify_complete (2) cookie 94802155173552 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7efe44029030 con 0x7efe4c0141d0 2024-02-18T16:22:30.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.180 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8b230 con 0x5638d8c6cb60 2024-02-18T16:22:30.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(101 bud.buckets [delete] v32'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe53b63980 10 removing user index: bud 2024-02-18T16:22:30.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe53b63980 10 removing default.rgw.meta+users.uid+bud from cache 2024-02-18T16:22:30.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe53b63980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-18T16:22:30.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94802155308608 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8b230 con 0x7efe4c0141d0 2024-02-18T16:22:30.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== watch-notify(notify (1) cookie 94802155105312 notify 137438953496 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7efe44029030 con 0x7efe4c0141d0 2024-02-18T16:22:30.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efd34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94802155105312 notifier 4748 bl.length()=152 2024-02-18T16:22:30.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.172+0000 7efd34ff9640 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efd14003d60 con 0x7efe4c0141d0 2024-02-18T16:22:30.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(102 notify.5 [notify cookie 94802155308608 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== watch-notify(notify_complete (2) cookie 94802155308608 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5638d8a8f4d0 con 0x7efe4c0141d0 2024-02-18T16:22:30.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8b230 con 0x7efe480ef070 2024-02-18T16:22:30.184 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(104 bud [call,call,delete] v32'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efd07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.176+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94802155128944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c8b5e0 con 0x5638d8c6cb60 2024-02-18T16:22:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.180+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94802155128944] v32'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.180+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94802155107440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7c870 con 0x7efe480ef070 2024-02-18T16:22:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.180+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94802155107440] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.180+0000 7efe53b63980 20 remove_watcher() i=0 2024-02-18T16:22:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.180+0000 7efe53b63980 2 removed watcher, disabling cache 2024-02-18T16:22:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.180+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94802155111920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7c870 con 0x5638d8c6cb60 2024-02-18T16:22:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.184+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94802155111920] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.184+0000 7efe53b63980 20 remove_watcher() i=1 2024-02-18T16:22:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.184+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94802155114144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c785f0 con 0x5638d8c72db0 2024-02-18T16:22:30.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.184+0000 7efe50e7d640 1 -- 172.21.15.129:0/1273766024 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94802155114144] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe480ec070 con 0x5638d8c72db0 2024-02-18T16:22:30.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.184+0000 7efe53b63980 20 remove_watcher() i=2 2024-02-18T16:22:30.193 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.184+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94802155117696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7c870 con 0x7efe480ef070 2024-02-18T16:22:30.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.188+0000 7efe51e7f640 1 -- 172.21.15.129:0/1273766024 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94802155117696] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe4c03a040 con 0x7efe480ef070 2024-02-18T16:22:30.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.188+0000 7efe53b63980 20 remove_watcher() i=3 2024-02-18T16:22:30.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.188+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94802155122016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c78ea0 con 0x5638d8c6cb60 2024-02-18T16:22:30.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.188+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94802155122016] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x5638d8c6cb60 2024-02-18T16:22:30.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.188+0000 7efe53b63980 20 remove_watcher() i=4 2024-02-18T16:22:30.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.188+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94802155105312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c7c870 con 0x7efe4c0141d0 2024-02-18T16:22:30.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.192+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94802155105312] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.192+0000 7efe53b63980 20 remove_watcher() i=5 2024-02-18T16:22:30.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.192+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94802155125392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c76c20 con 0x7efe4c0141d0 2024-02-18T16:22:30.201 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.192+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94802155125392] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.192+0000 7efe53b63980 20 remove_watcher() i=6 2024-02-18T16:22:30.202 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.192+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94802155127888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5638d8c76c20 con 0x7efe4c0141d0 2024-02-18T16:22:30.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94802155127888] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe44054040 con 0x7efe4c0141d0 2024-02-18T16:22:30.206 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 20 remove_watcher() i=7 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7efe4c0141d0 msgr2=0x7efe4c015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7efe4c0141d0 0x7efe4c015940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8c6cb60 msgr2=0x5638d8c6f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8c6cb60 0x5638d8c6f020 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7efe480ef070 msgr2=0x7efe480ef7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7efe480ef070 0x7efe480ef7b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5638d8c72db0 msgr2=0x5638d8c751a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5638d8c72db0 0x5638d8c751a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd1c0342b0 msgr2=0x7efd1c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd1c0342b0 0x7efd1c036770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efe4c011010 tx=0x7efe4c020000 comp rx=0 tx=0).stop 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 msgr2=0x5638d8c2a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.207 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe5167e640 1 -- 172.21.15.129:0/1273766024 reap_dead start 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c2a770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efe480aae70 tx=0x7efe480e46e0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 shutdown_connections 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/1273766024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c58400 0x5638d8c2a770 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 >> 172.21.15.129:0/1273766024 conn(0x5638d8c54790 msgr2=0x5638d8c51df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 shutdown_connections 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/1273766024 wait complete. 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd2c0342b0 msgr2=0x7efd2c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd2c0342b0 0x7efd2c036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5638d8c3b930 tx=0x7efe4c005850 comp rx=0 tx=0).stop 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 msgr2=0x5638d8c4b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 0x5638d8c4b810 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efe48096e80 tx=0x7efe48018020 comp rx=0 tx=0).stop 2024-02-18T16:22:30.208 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 shutdown_connections 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd2c0342b0 0x7efd2c036770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/2207640844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8c4b3f0 0x5638d8c4b810 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 >> 172.21.15.129:0/2207640844 conn(0x5638d8c40200 msgr2=0x5638d8c40d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 shutdown_connections 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2207640844 wait complete. 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8b46580 msgr2=0x5638d8c3abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.196+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8b46580 0x5638d8c3abd0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd380342b0 msgr2=0x7efd38036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd380342b0 0x7efd38036770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efe480ad000 tx=0x7efe480a5040 comp rx=0 tx=0).stop 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 msgr2=0x5638d8c33f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c33f50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efe4400b710 tx=0x7efe44000bd0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.209 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 shutdown_connections 2024-02-18T16:22:30.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5638d8b46580 0x5638d8c3abd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7efd380342b0 0x7efd38036770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 --2- 172.21.15.129:0/2609652360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5638d8b42020 0x5638d8c33f50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 >> 172.21.15.129:0/2609652360 conn(0x5638d8b3d8f0 msgr2=0x5638d8c2ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 shutdown_connections 2024-02-18T16:22:30.210 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.200+0000 7efe53b63980 1 -- 172.21.15.129:0/2609652360 wait complete. 2024-02-18T16:22:30.218 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-18T16:22:30.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-18T16:22:30.218 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-02-18T16:22:30.299 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:30.299 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:30.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbe0782980 1 Processor -- start 2024-02-18T16:22:30.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbe0782980 1 -- start start 2024-02-18T16:22:30.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbe0782980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5622097c35e0 0x5622097c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbe0782980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5622097114d0 con 0x5622097c3f00 2024-02-18T16:22:30.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbe0782980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5622096d8180 con 0x5622097c35e0 2024-02-18T16:22:30.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbde29d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5622097c35e0 0x5622097c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbdda9c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5622097c3f00 0x5622097ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40440/0 (socket says 172.21.15.129:40440) 2024-02-18T16:22:30.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbdda9c640 1 -- 172.21.15.129:0/630336865 learned_addr learned my addr 172.21.15.129:0/630336865 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:30.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbde29d640 1 -- 172.21.15.129:0/630336865 >> v1:172.21.15.80:6789/0 conn(0x5622097c3f00 legacy=0x5622097ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.292+0000 7fbbde29d640 1 -- 172.21.15.129:0/630336865 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622097ccee0 con 0x5622097c35e0 2024-02-18T16:22:30.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbde29d640 1 --2- 172.21.15.129:0/630336865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622097c39c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000a420 tx=0x7fbbd001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43057a70ad3e415d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbdd29b640 1 -- 172.21.15.129:0/630336865 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd00aa530 con 0x5622097c35e0 2024-02-18T16:22:30.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbdd29b640 1 -- 172.21.15.129:0/630336865 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00a6050 con 0x5622097c35e0 2024-02-18T16:22:30.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbdd29b640 1 -- 172.21.15.129:0/630336865 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd00aa800 con 0x5622097c35e0 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 -- 172.21.15.129:0/630336865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 msgr2=0x5622097c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 --2- 172.21.15.129:0/630336865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622097c39c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000a420 tx=0x7fbbd001afd0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 -- 172.21.15.129:0/630336865 shutdown_connections 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 --2- 172.21.15.129:0/630336865 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622097c39c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 -- 172.21.15.129:0/630336865 >> 172.21.15.129:0/630336865 conn(0x5622097bf070 msgr2=0x5622097c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 -- 172.21.15.129:0/630336865 shutdown_connections 2024-02-18T16:22:30.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.296+0000 7fbbe0782980 1 -- 172.21.15.129:0/630336865 wait complete. 2024-02-18T16:22:30.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.312+0000 7fbbe0782980 1 Processor -- start 2024-02-18T16:22:30.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.312+0000 7fbbe0782980 1 -- start start 2024-02-18T16:22:30.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.312+0000 7fbbe0782980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.312+0000 7fbbe0782980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622096d56b0 con 0x5622097c35e0 2024-02-18T16:22:30.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56042/0 (socket says 172.21.15.129:56042) 2024-02-18T16:22:30.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 -- 172.21.15.129:0/1365052998 learned_addr learned my addr 172.21.15.129:0/1365052998 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 -- 172.21.15.129:0/1365052998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd000a100 con 0x5622097c35e0 2024-02-18T16:22:30.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 --2- 172.21.15.129:0/1365052998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098af0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00ad040 tx=0x7fbbd00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e8f40572392c92 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbacc608640 1 -- 172.21.15.129:0/1365052998 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd00aa6c0 con 0x5622097c35e0 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbacc608640 1 -- 172.21.15.129:0/1365052998 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00aa820 con 0x5622097c35e0 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbacc608640 1 -- 172.21.15.129:0/1365052998 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd00aaac0 con 0x5622097c35e0 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- 172.21.15.129:0/1365052998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 msgr2=0x5622098af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1365052998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098af0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00ad040 tx=0x7fbbd00033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- 172.21.15.129:0/1365052998 shutdown_connections 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1365052998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098af0a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- 172.21.15.129:0/1365052998 >> 172.21.15.129:0/1365052998 conn(0x5622097bf070 msgr2=0x5622098aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- 172.21.15.129:0/1365052998 shutdown_connections 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- 172.21.15.129:0/1365052998 wait complete. 2024-02-18T16:22:30.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 Processor -- start 2024-02-18T16:22:30.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- start start 2024-02-18T16:22:30.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbe0782980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622096d0e90 con 0x5622097c35e0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56058/0 (socket says 172.21.15.129:56058) 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 -- 172.21.15.129:0/3841014041 learned_addr learned my addr 172.21.15.129:0/3841014041 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.316+0000 7fbbde29d640 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622097ccee0 con 0x5622097c35e0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbde29d640 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098b5d50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbbd001b4b0 tx=0x7fbbd0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbacae05640 1 -- 172.21.15.129:0/3841014041 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd00c5070 con 0x5622097c35e0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbacae05640 1 -- 172.21.15.129:0/3841014041 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00b6bb0 con 0x5622097c35e0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622098b6290 con 0x5622097c35e0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbacae05640 1 -- 172.21.15.129:0/3841014041 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd00b6e70 con 0x5622097c35e0 2024-02-18T16:22:30.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622098b6740 con 0x5622097c35e0 2024-02-18T16:22:30.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbacae05640 1 -- 172.21.15.129:0/3841014041 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbbd00ca410 con 0x5622097c35e0 2024-02-18T16:22:30.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbacae05640 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbac40342b0 0x7fbac4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbacae05640 1 -- 172.21.15.129:0/3841014041 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fbbd00e3a90 con 0x5622097c35e0 2024-02-18T16:22:30.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbac40342b0 0x7fbac4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622097c3f00 0x5622098bc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098bcec0 con 0x5622097c3f00 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622097c3f00 0x5622098bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbac40342b0 0x7fbac4036770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4001da0 tx=0x7fbbd4001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622097c3f00 0x5622098bc980 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbdea9e640 1 -- 172.21.15.129:0/3841014041 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbd80083f0 con 0x5622097c3f00 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098bd2b0 con 0x5622097c3f00 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbdea9e640 1 -- 172.21.15.129:0/3841014041 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbbd80083f0 con 0x5622097c3f00 2024-02-18T16:22:30.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.320+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098beb60 con 0x5622097c3f00 2024-02-18T16:22:30.331 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdea9e640 1 -- 172.21.15.129:0/3841014041 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fbbd80083f0 con 0x5622097c3f00 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098bdd60 con 0x5622097c3f00 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdea9e640 1 -- 172.21.15.129:0/3841014041 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbbd80083f0 con 0x5622097c3f00 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098be170 con 0x5622097c3f00 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdea9e640 1 -- 172.21.15.129:0/3841014041 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbbd8012040 con 0x5622097c3f00 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 Processor -- start 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 -- start start 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 0x5622098cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x562209669f20 con 0x5622098cd220 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdda9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 0x5622098cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdda9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 0x5622098cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56062/0 (socket says 172.21.15.129:56062) 2024-02-18T16:22:30.332 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1059598329 learned_addr learned my addr 172.21.15.129:0/1059598329 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.335 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1059598329 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622098cdb80 con 0x5622098cd220 2024-02-18T16:22:30.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 0x5622098cd640 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d660 tx=0x7fbbd400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbac3fff640 1 -- 172.21.15.129:0/1059598329 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4020070 con 0x5622098cd220 2024-02-18T16:22:30.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbac3fff640 1 -- 172.21.15.129:0/1059598329 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd400c770 con 0x5622098cd220 2024-02-18T16:22:30.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622098cddd0 con 0x5622098cd220 2024-02-18T16:22:30.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbac3fff640 1 -- 172.21.15.129:0/1059598329 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4013040 con 0x5622098cd220 2024-02-18T16:22:30.336 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.324+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622098ce920 con 0x5622098cd220 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbac3fff640 1 -- 172.21.15.129:0/1059598329 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbbd400a040 con 0x5622098cd220 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbac3fff640 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbab8034300 0x7fbab80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbac3fff640 1 -- 172.21.15.129:0/1059598329 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fbbd404b6f0 con 0x5622098cd220 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbab8034300 0x7fbab80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 Processor -- start 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbab8034300 0x7fbab80367c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5622098bd7a0 tx=0x7fbbd8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- start start 2024-02-18T16:22:30.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622097c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x56220965d790 con 0x5622097c5c30 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdda9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622097c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdda9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622097c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56066/0 (socket says 172.21.15.129:56066) 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdda9c640 1 -- 172.21.15.129:0/2679483833 learned_addr learned my addr 172.21.15.129:0/2679483833 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdda9c640 1 -- 172.21.15.129:0/2679483833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622097c4480 con 0x5622097c5c30 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/2679483833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622097c6050 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4019ef0 tx=0x7fbbd40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80ce7710e2d27c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbac1ffb640 1 -- 172.21.15.129:0/2679483833 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd401b7a0 con 0x5622097c5c30 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbac1ffb640 1 -- 172.21.15.129:0/2679483833 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd401b900 con 0x5622097c5c30 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbac1ffb640 1 -- 172.21.15.129:0/2679483833 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd401adf0 con 0x5622097c5c30 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- 172.21.15.129:0/2679483833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 msgr2=0x5622097c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 --2- 172.21.15.129:0/2679483833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622097c6050 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4019ef0 tx=0x7fbbd40196f0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- 172.21.15.129:0/2679483833 shutdown_connections 2024-02-18T16:22:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 --2- 172.21.15.129:0/2679483833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622097c6050 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- 172.21.15.129:0/2679483833 >> 172.21.15.129:0/2679483833 conn(0x5622098d6580 msgr2=0x5622098d45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- 172.21.15.129:0/2679483833 shutdown_connections 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 -- 172.21.15.129:0/2679483833 wait complete. 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.328+0000 7fbbe0782980 1 Processor -- start 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 -- start start 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622098e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622098e3880 con 0x5622097c5c30 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbdda9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622098e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbdda9c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622098e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56070/0 (socket says 172.21.15.129:56070) 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 learned_addr learned my addr 172.21.15.129:0/1371574321 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622098ce920 con 0x5622097c5c30 2024-02-18T16:22:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622098e3340 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40488a0 tx=0x7fbbd4049910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbaaffff640 1 -- 172.21.15.129:0/1371574321 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4048590 con 0x5622097c5c30 2024-02-18T16:22:30.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622098e3a80 con 0x5622097c5c30 2024-02-18T16:22:30.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbaaffff640 1 -- 172.21.15.129:0/1371574321 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4034070 con 0x5622097c5c30 2024-02-18T16:22:30.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbaaffff640 1 -- 172.21.15.129:0/1371574321 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbd400cb60 con 0x5622097c5c30 2024-02-18T16:22:30.343 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622098e3f10 con 0x5622097c5c30 2024-02-18T16:22:30.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbaaffff640 1 -- 172.21.15.129:0/1371574321 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbbd400ccc0 con 0x5622097c5c30 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbaaffff640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbaa80342b0 0x7fbaa8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbaaffff640 1 -- 172.21.15.129:0/1371574321 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fbbd4040020 con 0x5622097c5c30 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbaa80342b0 0x7fbaa8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622098ee920 0x5622098f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.332+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f1530 con 0x5622098ee920 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbaa80342b0 0x7fbaa8036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8008fd0 tx=0x7fbbd801c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622098ee920 0x5622098f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622098ee920 0x5622098f0de0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 realm 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f1900 con 0x5622098ee920 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f2180 con 0x5622098ee920 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.349 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f24e0 con 0x5622098ee920 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f2ce0 con 0x5622098ee920 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 20 searching for the correct realm 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622098f4b70 0x5622098f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622098f4b70 0x5622098f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622098f4b70 0x5622098f7000 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdda9c640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbbd401a3c0 0x7fbbd4030450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbbd401a3c0 0x7fbbd4030450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbbd401a3c0 0x7fbbd4030450 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd802c040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdea9e640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbbd8027940 0x7fbbd80333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.336+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbbd8027940 0x7fbbd80333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbbd8027940 0x7fbbd80333c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:30.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd802c040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.340+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbbd802c040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.344+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.359 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd802c040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd802c040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd8027940 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd00b1040 con 0x7fbbd8027940 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd802c040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098f4b70 2024-02-18T16:22:30.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.348+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x5622098ee920 2024-02-18T16:22:30.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fbbd00b1040 con 0x5622098ee920 2024-02-18T16:22:30.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f76d0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f35e0 con 0x5622098ee920 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f3e30 con 0x5622098ee920 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f7b10 con 0x5622098ee920 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 zone default found 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 4 Realm: () 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 zonegroup default 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f7b70 con 0x7fbbd401a3c0 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f9950 con 0x5622098f4b70 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f9d50 con 0x5622098f4b70 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 started sync module instance, tier type = 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f9230 con 0x7fbbd401a3c0 2024-02-18T16:22:30.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.352+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94704189279632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098f95e0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.356+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098faab0 con 0x5622098ee920 2024-02-18T16:22:30.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.356+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94704189279632] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.356+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.356+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94704189284720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098faa30 con 0x5622098ee920 2024-02-18T16:22:30.368 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.356+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fb4d0 con 0x5622098f4b70 2024-02-18T16:22:30.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.369 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94704189288368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fbd20 con 0x5622098f4b70 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fc740 con 0x7fbbd401a3c0 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94704189284720] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94704189293088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fcaf0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fd4a0 con 0x5622098ee920 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94704189288368] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94704189293088] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94704189285776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fcfc0 con 0x5622098ee920 2024-02-18T16:22:30.370 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.360+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fd930 con 0x7fbbd8027940 2024-02-18T16:22:30.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.364+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94704189285776] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.364+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.364+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94704189290624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fd930 con 0x7fbbd8027940 2024-02-18T16:22:30.372 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.364+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fe2a0 con 0x7fbbd8027940 2024-02-18T16:22:30.374 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94704189290624] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94704189297808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098fe2a0 con 0x7fbbd8027940 2024-02-18T16:22:30.375 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098feae0 con 0x7fbbd8027940 2024-02-18T16:22:30.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94704189301408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098ff160 con 0x7fbbd8027940 2024-02-18T16:22:30.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=0 2024-02-18T16:22:30.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=1 2024-02-18T16:22:30.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=2 2024-02-18T16:22:30.377 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=3 2024-02-18T16:22:30.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=4 2024-02-18T16:22:30.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=5 2024-02-18T16:22:30.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94704189297808] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.378 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.368+0000 7fbbe0782980 20 add_watcher() i=6 2024-02-18T16:22:30.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94704189301408] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 20 add_watcher() i=7 2024-02-18T16:22:30.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:30.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209902080 con 0x5622098ee920 2024-02-18T16:22:30.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.379 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94704189303728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622098ff4a0 con 0x5622098ee920 2024-02-18T16:22:30.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94704189303728] v32'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fba94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:30.380 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:30.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:30.381 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.372+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990a5e0 con 0x5622098ee920 2024-02-18T16:22:30.382 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.376+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.383 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.376+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990aa20 con 0x7fbbd8027940 2024-02-18T16:22:30.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.376+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.385 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.376+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990aec0 con 0x5622098f4b70 2024-02-18T16:22:30.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.380+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.386 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.380+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990b6c0 con 0x5622098ee920 2024-02-18T16:22:30.387 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.380+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.388 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.380+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990b6c0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.380+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.389 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.380+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990bbf0 con 0x5622098f4b70 2024-02-18T16:22:30.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.384+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.384+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990c5c0 con 0x5622098ee920 2024-02-18T16:22:30.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.384+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.384+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990c5c0 con 0x7fbbd8027940 2024-02-18T16:22:30.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.388+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.388+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990c5c0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.388+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.388+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990caf0 con 0x5622098f4b70 2024-02-18T16:22:30.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.392+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.392+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220990cf90 con 0x7fbbd401a3c0 2024-02-18T16:22:30.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.392+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.392+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099085b0 con 0x7fbbd8027940 2024-02-18T16:22:30.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.392+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.392+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.396+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.403 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.396+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd8027940 2024-02-18T16:22:30.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.396+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.396+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098ee920 2024-02-18T16:22:30.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.400+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.400+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.408 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.400+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.409 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.400+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.404+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.410 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.404+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.404+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.411 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.404+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098ee920 2024-02-18T16:22:30.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.404+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.408+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098ee920 2024-02-18T16:22:30.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.408+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.408+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.408+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.418 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.408+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.412+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.412+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.412+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.412+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.416+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.416+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.416+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.416+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.416+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.416+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd8027940 2024-02-18T16:22:30.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.420+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.420+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.420+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.420+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd8027940 2024-02-18T16:22:30.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.424+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.424+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x5622098f4b70 2024-02-18T16:22:30.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.424+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.424+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd8027940 2024-02-18T16:22:30.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.428+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.436 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.428+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908ba0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.438 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fba0f7fe640 20 reqs_thread_entry: start 2024-02-18T16:22:30.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:30.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 20 Filter name: none 2024-02-18T16:22:30.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fba0d7fa640 20 reqs_thread_entry: start 2024-02-18T16:22:30.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-18T16:22:30.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209907cc0 con 0x7fbbd8027940 2024-02-18T16:22:30.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=346 2024-02-18T16:22:30.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-18T16:22:30.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-18T16:22:30.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:30.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209908060 con 0x7fbbd8027940 2024-02-18T16:22:30.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.432+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 : miss 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:96 8.14 8:29a8d8ed:root::.bucket.meta.myfoo7%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209929370 con 0x5622098f4b70 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=355 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 info.flags=0x17 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 to cache LRU end 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:97 4.0 4:0266ccb4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6cd0 con 0x5622098f4b70 2024-02-18T16:22:30.444 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(97 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:98 4.30 4:0d9ccd95:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d10 con 0x5622098f4b70 2024-02-18T16:22:30.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(98 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.445 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:99 4.3a 4:5f750c47:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d10 con 0x5622098f4b70 2024-02-18T16:22:30.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(99 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:100 4.5 4:a3e6fa0e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d10 con 0x5622098f4b70 2024-02-18T16:22:30.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(100 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 4.31 4:8db12e53:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d10 con 0x5622098ee920 2024-02-18T16:22:30.446 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(101 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.436+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:102 4.3b 4:de4170c8:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d10 con 0x5622098f4b70 2024-02-18T16:22:30.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(102 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 [call out=377b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+377 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 10 cls_bucket_list_unordered: got fourteen 2024-02-18T16:22:30.447 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:103 4.2a 4:5454dfe6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d20 con 0x5622098ee920 2024-02-18T16:22:30.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(103 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:104 4.2e 4:75dc8a45:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d20 con 0x5622098f4b70 2024-02-18T16:22:30.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(104 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:105 4.d 4:b3e756e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d20 con 0x5622098f4b70 2024-02-18T16:22:30.448 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(105 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:106 4.30 4:0e36627f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d20 con 0x5622098f4b70 2024-02-18T16:22:30.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(106 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:107 4.33 4:cd082ca3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099a6d20 con 0x7fbbd8027940 2024-02-18T16:22:30.449 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(107 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 20 get_obj_state: octx=0x7fbbd0005e80 obj=myfoo7:fourteen state=0x56220992a5c8 s->prefetch_data=0 2024-02-18T16:22:30.450 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.440+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:108 3.29s0 3:974a0638:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220992b3d0 con 0x7fbbd8027940 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(108 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 239+0+872 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 10 manifest: total_size = 8 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7370123470211735645 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 20 get_obj_state: octx=0x7fbbd0005e80 obj=myfoo7:fourteen state=0x56220992a5c8 s->prefetch_data=0 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 20 prepare_atomic_modification: state is not atomic. state=0x56220992a5c8 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 2024-02-18T16:22:30.451 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:109 4.3b 4:de4170c8:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220992fc80 con 0x5622098f4b70 2024-02-18T16:22:30.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 35 ==== osd_op_reply(109 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 [stat,call,call] v32'20 uv20 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.453 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.444+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:110 3.29s0 3:974a0638:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220992dc60 con 0x7fbbd8027940 2024-02-18T16:22:30.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(110 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10_fourteen [call] v32'4 uv4 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:111 4.3b 4:de4170c8:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220992dc60 con 0x5622098f4b70 2024-02-18T16:22:30.456 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 20 list_objects_ordered: starting attempt 1 2024-02-18T16:22:30.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-18T16:22:30.457 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:112 4.0 4:0266ccb4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220992dc60 con 0x5622098f4b70 2024-02-18T16:22:30.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:113 4.30 4:0d9ccd95:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209933c90 con 0x5622098f4b70 2024-02-18T16:22:30.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:114 4.3a 4:5f750c47:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220992dc60 con 0x5622098f4b70 2024-02-18T16:22:30.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:115 4.5 4:a3e6fa0e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209938a10 con 0x5622098f4b70 2024-02-18T16:22:30.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 36 ==== osd_op_reply(113 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:116 4.31 4:8db12e53:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220993b410 con 0x5622098ee920 2024-02-18T16:22:30.459 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 37 ==== osd_op_reply(112 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:117 4.3b 4:de4170c8:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209931870 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:118 4.2a 4:5454dfe6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209933360 con 0x5622098ee920 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.448+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:119 4.2e 4:75dc8a45:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56220993e4c0 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:120 4.d 4:b3e756e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209940e20 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:121 4.30 4:0e36627f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209943880 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:122 4.33 4:cd082ca3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099462a0 con 0x7fbbd8027940 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 38 ==== osd_op_reply(114 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 39 ==== osd_op_reply(115 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(116 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.460 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(118 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 40 ==== osd_op_reply(119 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 41 ==== osd_op_reply(120 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 42 ==== osd_op_reply(121 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.461 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(122 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 43 ==== osd_op_reply(111 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 [stat,call,call] v32'21 uv21 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbac1ffb640 20 handle_completion(): completion ok for obj=fourteen 2024-02-18T16:22:30.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 44 ==== osd_op_reply(117 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 [call out=124b] v0'0 uv21 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.464 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10])"; uploads.size()=0; is_truncated=0 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:123 4.0 4:0266ccb4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209946220 con 0x5622098f4b70 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:124 4.30 4:0d9ccd95:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099383d0 con 0x5622098f4b70 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:125 4.3a 4:5f750c47:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945190 con 0x5622098f4b70 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:126 4.5 4:a3e6fa0e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099455e0 con 0x5622098f4b70 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:127 4.31 4:8db12e53:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945a20 con 0x5622098ee920 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:128 4.3b 4:de4170c8:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209946220 con 0x5622098f4b70 2024-02-18T16:22:30.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:129 4.2a 4:5454dfe6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945e20 con 0x5622098ee920 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:130 4.2e 4:75dc8a45:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099409c0 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:131 4.d 4:b3e756e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099383d0 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:132 4.30 4:0e36627f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945190 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:133 4.33 4:cd082ca3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099455e0 con 0x7fbbd8027940 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 45 ==== osd_op_reply(123 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 46 ==== osd_op_reply(125 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 47 ==== osd_op_reply(128 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 [call out=124b] v0'0 uv21 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 48 ==== osd_op_reply(131 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(129 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 49 ==== osd_op_reply(130 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 50 ==== osd_op_reply(126 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.466 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(127 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 51 ==== osd_op_reply(124 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 52 ==== osd_op_reply(132 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(133 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.452+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099459e0 con 0x7fbbd8027940 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099459e0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 20 rados_obj.operate() r=0 bl.length=168 2024-02-18T16:22:30.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-02-18T16:22:30.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-02-18T16:22:30.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-02-18T16:22:30.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-02-18T16:22:30.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94704189595072 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099459e0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== watch-notify(notify (1) cookie 94704189293088 notify 137438953495 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7fbbd801a990 con 0x7fbbd401a3c0 2024-02-18T16:22:30.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(136 notify.3 [notify cookie 94704189595072 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbac17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94704189293088 notifier 4755 bl.length()=150 2024-02-18T16:22:30.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbac17fa640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fba140032c0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== watch-notify(notify_complete (2) cookie 94704189595072 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbbd801ab20 con 0x7fbbd401a3c0 2024-02-18T16:22:30.470 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.456+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099459e0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(138 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbe0782980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 from cache 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbe0782980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10, ofs0, ns] 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [notify cookie 94704189595072 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099459e0 con 0x7fbbd8027940 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== watch-notify(notify (1) cookie 94704189290624 notify 137438953497 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x5622098b6740 con 0x7fbbd8027940 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbac17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94704189290624 notifier 4755 bl.length()=208 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbac17fa640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fba140032a0 con 0x7fbbd8027940 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(139 notify.5 [notify cookie 94704189595072 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== watch-notify(notify_complete (2) cookie 94704189595072 notify 137438953497 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbbd00ce020 con 0x7fbbd8027940 2024-02-18T16:22:30.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:141 8.14 8:29a8d8ed:root::.bucket.meta.myfoo7%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.460+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(140 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 53 ==== osd_op_reply(141 .bucket.meta.myfoo7:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 [call,call,delete] v32'2 uv2 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:142 4.0 4:0266ccb4:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:143 4.30 4:0d9ccd95:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209928ab0 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:144 4.3a 4:5f750c47:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209932100 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:145 4.5 4:a3e6fa0e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209932980 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:146 4.31 4:8db12e53:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209932d40 con 0x5622098ee920 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:147 4.3b 4:de4170c8:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209930b00 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:148 4.2a 4:5454dfe6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5622099313c0 con 0x5622098ee920 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:149 4.2e 4:75dc8a45:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:150 4.d 4:b3e756e5:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209928ab0 con 0x5622098f4b70 2024-02-18T16:22:30.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:151 4.30 4:0e36627f:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209932100 con 0x5622098f4b70 2024-02-18T16:22:30.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.464+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:152 4.33 4:cd082ca3:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209932980 con 0x7fbbd8027940 2024-02-18T16:22:30.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 54 ==== osd_op_reply(142 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.0 [delete] v32'5 uv5 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(146 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.4 [delete] v32'10 uv10 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(148 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.6 [delete] v32'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(152 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.10 [delete] v32'3 uv3 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 55 ==== osd_op_reply(144 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.2 [delete] v32'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 56 ==== osd_op_reply(147 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.5 [delete] v32'22 uv22 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 57 ==== osd_op_reply(143 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.1 [delete] v32'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 58 ==== osd_op_reply(151 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.9 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 59 ==== osd_op_reply(145 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.3 [delete] v32'3 uv3 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 60 ==== osd_op_reply(149 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.7 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 61 ==== osd_op_reply(150 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10.8 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 : miss 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 20 rados->read ofs=0 len=0 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:153 6.b 6:d6537f24:::pubsub..bucket.myfoo7%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209930b00 con 0x5622098f4b70 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 62 ==== osd_op_reply(153 pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 info.flags=0x0 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 10 adding default.rgw.log++pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 to cache LRU end 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 10 removing default.rgw.log++pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 from cache 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10, ofs0, ns] 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:154 7.15 7:a93a5511:::notify.2:head [notify cookie 94704189509408 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 63 ==== watch-notify(notify (1) cookie 94704189288368 notify 137438953479 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x5622098e3f10 con 0x5622098f4b70 2024-02-18T16:22:30.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbac17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94704189288368 notifier 4755 bl.length()=205 2024-02-18T16:22:30.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbac17fa640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:155 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fba140032a0 con 0x5622098f4b70 2024-02-18T16:22:30.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 64 ==== osd_op_reply(154 notify.2 [notify cookie 94704189509408 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 65 ==== watch-notify(notify_complete (2) cookie 94704189509408 notify 137438953479 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622098e3a80 con 0x5622098f4b70 2024-02-18T16:22:30.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 66 ==== osd_op_reply(155 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.468+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:156 6.b 6:d6537f24:::pubsub..bucket.myfoo7%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.472+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 67 ==== osd_op_reply(156 pubsub..bucket.myfoo7/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.10 [delete] v32'28 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.472+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.472+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(157 fud.buckets [call] v32'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.472+0000 7fbbe0782980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-18T16:22:30.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.472+0000 7fbbe0782980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-18T16:22:30.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.472+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94704189516912 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 68 ==== watch-notify(notify (1) cookie 94704189288368 notify 137438953480 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5622098e3a80 con 0x5622098f4b70 2024-02-18T16:22:30.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbac1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94704189288368 notifier 4755 bl.length()=170 2024-02-18T16:22:30.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbac1ffb640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fbaa4003d60 con 0x5622098f4b70 2024-02-18T16:22:30.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 69 ==== osd_op_reply(158 notify.2 [notify cookie 94704189516912 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 70 ==== watch-notify(notify_complete (2) cookie 94704189516912 notify 137438953480 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622098ce920 con 0x5622098f4b70 2024-02-18T16:22:30.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 71 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbe0782980 10 removing email index: 2024-02-18T16:22:30.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbe0782980 10 removing user buckets index 2024-02-18T16:22:30.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbe0782980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-18T16:22:30.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94704189516912 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== watch-notify(notify (1) cookie 94704189297808 notify 137438953498 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7fbbd00ce020 con 0x7fbbd8027940 2024-02-18T16:22:30.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbac17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94704189297808 notifier 4755 bl.length()=160 2024-02-18T16:22:30.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 37 ==== osd_op_reply(161 notify.6 [notify cookie 94704189516912 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.476+0000 7fbac17fa640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fba140032a0 con 0x7fbbd8027940 2024-02-18T16:22:30.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 38 ==== watch-notify(notify_complete (2) cookie 94704189516912 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622098b6290 con 0x7fbbd8027940 2024-02-18T16:22:30.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 39 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 40 ==== osd_op_reply(163 fud.buckets [delete] v32'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbe0782980 10 removing user index: fud 2024-02-18T16:22:30.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbe0782980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-18T16:22:30.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbe0782980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-18T16:22:30.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94704189512800 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 41 ==== watch-notify(notify (1) cookie 94704189290624 notify 137438953499 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5622098b6290 con 0x7fbbd8027940 2024-02-18T16:22:30.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbac17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94704189290624 notifier 4755 bl.length()=152 2024-02-18T16:22:30.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbac17fa640 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fba140032a0 con 0x7fbbd8027940 2024-02-18T16:22:30.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.480+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 42 ==== osd_op_reply(164 notify.5 [notify cookie 94704189512800 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.484+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 43 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.484+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 44 ==== watch-notify(notify_complete (2) cookie 94704189512800 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5622097ccee0 con 0x7fbbd8027940 2024-02-18T16:22:30.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.484+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.484+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 45 ==== osd_op_reply(166 fud [call,call,delete] v32'7 uv7 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fba94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:30.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94704189303728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098ee920 2024-02-18T16:22:30.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94704189303728] v32'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94704189279632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94704189279632] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbe0782980 20 remove_watcher() i=0 2024-02-18T16:22:30.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbe0782980 2 removed watcher, disabling cache 2024-02-18T16:22:30.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.488+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94704189284720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098ee920 2024-02-18T16:22:30.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.492+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94704189284720] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.492+0000 7fbbe0782980 20 remove_watcher() i=1 2024-02-18T16:22:30.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.492+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94704189288368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098f4b70 2024-02-18T16:22:30.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.496+0000 7fbbdda9c640 1 -- 172.21.15.129:0/1371574321 <== osd.3 v2:172.21.15.129:6800/2085458436 72 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94704189288368] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd4022070 con 0x5622098f4b70 2024-02-18T16:22:30.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.496+0000 7fbbe0782980 20 remove_watcher() i=2 2024-02-18T16:22:30.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.496+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94704189293088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd401a3c0 2024-02-18T16:22:30.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.496+0000 7fbbdea9e640 1 -- 172.21.15.129:0/1371574321 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94704189293088] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd803f040 con 0x7fbbd401a3c0 2024-02-18T16:22:30.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.496+0000 7fbbe0782980 20 remove_watcher() i=3 2024-02-18T16:22:30.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.496+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94704189285776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x5622098ee920 2024-02-18T16:22:30.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.500+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94704189285776] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x5622098ee920 2024-02-18T16:22:30.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.500+0000 7fbbe0782980 20 remove_watcher() i=4 2024-02-18T16:22:30.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.500+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94704189290624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.500+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 46 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94704189290624] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.500+0000 7fbbe0782980 20 remove_watcher() i=5 2024-02-18T16:22:30.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.500+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94704189297808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 47 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94704189297808] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 20 remove_watcher() i=6 2024-02-18T16:22:30.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94704189301408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562209945da0 con 0x7fbbd8027940 2024-02-18T16:22:30.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 <== osd.0 v2:172.21.15.80:6800/4245413050 48 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94704189301408] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbbd00f3040 con 0x7fbbd8027940 2024-02-18T16:22:30.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 20 remove_watcher() i=7 2024-02-18T16:22:30.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbbd8027940 msgr2=0x7fbbd80333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fbbd8027940 0x7fbbd80333c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622098ee920 msgr2=0x5622098f0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622098ee920 0x5622098f0de0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbbd401a3c0 msgr2=0x7fbbd4030450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fbbd401a3c0 0x7fbbd4030450 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622098f4b70 msgr2=0x5622098f7000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5622098f4b70 0x5622098f7000 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbaa80342b0 msgr2=0x7fbaa8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbaa80342b0 0x7fbaa8036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8008fd0 tx=0x7fbbd801c070 comp rx=0 tx=0).stop 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 msgr2=0x5622098e3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbde29d640 1 -- 172.21.15.129:0/1371574321 reap_dead start 2024-02-18T16:22:30.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622098e3340 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40488a0 tx=0x7fbbd4049910 comp rx=0 tx=0).stop 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 shutdown_connections 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1371574321 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c5c30 0x5622098e3340 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 >> 172.21.15.129:0/1371574321 conn(0x5622098d6580 msgr2=0x5622098d3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 shutdown_connections 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.504+0000 7fbbe0782980 1 -- 172.21.15.129:0/1371574321 wait complete. 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbab8034300 msgr2=0x7fbab80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbab8034300 0x7fbab80367c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5622098bd7a0 tx=0x7fbbd8003070 comp rx=0 tx=0).stop 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 msgr2=0x5622098cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 0x5622098cd640 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d660 tx=0x7fbbd400da60 comp rx=0 tx=0).stop 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 shutdown_connections 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbab8034300 0x7fbab80367c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/1059598329 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622098cd220 0x5622098cd640 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 >> 172.21.15.129:0/1059598329 conn(0x5622098c2030 msgr2=0x5622098c2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 shutdown_connections 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/1059598329 wait complete. 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622097c3f00 msgr2=0x5622098bc980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622097c3f00 0x5622098bc980 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbac40342b0 msgr2=0x7fbac4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbac40342b0 0x7fbac4036770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4001da0 tx=0x7fbbd4001300 comp rx=0 tx=0).stop 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 msgr2=0x5622098b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098b5d50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbbd001b4b0 tx=0x7fbbd0019810 comp rx=0 tx=0).stop 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 shutdown_connections 2024-02-18T16:22:30.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5622097c3f00 0x5622098bc980 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fbac40342b0 0x7fbac4036770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 --2- 172.21.15.129:0/3841014041 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5622097c35e0 0x5622098b5d50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:30.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 >> 172.21.15.129:0/3841014041 conn(0x5622097bf070 msgr2=0x5622098a9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:30.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 shutdown_connections 2024-02-18T16:22:30.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:30.508+0000 7fbbe0782980 1 -- 172.21.15.129:0/3841014041 wait complete. 2024-02-18T16:22:35.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-02-18T16:22:35.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-02-18T16:22:35.528 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-02-18T16:22:35.568 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:35.568 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:35.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f946b3b2980 1 Processor -- start 2024-02-18T16:22:35.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f946b3b2980 1 -- start start 2024-02-18T16:22:35.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f946b3b2980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b5a31eb170 0x55b5a31eb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f946b3b2980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b5a31374c0 con 0x55b5a31eba90 2024-02-18T16:22:35.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f946b3b2980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b5a30fe180 con 0x55b5a31eb170 2024-02-18T16:22:35.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f9468ecd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b5a31eb170 0x55b5a31eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f94686cc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55b5a31eba90 0x55b5a31ec450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40452/0 (socket says 172.21.15.129:40452) 2024-02-18T16:22:35.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.560+0000 7f94686cc640 1 -- 172.21.15.129:0/1048065261 learned_addr learned my addr 172.21.15.129:0/1048065261 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:35.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.564+0000 7f9468ecd640 1 -- 172.21.15.129:0/1048065261 >> v1:172.21.15.80:6789/0 conn(0x55b5a31eba90 legacy=0x55b5a31ec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.564+0000 7f9468ecd640 1 -- 172.21.15.129:0/1048065261 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a31ecc80 con 0x55b5a31eb170 2024-02-18T16:22:35.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.564+0000 7f9467ecb640 1 -- 172.21.15.129:0/1048065261 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938435212 0 0) 0x55b5a31374c0 con 0x55b5a31eba90 2024-02-18T16:22:35.573 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.564+0000 7f9468ecd640 1 --2- 172.21.15.129:0/1048065261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a31eb550 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f945800a420 tx=0x7f945801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe152e5ac8dbce11 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f9467ecb640 1 -- 172.21.15.129:0/1048065261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94580aa530 con 0x55b5a31eb170 2024-02-18T16:22:35.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f9467ecb640 1 -- 172.21.15.129:0/1048065261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580a6050 con 0x55b5a31eb170 2024-02-18T16:22:35.574 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f9467ecb640 1 -- 172.21.15.129:0/1048065261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94580aa7c0 con 0x55b5a31eb170 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 -- 172.21.15.129:0/1048065261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 msgr2=0x55b5a31eb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1048065261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a31eb550 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f945800a420 tx=0x7f945801afd0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 -- 172.21.15.129:0/1048065261 shutdown_connections 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1048065261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a31eb550 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 -- 172.21.15.129:0/1048065261 >> 172.21.15.129:0/1048065261 conn(0x55b5a31e6a40 msgr2=0x55b5a31e8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 -- 172.21.15.129:0/1048065261 shutdown_connections 2024-02-18T16:22:35.575 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.568+0000 7f946b3b2980 1 -- 172.21.15.129:0/1048065261 wait complete. 2024-02-18T16:22:35.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 Processor -- start 2024-02-18T16:22:35.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- start start 2024-02-18T16:22:35.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32d53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.591 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a30fb6b0 con 0x55b5a31eb170 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9468ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32d53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9468ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32d53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56092/0 (socket says 172.21.15.129:56092) 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9468ecd640 1 -- 172.21.15.129:0/3095168152 learned_addr learned my addr 172.21.15.129:0/3095168152 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9468ecd640 1 -- 172.21.15.129:0/3095168152 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945800a100 con 0x55b5a31eb170 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9468ecd640 1 --2- 172.21.15.129:0/3095168152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32d53f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f94580ad040 tx=0x7f94580033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b74c92052af7b5d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9356e0d640 1 -- 172.21.15.129:0/3095168152 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94580aa6c0 con 0x55b5a31eb170 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9356e0d640 1 -- 172.21.15.129:0/3095168152 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580aa820 con 0x55b5a31eb170 2024-02-18T16:22:35.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f9356e0d640 1 -- 172.21.15.129:0/3095168152 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94580aaac0 con 0x55b5a31eb170 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- 172.21.15.129:0/3095168152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 msgr2=0x55b5a32d53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 --2- 172.21.15.129:0/3095168152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32d53f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f94580ad040 tx=0x7f94580033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- 172.21.15.129:0/3095168152 shutdown_connections 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 --2- 172.21.15.129:0/3095168152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32d53f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- 172.21.15.129:0/3095168152 >> 172.21.15.129:0/3095168152 conn(0x55b5a31e6a40 msgr2=0x55b5a32d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- 172.21.15.129:0/3095168152 shutdown_connections 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.584+0000 7f946b3b2980 1 -- 172.21.15.129:0/3095168152 wait complete. 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 Processor -- start 2024-02-18T16:22:35.595 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 -- start start 2024-02-18T16:22:35.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32dc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a30f6e90 con 0x55b5a31eb170 2024-02-18T16:22:35.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f9468ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f9468ecd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32dc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56102/0 (socket says 172.21.15.129:56102) 2024-02-18T16:22:35.596 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f9468ecd640 1 -- 172.21.15.129:0/1444186428 learned_addr learned my addr 172.21.15.129:0/1444186428 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.597 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f9468ecd640 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a31ecc80 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f9468ecd640 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32dc180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9458003430 tx=0x7f9458019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f935560a640 1 -- 172.21.15.129:0/1444186428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94580b6920 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5a32dc6c0 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f935560a640 1 -- 172.21.15.129:0/1444186428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580b6a80 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f935560a640 1 -- 172.21.15.129:0/1444186428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94580b6d20 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5a32dcb10 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f935560a640 1 -- 172.21.15.129:0/1444186428 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f94580c0450 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f935560a640 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93500342b0 0x7f9350036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f935560a640 1 -- 172.21.15.129:0/1444186428 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f94580e40e0 con 0x55b5a31eb170 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f94686cc640 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93500342b0 0x7f9350036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a31eba90 0x55b5a32e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.588+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a32e32b0 con 0x55b5a31eba90 2024-02-18T16:22:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a31eba90 0x55b5a32e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94686cc640 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93500342b0 0x7f9350036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c10 tx=0x7f945c0013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a31eba90 0x55b5a32e2d70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 -- 172.21.15.129:0/1444186428 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94600083f0 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a32e0450 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 -- 172.21.15.129:0/1444186428 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f94600083f0 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a32e4c70 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 -- 172.21.15.129:0/1444186428 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f94600083f0 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a32e3af0 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 -- 172.21.15.129:0/1444186428 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f94600083f0 con 0x55b5a31eba90 2024-02-18T16:22:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a32e3f00 con 0x55b5a31eba90 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94696ce640 1 -- 172.21.15.129:0/1444186428 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f94600121d0 con 0x55b5a31eba90 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 Processor -- start 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 -- start start 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 0x55b5a32f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f946b3b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a308ff20 con 0x55b5a32f35c0 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94686cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 0x55b5a32f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94686cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 0x55b5a32f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56110/0 (socket says 172.21.15.129:56110) 2024-02-18T16:22:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94686cc640 1 -- 172.21.15.129:0/1037296531 learned_addr learned my addr 172.21.15.129:0/1037296531 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.603 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.592+0000 7f94686cc640 1 -- 172.21.15.129:0/1037296531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a32f3f20 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94686cc640 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 0x55b5a32f39e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f945c00e620 tx=0x7f945c00e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f934e7fc640 1 -- 172.21.15.129:0/1037296531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f945c01b380 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5a32f4170 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f934e7fc640 1 -- 172.21.15.129:0/1037296531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c01b4e0 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f934e7fc640 1 -- 172.21.15.129:0/1037296531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f945c01b780 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5a32f4cc0 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f934e7fc640 1 -- 172.21.15.129:0/1037296531 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f945c01a070 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f934e7fc640 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93400342b0 0x7f9340036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f934e7fc640 1 -- 172.21.15.129:0/1037296531 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f945c017050 con 0x55b5a32f35c0 2024-02-18T16:22:35.604 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94696ce640 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93400342b0 0x7f9340036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f946b3b2980 1 Processor -- start 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f946b3b2980 1 -- start start 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f946b3b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3300970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94696ce640 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93400342b0 0x7f9340036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55b5a32e46a0 tx=0x7f9460003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f946b3b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a3083790 con 0x55b5a3300590 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94686cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3300970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94686cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3300970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56116/0 (socket says 172.21.15.129:56116) 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94686cc640 1 -- 172.21.15.129:0/2065862210 learned_addr learned my addr 172.21.15.129:0/2065862210 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94686cc640 1 -- 172.21.15.129:0/2065862210 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a3300f40 con 0x55b5a3300590 2024-02-18T16:22:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.596+0000 7f94686cc640 1 --2- 172.21.15.129:0/2065862210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3300970 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f945c027030 tx=0x7f945c00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea4df773a0426b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f933ffff640 1 -- 172.21.15.129:0/2065862210 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f945c047070 con 0x55b5a3300590 2024-02-18T16:22:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f933ffff640 1 -- 172.21.15.129:0/2065862210 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c00d300 con 0x55b5a3300590 2024-02-18T16:22:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f933ffff640 1 -- 172.21.15.129:0/2065862210 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f945c00d470 con 0x55b5a3300590 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2065862210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 msgr2=0x55b5a3300970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2065862210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3300970 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f945c027030 tx=0x7f945c00ded0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2065862210 shutdown_connections 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2065862210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3300970 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2065862210 >> 172.21.15.129:0/2065862210 conn(0x55b5a32fc8d0 msgr2=0x55b5a32fa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2065862210 shutdown_connections 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2065862210 wait complete. 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 Processor -- start 2024-02-18T16:22:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- start start 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3307430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5a3307970 con 0x55b5a3300590 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f94686cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3307430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f94686cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3307430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56132/0 (socket says 172.21.15.129:56132) 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 learned_addr learned my addr 172.21.15.129:0/2227278276 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5a32f4cc0 con 0x55b5a3300590 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f94686cc640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3307430 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f945c00eae0 tx=0x7f945c048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f933e7fc640 1 -- 172.21.15.129:0/2227278276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f945c00d470 con 0x55b5a3300590 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f933e7fc640 1 -- 172.21.15.129:0/2227278276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c04a0f0 con 0x55b5a3300590 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5a3307b70 con 0x55b5a3300590 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f933e7fc640 1 -- 172.21.15.129:0/2227278276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f945c04a280 con 0x55b5a3300590 2024-02-18T16:22:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.600+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5a3307fa0 con 0x55b5a3300590 2024-02-18T16:22:35.614 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f933e7fc640 1 -- 172.21.15.129:0/2227278276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f945c032020 con 0x55b5a3300590 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f933e7fc640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9334034300 0x7f93340367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f933e7fc640 1 -- 172.21.15.129:0/2227278276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f945c009050 con 0x55b5a3300590 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f94696ce640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9334034300 0x7f93340367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a33129a0 0x55b5a3314e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33155b0 con 0x55b5a33129a0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f94696ce640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9334034300 0x7f93340367c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9460008fd0 tx=0x7f946001d070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a33129a0 0x55b5a3314e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a33129a0 0x55b5a3314e60 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.615 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 realm 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3315980 con 0x55b5a33129a0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3316200 con 0x55b5a33129a0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3316560 con 0x55b5a33129a0 2024-02-18T16:22:35.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3316d60 con 0x55b5a33129a0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 20 searching for the correct realm 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b5a3318bf0 0x55b5a331b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f94686cc640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b5a3318bf0 0x55b5a331b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.604+0000 7f94686cc640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b5a3318bf0 0x55b5a331b080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94686cc640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f945c027060 0x7f945c045450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94696ce640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f945c027060 0x7f945c045450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.617 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94696ce640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f945c027060 0x7f945c045450 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002d040 con 0x7f945c027060 2024-02-18T16:22:35.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94696ce640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9460028940 0x7f9460012420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.618 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9460028940 0x7f9460012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9460028940 0x7f9460012420 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.621 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.608+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002d040 con 0x7f945c027060 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.622 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f946002d040 con 0x7f945c027060 2024-02-18T16:22:35.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.623 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.612+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002d040 con 0x7f945c027060 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002d040 con 0x7f945c027060 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.616+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f9460028940 2024-02-18T16:22:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94580c6070 con 0x7f9460028940 2024-02-18T16:22:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002d040 con 0x7f945c027060 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a3318bf0 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x55b5a33129a0 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f94580c6070 con 0x55b5a33129a0 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331b750 con 0x7f945c027060 2024-02-18T16:22:35.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3317660 con 0x55b5a33129a0 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3317eb0 con 0x55b5a33129a0 2024-02-18T16:22:35.633 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331bb90 con 0x55b5a33129a0 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 zone default found 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 4 Realm: () 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 zonegroup default 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331bbf0 con 0x7f945c027060 2024-02-18T16:22:35.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331de70 con 0x55b5a3318bf0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331e1d0 con 0x55b5a3318bf0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.635 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 started sync module instance, tier type = 2024-02-18T16:22:35.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:35.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.620+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331d440 con 0x7f945c027060 2024-02-18T16:22:35.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94238615394336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331d440 con 0x7f945c027060 2024-02-18T16:22:35.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331ebb0 con 0x55b5a33129a0 2024-02-18T16:22:35.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94238615394336] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94238615398432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331d440 con 0x55b5a33129a0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.624+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331f570 con 0x55b5a3318bf0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94238615398432] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94238615392160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331d3c0 con 0x55b5a3318bf0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3320210 con 0x7f945c027060 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94238615404192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3320a60 con 0x7f945c027060 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33214c0 con 0x55b5a33129a0 2024-02-18T16:22:35.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.628+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94238615392160] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.632+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94238615404192] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.632+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.632+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94238615402704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33205c0 con 0x55b5a33129a0 2024-02-18T16:22:35.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.632+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3321d10 con 0x7f9460028940 2024-02-18T16:22:35.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.632+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94238615402704] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.632+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.636+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94238615408560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33205c0 con 0x7f9460028940 2024-02-18T16:22:35.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.636+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33221e0 con 0x7f9460028940 2024-02-18T16:22:35.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.636+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94238615408560] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.636+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.636+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94238615411936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33221a0 con 0x7f9460028940 2024-02-18T16:22:35.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.636+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3322b10 con 0x7f9460028940 2024-02-18T16:22:35.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94238615411936] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94238615410256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3322b10 con 0x7f9460028940 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=0 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=1 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=2 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=3 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=4 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=5 2024-02-18T16:22:35.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=6 2024-02-18T16:22:35.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94238615410256] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 20 add_watcher() i=7 2024-02-18T16:22:35.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:35.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3325f90 con 0x55b5a33129a0 2024-02-18T16:22:35.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.640+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94238615414848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33234a0 con 0x55b5a33129a0 2024-02-18T16:22:35.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94238615414848] v32'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f931f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:35.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 5 note: GC not initialized 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f931e7e4640 20 reqs_thread_entry: start 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 20 Filter name: none 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f93177fe640 20 reqs_thread_entry: start 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.652 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3347eb0 con 0x55b5a33129a0 2024-02-18T16:22:35.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:35.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:22:35.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:22:35.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:35.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.644+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a334a270 con 0x7f9460028940 2024-02-18T16:22:35.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.648+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.648+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a334a270 con 0x7f9460028940 2024-02-18T16:22:35.656 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.648+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f931f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:35.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94238615414848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a330fb10 con 0x55b5a33129a0 2024-02-18T16:22:35.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94238615414848] v32'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94238615394336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a33478e0 con 0x7f945c027060 2024-02-18T16:22:35.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94238615394336] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f946b3b2980 20 remove_watcher() i=0 2024-02-18T16:22:35.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f946b3b2980 2 removed watcher, disabling cache 2024-02-18T16:22:35.660 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.652+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94238615398432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331d820 con 0x55b5a33129a0 2024-02-18T16:22:35.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.656+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94238615398432] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.656+0000 7f946b3b2980 20 remove_watcher() i=1 2024-02-18T16:22:35.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.656+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94238615392160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331d820 con 0x55b5a3318bf0 2024-02-18T16:22:35.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.656+0000 7f94686cc640 1 -- 172.21.15.129:0/2227278276 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94238615392160] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f945c00c040 con 0x55b5a3318bf0 2024-02-18T16:22:35.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.656+0000 7f946b3b2980 20 remove_watcher() i=2 2024-02-18T16:22:35.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.656+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94238615404192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331cfa0 con 0x7f945c027060 2024-02-18T16:22:35.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.660+0000 7f94696ce640 1 -- 172.21.15.129:0/2227278276 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94238615404192] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9460040040 con 0x7f945c027060 2024-02-18T16:22:35.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.660+0000 7f946b3b2980 20 remove_watcher() i=3 2024-02-18T16:22:35.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.660+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94238615402704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331cfa0 con 0x55b5a33129a0 2024-02-18T16:22:35.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.660+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94238615402704] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x55b5a33129a0 2024-02-18T16:22:35.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.660+0000 7f946b3b2980 20 remove_watcher() i=4 2024-02-18T16:22:35.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.660+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94238615408560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331cfa0 con 0x7f9460028940 2024-02-18T16:22:35.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.664+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94238615408560] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.664+0000 7f946b3b2980 20 remove_watcher() i=5 2024-02-18T16:22:35.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.664+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94238615411936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a331cfa0 con 0x7f9460028940 2024-02-18T16:22:35.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.664+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94238615411936] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.664+0000 7f946b3b2980 20 remove_watcher() i=6 2024-02-18T16:22:35.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.664+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94238615410256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5a3321ce0 con 0x7f9460028940 2024-02-18T16:22:35.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94238615410256] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94580f6040 con 0x7f9460028940 2024-02-18T16:22:35.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 20 remove_watcher() i=7 2024-02-18T16:22:35.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9460028940 msgr2=0x7f9460012420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9460028940 0x7f9460012420 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a33129a0 msgr2=0x55b5a3314e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a33129a0 0x55b5a3314e60 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f945c027060 msgr2=0x7f945c045450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f945c027060 0x7f945c045450 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b5a3318bf0 msgr2=0x55b5a331b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b5a3318bf0 0x55b5a331b080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9334034300 msgr2=0x7f93340367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9334034300 0x7f93340367c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9460008fd0 tx=0x7f946001d070 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 msgr2=0x55b5a3307430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f9468ecd640 1 -- 172.21.15.129:0/2227278276 reap_dead start 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3307430 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f945c00eae0 tx=0x7f945c048a20 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 shutdown_connections 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/2227278276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a3300590 0x55b5a3307430 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 >> 172.21.15.129:0/2227278276 conn(0x55b5a32fc8d0 msgr2=0x55b5a32f9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 shutdown_connections 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/2227278276 wait complete. 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93400342b0 msgr2=0x7f9340036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93400342b0 0x7f9340036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55b5a32e46a0 tx=0x7f9460003070 comp rx=0 tx=0).stop 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 msgr2=0x55b5a32f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 0x55b5a32f39e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f945c00e620 tx=0x7f945c00e650 comp rx=0 tx=0).stop 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 shutdown_connections 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93400342b0 0x7f9340036770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1037296531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a32f35c0 0x55b5a32f39e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 >> 172.21.15.129:0/1037296531 conn(0x55b5a32e83d0 msgr2=0x55b5a32e8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 shutdown_connections 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1037296531 wait complete. 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a31eba90 msgr2=0x55b5a32e2d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a31eba90 0x55b5a32e2d70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93500342b0 msgr2=0x7f9350036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93500342b0 0x7f9350036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c10 tx=0x7f945c0013c0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 msgr2=0x55b5a32dc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32dc180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9458003430 tx=0x7f9458019810 comp rx=0 tx=0).stop 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 shutdown_connections 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b5a31eba90 0x55b5a32e2d70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93500342b0 0x7f9350036770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 --2- 172.21.15.129:0/1444186428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b5a31eb170 0x55b5a32dc180 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 >> 172.21.15.129:0/1444186428 conn(0x55b5a31e6a40 msgr2=0x55b5a32cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 shutdown_connections 2024-02-18T16:22:35.680 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.668+0000 7f946b3b2980 1 -- 172.21.15.129:0/1444186428 wait complete. 2024-02-18T16:22:35.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-18T16:22:35.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-18T16:22:35.688 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-18T16:22:35.763 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:35.763 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd932549980 1 Processor -- start 2024-02-18T16:22:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd932549980 1 -- start start 2024-02-18T16:22:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd932549980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5595c7083080 0x5595c7083490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd932549980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595c70564c0 con 0x5595c7080b80 2024-02-18T16:22:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd932549980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5595c701d180 con 0x5595c7083080 2024-02-18T16:22:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd92f863640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5595c7083080 0x5595c7083490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd930064640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x5595c7080b80 0x5595c7080f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40454/0 (socket says 172.21.15.129:40454) 2024-02-18T16:22:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd930064640 1 -- 172.21.15.129:0/408346896 learned_addr learned my addr 172.21.15.129:0/408346896 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd92f863640 1 -- 172.21.15.129:0/408346896 >> v1:172.21.15.80:6789/0 conn(0x5595c7080b80 legacy=0x5595c7080f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.756+0000 7fd92f863640 1 -- 172.21.15.129:0/408346896 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595c70849e0 con 0x5595c7083080 2024-02-18T16:22:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd92f863640 1 --2- 172.21.15.129:0/408346896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7083080 0x5595c7083490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd91800a480 tx=0x7fd91801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ea4260a9afe1c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd92f062640 1 -- 172.21.15.129:0/408346896 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9180ab540 con 0x5595c7083080 2024-02-18T16:22:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd92f062640 1 -- 172.21.15.129:0/408346896 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9180ab6a0 con 0x5595c7083080 2024-02-18T16:22:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd92f062640 1 -- 172.21.15.129:0/408346896 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9180ab960 con 0x5595c7083080 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 -- 172.21.15.129:0/408346896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7083080 msgr2=0x5595c7083490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 --2- 172.21.15.129:0/408346896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7083080 0x5595c7083490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd91800a480 tx=0x7fd91801b280 comp rx=0 tx=0).stop 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 -- 172.21.15.129:0/408346896 shutdown_connections 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 --2- 172.21.15.129:0/408346896 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7083080 0x5595c7083490 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 -- 172.21.15.129:0/408346896 >> 172.21.15.129:0/408346896 conn(0x5595c707fa40 msgr2=0x5595c707fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 -- 172.21.15.129:0/408346896 shutdown_connections 2024-02-18T16:22:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.760+0000 7fd932549980 1 -- 172.21.15.129:0/408346896 wait complete. 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd932549980 1 Processor -- start 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd932549980 1 -- start start 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd932549980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c71fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd932549980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595c701a6b0 con 0x5595c7080b80 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd930064640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c71fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd930064640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c71fa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56144/0 (socket says 172.21.15.129:56144) 2024-02-18T16:22:35.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd930064640 1 -- 172.21.15.129:0/1401460200 learned_addr learned my addr 172.21.15.129:0/1401460200 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd930064640 1 -- 172.21.15.129:0/1401460200 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918005d30 con 0x5595c7080b80 2024-02-18T16:22:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.776+0000 7fd930064640 1 --2- 172.21.15.129:0/1401460200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c71fa840 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd928006fb0 tx=0x7fd928001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c926b766750dd5f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd81e60c640 1 -- 172.21.15.129:0/1401460200 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd928004530 con 0x5595c7080b80 2024-02-18T16:22:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd81e60c640 1 -- 172.21.15.129:0/1401460200 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd928004690 con 0x5595c7080b80 2024-02-18T16:22:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd81e60c640 1 -- 172.21.15.129:0/1401460200 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9280049b0 con 0x5595c7080b80 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/1401460200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 msgr2=0x5595c71fa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 --2- 172.21.15.129:0/1401460200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c71fa840 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd928006fb0 tx=0x7fd928001940 comp rx=0 tx=0).stop 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/1401460200 shutdown_connections 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 --2- 172.21.15.129:0/1401460200 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c71fa840 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/1401460200 >> 172.21.15.129:0/1401460200 conn(0x5595c707fa40 msgr2=0x5595c71f6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/1401460200 shutdown_connections 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/1401460200 wait complete. 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 Processor -- start 2024-02-18T16:22:35.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- start start 2024-02-18T16:22:35.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c7201690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595c7015e90 con 0x5595c7080b80 2024-02-18T16:22:35.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd930064640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c7201690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd930064640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c7201690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56150/0 (socket says 172.21.15.129:56150) 2024-02-18T16:22:35.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd930064640 1 -- 172.21.15.129:0/3072799504 learned_addr learned my addr 172.21.15.129:0/3072799504 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd930064640 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595c70564c0 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd930064640 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c7201690 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5595c71fb6d0 tx=0x7fd928000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd81ce09640 1 -- 172.21.15.129:0/3072799504 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd928013760 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd81ce09640 1 -- 172.21.15.129:0/3072799504 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9280138c0 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595c7201bd0 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd81ce09640 1 -- 172.21.15.129:0/3072799504 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd928013b60 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.780+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595c7202000 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd81ce09640 1 -- 172.21.15.129:0/3072799504 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd928028460 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd81ce09640 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8180342b0 0x7fd818036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd81ce09640 1 -- 172.21.15.129:0/3072799504 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd928049690 con 0x5595c7080b80 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd92f863640 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8180342b0 0x7fd818036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.791 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c7206300 0x5595c72086f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7208c30 con 0x5595c7206300 2024-02-18T16:22:35.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c7206300 0x5595c72086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd92f863640 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8180342b0 0x7fd818036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9180ad000 tx=0x7fd9180a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c7206300 0x5595c72086f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 -- 172.21.15.129:0/3072799504 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9200083f0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7208ff0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 -- 172.21.15.129:0/3072799504 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd9200083f0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c720a8a0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 -- 172.21.15.129:0/3072799504 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fd9200083f0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7209aa0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 -- 172.21.15.129:0/3072799504 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd9200083f0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7209eb0 con 0x5595c7206300 2024-02-18T16:22:35.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd930865640 1 -- 172.21.15.129:0/3072799504 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd920012040 con 0x5595c7206300 2024-02-18T16:22:35.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.784+0000 7fd932549980 1 Processor -- start 2024-02-18T16:22:35.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 -- start start 2024-02-18T16:22:35.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 0x5595c7219380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595c6faef20 con 0x5595c7218f60 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd92f863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 0x5595c7219380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd92f863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 0x5595c7219380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56162/0 (socket says 172.21.15.129:56162) 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd92f863640 1 -- 172.21.15.129:0/3756910226 learned_addr learned my addr 172.21.15.129:0/3756910226 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd92f863640 1 -- 172.21.15.129:0/3756910226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595c72198c0 con 0x5595c7218f60 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd92f863640 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 0x5595c7219380 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd918000c10 tx=0x7fd918018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd815ffb640 1 -- 172.21.15.129:0/3756910226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9180bf410 con 0x5595c7218f60 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595c7219ab0 con 0x5595c7218f60 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd815ffb640 1 -- 172.21.15.129:0/3756910226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9180bf570 con 0x5595c7218f60 2024-02-18T16:22:35.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd815ffb640 1 -- 172.21.15.129:0/3756910226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9180bf810 con 0x5595c7218f60 2024-02-18T16:22:35.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595c721a600 con 0x5595c7218f60 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd815ffb640 1 -- 172.21.15.129:0/3756910226 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd9180bf9c0 con 0x5595c7218f60 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd815ffb640 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8080342b0 0x7fd808036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd815ffb640 1 -- 172.21.15.129:0/3756910226 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd9180e5fc0 con 0x5595c7218f60 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd930865640 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8080342b0 0x7fd808036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 Processor -- start 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 -- start start 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd930865640 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8080342b0 0x7fd808036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5595c72094e0 tx=0x7fd920003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c7226390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.788+0000 7fd932549980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595c6fa2790 con 0x5595c7225f90 2024-02-18T16:22:35.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c7226390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c7226390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56178/0 (socket says 172.21.15.129:56178) 2024-02-18T16:22:35.799 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 -- 172.21.15.129:0/3666358540 learned_addr learned my addr 172.21.15.129:0/3666358540 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 -- 172.21.15.129:0/3666358540 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595c7226960 con 0x5595c7225f90 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 --2- 172.21.15.129:0/3666358540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c7226390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd918005730 tx=0x7fd918006590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db57baf14c090fca server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd80f7fe640 1 -- 172.21.15.129:0/3666358540 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd918006990 con 0x5595c7225f90 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd80f7fe640 1 -- 172.21.15.129:0/3666358540 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918006af0 con 0x5595c7225f90 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd80f7fe640 1 -- 172.21.15.129:0/3666358540 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd918006d90 con 0x5595c7225f90 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- 172.21.15.129:0/3666358540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 msgr2=0x5595c7226390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 --2- 172.21.15.129:0/3666358540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c7226390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd918005730 tx=0x7fd918006590 comp rx=0 tx=0).stop 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- 172.21.15.129:0/3666358540 shutdown_connections 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 --2- 172.21.15.129:0/3666358540 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c7226390 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- 172.21.15.129:0/3666358540 >> 172.21.15.129:0/3666358540 conn(0x5595c72222d0 msgr2=0x5595c7220330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- 172.21.15.129:0/3666358540 shutdown_connections 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- 172.21.15.129:0/3666358540 wait complete. 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 Processor -- start 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- start start 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c722ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd932549980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595c722d3b0 con 0x5595c7225f90 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c722ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c722ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56190/0 (socket says 172.21.15.129:56190) 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 learned_addr learned my addr 172.21.15.129:0/3361094929 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595c721a600 con 0x5595c7225f90 2024-02-18T16:22:35.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.792+0000 7fd92f863640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c722ce70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd91801b0b0 tx=0x7fd9180e42a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd80dffb640 1 -- 172.21.15.129:0/3361094929 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9180bee00 con 0x5595c7225f90 2024-02-18T16:22:35.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd80dffb640 1 -- 172.21.15.129:0/3361094929 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9180b5760 con 0x5595c7225f90 2024-02-18T16:22:35.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595c722d5b0 con 0x5595c7225f90 2024-02-18T16:22:35.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd80dffb640 1 -- 172.21.15.129:0/3361094929 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9180b5a00 con 0x5595c7225f90 2024-02-18T16:22:35.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595c722d9e0 con 0x5595c7225f90 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd80dffb640 1 -- 172.21.15.129:0/3361094929 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd9180b5b60 con 0x5595c7225f90 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd80dffb640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd800034300 0x7fd8000367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd80dffb640 1 -- 172.21.15.129:0/3361094929 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fd9180f2d70 con 0x5595c7225f90 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930865640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd800034300 0x7fd8000367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c72383f0 0x5595c723a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723afe0 con 0x5595c72383f0 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930064640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c72383f0 0x5595c723a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930865640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd800034300 0x7fd8000367c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd920008fd0 tx=0x7fd92001c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.805 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930064640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c72383f0 0x5595c723a890 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd928024020 con 0x5595c72383f0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 realm 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723b3b0 con 0x5595c72383f0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd928024020 con 0x5595c72383f0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723bc00 con 0x5595c72383f0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd928024020 con 0x5595c72383f0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723bf60 con 0x5595c72383f0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd928024020 con 0x5595c72383f0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.796+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723b8a0 con 0x5595c72383f0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd928024020 con 0x5595c72383f0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd932549980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd932549980 20 searching for the correct realm 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5595c723e1b0 0x5595c72405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd92f863640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5595c723e1b0 0x5595c72405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd92f863640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5595c723e1b0 0x5595c72405e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9180b2040 con 0x5595c723e1b0 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd92f863640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd9180f1070 0x7fd9180e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930865640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd9180f1070 0x7fd9180e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930865640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd9180f1070 0x7fd9180e17c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92002c040 con 0x7fd9180f1070 2024-02-18T16:22:35.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930865640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd920027940 0x7fd9200333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd920027940 0x7fd9200333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd920027940 0x7fd9200333c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd928024020 con 0x7fd920027940 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd928024020 con 0x5595c72383f0 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.800+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92002c040 con 0x7fd9180f1070 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9180b2040 con 0x5595c723e1b0 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd92002c040 con 0x7fd9180f1070 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.804+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92002c040 con 0x7fd9180f1070 2024-02-18T16:22:35.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.808+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92002c040 con 0x7fd9180f1070 2024-02-18T16:22:35.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd920027940 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92002c040 con 0x7fd9180f1070 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c723e1b0 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.823 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x5595c72383f0 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7240cb0 con 0x7fd9180f1070 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723cdd0 con 0x5595c72383f0 2024-02-18T16:22:35.824 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723ca50 con 0x5595c72383f0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c723d720 con 0x5595c72383f0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 zone default found 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 4 Realm: () 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:35.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 zonegroup default 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.812+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7241590 con 0x7fd9180f1070 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7242f70 con 0x5595c723e1b0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7243300 con 0x5595c723e1b0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 started sync module instance, tier type = 2024-02-18T16:22:35.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:35.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7242540 con 0x7fd9180f1070 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101779523824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7242540 con 0x7fd9180f1070 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7243df0 con 0x5595c72383f0 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.816+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101779523824] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101779527920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7242540 con 0x5595c72383f0 2024-02-18T16:22:35.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72447b0 con 0x5595c723e1b0 2024-02-18T16:22:35.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101779527920] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101779521696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72424c0 con 0x5595c723e1b0 2024-02-18T16:22:35.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.820+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7245490 con 0x7fd9180f1070 2024-02-18T16:22:35.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101779533744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7245ce0 con 0x7fd9180f1070 2024-02-18T16:22:35.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72466b0 con 0x5595c72383f0 2024-02-18T16:22:35.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101779521696] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101779533744] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101779538352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7245840 con 0x5595c72383f0 2024-02-18T16:22:35.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.824+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7246f00 con 0x7fd920027940 2024-02-18T16:22:35.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101779540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7247170 con 0x7fd920027940 2024-02-18T16:22:35.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7247610 con 0x7fd920027940 2024-02-18T16:22:35.835 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101779538352] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101779540144] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101779541200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7247590 con 0x7fd920027940 2024-02-18T16:22:35.837 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.828+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7247e60 con 0x7fd920027940 2024-02-18T16:22:35.838 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101779541200] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101779542256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7248040 con 0x7fd920027940 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=0 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=1 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=2 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=3 2024-02-18T16:22:35.839 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=4 2024-02-18T16:22:35.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=5 2024-02-18T16:22:35.840 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=6 2024-02-18T16:22:35.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101779542256] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 20 add_watcher() i=7 2024-02-18T16:22:35.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:35.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c724b220 con 0x5595c72383f0 2024-02-18T16:22:35.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.832+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101779557344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c7247fe0 con 0x5595c72383f0 2024-02-18T16:22:35.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101779557344] v32'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd7e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 5 note: GC not initialized 2024-02-18T16:22:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd7e57e2640 20 reqs_thread_entry: start 2024-02-18T16:22:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:35.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 20 Filter name: none 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd756ffd640 20 reqs_thread_entry: start 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c726cd40 con 0x5595c72383f0 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c726cd40 con 0x7fd920027940 2024-02-18T16:22:35.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.836+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd7e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:35.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101779557344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c726cd40 con 0x5595c72383f0 2024-02-18T16:22:35.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94101779557344] v32'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101779523824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c726cd40 con 0x7fd9180f1070 2024-02-18T16:22:35.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94101779523824] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd932549980 20 remove_watcher() i=0 2024-02-18T16:22:35.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd932549980 2 removed watcher, disabling cache 2024-02-18T16:22:35.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.840+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101779527920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c726cd40 con 0x5595c72383f0 2024-02-18T16:22:35.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.844+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94101779527920] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.844+0000 7fd932549980 20 remove_watcher() i=1 2024-02-18T16:22:35.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.844+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101779521696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c726cd40 con 0x5595c723e1b0 2024-02-18T16:22:35.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.844+0000 7fd92f863640 1 -- 172.21.15.129:0/3361094929 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94101779521696] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd918104040 con 0x5595c723e1b0 2024-02-18T16:22:35.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.844+0000 7fd932549980 20 remove_watcher() i=2 2024-02-18T16:22:35.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.844+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101779533744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72420a0 con 0x7fd9180f1070 2024-02-18T16:22:35.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.848+0000 7fd930865640 1 -- 172.21.15.129:0/3361094929 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94101779533744] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92003f040 con 0x7fd9180f1070 2024-02-18T16:22:35.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.848+0000 7fd932549980 20 remove_watcher() i=3 2024-02-18T16:22:35.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.848+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101779538352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72420a0 con 0x5595c72383f0 2024-02-18T16:22:35.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.848+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94101779538352] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x5595c72383f0 2024-02-18T16:22:35.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.848+0000 7fd932549980 20 remove_watcher() i=4 2024-02-18T16:22:35.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.848+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101779540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72461b0 con 0x7fd920027940 2024-02-18T16:22:35.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.852+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94101779540144] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.852+0000 7fd932549980 20 remove_watcher() i=5 2024-02-18T16:22:35.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.852+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101779541200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72420a0 con 0x7fd920027940 2024-02-18T16:22:35.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.852+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94101779541200] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.852+0000 7fd932549980 20 remove_watcher() i=6 2024-02-18T16:22:35.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.852+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101779542256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595c72461b0 con 0x7fd920027940 2024-02-18T16:22:35.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94101779542256] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd92803f040 con 0x7fd920027940 2024-02-18T16:22:35.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 20 remove_watcher() i=7 2024-02-18T16:22:35.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd920027940 msgr2=0x7fd9200333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fd920027940 0x7fd9200333c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c72383f0 msgr2=0x5595c723a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c72383f0 0x5595c723a890 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd9180f1070 msgr2=0x7fd9180e17c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fd9180f1070 0x7fd9180e17c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5595c723e1b0 msgr2=0x5595c72405e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x5595c723e1b0 0x5595c72405e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd800034300 msgr2=0x7fd8000367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd800034300 0x7fd8000367c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd920008fd0 tx=0x7fd92001c070 comp rx=0 tx=0).stop 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 msgr2=0x5595c722ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd930064640 1 -- 172.21.15.129:0/3361094929 reap_dead start 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c722ce70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd91801b0b0 tx=0x7fd9180e42a0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 shutdown_connections 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3361094929 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7225f90 0x5595c722ce70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 >> 172.21.15.129:0/3361094929 conn(0x5595c72222d0 msgr2=0x5595c721f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 shutdown_connections 2024-02-18T16:22:35.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3361094929 wait complete. 2024-02-18T16:22:35.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8080342b0 msgr2=0x7fd808036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8080342b0 0x7fd808036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5595c72094e0 tx=0x7fd920003070 comp rx=0 tx=0).stop 2024-02-18T16:22:35.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 msgr2=0x5595c7219380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 0x5595c7219380 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd918000c10 tx=0x7fd918018020 comp rx=0 tx=0).stop 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 shutdown_connections 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8080342b0 0x7fd808036770 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 --2- 172.21.15.129:0/3756910226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7218f60 0x5595c7219380 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 >> 172.21.15.129:0/3756910226 conn(0x5595c720dd70 msgr2=0x5595c720e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 shutdown_connections 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3756910226 wait complete. 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.856+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c7206300 msgr2=0x5595c72086f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c7206300 0x5595c72086f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8180342b0 msgr2=0x7fd818036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8180342b0 0x7fd818036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9180ad000 tx=0x7fd9180a5040 comp rx=0 tx=0).stop 2024-02-18T16:22:35.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 msgr2=0x5595c7201690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c7201690 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5595c71fb6d0 tx=0x7fd928000f50 comp rx=0 tx=0).stop 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 shutdown_connections 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5595c7206300 0x5595c72086f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fd8180342b0 0x7fd818036770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 --2- 172.21.15.129:0/3072799504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5595c7080b80 0x5595c7201690 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 >> 172.21.15.129:0/3072799504 conn(0x5595c707fa40 msgr2=0x5595c71f4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 shutdown_connections 2024-02-18T16:22:35.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.860+0000 7fd932549980 1 -- 172.21.15.129:0/3072799504 wait complete. 2024-02-18T16:22:35.879 INFO:teuthology.orchestra.run.smithi129.stdout:{"entries":[],"summary":[]} 2024-02-18T16:22:35.879 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-18T16:22:35.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-18T16:22:35.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-18T16:22:35.880 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-02-18T16:22:35.951 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:35.951 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:35.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a09566980 1 Processor -- start 2024-02-18T16:22:35.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a09566980 1 -- start start 2024-02-18T16:22:35.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a09566980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b19b42d020 0x55b19b42d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a09566980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b19b37a4d0 con 0x55b19b42d940 2024-02-18T16:22:35.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a09566980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b19b341180 con 0x55b19b42d020 2024-02-18T16:22:35.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a07081640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55b19b42d020 0x55b19b42d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a06880640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55b19b42d940 0x55b19b42e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40466/0 (socket says 172.21.15.129:40466) 2024-02-18T16:22:35.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a06880640 1 -- 172.21.15.129:0/842290116 learned_addr learned my addr 172.21.15.129:0/842290116 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:35.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a07081640 1 -- 172.21.15.129:0/842290116 >> v1:172.21.15.80:6789/0 conn(0x55b19b42d940 legacy=0x55b19b42e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.944+0000 7f5a07081640 1 -- 172.21.15.129:0/842290116 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b19b42eb80 con 0x55b19b42d020 2024-02-18T16:22:35.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a07081640 1 --2- 172.21.15.129:0/842290116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b42d400 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f59f800a480 tx=0x7f59f801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1fa547bebb01db server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a0607f640 1 -- 172.21.15.129:0/842290116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f80ab540 con 0x55b19b42d020 2024-02-18T16:22:35.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a0607f640 1 -- 172.21.15.129:0/842290116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f80ab6a0 con 0x55b19b42d020 2024-02-18T16:22:35.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a0607f640 1 -- 172.21.15.129:0/842290116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f80ab960 con 0x55b19b42d020 2024-02-18T16:22:35.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 -- 172.21.15.129:0/842290116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 msgr2=0x55b19b42d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 --2- 172.21.15.129:0/842290116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b42d400 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f59f800a480 tx=0x7f59f801b280 comp rx=0 tx=0).stop 2024-02-18T16:22:35.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 -- 172.21.15.129:0/842290116 shutdown_connections 2024-02-18T16:22:35.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 --2- 172.21.15.129:0/842290116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b42d400 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 -- 172.21.15.129:0/842290116 >> 172.21.15.129:0/842290116 conn(0x55b19b4288f0 msgr2=0x55b19b42ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 -- 172.21.15.129:0/842290116 shutdown_connections 2024-02-18T16:22:35.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.948+0000 7f5a09566980 1 -- 172.21.15.129:0/842290116 wait complete. 2024-02-18T16:22:35.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 Processor -- start 2024-02-18T16:22:35.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- start start 2024-02-18T16:22:35.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b438740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.971 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19b33e6b0 con 0x55b19b42d020 2024-02-18T16:22:35.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a07081640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b438740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a07081640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b438740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56208/0 (socket says 172.21.15.129:56208) 2024-02-18T16:22:35.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a07081640 1 -- 172.21.15.129:0/1559645627 learned_addr learned my addr 172.21.15.129:0/1559645627 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a07081640 1 -- 172.21.15.129:0/1559645627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8005d30 con 0x55b19b42d020 2024-02-18T16:22:35.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a07081640 1 --2- 172.21.15.129:0/1559645627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b438740 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f59f80ae040 tx=0x7f59f8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f1e5798a5c3a0e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f58f560a640 1 -- 172.21.15.129:0/1559645627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f80ab810 con 0x55b19b42d020 2024-02-18T16:22:35.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f58f560a640 1 -- 172.21.15.129:0/1559645627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f80ab970 con 0x55b19b42d020 2024-02-18T16:22:35.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f58f560a640 1 -- 172.21.15.129:0/1559645627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f80abc10 con 0x55b19b42d020 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- 172.21.15.129:0/1559645627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 msgr2=0x55b19b438740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 --2- 172.21.15.129:0/1559645627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b438740 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f59f80ae040 tx=0x7f59f8003030 comp rx=0 tx=0).stop 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- 172.21.15.129:0/1559645627 shutdown_connections 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 --2- 172.21.15.129:0/1559645627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b438740 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- 172.21.15.129:0/1559645627 >> 172.21.15.129:0/1559645627 conn(0x55b19b4288f0 msgr2=0x55b19b5141a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- 172.21.15.129:0/1559645627 shutdown_connections 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 -- 172.21.15.129:0/1559645627 wait complete. 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.964+0000 7f5a09566980 1 Processor -- start 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 -- start start 2024-02-18T16:22:35.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b521510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19b339e90 con 0x55b19b42d020 2024-02-18T16:22:35.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07081640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b521510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07081640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b521510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56212/0 (socket says 172.21.15.129:56212) 2024-02-18T16:22:35.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07081640 1 -- 172.21.15.129:0/499491067 learned_addr learned my addr 172.21.15.129:0/499491067 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07081640 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b19b42eb80 con 0x55b19b42d020 2024-02-18T16:22:35.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07081640 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b521510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f59f801bb20 tx=0x7f59f8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f58f3e07640 1 -- 172.21.15.129:0/499491067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f80c2070 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b19b521a50 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f58f3e07640 1 -- 172.21.15.129:0/499491067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f80b59d0 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f58f3e07640 1 -- 172.21.15.129:0/499491067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f80b5c70 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b19b521ee0 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f58f3e07640 1 -- 172.21.15.129:0/499491067 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f59f80b2070 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f58f3e07640 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58ec0342b0 0x7f58ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f58f3e07640 1 -- 172.21.15.129:0/499491067 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f59f80e35c0 con 0x55b19b42d020 2024-02-18T16:22:35.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a06880640 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58ec0342b0 0x7f58ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b42d940 0x55b19b528140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b528680 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07882640 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b42d940 0x55b19b528140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a06880640 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58ec0342b0 0x7f58ec036770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f59fc001da0 tx=0x7f59fc001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.968+0000 7f5a07882640 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b42d940 0x55b19b528140 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a07882640 1 -- 172.21.15.129:0/499491067 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5a0000a4d0 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b525870 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a07882640 1 -- 172.21.15.129:0/499491067 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5a0000a4d0 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b52a380 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a07882640 1 -- 172.21.15.129:0/499491067 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5a0000a4d0 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b529580 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a07882640 1 -- 172.21.15.129:0/499491067 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5a0000a4d0 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b529990 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a07882640 1 -- 172.21.15.129:0/499491067 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5a0000a4d0 con 0x55b19b42d940 2024-02-18T16:22:35.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 Processor -- start 2024-02-18T16:22:35.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- start start 2024-02-18T16:22:35.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 0x55b19b538e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19b2d2f20 con 0x55b19b538a40 2024-02-18T16:22:35.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a06880640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 0x55b19b538e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a06880640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 0x55b19b538e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56222/0 (socket says 172.21.15.129:56222) 2024-02-18T16:22:35.982 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a06880640 1 -- 172.21.15.129:0/1699103551 learned_addr learned my addr 172.21.15.129:0/1699103551 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a06880640 1 -- 172.21.15.129:0/1699103551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b19b5393a0 con 0x55b19b538a40 2024-02-18T16:22:35.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a06880640 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 0x55b19b538e60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00d660 tx=0x7f59fc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f58f1602640 1 -- 172.21.15.129:0/1699103551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc020070 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b19b5395f0 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f58f1602640 1 -- 172.21.15.129:0/1699103551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc00c770 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f58f1602640 1 -- 172.21.15.129:0/1699103551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc013040 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.972+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b19b53a140 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f58f1602640 1 -- 172.21.15.129:0/1699103551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f59fc00a040 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f58f1602640 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58e0034300 0x7f58e00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f58f1602640 1 -- 172.21.15.129:0/1699103551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f59fc04b730 con 0x55b19b538a40 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a07882640 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58e0034300 0x7f58e00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 Processor -- start 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- start start 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b545e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19b2c6790 con 0x55b19b545a80 2024-02-18T16:22:35.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a07882640 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58e0034300 0x7f58e00367c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55b19b528fc0 tx=0x7f5a00005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b545e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b545e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56236/0 (socket says 172.21.15.129:56236) 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 -- 172.21.15.129:0/3783866700 learned_addr learned my addr 172.21.15.129:0/3783866700 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 -- 172.21.15.129:0/3783866700 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b19b546430 con 0x55b19b545a80 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 --2- 172.21.15.129:0/3783866700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b545e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f59fc01aab0 tx=0x7f59fc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9236aa3e3ced9317 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f58eaffd640 1 -- 172.21.15.129:0/3783866700 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc01b7a0 con 0x55b19b545a80 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f58eaffd640 1 -- 172.21.15.129:0/3783866700 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc01b900 con 0x55b19b545a80 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f58eaffd640 1 -- 172.21.15.129:0/3783866700 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc01ae10 con 0x55b19b545a80 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- 172.21.15.129:0/3783866700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 msgr2=0x55b19b545e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 --2- 172.21.15.129:0/3783866700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b545e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f59fc01aab0 tx=0x7f59fc00ce50 comp rx=0 tx=0).stop 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- 172.21.15.129:0/3783866700 shutdown_connections 2024-02-18T16:22:35.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 --2- 172.21.15.129:0/3783866700 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b545e60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- 172.21.15.129:0/3783866700 >> 172.21.15.129:0/3783866700 conn(0x55b19b541dc0 msgr2=0x55b19b53fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- 172.21.15.129:0/3783866700 shutdown_connections 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- 172.21.15.129:0/3783866700 wait complete. 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 Processor -- start 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- start start 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b54c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a09566980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b19b54ce90 con 0x55b19b545a80 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b54c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b54c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56246/0 (socket says 172.21.15.129:56246) 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.976+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 learned_addr learned my addr 172.21.15.129:0/1567107237 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b19b53a140 con 0x55b19b545a80 2024-02-18T16:22:35.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f5a06880640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b54c950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f59fc019fd0 tx=0x7f59fc049950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f58e97fa640 1 -- 172.21.15.129:0/1567107237 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc049df0 con 0x55b19b545a80 2024-02-18T16:22:35.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f58e97fa640 1 -- 172.21.15.129:0/1567107237 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc035030 con 0x55b19b545a80 2024-02-18T16:22:35.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f58e97fa640 1 -- 172.21.15.129:0/1567107237 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59fc04a080 con 0x55b19b545a80 2024-02-18T16:22:35.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b19b54d090 con 0x55b19b545a80 2024-02-18T16:22:35.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b19b54d4c0 con 0x55b19b545a80 2024-02-18T16:22:35.991 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.980+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f58e97fa640 1 -- 172.21.15.129:0/1567107237 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f59fc048250 con 0x55b19b545a80 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f58e97fa640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58d00342b0 0x7f58d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f58e97fa640 1 -- 172.21.15.129:0/1567107237 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f59fc040020 con 0x55b19b545a80 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07882640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58d00342b0 0x7f58d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b557f40 0x55b19b55a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55ab50 con 0x55b19b557f40 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b557f40 0x55b19b55a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07882640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58d00342b0 0x7f58d0036770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a00011010 tx=0x7f5a00020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.995 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b557f40 0x55b19b55a400 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 realm 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55af20 con 0x55b19b557f40 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55b770 con 0x55b19b557f40 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:35.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55bad0 con 0x55b19b557f40 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55c2d0 con 0x55b19b557f40 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 20 searching for the correct realm 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b19b55e220 0x55b19b560670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x55b19b55e220 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a06880640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b19b55e220 0x55b19b560670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.984+0000 7f5a06880640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b19b55e220 0x55b19b560670 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a06880640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f59fc01dbc0 0x7f59fc03eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x7f59fc01dbc0 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07882640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f59fc01dbc0 0x7f59fc03eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07882640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f59fc01dbc0 0x7f59fc03eaa0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0000a4d0 con 0x7f59fc01dbc0 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07882640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f5a000141d0 0x7f5a00015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x7f5a000141d0 2024-02-18T16:22:35.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f5a000141d0 0x7f5a00015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f5a000141d0 0x7f5a00015940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x55b19b557f40 2024-02-18T16:22:36.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x55b19b557f40 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x7f5a000141d0 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.988+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x7f5a000141d0 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0000a4d0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b560cf0 con 0x55b19b55e220 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b557f40 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f5a000141d0 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b557f40 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f5a000141d0 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.992+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b557f40 2024-02-18T16:22:36.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b557f40 2024-02-18T16:22:36.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f5a000141d0 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b557f40 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f5a000141d0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b55e220 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:35.996+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x55b19b557f40 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.012 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f59fc039040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55cc90 con 0x55b19b557f40 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b55d4e0 con 0x55b19b557f40 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b561130 con 0x55b19b557f40 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 zone default found 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 4 Realm: () 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 zonegroup default 2024-02-18T16:22:36.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b561130 con 0x7f59fc01dbc0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b562ee0 con 0x55b19b55e220 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5632e0 con 0x55b19b55e220 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 started sync module instance, tier type = 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5627c0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94221303685920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b562b70 con 0x7f59fc01dbc0 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.000+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b564040 con 0x55b19b557f40 2024-02-18T16:22:36.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94221303685920] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94221303691008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b563fc0 con 0x55b19b557f40 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b564a60 con 0x55b19b55e220 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59fc022070 con 0x55b19b55e220 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94221303694656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5652b0 con 0x55b19b55e220 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.004+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b565cd0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94221303691008] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94221303699376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b566080 con 0x7f59fc01dbc0 2024-02-18T16:22:36.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b566a30 con 0x55b19b557f40 2024-02-18T16:22:36.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94221303694656] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94221303699376] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94221303692064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b566550 con 0x55b19b557f40 2024-02-18T16:22:36.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.008+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b567280 con 0x7f5a000141d0 2024-02-18T16:22:36.019 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94221303692064] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94221303696912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b566f70 con 0x7f5a000141d0 2024-02-18T16:22:36.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b567770 con 0x7f5a000141d0 2024-02-18T16:22:36.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94221303705728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b567ac0 con 0x7f5a000141d0 2024-02-18T16:22:36.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b568590 con 0x7f5a000141d0 2024-02-18T16:22:36.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.012+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94221303696912] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94221303705728] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94221303709808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b567520 con 0x7f5a000141d0 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=0 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=1 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=2 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=3 2024-02-18T16:22:36.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=4 2024-02-18T16:22:36.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=5 2024-02-18T16:22:36.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=6 2024-02-18T16:22:36.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94221303709808] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 20 add_watcher() i=7 2024-02-18T16:22:36.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:36.025 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.016+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b56b580 con 0x55b19b557f40 2024-02-18T16:22:36.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94221303704272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5689f0 con 0x55b19b557f40 2024-02-18T16:22:36.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94221303704272] v32'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f58bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:36.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a09566980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a09566980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b573b30 con 0x55b19b557f40 2024-02-18T16:22:36.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.020+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b573f70 con 0x7f5a000141d0 2024-02-18T16:22:36.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.024+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.024+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b574410 con 0x55b19b55e220 2024-02-18T16:22:36.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.024+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.024+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b574c10 con 0x55b19b557f40 2024-02-18T16:22:36.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.024+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.024+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b571b90 con 0x7f59fc01dbc0 2024-02-18T16:22:36.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.028+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.028+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b571b60 con 0x55b19b55e220 2024-02-18T16:22:36.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.028+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.028+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b575950 con 0x55b19b557f40 2024-02-18T16:22:36.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.028+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.028+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b575df0 con 0x7f5a000141d0 2024-02-18T16:22:36.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.032+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.032+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b575df0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.032+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.032+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b576170 con 0x55b19b55e220 2024-02-18T16:22:36.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.032+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.032+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b576610 con 0x7f59fc01dbc0 2024-02-18T16:22:36.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.036+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.036+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b570b50 con 0x7f5a000141d0 2024-02-18T16:22:36.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.036+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.045 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.036+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b571160 con 0x7f59fc01dbc0 2024-02-18T16:22:36.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.036+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.040+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b571160 con 0x7f5a000141d0 2024-02-18T16:22:36.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.040+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.040+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b557f40 2024-02-18T16:22:36.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.040+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.040+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.044+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.044+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x7f59fc01dbc0 2024-02-18T16:22:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.044+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.044+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.044+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.044+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b557f40 2024-02-18T16:22:36.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.048+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.048+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b557f40 2024-02-18T16:22:36.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.048+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.048+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x7f59fc01dbc0 2024-02-18T16:22:36.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.052+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.056+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.056+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.056+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.056+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x7f5a000141d0 2024-02-18T16:22:36.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.056+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.065 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.056+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.060+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.060+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x7f5a000141d0 2024-02-18T16:22:36.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.060+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.060+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x55b19b55e220 2024-02-18T16:22:36.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.064+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.070 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.064+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x7f5a000141d0 2024-02-18T16:22:36.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.064+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.072 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.064+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b577180 con 0x7f59fc01dbc0 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f58bcfe1640 20 reqs_thread_entry: start 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 20 Filter name: none 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f58367fc640 20 reqs_thread_entry: start 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b576e10 con 0x55b19b557f40 2024-02-18T16:22:36.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=357 2024-02-18T16:22:36.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-18T16:22:36.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5935d0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 : miss 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 8.1f 8:f99bceac:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b570520 con 0x7f59fc01dbc0 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(96 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=352 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 info.flags=0x17 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 to cache LRU end 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 2024-02-18T16:22:36.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:97 4.22 4:45e57ec9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b6102e0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(97 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 4.16 4:68089dcb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b6102e0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(98 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:99 4.2c 4:34e52cbb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b6102e0 con 0x55b19b557f40 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(99 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:100 4.18 4:19bbe834:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b6102e0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(100 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.068+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:101 4.35 4:ac6f860b:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b6102e0 con 0x55b19b557f40 2024-02-18T16:22:36.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(101 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:102 4.16 4:6a3b564d:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b610260 con 0x7f59fc01dbc0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(102 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:103 4.3e 4:7cf4b040:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b610260 con 0x7f59fc01dbc0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(103 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:104 4.3c 4:3f421bc6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b610260 con 0x55b19b557f40 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(104 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:105 4.32 4:4e27e11e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b610260 con 0x55b19b557f40 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(105 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:106 4.33 4:cebb0436:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b610260 con 0x7f5a000141d0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(106 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:107 4.5 4:a01eb1d0:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b610260 con 0x55b19b55e220 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(107 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 20 get_obj_state: octx=0x7f59f80aad90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55b19b593c78 s->prefetch_data=0 2024-02-18T16:22:36.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:108 3.39s0 3:9e35dac5:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b594ba0 con 0x55b19b55e220 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(108 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 10 manifest: total_size = 6 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 20 get_obj_state: setting s->obj_tag to 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.9142906388886311159 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 20 get_obj_state: octx=0x7f59f80aad90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55b19b593c78 s->prefetch_data=0 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 20 prepare_atomic_modification: state is not atomic. state=0x55b19b593c78 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 20 bucket index object: :.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.072+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:109 4.35 4:ac6f860b:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b599660 con 0x55b19b557f40 2024-02-18T16:22:36.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.076+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(109 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.076+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:110 3.39s0 3:9e35dac5:::4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b599660 con 0x55b19b55e220 2024-02-18T16:22:36.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(110 4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:111 4.35 4:ac6f860b:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b599c00 con 0x55b19b557f40 2024-02-18T16:22:36.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 20 list_objects_ordered: starting attempt 1 2024-02-18T16:22:36.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-18T16:22:36.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:112 4.22 4:45e57ec9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b599c00 con 0x7f59fc01dbc0 2024-02-18T16:22:36.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:113 4.16 4:68089dcb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b59dec0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:114 4.2c 4:34e52cbb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a07a0 con 0x55b19b557f40 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:115 4.18 4:19bbe834:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b599c00 con 0x7f59fc01dbc0 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:116 4.35 4:ac6f860b:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b59dec0 con 0x55b19b557f40 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:117 4.16 4:6a3b564d:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a7f40 con 0x7f59fc01dbc0 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:118 4.3e 4:7cf4b040:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aace0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:119 4.3c 4:3f421bc6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a7f40 con 0x55b19b557f40 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:120 4.32 4:4e27e11e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5afd60 con 0x55b19b557f40 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:121 4.33 4:cebb0436:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b2a80 con 0x7f5a000141d0 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:122 4.5 4:a01eb1d0:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x55b19b55e220 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(112 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 29 ==== osd_op_reply(113 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.088 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 30 ==== osd_op_reply(115 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(114 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(119 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(120 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 31 ==== osd_op_reply(118 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 32 ==== osd_op_reply(117 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(122 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.089 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(121 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(111 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f58ea7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(116 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7])"; uploads.size()=0; is_truncated=0 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:123 4.22 4:45e57ec9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:124 4.16 4:68089dcb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a7ec0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:125 4.2c 4:34e52cbb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aa6e0 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:126 4.18 4:19bbe834:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b596360 con 0x7f59fc01dbc0 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:127 4.35 4:ac6f860b:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a7ec0 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:128 4.16 4:6a3b564d:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aa6e0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:129 4.3e 4:7cf4b040:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b596360 con 0x7f59fc01dbc0 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:130 4.3c 4:3f421bc6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a7ec0 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:131 4.32 4:4e27e11e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aa6e0 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:132 4.33 4:cebb0436:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b596360 con 0x7f5a000141d0 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:133 4.5 4:a01eb1d0:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x55b19b55e220 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(125 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 41 ==== osd_op_reply(130 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 42 ==== osd_op_reply(127 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 43 ==== osd_op_reply(131 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 33 ==== osd_op_reply(123 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 34 ==== osd_op_reply(126 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(133 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 35 ==== osd_op_reply(124 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 36 ==== osd_op_reply(128 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 37 ==== osd_op_reply(129 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(132 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.080+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 38 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 39 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 20 rados_obj.operate() r=0 bl.length=165 2024-02-18T16:22:36.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-18T16:22:36.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-18T16:22:36.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-18T16:22:36.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-18T16:22:36.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94221303912384 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f5a000141d0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== watch-notify(notify (1) cookie 94221303705728 notify 137438953500 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f59f8106060 con 0x7f5a000141d0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f58ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94221303705728 notifier 4776 bl.length()=149 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(136 notify.6 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f58ea7fc640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f583c0032c0 con 0x7f5a000141d0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f59f80e7040 con 0x7f5a000141d0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.084+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f80c6500 con 0x7f5a000141d0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 40 ==== osd_op_reply(138 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a09566980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 from cache 2024-02-18T16:22:36.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7, ofs0, ns] 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:139 7.0 7:05bf5b68:::notify.1:head [notify cookie 94221303912384 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x55b19b557f40 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 44 ==== watch-notify(notify (1) cookie 94221303691008 notify 137438953513 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f59f80e7040 con 0x55b19b557f40 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f58ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94221303691008 notifier 4776 bl.length()=206 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 45 ==== osd_op_reply(139 notify.1 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f59f80c6500 con 0x55b19b557f40 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f58ea7fc640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f583c0032c0 con 0x55b19b557f40 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 46 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953513 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b19b521ee0 con 0x55b19b557f40 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 47 ==== osd_op_reply(140 notify.1 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.088+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:141 8.1f 8:f99bceac:root::.bucket.meta.myfoo%3a4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 41 ==== osd_op_reply(141 .bucket.meta.myfoo:4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 [call,call,delete] v32'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:142 4.22 4:45e57ec9:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aa910 con 0x7f59fc01dbc0 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:143 4.16 4:68089dcb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:144 4.2c 4:34e52cbb:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5997c0 con 0x55b19b557f40 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:145 4.18 4:19bbe834:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a8d30 con 0x7f59fc01dbc0 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:146 4.35 4:ac6f860b:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b33b0 con 0x55b19b557f40 2024-02-18T16:22:36.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:147 4.16 4:6a3b564d:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aa910 con 0x7f59fc01dbc0 2024-02-18T16:22:36.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:148 4.3e 4:7cf4b040:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x7f59fc01dbc0 2024-02-18T16:22:36.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:149 4.3c 4:3f421bc6:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a8d30 con 0x55b19b557f40 2024-02-18T16:22:36.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:150 4.32 4:4e27e11e:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5997c0 con 0x55b19b557f40 2024-02-18T16:22:36.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:151 4.33 4:cebb0436:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5aa910 con 0x7f5a000141d0 2024-02-18T16:22:36.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:152 4.5 4:a01eb1d0:::.dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5a8d30 con 0x55b19b55e220 2024-02-18T16:22:36.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 48 ==== osd_op_reply(150 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.8 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 42 ==== osd_op_reply(142 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.0 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 49 ==== osd_op_reply(144 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.2 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 50 ==== osd_op_reply(146 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.4 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.092+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 51 ==== osd_op_reply(149 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.7 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(152 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.10 [delete] v32'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 43 ==== osd_op_reply(148 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.6 [delete] v32'17 uv17 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 44 ==== osd_op_reply(145 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.3 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 45 ==== osd_op_reply(143 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.1 [delete] v32'9 uv9 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(151 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.9 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 46 ==== osd_op_reply(147 .dir.4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7.5 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 : miss 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:153 6.1e 6:790d8280:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5860 con 0x55b19b55e220 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(153 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 info.flags=0x0 2024-02-18T16:22:36.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 10 adding default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 to cache LRU end 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 10 removing default.rgw.log++pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 from cache 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7, ofs0, ns] 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94221303912384 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b33b0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 47 ==== watch-notify(notify (1) cookie 94221303685920 notify 137438953496 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f5a00045060 con 0x7f59fc01dbc0 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f58ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94221303685920 notifier 4776 bl.length()=203 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f58ea7fc640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f583c0032c0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 48 ==== osd_op_reply(154 notify.0 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 49 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 50 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5a00026ca0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:156 6.1e 6:790d8280:::pubsub..bucket.myfoo%2f4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b55e220 2024-02-18T16:22:36.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(156 pubsub..bucket.myfoo/4654bfe8-cc1b-4e5c-898b-5aaaee650498.4224.7 [delete] v32'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.096+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f59fc01dbc0 2024-02-18T16:22:36.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 51 ==== osd_op_reply(157 foo.buckets [call] v32'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a09566980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-02-18T16:22:36.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-18T16:22:36.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94221303912384 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f59fc01dbc0 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 52 ==== watch-notify(notify (1) cookie 94221303699376 notify 137438953497 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f5a00026ca0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f58eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94221303699376 notifier 4776 bl.length()=170 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 53 ==== osd_op_reply(158 notify.3 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f58eaffd640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f58cc003d60 con 0x7f59fc01dbc0 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 54 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 55 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953497 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5a000306f0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.100+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f5a000141d0 2024-02-18T16:22:36.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 10 removing email index: foo@foo.com 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94221303912384 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f59fc01dbc0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 56 ==== watch-notify(notify (1) cookie 94221303699376 notify 137438953498 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7f5a000306f0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f58ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94221303699376 notifier 4776 bl.length()=162 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 57 ==== osd_op_reply(161 notify.3 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f58ea7fc640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f583c0032c0 con 0x7f59fc01dbc0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 58 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 59 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5a00030880 con 0x7f59fc01dbc0 2024-02-18T16:22:36.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b557f40 2024-02-18T16:22:36.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 52 ==== osd_op_reply(163 foo@foo.com [delete] v32'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 10 removing user buckets index 2024-02-18T16:22:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-02-18T16:22:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94221303912384 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f5a000141d0 2024-02-18T16:22:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== watch-notify(notify (1) cookie 94221303696912 notify 137438953501 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55b19b521ee0 con 0x7f5a000141d0 2024-02-18T16:22:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(164 notify.5 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f58ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94221303696912 notifier 4776 bl.length()=160 2024-02-18T16:22:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.104+0000 7f58ea7fc640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f583c0032c0 con 0x7f5a000141d0 2024-02-18T16:22:36.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b19b521a50 con 0x7f5a000141d0 2024-02-18T16:22:36.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f59fc01dbc0 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 60 ==== osd_op_reply(166 foo.buckets [delete] v32'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a09566980 10 removing user index: foo 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a09566980 10 removing default.rgw.meta+users.uid+foo from cache 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a09566980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94221303912384 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b557f40 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 53 ==== watch-notify(notify (1) cookie 94221303692064 notify 137438953514 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55b19b521a50 con 0x55b19b557f40 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f58ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94221303692064 notifier 4776 bl.length()=152 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 54 ==== osd_op_reply(167 notify.4 [notify cookie 94221303912384 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f58ea7fc640 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f583c0032c0 con 0x55b19b557f40 2024-02-18T16:22:36.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 55 ==== watch-notify(notify_complete (2) cookie 94221303912384 notify 137438953514 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b19b42eb80 con 0x55b19b557f40 2024-02-18T16:22:36.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b557f40 2024-02-18T16:22:36.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.108+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 56 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 57 ==== osd_op_reply(169 foo [call,call,delete] v32'17 uv17 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f58bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94221303704272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b557f40 2024-02-18T16:22:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 58 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94221303704272] v32'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94221303685920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f59fc01dbc0 2024-02-18T16:22:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 61 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94221303685920] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a09566980 20 remove_watcher() i=0 2024-02-18T16:22:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a09566980 2 removed watcher, disabling cache 2024-02-18T16:22:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.112+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94221303691008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b557f40 2024-02-18T16:22:36.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.116+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 59 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94221303691008] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.116+0000 7f5a09566980 20 remove_watcher() i=1 2024-02-18T16:22:36.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.116+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94221303694656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b55e220 2024-02-18T16:22:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a06880640 1 -- 172.21.15.129:0/1567107237 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94221303694656] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59fc06f040 con 0x55b19b55e220 2024-02-18T16:22:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a09566980 20 remove_watcher() i=2 2024-02-18T16:22:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94221303699376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f59fc01dbc0 2024-02-18T16:22:36.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a07882640 1 -- 172.21.15.129:0/1567107237 <== osd.2 v2:172.21.15.129:6808/222672308 62 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94221303699376] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5a0003a040 con 0x7f59fc01dbc0 2024-02-18T16:22:36.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a09566980 20 remove_watcher() i=3 2024-02-18T16:22:36.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94221303692064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x55b19b557f40 2024-02-18T16:22:36.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.1 v2:172.21.15.129:6816/834716550 60 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94221303692064] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x55b19b557f40 2024-02-18T16:22:36.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a09566980 20 remove_watcher() i=4 2024-02-18T16:22:36.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.120+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94221303696912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f5a000141d0 2024-02-18T16:22:36.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.124+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94221303696912] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.124+0000 7f5a09566980 20 remove_watcher() i=5 2024-02-18T16:22:36.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.124+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94221303705728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f5a000141d0 2024-02-18T16:22:36.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94221303705728] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 20 remove_watcher() i=6 2024-02-18T16:22:36.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94221303709808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b19b5b5820 con 0x7f5a000141d0 2024-02-18T16:22:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94221303709808] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59f810f040 con 0x7f5a000141d0 2024-02-18T16:22:36.139 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 20 remove_watcher() i=7 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f5a000141d0 msgr2=0x7f5a00015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f5a000141d0 0x7f5a00015940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b557f40 msgr2=0x55b19b55a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b557f40 0x55b19b55a400 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f59fc01dbc0 msgr2=0x7f59fc03eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f59fc01dbc0 0x7f59fc03eaa0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b19b55e220 msgr2=0x55b19b560670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55b19b55e220 0x55b19b560670 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58d00342b0 msgr2=0x7f58d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58d00342b0 0x7f58d0036770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a00011010 tx=0x7f5a00020000 comp rx=0 tx=0).stop 2024-02-18T16:22:36.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 msgr2=0x55b19b54c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b54c950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f59fc019fd0 tx=0x7f59fc049950 comp rx=0 tx=0).stop 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a07081640 1 -- 172.21.15.129:0/1567107237 reap_dead start 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 shutdown_connections 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1567107237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b545a80 0x55b19b54c950 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 >> 172.21.15.129:0/1567107237 conn(0x55b19b541dc0 msgr2=0x55b19b53f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 shutdown_connections 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1567107237 wait complete. 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58e0034300 msgr2=0x7f58e00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58e0034300 0x7f58e00367c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55b19b528fc0 tx=0x7f5a00005850 comp rx=0 tx=0).stop 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 msgr2=0x55b19b538e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.128+0000 7f5a09566980 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 0x55b19b538e60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00d660 tx=0x7f59fc00da60 comp rx=0 tx=0).stop 2024-02-18T16:22:36.141 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 shutdown_connections 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58e0034300 0x7f58e00367c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/1699103551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b538a40 0x55b19b538e60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 >> 172.21.15.129:0/1699103551 conn(0x55b19b52d850 msgr2=0x55b19b52e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 shutdown_connections 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/1699103551 wait complete. 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b42d940 msgr2=0x55b19b528140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b42d940 0x55b19b528140 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58ec0342b0 msgr2=0x7f58ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58ec0342b0 0x7f58ec036770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f59fc001da0 tx=0x7f59fc001300 comp rx=0 tx=0).stop 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 msgr2=0x55b19b521510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b521510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f59f801bb20 tx=0x7f59f8018020 comp rx=0 tx=0).stop 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 shutdown_connections 2024-02-18T16:22:36.142 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55b19b42d940 0x55b19b528140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f58ec0342b0 0x7f58ec036770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 --2- 172.21.15.129:0/499491067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55b19b42d020 0x55b19b521510 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 >> 172.21.15.129:0/499491067 conn(0x55b19b4288f0 msgr2=0x55b19b512cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 shutdown_connections 2024-02-18T16:22:36.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.132+0000 7f5a09566980 1 -- 172.21.15.129:0/499491067 wait complete. 2024-02-18T16:22:36.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-18T16:22:36.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-18T16:22:36.148 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-18T16:22:36.222 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:36.222 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:36.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f823bb8e980 1 Processor -- start 2024-02-18T16:22:36.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f823bb8e980 1 -- start start 2024-02-18T16:22:36.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f823bb8e980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a123ba99e0 0x55a123ba7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f823bb8e980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a123b7f4c0 con 0x55a123ba84d0 2024-02-18T16:22:36.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f823bb8e980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a123b46180 con 0x55a123ba99e0 2024-02-18T16:22:36.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f82396a9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a123ba99e0 0x55a123ba7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f8238ea8640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55a123ba84d0 0x55a123c3b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40470/0 (socket says 172.21.15.129:40470) 2024-02-18T16:22:36.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f8238ea8640 1 -- 172.21.15.129:0/833546590 learned_addr learned my addr 172.21.15.129:0/833546590 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:36.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f82396a9640 1 -- 172.21.15.129:0/833546590 >> v1:172.21.15.80:6789/0 conn(0x55a123ba84d0 legacy=0x55a123c3b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.224 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.216+0000 7f82396a9640 1 -- 172.21.15.129:0/833546590 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a123ba88e0 con 0x55a123ba99e0 2024-02-18T16:22:36.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f82396a9640 1 --2- 172.21.15.129:0/833546590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123ba7f90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a480 tx=0x7f822c01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf50ed6a56f630a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f822bfff640 1 -- 172.21.15.129:0/833546590 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c0aa400 con 0x55a123ba99e0 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f822bfff640 1 -- 172.21.15.129:0/833546590 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c0a6050 con 0x55a123ba99e0 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f822bfff640 1 -- 172.21.15.129:0/833546590 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c0aa6b0 con 0x55a123ba99e0 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 -- 172.21.15.129:0/833546590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 msgr2=0x55a123ba7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 --2- 172.21.15.129:0/833546590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123ba7f90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a480 tx=0x7f822c01b220 comp rx=0 tx=0).stop 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 -- 172.21.15.129:0/833546590 shutdown_connections 2024-02-18T16:22:36.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 --2- 172.21.15.129:0/833546590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123ba7f90 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 -- 172.21.15.129:0/833546590 >> 172.21.15.129:0/833546590 conn(0x55a123c2ea00 msgr2=0x55a123c30e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 -- 172.21.15.129:0/833546590 shutdown_connections 2024-02-18T16:22:36.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.220+0000 7f823bb8e980 1 -- 172.21.15.129:0/833546590 wait complete. 2024-02-18T16:22:36.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 Processor -- start 2024-02-18T16:22:36.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- start start 2024-02-18T16:22:36.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 0x55a123d1f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a123b436b0 con 0x55a123ba84d0 2024-02-18T16:22:36.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f82396a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 0x55a123d1f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f82396a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 0x55a123d1f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56274/0 (socket says 172.21.15.129:56274) 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f82396a9640 1 -- 172.21.15.129:0/2411724539 learned_addr learned my addr 172.21.15.129:0/2411724539 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f82396a9640 1 -- 172.21.15.129:0/2411724539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c005d30 con 0x55a123ba84d0 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f82396a9640 1 --2- 172.21.15.129:0/2411724539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 0x55a123d1f840 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f822c018eb0 tx=0x7f822c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2604b068e3a12200 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f8127606640 1 -- 172.21.15.129:0/2411724539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c0aa670 con 0x55a123ba84d0 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f8127606640 1 -- 172.21.15.129:0/2411724539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c0aa7d0 con 0x55a123ba84d0 2024-02-18T16:22:36.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f8127606640 1 -- 172.21.15.129:0/2411724539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c0aaa90 con 0x55a123ba84d0 2024-02-18T16:22:36.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- 172.21.15.129:0/2411724539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 msgr2=0x55a123d1f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 --2- 172.21.15.129:0/2411724539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 0x55a123d1f840 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f822c018eb0 tx=0x7f822c003030 comp rx=0 tx=0).stop 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- 172.21.15.129:0/2411724539 shutdown_connections 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 --2- 172.21.15.129:0/2411724539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba84d0 0x55a123d1f840 secure :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f822c018eb0 tx=0x7f822c003030 comp rx=0 tx=0).stop 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- 172.21.15.129:0/2411724539 >> 172.21.15.129:0/2411724539 conn(0x55a123c2ea00 msgr2=0x55a123d1b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- 172.21.15.129:0/2411724539 shutdown_connections 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 -- 172.21.15.129:0/2411724539 wait complete. 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.236+0000 7f823bb8e980 1 Processor -- start 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 -- start start 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123d266f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a123b3ee90 con 0x55a123ba99e0 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f82396a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123d266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f82396a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123d266f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56284/0 (socket says 172.21.15.129:56284) 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f82396a9640 1 -- 172.21.15.129:0/102060717 learned_addr learned my addr 172.21.15.129:0/102060717 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f82396a9640 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a123ba88e0 con 0x55a123ba99e0 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f82396a9640 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123d266f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a480 tx=0x7f822c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8125e03640 1 -- 172.21.15.129:0/102060717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c0b4930 con 0x55a123ba99e0 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a123d26c30 con 0x55a123ba99e0 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8125e03640 1 -- 172.21.15.129:0/102060717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c0b4a90 con 0x55a123ba99e0 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a123d270e0 con 0x55a123ba99e0 2024-02-18T16:22:36.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8125e03640 1 -- 172.21.15.129:0/102060717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c0b4d30 con 0x55a123ba99e0 2024-02-18T16:22:36.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8125e03640 1 -- 172.21.15.129:0/102060717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f822c0c4070 con 0x55a123ba99e0 2024-02-18T16:22:36.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8125e03640 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81200342b0 0x7f8120036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8125e03640 1 -- 172.21.15.129:0/102060717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f822c0e3e60 con 0x55a123ba99e0 2024-02-18T16:22:36.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8238ea8640 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81200342b0 0x7f8120036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d2b320 0x55a123d2d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d2dc50 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8239eaa640 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d2b320 0x55a123d2d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8238ea8640 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81200342b0 0x7f8120036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8230001650 tx=0x7f8230006740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.240+0000 7f8239eaa640 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d2b320 0x55a123d2d710 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8239eaa640 1 -- 172.21.15.129:0/102060717 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f82340083f0 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d2e020 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8239eaa640 1 -- 172.21.15.129:0/102060717 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f82340083f0 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d2f8d0 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8239eaa640 1 -- 172.21.15.129:0/102060717 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f82340083f0 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d2ead0 con 0x55a123d2b320 2024-02-18T16:22:36.252 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8239eaa640 1 -- 172.21.15.129:0/102060717 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f82340083f0 con 0x55a123d2b320 2024-02-18T16:22:36.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d2eee0 con 0x55a123d2b320 2024-02-18T16:22:36.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8239eaa640 1 -- 172.21.15.129:0/102060717 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8234012040 con 0x55a123d2b320 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 Processor -- start 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- start start 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 0x55a123d3e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a123ad7f20 con 0x55a123d3df90 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8238ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 0x55a123d3e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8238ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 0x55a123d3e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56286/0 (socket says 172.21.15.129:56286) 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8238ea8640 1 -- 172.21.15.129:0/374122782 learned_addr learned my addr 172.21.15.129:0/374122782 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8238ea8640 1 -- 172.21.15.129:0/374122782 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a123d3e8f0 con 0x55a123d3df90 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f8238ea8640 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 0x55a123d3e3b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8230004ef0 tx=0x7f8230015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f811effd640 1 -- 172.21.15.129:0/374122782 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f823001a070 con 0x55a123d3df90 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f811effd640 1 -- 172.21.15.129:0/374122782 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8230015240 con 0x55a123d3df90 2024-02-18T16:22:36.256 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a123d3eb40 con 0x55a123d3df90 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f811effd640 1 -- 172.21.15.129:0/374122782 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82300115b0 con 0x55a123d3df90 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.244+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a123d3f690 con 0x55a123d3df90 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f811effd640 1 -- 172.21.15.129:0/374122782 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8230011710 con 0x55a123d3df90 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f811effd640 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81100342b0 0x7f8110036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f811effd640 1 -- 172.21.15.129:0/374122782 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f823004ab70 con 0x55a123d3df90 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8239eaa640 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81100342b0 0x7f8110036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 Processor -- start 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- start start 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8239eaa640 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81100342b0 0x7f8110036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55a123d2e510 tx=0x7f8234003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d4b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a123acb790 con 0x55a123d4af50 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8238ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d4b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.257 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8238ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d4b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56302/0 (socket says 172.21.15.129:56302) 2024-02-18T16:22:36.258 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8238ea8640 1 -- 172.21.15.129:0/978362564 learned_addr learned my addr 172.21.15.129:0/978362564 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8238ea8640 1 -- 172.21.15.129:0/978362564 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a123d4b920 con 0x55a123d4af50 2024-02-18T16:22:36.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f8238ea8640 1 --2- 172.21.15.129:0/978362564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d4b350 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f82300138f0 tx=0x7f8230013920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32f830d3bcee175 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f811cff9640 1 -- 172.21.15.129:0/978362564 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8230047070 con 0x55a123d4af50 2024-02-18T16:22:36.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f811cff9640 1 -- 172.21.15.129:0/978362564 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823001ed60 con 0x55a123d4af50 2024-02-18T16:22:36.264 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f811cff9640 1 -- 172.21.15.129:0/978362564 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f823001f6c0 con 0x55a123d4af50 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- 172.21.15.129:0/978362564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 msgr2=0x55a123d4b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 --2- 172.21.15.129:0/978362564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d4b350 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f82300138f0 tx=0x7f8230013920 comp rx=0 tx=0).stop 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- 172.21.15.129:0/978362564 shutdown_connections 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 --2- 172.21.15.129:0/978362564 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d4b350 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- 172.21.15.129:0/978362564 >> 172.21.15.129:0/978362564 conn(0x55a123d47290 msgr2=0x55a123d452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- 172.21.15.129:0/978362564 shutdown_connections 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 -- 172.21.15.129:0/978362564 wait complete. 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.248+0000 7f823bb8e980 1 Processor -- start 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 -- start start 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d51e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a123d523b0 con 0x55a123d4af50 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8238ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d51e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.265 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8238ea8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d51e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56308/0 (socket says 172.21.15.129:56308) 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 learned_addr learned my addr 172.21.15.129:0/3948633153 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a123d3f690 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8238ea8640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d51e70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8230015d70 tx=0x7f8230048e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f810effd640 1 -- 172.21.15.129:0/3948633153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f823002e040 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a123d525b0 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f810effd640 1 -- 172.21.15.129:0/3948633153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8230013430 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f810effd640 1 -- 172.21.15.129:0/3948633153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8230011b30 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a123d52980 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f810effd640 1 -- 172.21.15.129:0/3948633153 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8230011c90 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f810effd640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81040342b0 0x7f8104036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f810effd640 1 -- 172.21.15.129:0/3948633153 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f8230034d50 con 0x55a123d4af50 2024-02-18T16:22:36.266 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8239eaa640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81040342b0 0x7f8104036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d5d3e0 0x55a123d5f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d5fff0 con 0x55a123d5d3e0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f82396a9640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d5d3e0 0x55a123d5f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f8239eaa640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81040342b0 0x7f8104036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8234008fd0 tx=0x7f823401c070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f82396a9640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d5d3e0 0x55a123d5f8a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 20 realm 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.252+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d603c0 con 0x55a123d5d3e0 2024-02-18T16:22:36.267 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d60c10 con 0x55a123d5d3e0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d60f70 con 0x55a123d5d3e0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:36.268 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d608b0 con 0x55a123d5d3e0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 rados_obj.operate() r=0 bl.length=874 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 20 searching for the correct realm 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a123d631c0 0x55a123d655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x55a123d631c0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8238ea8640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a123d631c0 0x55a123d655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8238ea8640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a123d631c0 0x55a123d655b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823001e330 con 0x55a123d631c0 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8238ea8640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f82300170c0 0x7f823004a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.269 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x7f82300170c0 2024-02-18T16:22:36.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8239eaa640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f82300170c0 0x7f823004a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8239eaa640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f82300170c0 0x7f823004a0d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823402c040 con 0x7f82300170c0 2024-02-18T16:22:36.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8239eaa640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8234027940 0x7f82340333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.270 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x7f8234027940 2024-02-18T16:22:36.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f82396a9640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8234027940 0x7f82340333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.256+0000 7f82396a9640 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8234027940 0x7f82340333c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x55a123d5d3e0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x55a123d5d3e0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x7f8234027940 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d65c80 con 0x7f8234027940 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823402c040 con 0x7f82300170c0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823001e330 con 0x55a123d631c0 2024-02-18T16:22:36.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d5d3e0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f8234027940 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d5d3e0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.260+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f823402c040 con 0x7f82300170c0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823001e330 con 0x55a123d631c0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f8234027940 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d5d3e0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d5d3e0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f8234027940 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823402c040 con 0x7f82300170c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d5d3e0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.264+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823402c040 con 0x7f82300170c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f8234027940 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f822c0c3030 con 0x7f8234027940 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823402c040 con 0x7f82300170c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d631c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x55a123d5d3e0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f822c0ea040 con 0x7f82300170c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:36.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d61ca0 con 0x55a123d5d3e0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f822c0c3030 con 0x55a123d5d3e0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d62050 con 0x55a123d5d3e0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d62050 con 0x55a123d5d3e0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 zone default found 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 4 Realm: () 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 zonegroup default 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d628d0 con 0x7f82300170c0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d67aa0 con 0x55a123d631c0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.268+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d67e00 con 0x55a123d631c0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 20 started sync module instance, tier type = 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d67380 con 0x7f82300170c0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94150579351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d67730 con 0x7f82300170c0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d67360 con 0x55a123d5d3e0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94150579351264] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94150579356000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d68af0 con 0x55a123d5d3e0 2024-02-18T16:22:36.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.272+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d69460 con 0x55a123d631c0 2024-02-18T16:22:36.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94150579356000] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94150579359680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d697c0 con 0x55a123d631c0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6a130 con 0x7f82300170c0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94150579363232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6a860 con 0x7f82300170c0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.276+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6b330 con 0x55a123d5d3e0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94150579359680] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94150579363232] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94150579367440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6b2f0 con 0x55a123d5d3e0 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6a430 con 0x7f8234027940 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94150579368960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6be80 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6c950 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.280+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94150579367440] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.284+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94150579368960] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.284+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.284+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94150579373104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6b8e0 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.284+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6cf20 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.284+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94150579373104] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94150579357056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6cf20 con 0x7f8234027940 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=0 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=1 2024-02-18T16:22:36.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=2 2024-02-18T16:22:36.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=3 2024-02-18T16:22:36.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=4 2024-02-18T16:22:36.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=5 2024-02-18T16:22:36.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=6 2024-02-18T16:22:36.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94150579357056] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 add_watcher() i=7 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d701a0 con 0x55a123d5d3e0 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94150579375088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d6d4b0 con 0x55a123d5d3e0 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94150579375088] v32'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f80ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 5 note: GC not initialized 2024-02-18T16:22:36.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f80ee7e4640 20 reqs_thread_entry: start 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 Filter name: none 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f805ffff640 20 reqs_thread_entry: start 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 20 rados->read ofs=0 len=0 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.288+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d91c90 con 0x55a123d5d3e0 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f823bb8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:could not fetch user info: no user info saved 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f80ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94150579375088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d91c50 con 0x55a123d5d3e0 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94150579375088] v32'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94150579351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d91c50 con 0x7f82300170c0 2024-02-18T16:22:36.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94150579351264] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f823bb8e980 20 remove_watcher() i=0 2024-02-18T16:22:36.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f823bb8e980 2 removed watcher, disabling cache 2024-02-18T16:22:36.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.292+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94150579356000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d91c50 con 0x55a123d5d3e0 2024-02-18T16:22:36.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.296+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94150579356000] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.296+0000 7f823bb8e980 20 remove_watcher() i=1 2024-02-18T16:22:36.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.296+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94150579359680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d91c50 con 0x55a123d631c0 2024-02-18T16:22:36.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.296+0000 7f8238ea8640 1 -- 172.21.15.129:0/3948633153 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94150579359680] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823005e040 con 0x55a123d631c0 2024-02-18T16:22:36.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.296+0000 7f823bb8e980 20 remove_watcher() i=2 2024-02-18T16:22:36.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.296+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94150579363232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d66ee0 con 0x7f82300170c0 2024-02-18T16:22:36.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.300+0000 7f8239eaa640 1 -- 172.21.15.129:0/3948633153 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94150579363232] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f823403f040 con 0x7f82300170c0 2024-02-18T16:22:36.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.300+0000 7f823bb8e980 20 remove_watcher() i=3 2024-02-18T16:22:36.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.300+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94150579367440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d68160 con 0x55a123d5d3e0 2024-02-18T16:22:36.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.300+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94150579367440] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x55a123d5d3e0 2024-02-18T16:22:36.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.300+0000 7f823bb8e980 20 remove_watcher() i=4 2024-02-18T16:22:36.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.300+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94150579368960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d68fc0 con 0x7f8234027940 2024-02-18T16:22:36.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.304+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94150579368960] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.304+0000 7f823bb8e980 20 remove_watcher() i=5 2024-02-18T16:22:36.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.304+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94150579373104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d66ee0 con 0x7f8234027940 2024-02-18T16:22:36.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.304+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94150579373104] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.304+0000 7f823bb8e980 20 remove_watcher() i=6 2024-02-18T16:22:36.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.304+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94150579357056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a123d68160 con 0x7f8234027940 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94150579357056] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f822c0f3040 con 0x7f8234027940 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 20 remove_watcher() i=7 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8234027940 msgr2=0x7f82340333c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f8234027940 0x7f82340333c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d5d3e0 msgr2=0x55a123d5f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d5d3e0 0x55a123d5f8a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f82300170c0 msgr2=0x7f823004a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f82300170c0 0x7f823004a0d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a123d631c0 msgr2=0x55a123d655b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55a123d631c0 0x55a123d655b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81040342b0 msgr2=0x7f8104036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81040342b0 0x7f8104036770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8234008fd0 tx=0x7f823401c070 comp rx=0 tx=0).stop 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 msgr2=0x55a123d51e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d51e70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8230015d70 tx=0x7f8230048e50 comp rx=0 tx=0).stop 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f82396a9640 1 -- 172.21.15.129:0/3948633153 reap_dead start 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 shutdown_connections 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/3948633153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d4af50 0x55a123d51e70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 >> 172.21.15.129:0/3948633153 conn(0x55a123d47290 msgr2=0x55a123d448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 shutdown_connections 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/3948633153 wait complete. 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81100342b0 msgr2=0x7f8110036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81100342b0 0x7f8110036770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55a123d2e510 tx=0x7f8234003070 comp rx=0 tx=0).stop 2024-02-18T16:22:36.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 msgr2=0x55a123d3e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 0x55a123d3e3b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8230004ef0 tx=0x7f8230015820 comp rx=0 tx=0).stop 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 shutdown_connections 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81100342b0 0x7f8110036770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/374122782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123d3df90 0x55a123d3e3b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 >> 172.21.15.129:0/374122782 conn(0x55a123d32da0 msgr2=0x55a123d338b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 shutdown_connections 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/374122782 wait complete. 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d2b320 msgr2=0x55a123d2d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d2b320 0x55a123d2d710 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81200342b0 msgr2=0x7f8120036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81200342b0 0x7f8120036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8230001650 tx=0x7f8230006740 comp rx=0 tx=0).stop 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 msgr2=0x55a123d266f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123d266f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a480 tx=0x7f822c018020 comp rx=0 tx=0).stop 2024-02-18T16:22:36.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 shutdown_connections 2024-02-18T16:22:36.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a123d2b320 0x55a123d2d710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f81200342b0 0x7f8120036770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 --2- 172.21.15.129:0/102060717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a123ba99e0 0x55a123d266f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 >> 172.21.15.129:0/102060717 conn(0x55a123c2ea00 msgr2=0x55a123d19ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 shutdown_connections 2024-02-18T16:22:36.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.308+0000 7f823bb8e980 1 -- 172.21.15.129:0/102060717 wait complete. 2024-02-18T16:22:36.324 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-18T16:22:36.324 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-02-18T16:22:36.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-02-18T16:22:36.325 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-02-18T16:22:36.392 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:36.392 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.384+0000 7fc57f31f980 1 Processor -- start 2024-02-18T16:22:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.384+0000 7fc57f31f980 1 -- start start 2024-02-18T16:22:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.384+0000 7fc57f31f980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cf0fb298e0 0x55cf0fb2bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.384+0000 7fc57f31f980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cf0fa6f4c0 con 0x55cf0fb253d0 2024-02-18T16:22:36.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.384+0000 7fc57f31f980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cf0fa36180 con 0x55cf0fb298e0 2024-02-18T16:22:36.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57ce3a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55cf0fb253d0 0x55cf0fb257b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40486/0 (socket says 172.21.15.129:40486) 2024-02-18T16:22:36.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57c639640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cf0fb298e0 0x55cf0fb2bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57ce3a640 1 -- 172.21.15.129:0/3450373796 learned_addr learned my addr 172.21.15.129:0/3450373796 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:36.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57be38640 1 -- 172.21.15.129:0/3450373796 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378980536 0 0) 0x55cf0fa6f4c0 con 0x55cf0fb253d0 2024-02-18T16:22:36.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57be38640 1 -- 172.21.15.129:0/3450373796 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc564001e20 con 0x55cf0fb253d0 2024-02-18T16:22:36.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57c639640 1 -- 172.21.15.129:0/3450373796 >> v1:172.21.15.80:6789/0 conn(0x55cf0fb253d0 legacy=0x55cf0fb257b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.388+0000 7fc57c639640 1 -- 172.21.15.129:0/3450373796 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf0fb2d220 con 0x55cf0fb298e0 2024-02-18T16:22:36.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57c639640 1 --2- 172.21.15.129:0/3450373796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb298e0 0x55cf0fb2bcd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc57000a480 tx=0x7fc57001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf8c25f8b6270d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57be38640 1 -- 172.21.15.129:0/3450373796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5700ab540 con 0x55cf0fb298e0 2024-02-18T16:22:36.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57be38640 1 -- 172.21.15.129:0/3450373796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5700ab6a0 con 0x55cf0fb298e0 2024-02-18T16:22:36.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57be38640 1 -- 172.21.15.129:0/3450373796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5700ab940 con 0x55cf0fb298e0 2024-02-18T16:22:36.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 -- 172.21.15.129:0/3450373796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb298e0 msgr2=0x55cf0fb2bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 --2- 172.21.15.129:0/3450373796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb298e0 0x55cf0fb2bcd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc57000a480 tx=0x7fc57001b280 comp rx=0 tx=0).stop 2024-02-18T16:22:36.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 -- 172.21.15.129:0/3450373796 shutdown_connections 2024-02-18T16:22:36.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 --2- 172.21.15.129:0/3450373796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb298e0 0x55cf0fb2bcd0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 -- 172.21.15.129:0/3450373796 >> 172.21.15.129:0/3450373796 conn(0x55cf0fa98b20 msgr2=0x55cf0fa98f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.400 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 -- 172.21.15.129:0/3450373796 shutdown_connections 2024-02-18T16:22:36.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.392+0000 7fc57f31f980 1 -- 172.21.15.129:0/3450373796 wait complete. 2024-02-18T16:22:36.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57f31f980 1 Processor -- start 2024-02-18T16:22:36.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57f31f980 1 -- start start 2024-02-18T16:22:36.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57f31f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc0f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.413 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57f31f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0fa336b0 con 0x55cf0fb253d0 2024-02-18T16:22:36.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57ce3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc0f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57ce3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc0f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56328/0 (socket says 172.21.15.129:56328) 2024-02-18T16:22:36.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.404+0000 7fc57ce3a640 1 -- 172.21.15.129:0/3190731247 learned_addr learned my addr 172.21.15.129:0/3190731247 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 -- 172.21.15.129:0/3190731247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570005d30 con 0x55cf0fb253d0 2024-02-18T16:22:36.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 --2- 172.21.15.129:0/3190731247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc0f170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc56c001c30 tx=0x7fc56c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceebf3628dfacc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc46ae0d640 1 -- 172.21.15.129:0/3190731247 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c00e690 con 0x55cf0fb253d0 2024-02-18T16:22:36.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc46ae0d640 1 -- 172.21.15.129:0/3190731247 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00e7f0 con 0x55cf0fb253d0 2024-02-18T16:22:36.415 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc46ae0d640 1 -- 172.21.15.129:0/3190731247 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c00eb50 con 0x55cf0fb253d0 2024-02-18T16:22:36.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/3190731247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 msgr2=0x55cf0fc0f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 --2- 172.21.15.129:0/3190731247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc0f170 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc56c001c30 tx=0x7fc56c00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.416 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/3190731247 shutdown_connections 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 --2- 172.21.15.129:0/3190731247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc0f170 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/3190731247 >> 172.21.15.129:0/3190731247 conn(0x55cf0fa98b20 msgr2=0x55cf0fc0ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/3190731247 shutdown_connections 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/3190731247 wait complete. 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 Processor -- start 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- start start 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc16040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0fa2ee90 con 0x55cf0fb253d0 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc16040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc16040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56336/0 (socket says 172.21.15.129:56336) 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 -- 172.21.15.129:0/947454669 learned_addr learned my addr 172.21.15.129:0/947454669 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.417 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 -- 172.21.15.129:0/947454669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564001e20 con 0x55cf0fb253d0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57ce3a640 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc16040 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00b710 tx=0x7fc56c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc46960a640 1 -- 172.21.15.129:0/947454669 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c01f070 con 0x55cf0fb253d0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf0fc16580 con 0x55cf0fb253d0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc46960a640 1 -- 172.21.15.129:0/947454669 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c01a2e0 con 0x55cf0fb253d0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf0fc169d0 con 0x55cf0fb253d0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.408+0000 7fc46960a640 1 -- 172.21.15.129:0/947454669 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c01a820 con 0x55cf0fb253d0 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 Processor -- start 2024-02-18T16:22:36.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- start start 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc23440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0f9c7f20 con 0x55cf0fc23020 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc23440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc23440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56346/0 (socket says 172.21.15.129:56346) 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 -- 172.21.15.129:0/2460364089 learned_addr learned my addr 172.21.15.129:0/2460364089 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc46960a640 1 -- 172.21.15.129:0/947454669 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc56c00a040 con 0x55cf0fb253d0 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc46960a640 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc464034300 0x7fc4640367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc46960a640 1 -- 172.21.15.129:0/947454669 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc56c0498b0 con 0x55cf0fb253d0 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57ce3a640 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc464034300 0x7fc4640367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 -- 172.21.15.129:0/2460364089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf0fc23980 con 0x55cf0fc23020 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 --2- 172.21.15.129:0/2460364089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc23440 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc57400a430 tx=0x7fc57400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bd96cf84fb1083 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57ce3a640 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc464034300 0x7fc4640367c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0185a0 tx=0x7fc56c018430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc462ffd640 1 -- 172.21.15.129:0/2460364089 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc57400f6e0 con 0x55cf0fc23020 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc462ffd640 1 -- 172.21.15.129:0/2460364089 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400f860 con 0x55cf0fc23020 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc462ffd640 1 -- 172.21.15.129:0/2460364089 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc57400fb40 con 0x55cf0fc23020 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- 172.21.15.129:0/2460364089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 msgr2=0x55cf0fc23440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 --2- 172.21.15.129:0/2460364089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc23440 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc57400a430 tx=0x7fc57400a8f0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- 172.21.15.129:0/2460364089 shutdown_connections 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 --2- 172.21.15.129:0/2460364089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc23440 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- 172.21.15.129:0/2460364089 >> 172.21.15.129:0/2460364089 conn(0x55cf0fb298e0 msgr2=0x55cf0fc1e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- 172.21.15.129:0/2460364089 shutdown_connections 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- 172.21.15.129:0/2460364089 wait complete. 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 Processor -- start 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- start start 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc29f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57f31f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0f9bb790 con 0x55cf0fc23020 2024-02-18T16:22:36.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc29f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc29f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56350/0 (socket says 172.21.15.129:56350) 2024-02-18T16:22:36.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 -- 172.21.15.129:0/4003336506 learned_addr learned my addr 172.21.15.129:0/4003336506 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.412+0000 7fc57d63b640 1 -- 172.21.15.129:0/4003336506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57400a0e0 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57d63b640 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc29f10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55cf0fc23e00 tx=0x7fc574003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4617fa640 1 -- 172.21.15.129:0/4003336506 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc574010a20 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf0fc2a450 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4617fa640 1 -- 172.21.15.129:0/4003336506 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574010b80 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4617fa640 1 -- 172.21.15.129:0/4003336506 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc57401a480 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf0fc2a8e0 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4617fa640 1 -- 172.21.15.129:0/4003336506 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc57401a6f0 con 0x55cf0fc23020 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 Processor -- start 2024-02-18T16:22:36.428 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4617fa640 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc4540342b0 0x7fc454036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4617fa640 1 -- 172.21.15.129:0/4003336506 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc574049e70 con 0x55cf0fc23020 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 -- start start 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57d63b640 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc4540342b0 0x7fc454036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 0x55cf0fc440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0fc445f0 con 0x55cf0fc43c90 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57d63b640 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc4540342b0 0x7fc454036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc57402efd0 tx=0x7fc57401a5e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57ce3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 0x55cf0fc440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57ce3a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 0x55cf0fc440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56366/0 (socket says 172.21.15.129:56366) 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57ce3a640 1 -- 172.21.15.129:0/439058633 learned_addr learned my addr 172.21.15.129:0/439058633 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57ce3a640 1 -- 172.21.15.129:0/439058633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf0fc44730 con 0x55cf0fc43c90 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57ce3a640 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 0x55cf0fc440b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc56c023580 tx=0x7fc56c016780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4417e2640 1 -- 172.21.15.129:0/439058633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c017c90 con 0x55cf0fc43c90 2024-02-18T16:22:36.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf0fc45080 con 0x55cf0fc43c90 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4417e2640 1 -- 172.21.15.129:0/439058633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c017ab0 con 0x55cf0fc43c90 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc4417e2640 1 -- 172.21.15.129:0/439058633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56c023e40 con 0x55cf0fc43c90 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.416+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf0fc45510 con 0x55cf0fc43c90 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc4417e2640 1 -- 172.21.15.129:0/439058633 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc56c0187b0 con 0x55cf0fc43c90 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc4417e2640 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc3b8034300 0x7fc3b80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc4417e2640 1 -- 172.21.15.129:0/439058633 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fc56c03d030 con 0x55cf0fc43c90 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57c639640 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc3b8034300 0x7fc3b80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc3c2ffd640 20 reqs_thread_entry: start 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf0fc48c60 0x55cf0fc4b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf0fc4b590 con 0x55cf0fc48c60 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57c639640 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc3b8034300 0x7fc3b80367c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5700ad000 tx=0x7fc5700a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57d63b640 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf0fc48c60 0x55cf0fc4b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57d63b640 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf0fc48c60 0x55cf0fc4b050 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57d63b640 1 -- 172.21.15.129:0/947454669 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc574016020 con 0x55cf0fc48c60 2024-02-18T16:22:36.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf0fc4c900 con 0x55cf0fc48c60 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57d63b640 1 -- 172.21.15.129:0/947454669 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc574016020 con 0x55cf0fc48c60 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc4540342b0 msgr2=0x7fc454036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc4540342b0 0x7fc454036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc57402efd0 tx=0x7fc57401a5e0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 msgr2=0x55cf0fc29f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc29f10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55cf0fc23e00 tx=0x7fc574003380 comp rx=0 tx=0).stop 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 shutdown_connections 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc4540342b0 0x7fc454036770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/4003336506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc23020 0x55cf0fc29f10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.433 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 >> 172.21.15.129:0/4003336506 conn(0x55cf0fb298e0 msgr2=0x55cf0fc1d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 shutdown_connections 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/4003336506 wait complete. 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc3b8034300 msgr2=0x7fc3b80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc3b8034300 0x7fc3b80367c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5700ad000 tx=0x7fc5700a5040 comp rx=0 tx=0).stop 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 msgr2=0x55cf0fc440b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 0x55cf0fc440b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc56c023580 tx=0x7fc56c016780 comp rx=0 tx=0).stop 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 shutdown_connections 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc3b8034300 0x7fc3b80367c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 --2- 172.21.15.129:0/439058633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fc43c90 0x55cf0fc440b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 >> 172.21.15.129:0/439058633 conn(0x55cf0fc389b0 msgr2=0x55cf0fc393d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 shutdown_connections 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.420+0000 7fc57f31f980 1 -- 172.21.15.129:0/439058633 wait complete. 2024-02-18T16:22:36.434 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf0fc48c60 msgr2=0x55cf0fc4b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf0fc48c60 0x55cf0fc4b050 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc464034300 msgr2=0x7fc4640367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc464034300 0x7fc4640367c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0185a0 tx=0x7fc56c018430 comp rx=0 tx=0).stop 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 msgr2=0x55cf0fc16040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc16040 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00b710 tx=0x7fc56c000bd0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 shutdown_connections 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf0fc48c60 0x55cf0fc4b050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fc464034300 0x7fc4640367c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 --2- 172.21.15.129:0/947454669 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf0fb253d0 0x55cf0fc16040 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 >> 172.21.15.129:0/947454669 conn(0x55cf0fa98b20 msgr2=0x55cf0fc09810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 shutdown_connections 2024-02-18T16:22:36.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.424+0000 7fc57f31f980 1 -- 172.21.15.129:0/947454669 wait complete. 2024-02-18T16:22:36.439 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-18T16:22:36.439 DEBUG:tasks.util.rgw: json result: {'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-18T16:22:36.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-02-18T16:22:36.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-02-18T16:22:36.440 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-02-18T16:22:36.513 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:36.513 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:36.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.504+0000 7f9d1b835980 1 Processor -- start 2024-02-18T16:22:36.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d1b835980 1 -- start start 2024-02-18T16:22:36.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d1b835980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cc8e0d0560 0x55cc8e0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d1b835980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cc8e0194b0 con 0x55cc8e0cc000 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d1b835980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cc8dfe0180 con 0x55cc8e0d0560 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d18b4f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cc8e0d0560 0x55cc8e0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d18b4f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cc8e0d0560 0x55cc8e0d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56380/0 (socket says 172.21.15.129:56380) 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d18b4f640 1 -- 172.21.15.129:0/740592707 learned_addr learned my addr 172.21.15.129:0/740592707 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d19350640 1 --1- 172.21.15.129:0/740592707 >> v1:172.21.15.80:6789/0 conn(0x55cc8e0cc000 0x55cc8e0cc3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40502/0 (socket says 172.21.15.129:40502) 2024-02-18T16:22:36.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d18b4f640 1 -- 172.21.15.129:0/740592707 >> v1:172.21.15.80:6789/0 conn(0x55cc8e0cc000 legacy=0x55cc8e0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.516 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d18b4f640 1 -- 172.21.15.129:0/740592707 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc8e0d3ea0 con 0x55cc8e0d0560 2024-02-18T16:22:36.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d18b4f640 1 --2- 172.21.15.129:0/740592707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0d0560 0x55cc8e0d2950 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00a5c0 tx=0x7f9d0c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305266902251a1a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.517 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d13fff640 1 -- 172.21.15.129:0/740592707 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d0c0aa470 con 0x55cc8e0d0560 2024-02-18T16:22:36.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d13fff640 1 -- 172.21.15.129:0/740592707 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c0aa5d0 con 0x55cc8e0d0560 2024-02-18T16:22:36.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.508+0000 7f9d13fff640 1 -- 172.21.15.129:0/740592707 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d0c0aa890 con 0x55cc8e0d0560 2024-02-18T16:22:36.518 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 -- 172.21.15.129:0/740592707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0d0560 msgr2=0x55cc8e0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 --2- 172.21.15.129:0/740592707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0d0560 0x55cc8e0d2950 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00a5c0 tx=0x7f9d0c01b340 comp rx=0 tx=0).stop 2024-02-18T16:22:36.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 -- 172.21.15.129:0/740592707 shutdown_connections 2024-02-18T16:22:36.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 --2- 172.21.15.129:0/740592707 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0d0560 0x55cc8e0d2950 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 -- 172.21.15.129:0/740592707 >> 172.21.15.129:0/740592707 conn(0x55cc8e0c78d0 msgr2=0x55cc8e0c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 -- 172.21.15.129:0/740592707 shutdown_connections 2024-02-18T16:22:36.519 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.512+0000 7f9d1b835980 1 -- 172.21.15.129:0/740592707 wait complete. 2024-02-18T16:22:36.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d1b835980 1 Processor -- start 2024-02-18T16:22:36.532 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d1b835980 1 -- start start 2024-02-18T16:22:36.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d1b835980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d1b835980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc8dfdd6b0 con 0x55cc8e0cc000 2024-02-18T16:22:36.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d19350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d19350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56390/0 (socket says 172.21.15.129:56390) 2024-02-18T16:22:36.533 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d19350640 1 -- 172.21.15.129:0/879506932 learned_addr learned my addr 172.21.15.129:0/879506932 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d19350640 1 -- 172.21.15.129:0/879506932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c005df0 con 0x55cc8e0cc000 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9d19350640 1 --2- 172.21.15.129:0/879506932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1b5f70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006fc0 tx=0x7f9d140019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdb6753f34f9e59 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9c07606640 1 -- 172.21.15.129:0/879506932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d14013420 con 0x55cc8e0cc000 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9c07606640 1 -- 172.21.15.129:0/879506932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14013580 con 0x55cc8e0cc000 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.524+0000 7f9c07606640 1 -- 172.21.15.129:0/879506932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d14013880 con 0x55cc8e0cc000 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/879506932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 msgr2=0x55cc8e1b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.535 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 --2- 172.21.15.129:0/879506932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1b5f70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006fc0 tx=0x7f9d140019b0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/879506932 shutdown_connections 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 --2- 172.21.15.129:0/879506932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1b5f70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/879506932 >> 172.21.15.129:0/879506932 conn(0x55cc8e0c78d0 msgr2=0x55cc8e1b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/879506932 shutdown_connections 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/879506932 wait complete. 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 Processor -- start 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- start start 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc8dfd8e90 con 0x55cc8e0cc000 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1bcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56404/0 (socket says 172.21.15.129:56404) 2024-02-18T16:22:36.536 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 learned_addr learned my addr 172.21.15.129:0/987432779 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc8e0194b0 con 0x55cc8e0cc000 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19350640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1bcde0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9d140012f0 tx=0x7f9d14001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9c05e03640 1 -- 172.21.15.129:0/987432779 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d14006320 con 0x55cc8e0cc000 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc8e1bd320 con 0x55cc8e0cc000 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc8e1bd770 con 0x55cc8e0cc000 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9c05e03640 1 -- 172.21.15.129:0/987432779 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14006840 con 0x55cc8e0cc000 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9c05e03640 1 -- 172.21.15.129:0/987432779 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d14004c50 con 0x55cc8e0cc000 2024-02-18T16:22:36.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 Processor -- start 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- start start 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d1b835980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc8df71f20 con 0x55cc8e0410e0 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9c05e03640 1 -- 172.21.15.129:0/987432779 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d14027400 con 0x55cc8e0cc000 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19b51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19b51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56414/0 (socket says 172.21.15.129:56414) 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.528+0000 7f9d19b51640 1 -- 172.21.15.129:0/1167710412 learned_addr learned my addr 172.21.15.129:0/1167710412 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9c05e03640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9c00034300 0x7f9c000367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9c05e03640 1 -- 172.21.15.129:0/987432779 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9d140494e0 con 0x55cc8e0cc000 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19350640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9c00034300 0x7f9c000367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 -- 172.21.15.129:0/1167710412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc8e1ce0e0 con 0x55cc8e0410e0 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19350640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9c00034300 0x7f9c000367c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d140104d0 tx=0x7f9d14010360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 --2- 172.21.15.129:0/1167710412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1cdba0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400a440 tx=0x7f9d0400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd5ece2ce1215a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9bff7fe640 1 -- 172.21.15.129:0/1167710412 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d04008850 con 0x55cc8e0410e0 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9bff7fe640 1 -- 172.21.15.129:0/1167710412 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d040089d0 con 0x55cc8e0410e0 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9bff7fe640 1 -- 172.21.15.129:0/1167710412 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d04008cb0 con 0x55cc8e0410e0 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1167710412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 msgr2=0x55cc8e1cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 --2- 172.21.15.129:0/1167710412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1cdba0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400a440 tx=0x7f9d0400a900 comp rx=0 tx=0).stop 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1167710412 shutdown_connections 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 --2- 172.21.15.129:0/1167710412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1cdba0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1167710412 >> 172.21.15.129:0/1167710412 conn(0x55cc8e0d0560 msgr2=0x55cc8e1c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1167710412 shutdown_connections 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1167710412 wait complete. 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 Processor -- start 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- start start 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc8df65790 con 0x55cc8e0410e0 2024-02-18T16:22:36.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56416/0 (socket says 172.21.15.129:56416) 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 -- 172.21.15.129:0/1670949404 learned_addr learned my addr 172.21.15.129:0/1670949404 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 -- 172.21.15.129:0/1670949404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d04005cd0 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d19b51640 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1d1e40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55cc8e040700 tx=0x7f9d04003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9bfdffb640 1 -- 172.21.15.129:0/1670949404 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d04013a50 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc8e1d2380 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc8e1d2810 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9bfdffb640 1 -- 172.21.15.129:0/1670949404 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04013bb0 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.532+0000 7f9bfdffb640 1 -- 172.21.15.129:0/1670949404 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d04013e50 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bfdffb640 1 -- 172.21.15.129:0/1670949404 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d0401e420 con 0x55cc8e0410e0 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 1 Processor -- start 2024-02-18T16:22:36.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bfdffb640 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9bf0034260 0x7f9bf0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 1 -- start start 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bfdffb640 1 -- 172.21.15.129:0/1670949404 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9d04049400 con 0x55cc8e0410e0 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19b51640 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9bf0034260 0x7f9bf0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 0x55cc8e1c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc8e1ca080 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19b51640 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9bf0034260 0x7f9bf0036720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d04006ad0 tx=0x7f9d04006a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 0x55cc8e1c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19350640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 0x55cc8e1c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56426/0 (socket says 172.21.15.129:56426) 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19350640 1 -- 172.21.15.129:0/579408488 learned_addr learned my addr 172.21.15.129:0/579408488 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19350640 1 -- 172.21.15.129:0/579408488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc8e1ca1c0 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.548 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d19350640 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 0x55cc8e1c9b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9d140477a0 tx=0x7f9d1400fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bddfe3640 1 -- 172.21.15.129:0/579408488 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d140125d0 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc8e1ca470 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bddfe3640 1 -- 172.21.15.129:0/579408488 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400f690 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bddfe3640 1 -- 172.21.15.129:0/579408488 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d140119d0 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc8e1ca470 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.536+0000 7f9bddfe3640 1 -- 172.21.15.129:0/579408488 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9d14011b30 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9bddfe3640 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9b5c0342b0 0x7f9b5c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9bddfe3640 1 -- 172.21.15.129:0/579408488 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f9d1403e2c0 con 0x55cc8e1cb6a0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9b5c0342b0 0x7f9b5c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9b577fe640 20 reqs_thread_entry: start 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cc8e1f2a30 0x55cc8e1f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9b5c0342b0 0x7f9b5c036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0ae000 tx=0x7f9d0c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f5360 con 0x55cc8e1f2a30 2024-02-18T16:22:36.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19b51640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cc8e1f2a30 0x55cc8e1f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19b51640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cc8e1f2a30 0x55cc8e1f4e20 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f56c0 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f6c10 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1fcb10 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:NOTICE: set zone's realm_id= 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cc8e200b40 0x55cc8e1fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19350640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cc8e200b40 0x55cc8e1fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19350640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cc8e200b40 0x55cc8e1fc3a0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.555 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d14024070 con 0x55cc8e200b40 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19350640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9d14027020 0x7f9d1403f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9d14027020 0x7f9d1403f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9d14027020 0x7f9d1403f9b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9d0c009040 0x7f9d0c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.540+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9d0c009040 0x7f9d0c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9d0c009040 0x7f9d0c0b33f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d14024070 con 0x55cc8e200b40 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.544+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.563 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.548+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d0c009040 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d04024070 con 0x7f9d0c009040 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.564 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e200b40 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d1405b040 con 0x55cc8e200b40 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19350640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x55cc8e1f2a30 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f7020 con 0x7f9d14027020 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d18b4f640 1 -- 172.21.15.129:0/987432779 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0c0b0020 con 0x7f9d14027020 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1fe110 con 0x55cc8e1f2a30 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f9c10 con 0x55cc8e1f2a30 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.565 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.552+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [create,call version.set in=58b,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1f9fd0 con 0x55cc8e1f2a30 2024-02-18T16:22:36.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.556+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [create,call,writefull 0~1036] v32'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.556+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1fbed0 con 0x55cc8e1f2a30 2024-02-18T16:22:36.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.556+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'4 uv4 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.556+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cc8e1fe990 con 0x55cc8e1f2a30 2024-02-18T16:22:36.568 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.556+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f9d04024070 con 0x55cc8e1f2a30 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9bf0034260 msgr2=0x7f9bf0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9bf0034260 0x7f9bf0036720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d04006ad0 tx=0x7f9d04006a00 comp rx=0 tx=0).stop 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 msgr2=0x55cc8e1d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1d1e40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55cc8e040700 tx=0x7f9d04003000 comp rx=0 tx=0).stop 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 shutdown_connections 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9bf0034260 0x7f9bf0036720 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/1670949404 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0410e0 0x55cc8e1d1e40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 >> 172.21.15.129:0/1670949404 conn(0x55cc8e0d0560 msgr2=0x55cc8e1c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 shutdown_connections 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/1670949404 wait complete. 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9b5c0342b0 msgr2=0x7f9b5c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9b5c0342b0 0x7f9b5c036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0ae000 tx=0x7f9d0c0a6000 comp rx=0 tx=0).stop 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 msgr2=0x55cc8e1c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.569 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 0x55cc8e1c9b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9d140477a0 tx=0x7f9d1400fe40 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 shutdown_connections 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9b5c0342b0 0x7f9b5c036770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/579408488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e1cb6a0 0x55cc8e1c9b40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 >> 172.21.15.129:0/579408488 conn(0x55cc8e1e0950 msgr2=0x55cc8e1e1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 shutdown_connections 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/579408488 wait complete. 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9d0c009040 msgr2=0x7f9d0c0b33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7f9d0c009040 0x7f9d0c0b33f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cc8e1f2a30 msgr2=0x55cc8e1f4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cc8e1f2a30 0x55cc8e1f4e20 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9d14027020 msgr2=0x7f9d1403f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f9d14027020 0x7f9d1403f9b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cc8e200b40 msgr2=0x55cc8e1fc3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cc8e200b40 0x55cc8e1fc3a0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9c00034300 msgr2=0x7f9c000367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.570 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f9c00034300 0x7f9c000367c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d140104d0 tx=0x7f9d14010360 comp rx=0 tx=0).stop 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 msgr2=0x55cc8e1bcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 --2- 172.21.15.129:0/987432779 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cc8e0cc000 0x55cc8e1bcde0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9d140012f0 tx=0x7f9d14001260 comp rx=0 tx=0).stop 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d19b51640 1 -- 172.21.15.129:0/987432779 reap_dead start 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 shutdown_connections 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 >> 172.21.15.129:0/987432779 conn(0x55cc8e0c78d0 msgr2=0x55cc8e1b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 shutdown_connections 2024-02-18T16:22:36.571 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.560+0000 7f9d1b835980 1 -- 172.21.15.129:0/987432779 wait complete. 2024-02-18T16:22:36.576 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-18T16:22:36.577 DEBUG:tasks.util.rgw: json result: {'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-18T16:22:36.577 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-02-18T16:22:36.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-02-18T16:22:36.577 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-02-18T16:22:36.643 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:36.643 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:36.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729e01a980 1 Processor -- start 2024-02-18T16:22:36.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729e01a980 1 -- start start 2024-02-18T16:22:36.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729e01a980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5591e769a9d0 0x5591e7698f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729e01a980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5591e76704b0 con 0x5591e76994c0 2024-02-18T16:22:36.644 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729e01a980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x5591e7637180 con 0x5591e769a9d0 2024-02-18T16:22:36.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729bb35640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5591e769a9d0 0x5591e7698f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729bb35640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x5591e769a9d0 0x5591e7698f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56434/0 (socket says 172.21.15.129:56434) 2024-02-18T16:22:36.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729bb35640 1 -- 172.21.15.129:0/3207118342 learned_addr learned my addr 172.21.15.129:0/3207118342 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729b334640 1 --1- 172.21.15.129:0/3207118342 >> v1:172.21.15.80:6789/0 conn(0x5591e76994c0 0x5591e7730910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40508/0 (socket says 172.21.15.129:40508) 2024-02-18T16:22:36.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729bb35640 1 -- 172.21.15.129:0/3207118342 >> v1:172.21.15.80:6789/0 conn(0x5591e76994c0 legacy=0x5591e7730910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.636+0000 7f729bb35640 1 -- 172.21.15.129:0/3207118342 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e7727d10 con 0x5591e769a9d0 2024-02-18T16:22:36.647 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729bb35640 1 --2- 172.21.15.129:0/3207118342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e769a9d0 0x5591e7698f80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f729400a4e0 tx=0x7f729401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd0e2c7e27042d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729ab33640 1 -- 172.21.15.129:0/3207118342 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940a3e30 con 0x5591e769a9d0 2024-02-18T16:22:36.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729ab33640 1 -- 172.21.15.129:0/3207118342 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940ab410 con 0x5591e769a9d0 2024-02-18T16:22:36.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729ab33640 1 -- 172.21.15.129:0/3207118342 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940ab730 con 0x5591e769a9d0 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 -- 172.21.15.129:0/3207118342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e769a9d0 msgr2=0x5591e7698f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 --2- 172.21.15.129:0/3207118342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e769a9d0 0x5591e7698f80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f729400a4e0 tx=0x7f729401b090 comp rx=0 tx=0).stop 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 -- 172.21.15.129:0/3207118342 shutdown_connections 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 --2- 172.21.15.129:0/3207118342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e769a9d0 0x5591e7698f80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 -- 172.21.15.129:0/3207118342 >> 172.21.15.129:0/3207118342 conn(0x5591e771f9f0 msgr2=0x5591e7721e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 -- 172.21.15.129:0/3207118342 shutdown_connections 2024-02-18T16:22:36.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.640+0000 7f729e01a980 1 -- 172.21.15.129:0/3207118342 wait complete. 2024-02-18T16:22:36.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729e01a980 1 Processor -- start 2024-02-18T16:22:36.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729e01a980 1 -- start start 2024-02-18T16:22:36.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729e01a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e7814f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.661 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729e01a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e76346b0 con 0x5591e76994c0 2024-02-18T16:22:36.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729bb35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e7814f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729bb35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e7814f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56438/0 (socket says 172.21.15.129:56438) 2024-02-18T16:22:36.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.652+0000 7f729bb35640 1 -- 172.21.15.129:0/3844921157 learned_addr learned my addr 172.21.15.129:0/3844921157 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 -- 172.21.15.129:0/3844921157 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729400a1c0 con 0x5591e76994c0 2024-02-18T16:22:36.662 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 --2- 172.21.15.129:0/3844921157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e7814f30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7294018cc0 tx=0x7f72940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6be59b19aee7a09 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f7189e0b640 1 -- 172.21.15.129:0/3844921157 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940ab6b0 con 0x5591e76994c0 2024-02-18T16:22:36.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f7189e0b640 1 -- 172.21.15.129:0/3844921157 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940ab810 con 0x5591e76994c0 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f7189e0b640 1 -- 172.21.15.129:0/3844921157 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940abad0 con 0x5591e76994c0 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/3844921157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 msgr2=0x5591e7814f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 --2- 172.21.15.129:0/3844921157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e7814f30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7294018cc0 tx=0x7f72940033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/3844921157 shutdown_connections 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 --2- 172.21.15.129:0/3844921157 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e7814f30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/3844921157 >> 172.21.15.129:0/3844921157 conn(0x5591e771f9f0 msgr2=0x5591e7810ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/3844921157 shutdown_connections 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/3844921157 wait complete. 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 Processor -- start 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- start start 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e781bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e762fe90 con 0x5591e76994c0 2024-02-18T16:22:36.665 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e781bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e781bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56448/0 (socket says 172.21.15.129:56448) 2024-02-18T16:22:36.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 -- 172.21.15.129:0/725476652 learned_addr learned my addr 172.21.15.129:0/725476652 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.666 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 -- 172.21.15.129:0/725476652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940af040 con 0x5591e76994c0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729bb35640 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e781bbc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7294003430 tx=0x7f7294017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f7183fff640 1 -- 172.21.15.129:0/725476652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940b4800 con 0x5591e76994c0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5591e781c100 con 0x5591e76994c0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591e781c5b0 con 0x5591e76994c0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f7183fff640 1 -- 172.21.15.129:0/725476652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940b4960 con 0x5591e76994c0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.656+0000 7f7183fff640 1 -- 172.21.15.129:0/725476652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940b4c20 con 0x5591e76994c0 2024-02-18T16:22:36.670 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 Processor -- start 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- start start 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e7829020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e75c8f20 con 0x5591e7828c00 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f7183fff640 1 -- 172.21.15.129:0/725476652 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x5591e7699ce0 con 0x5591e76994c0 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e7829020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e7829020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56460/0 (socket says 172.21.15.129:56460) 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 -- 172.21.15.129:0/3487145531 learned_addr learned my addr 172.21.15.129:0/3487145531 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f7183fff640 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7184034300 0x7f71840367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f7183fff640 1 -- 172.21.15.129:0/725476652 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f72940e3340 con 0x5591e76994c0 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729bb35640 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7184034300 0x7f71840367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 -- 172.21.15.129:0/3487145531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e7829560 con 0x5591e7828c00 2024-02-18T16:22:36.671 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729bb35640 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7184034300 0x7f71840367c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f72940a9ff0 tx=0x7f72940aaed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 --2- 172.21.15.129:0/3487145531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e7829020 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f728c00a440 tx=0x7f728c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9670e06bbf7a8914 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f7181ffb640 1 -- 172.21.15.129:0/3487145531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f728c008850 con 0x5591e7828c00 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f7181ffb640 1 -- 172.21.15.129:0/3487145531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c0089d0 con 0x5591e7828c00 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f7181ffb640 1 -- 172.21.15.129:0/3487145531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f728c008cb0 con 0x5591e7828c00 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- 172.21.15.129:0/3487145531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 msgr2=0x5591e7829020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 --2- 172.21.15.129:0/3487145531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e7829020 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f728c00a440 tx=0x7f728c00a900 comp rx=0 tx=0).stop 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- 172.21.15.129:0/3487145531 shutdown_connections 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 --2- 172.21.15.129:0/3487145531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e7829020 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- 172.21.15.129:0/3487145531 >> 172.21.15.129:0/3487145531 conn(0x5591e769a9d0 msgr2=0x5591e7824070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- 172.21.15.129:0/3487145531 shutdown_connections 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- 172.21.15.129:0/3487145531 wait complete. 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 Processor -- start 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- start start 2024-02-18T16:22:36.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e782fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729e01a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e75bc790 con 0x5591e7828c00 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e782fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e782fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56466/0 (socket says 172.21.15.129:56466) 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 -- 172.21.15.129:0/2583397007 learned_addr learned my addr 172.21.15.129:0/2583397007 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.660+0000 7f729c336640 1 -- 172.21.15.129:0/2583397007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c005cd0 con 0x5591e7828c00 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729c336640 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e782fbb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5591e78299e0 tx=0x7f728c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f717bfff640 1 -- 172.21.15.129:0/2583397007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f728c013aa0 con 0x5591e7828c00 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5591e78300f0 con 0x5591e7828c00 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591e7830520 con 0x5591e7828c00 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f717bfff640 1 -- 172.21.15.129:0/2583397007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c013c00 con 0x5591e7828c00 2024-02-18T16:22:36.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f717bfff640 1 -- 172.21.15.129:0/2583397007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f728c013ea0 con 0x5591e7828c00 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f717bfff640 1 -- 172.21.15.129:0/2583397007 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f728c01e420 con 0x5591e7828c00 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 Processor -- start 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f717bfff640 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7174034300 0x7f71740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f717bfff640 1 -- 172.21.15.129:0/2583397007 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f728c049c80 con 0x5591e7828c00 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 -- start start 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729c336640 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7174034300 0x7f71740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 0x5591e7849d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e784a290 con 0x5591e7849930 2024-02-18T16:22:36.677 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729c336640 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7174034300 0x7f71740367c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f728c012fd0 tx=0x7f728c027a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729bb35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 0x5591e7849d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729bb35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 0x5591e7849d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56480/0 (socket says 172.21.15.129:56480) 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729bb35640 1 -- 172.21.15.129:0/1165401276 learned_addr learned my addr 172.21.15.129:0/1165401276 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729bb35640 1 -- 172.21.15.129:0/1165401276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e784a3d0 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729bb35640 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 0x5591e7849d50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f72940e1600 tx=0x7f72940c6940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f70fbfff640 1 -- 172.21.15.129:0/1165401276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940aa810 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5591e784acd0 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f70fbfff640 1 -- 172.21.15.129:0/1165401276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940e30b0 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f70fbfff640 1 -- 172.21.15.129:0/1165401276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72940e13f0 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.664+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591e784b160 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f70fbfff640 1 -- 172.21.15.129:0/1165401276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72940c6a70 con 0x5591e7849930 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f70fbfff640 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f70d4034260 0x7f70d4036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.678 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f70fbfff640 1 -- 172.21.15.129:0/1165401276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f72940b6410 con 0x5591e7849930 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729b334640 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f70d4034260 0x7f70d4036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f70f9ffb640 20 reqs_thread_entry: start 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729b334640 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f70d4034260 0x7f70d4036720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f70 tx=0x7f7290001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5591e784e8b0 0x5591e7850ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591e78511e0 con 0x5591e784e8b0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729c336640 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5591e784e8b0 0x5591e7850ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729c336640 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5591e784e8b0 0x5591e7850ca0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729c336640 1 -- 172.21.15.129:0/725476652 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f728c024020 con 0x5591e784e8b0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591e7851540 con 0x5591e784e8b0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729c336640 1 -- 172.21.15.129:0/725476652 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f728c024020 con 0x5591e784e8b0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591e78528b0 con 0x5591e784e8b0 2024-02-18T16:22:36.679 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729c336640 1 -- 172.21.15.129:0/725476652 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7f728c024020 con 0x5591e784e8b0 2024-02-18T16:22:36.681 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7174034300 msgr2=0x7f71740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7174034300 0x7f71740367c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f728c012fd0 tx=0x7f728c027a30 comp rx=0 tx=0).stop 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 msgr2=0x5591e782fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e782fbb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5591e78299e0 tx=0x7f728c003000 comp rx=0 tx=0).stop 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 shutdown_connections 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7174034300 0x7f71740367c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 --2- 172.21.15.129:0/2583397007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7828c00 0x5591e782fbb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 >> 172.21.15.129:0/2583397007 conn(0x5591e769a9d0 msgr2=0x5591e7822e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 shutdown_connections 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.668+0000 7f729e01a980 1 -- 172.21.15.129:0/2583397007 wait complete. 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f70d4034260 msgr2=0x7f70d4036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f70d4034260 0x7f70d4036720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7290000f70 tx=0x7f7290001300 comp rx=0 tx=0).stop 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 msgr2=0x5591e7849d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.682 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 0x5591e7849d50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f72940e1600 tx=0x7f72940c6940 comp rx=0 tx=0).stop 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 shutdown_connections 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f70d4034260 0x7f70d4036720 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/1165401276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e7849930 0x5591e7849d50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 >> 172.21.15.129:0/1165401276 conn(0x5591e783e650 msgr2=0x5591e783f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 shutdown_connections 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/1165401276 wait complete. 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5591e784e8b0 msgr2=0x5591e7850ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5591e784e8b0 0x5591e7850ca0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7184034300 msgr2=0x7f71840367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7184034300 0x7f71840367c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f72940a9ff0 tx=0x7f72940aaed0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 msgr2=0x5591e781bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e781bbc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7294003430 tx=0x7f7294017e30 comp rx=0 tx=0).stop 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 shutdown_connections 2024-02-18T16:22:36.683 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x5591e784e8b0 0x5591e7850ca0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f7184034300 0x7f71840367c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 --2- 172.21.15.129:0/725476652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x5591e76994c0 0x5591e781bbc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 >> 172.21.15.129:0/725476652 conn(0x5591e771f9f0 msgr2=0x5591e780f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 shutdown_connections 2024-02-18T16:22:36.684 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.672+0000 7f729e01a980 1 -- 172.21.15.129:0/725476652 wait complete. 2024-02-18T16:22:36.687 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-18T16:22:36.687 DEBUG:tasks.util.rgw: json result: {'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-18T16:22:36.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-18T16:22:36.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-18T16:22:36.688 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-18T16:22:36.766 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:36.766 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd45f5980 1 Processor -- start 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd45f5980 1 -- start start 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd45f5980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55a7d71b29b0 0x55a7d7243250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd45f5980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a7d718a460 con 0x55a7d7243790 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd45f5980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a7d7151180 con 0x55a7d71b29b0 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd190f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55a7d7243790 0x55a7d7245b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:40512/0 (socket says 172.21.15.129:40512) 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd190f640 1 -- 172.21.15.129:0/185633732 learned_addr learned my addr 172.21.15.129:0/185633732 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:36.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd2110640 1 --2- 172.21.15.129:0/185633732 >> v2:172.21.15.80:3300/0 conn(0x55a7d71b29b0 0x55a7d7243250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd110e640 1 -- 172.21.15.129:0/185633732 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229784740 0 0) 0x55a7d718a460 con 0x55a7d7243790 2024-02-18T16:22:36.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd110e640 1 -- 172.21.15.129:0/185633732 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc0001e20 con 0x55a7d7243790 2024-02-18T16:22:36.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd2110640 1 -- 172.21.15.129:0/185633732 >> v1:172.21.15.80:6789/0 conn(0x55a7d7243790 legacy=0x55a7d7245b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.760+0000 7facd2110640 1 -- 172.21.15.129:0/185633732 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7d723ec70 con 0x55a7d71b29b0 2024-02-18T16:22:36.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd2110640 1 --2- 172.21.15.129:0/185633732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7243250 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7facc400a420 tx=0x7facc401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22efb8e444e8c50a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd110e640 1 -- 172.21.15.129:0/185633732 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40aa530 con 0x55a7d71b29b0 2024-02-18T16:22:36.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd110e640 1 -- 172.21.15.129:0/185633732 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc40a6050 con 0x55a7d71b29b0 2024-02-18T16:22:36.770 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd110e640 1 -- 172.21.15.129:0/185633732 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40aa800 con 0x55a7d71b29b0 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 -- 172.21.15.129:0/185633732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 msgr2=0x55a7d7243250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 --2- 172.21.15.129:0/185633732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7243250 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7facc400a420 tx=0x7facc401afd0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 -- 172.21.15.129:0/185633732 shutdown_connections 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 --2- 172.21.15.129:0/185633732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7243250 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 -- 172.21.15.129:0/185633732 >> 172.21.15.129:0/185633732 conn(0x55a7d7238930 msgr2=0x55a7d723ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 -- 172.21.15.129:0/185633732 shutdown_connections 2024-02-18T16:22:36.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.764+0000 7facd45f5980 1 -- 172.21.15.129:0/185633732 wait complete. 2024-02-18T16:22:36.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd45f5980 1 Processor -- start 2024-02-18T16:22:36.784 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd45f5980 1 -- start start 2024-02-18T16:22:36.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd45f5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d732a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd45f5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d714e6b0 con 0x55a7d71b29b0 2024-02-18T16:22:36.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd2110640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d732a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd2110640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d732a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56498/0 (socket says 172.21.15.129:56498) 2024-02-18T16:22:36.785 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd2110640 1 -- 172.21.15.129:0/643497641 learned_addr learned my addr 172.21.15.129:0/643497641 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd2110640 1 -- 172.21.15.129:0/643497641 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc400a100 con 0x55a7d71b29b0 2024-02-18T16:22:36.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7facd2110640 1 --2- 172.21.15.129:0/643497641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d732a1f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7facc4018c00 tx=0x7facc40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bfc448fee27f4d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7fabc0608640 1 -- 172.21.15.129:0/643497641 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40aa6c0 con 0x55a7d71b29b0 2024-02-18T16:22:36.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.776+0000 7fabc0608640 1 -- 172.21.15.129:0/643497641 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc40aa820 con 0x55a7d71b29b0 2024-02-18T16:22:36.786 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7fabc0608640 1 -- 172.21.15.129:0/643497641 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40aaac0 con 0x55a7d71b29b0 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/643497641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 msgr2=0x55a7d732a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 --2- 172.21.15.129:0/643497641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d732a1f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7facc4018c00 tx=0x7facc40033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/643497641 shutdown_connections 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 --2- 172.21.15.129:0/643497641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d732a1f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/643497641 >> 172.21.15.129:0/643497641 conn(0x55a7d7238930 msgr2=0x55a7d7325d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/643497641 shutdown_connections 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/643497641 wait complete. 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 Processor -- start 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- start start 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7330fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d7149e90 con 0x55a7d71b29b0 2024-02-18T16:22:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd2110640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7330fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd2110640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7330fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56510/0 (socket says 172.21.15.129:56510) 2024-02-18T16:22:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd2110640 1 -- 172.21.15.129:0/3969276017 learned_addr learned my addr 172.21.15.129:0/3969276017 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd2110640 1 -- 172.21.15.129:0/3969276017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7d723ec70 con 0x55a7d71b29b0 2024-02-18T16:22:36.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd2110640 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7330fa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7facc4000f90 tx=0x7facc4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7fabbee05640 1 -- 172.21.15.129:0/3969276017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40b4b10 con 0x55a7d71b29b0 2024-02-18T16:22:36.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7d73314e0 con 0x55a7d71b29b0 2024-02-18T16:22:36.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7fabbee05640 1 -- 172.21.15.129:0/3969276017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc40b4c70 con 0x55a7d71b29b0 2024-02-18T16:22:36.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7d7331910 con 0x55a7d71b29b0 2024-02-18T16:22:36.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7fabbee05640 1 -- 172.21.15.129:0/3969276017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40be450 con 0x55a7d71b29b0 2024-02-18T16:22:36.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 Processor -- start 2024-02-18T16:22:36.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- start start 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d733e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.780+0000 7facd45f5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d70e2f20 con 0x55a7d733dec0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d733e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabbee05640 1 -- 172.21.15.129:0/3969276017 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7facc40c4070 con 0x55a7d71b29b0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d733e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56512/0 (socket says 172.21.15.129:56512) 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 -- 172.21.15.129:0/943791625 learned_addr learned my addr 172.21.15.129:0/943791625 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabbee05640 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabb80342b0 0x7fabb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabbee05640 1 -- 172.21.15.129:0/3969276017 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7facc40e43c0 con 0x55a7d71b29b0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2110640 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabb80342b0 0x7fabb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 -- 172.21.15.129:0/943791625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7d733e820 con 0x55a7d733dec0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 --2- 172.21.15.129:0/943791625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d733e2e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faccc00a440 tx=0x7faccc00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e772294e560be5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2110640 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabb80342b0 0x7fabb8036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7facc40b4fd0 tx=0x7facc40bcef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabbce01640 1 -- 172.21.15.129:0/943791625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faccc008850 con 0x55a7d733dec0 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabbce01640 1 -- 172.21.15.129:0/943791625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0089d0 con 0x55a7d733dec0 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabbce01640 1 -- 172.21.15.129:0/943791625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faccc008cb0 con 0x55a7d733dec0 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/943791625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 msgr2=0x55a7d733e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 --2- 172.21.15.129:0/943791625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d733e2e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faccc00a440 tx=0x7faccc00a900 comp rx=0 tx=0).stop 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/943791625 shutdown_connections 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 --2- 172.21.15.129:0/943791625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d733e2e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/943791625 >> 172.21.15.129:0/943791625 conn(0x55a7d7243790 msgr2=0x55a7d7339330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/943791625 shutdown_connections 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/943791625 wait complete. 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 Processor -- start 2024-02-18T16:22:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- start start 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d7344e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d70d6790 con 0x55a7d733dec0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d7344e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d7344e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56526/0 (socket says 172.21.15.129:56526) 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 -- 172.21.15.129:0/894039555 learned_addr learned my addr 172.21.15.129:0/894039555 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 -- 172.21.15.129:0/894039555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc005cd0 con 0x55a7d733dec0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd2911640 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d7344e10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55a7d733eca0 tx=0x7faccc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabb6ffd640 1 -- 172.21.15.129:0/894039555 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faccc013aa0 con 0x55a7d733dec0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7d7345350 con 0x55a7d733dec0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7d7345780 con 0x55a7d733dec0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabb6ffd640 1 -- 172.21.15.129:0/894039555 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc013c00 con 0x55a7d733dec0 2024-02-18T16:22:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.784+0000 7fabb6ffd640 1 -- 172.21.15.129:0/894039555 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faccc013ea0 con 0x55a7d733dec0 2024-02-18T16:22:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7fabb6ffd640 1 -- 172.21.15.129:0/894039555 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faccc01e420 con 0x55a7d733dec0 2024-02-18T16:22:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7fabb6ffd640 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabac0342b0 0x7fabac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 1 Processor -- start 2024-02-18T16:22:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7fabb6ffd640 1 -- 172.21.15.129:0/894039555 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7faccc049a90 con 0x55a7d733dec0 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2911640 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabac0342b0 0x7fabac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 1 -- start start 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 0x55a7d723f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d723fb60 con 0x55a7d723f200 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2911640 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabac0342b0 0x7fabac036770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faccc027b20 tx=0x7faccc027a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2110640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 0x55a7d723f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2110640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 0x55a7d723f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56540/0 (socket says 172.21.15.129:56540) 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2110640 1 -- 172.21.15.129:0/1694408950 learned_addr learned my addr 172.21.15.129:0/1694408950 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2110640 1 -- 172.21.15.129:0/1694408950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7d723fca0 con 0x55a7d723f200 2024-02-18T16:22:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd2110640 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 0x55a7d723f620 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7facc40033d0 tx=0x7facc40e25e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7fab96fe5640 1 -- 172.21.15.129:0/1694408950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40a8cd0 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7d7240640 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7fab96fe5640 1 -- 172.21.15.129:0/1694408950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc40de070 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7fab96fe5640 1 -- 172.21.15.129:0/1694408950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facc40e23d0 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.788+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7d7240ad0 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7fab96fe5640 1 -- 172.21.15.129:0/1694408950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7facc40e0030 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7fab96fe5640 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fab140342b0 0x7fab14036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7fab96fe5640 1 -- 172.21.15.129:0/1694408950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7facc40070a0 con 0x55a7d723f200 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd190f640 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fab140342b0 0x7fab14036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7fab94fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a7d7242230 0x55a7d72426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a7d7242bf0 con 0x55a7d7242230 2024-02-18T16:22:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd190f640 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fab140342b0 0x7fab14036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7facbc000f70 tx=0x7facbc0010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd2911640 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a7d7242230 0x55a7d72426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd2911640 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a7d7242230 0x55a7d72426b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd2911640 1 -- 172.21.15.129:0/3969276017 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faccc024020 con 0x55a7d7242230 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a7d736bf20 con 0x55a7d7242230 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd2911640 1 -- 172.21.15.129:0/3969276017 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7faccc024020 con 0x55a7d7242230 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a7d7370760 con 0x55a7d7242230 2024-02-18T16:22:36.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.792+0000 7facd2911640 1 -- 172.21.15.129:0/3969276017 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [stat,call,call,writefull 0~874] v32'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7faccc024020 con 0x55a7d7242230 2024-02-18T16:22:36.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabac0342b0 msgr2=0x7fabac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabac0342b0 0x7fabac036770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faccc027b20 tx=0x7faccc027a30 comp rx=0 tx=0).stop 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 msgr2=0x55a7d7344e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d7344e10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55a7d733eca0 tx=0x7faccc003000 comp rx=0 tx=0).stop 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 shutdown_connections 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabac0342b0 0x7fabac036770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/894039555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d733dec0 0x55a7d7344e10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 >> 172.21.15.129:0/894039555 conn(0x55a7d7243790 msgr2=0x55a7d7338130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 shutdown_connections 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/894039555 wait complete. 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fab140342b0 msgr2=0x7fab14036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fab140342b0 0x7fab14036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7facbc000f70 tx=0x7facbc0010b0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 msgr2=0x55a7d723f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 0x55a7d723f620 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7facc40033d0 tx=0x7facc40e25e0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 shutdown_connections 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fab140342b0 0x7fab14036770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/1694408950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d723f200 0x55a7d723f620 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 >> 172.21.15.129:0/1694408950 conn(0x55a7d73538b0 msgr2=0x55a7d73542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 shutdown_connections 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/1694408950 wait complete. 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a7d7242230 msgr2=0x55a7d72426b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a7d7242230 0x55a7d72426b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabb80342b0 msgr2=0x7fabb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabb80342b0 0x7fabb8036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7facc40b4fd0 tx=0x7facc40bcef0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 msgr2=0x55a7d7330fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7330fa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7facc4000f90 tx=0x7facc4017d70 comp rx=0 tx=0).stop 2024-02-18T16:22:36.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 shutdown_connections 2024-02-18T16:22:36.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55a7d7242230 0x55a7d72426b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fabb80342b0 0x7fabb8036770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 --2- 172.21.15.129:0/3969276017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55a7d71b29b0 0x55a7d7330fa0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 >> 172.21.15.129:0/3969276017 conn(0x55a7d7238930 msgr2=0x55a7d7324890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 shutdown_connections 2024-02-18T16:22:36.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.796+0000 7facd45f5980 1 -- 172.21.15.129:0/3969276017 wait complete. 2024-02-18T16:22:36.812 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-18T16:22:36.812 DEBUG:tasks.util.rgw: json result: {'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-18T16:22:36.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-02-18T16:22:36.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-02-18T16:22:36.812 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-02-18T16:22:36.881 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:36.881 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:36.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a6290980 1 Processor -- start 2024-02-18T16:22:36.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a6290980 1 -- start start 2024-02-18T16:22:36.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a6290980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e86cfca120 0x55e86cfca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a6290980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e86cf164b0 con 0x55e86cfcaa40 2024-02-18T16:22:36.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a6290980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e86cedd180 con 0x55e86cfca120 2024-02-18T16:22:36.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a3dab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e86cfca120 0x55e86cfca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a3dab640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55e86cfca120 0x55e86cfca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56544/0 (socket says 172.21.15.129:56544) 2024-02-18T16:22:36.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a3dab640 1 -- 172.21.15.129:0/2471084307 learned_addr learned my addr 172.21.15.129:0/2471084307 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a3dab640 1 -- 172.21.15.129:0/2471084307 >> v1:172.21.15.80:6789/0 conn(0x55e86cfcaa40 legacy=0x55e86cfcb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a3dab640 1 -- 172.21.15.129:0/2471084307 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e86cfcbc30 con 0x55e86cfca120 2024-02-18T16:22:36.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a3dab640 1 --2- 172.21.15.129:0/2471084307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cfca500 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f409400a4e0 tx=0x7f409401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1156e9c3fcbf3218 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a2da9640 1 -- 172.21.15.129:0/2471084307 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940aa540 con 0x55e86cfca120 2024-02-18T16:22:36.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a2da9640 1 -- 172.21.15.129:0/2471084307 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940a6070 con 0x55e86cfca120 2024-02-18T16:22:36.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.876+0000 7f40a2da9640 1 -- 172.21.15.129:0/2471084307 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940aa850 con 0x55e86cfca120 2024-02-18T16:22:36.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 -- 172.21.15.129:0/2471084307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 msgr2=0x55e86cfca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 --2- 172.21.15.129:0/2471084307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cfca500 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f409400a4e0 tx=0x7f409401b090 comp rx=0 tx=0).stop 2024-02-18T16:22:36.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 -- 172.21.15.129:0/2471084307 shutdown_connections 2024-02-18T16:22:36.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 --2- 172.21.15.129:0/2471084307 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cfca500 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 -- 172.21.15.129:0/2471084307 >> 172.21.15.129:0/2471084307 conn(0x55e86cfc59f0 msgr2=0x55e86cfc7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 -- 172.21.15.129:0/2471084307 shutdown_connections 2024-02-18T16:22:36.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.880+0000 7f40a6290980 1 -- 172.21.15.129:0/2471084307 wait complete. 2024-02-18T16:22:36.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 Processor -- start 2024-02-18T16:22:36.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- start start 2024-02-18T16:22:36.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cf40780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e86ceda6b0 con 0x55e86cfca120 2024-02-18T16:22:36.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a3dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cf40780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a3dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cf40780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56558/0 (socket says 172.21.15.129:56558) 2024-02-18T16:22:36.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a3dab640 1 -- 172.21.15.129:0/2970723425 learned_addr learned my addr 172.21.15.129:0/2970723425 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a3dab640 1 -- 172.21.15.129:0/2970723425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409400a1c0 con 0x55e86cfca120 2024-02-18T16:22:36.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a3dab640 1 --2- 172.21.15.129:0/2970723425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cf40780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4094017ca0 tx=0x7f40940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dffc55eadef1b4c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f3f91e0b640 1 -- 172.21.15.129:0/2970723425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940aa780 con 0x55e86cfca120 2024-02-18T16:22:36.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f3f91e0b640 1 -- 172.21.15.129:0/2970723425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940aa8e0 con 0x55e86cfca120 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f3f91e0b640 1 -- 172.21.15.129:0/2970723425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940aab80 con 0x55e86cfca120 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- 172.21.15.129:0/2970723425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 msgr2=0x55e86cf40780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 --2- 172.21.15.129:0/2970723425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cf40780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4094017ca0 tx=0x7f40940033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- 172.21.15.129:0/2970723425 shutdown_connections 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 --2- 172.21.15.129:0/2970723425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86cf40780 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- 172.21.15.129:0/2970723425 >> 172.21.15.129:0/2970723425 conn(0x55e86cfc59f0 msgr2=0x55e86d0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- 172.21.15.129:0/2970723425 shutdown_connections 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.892+0000 7f40a6290980 1 -- 172.21.15.129:0/2970723425 wait complete. 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 Processor -- start 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 -- start start 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86d0bd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e86ced5e90 con 0x55e86cfca120 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a3dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86d0bd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a3dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86d0bd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56568/0 (socket says 172.21.15.129:56568) 2024-02-18T16:22:36.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a3dab640 1 -- 172.21.15.129:0/2455442276 learned_addr learned my addr 172.21.15.129:0/2455442276 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a3dab640 1 -- 172.21.15.129:0/2455442276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e86cfcbc30 con 0x55e86cfca120 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a3dab640 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86d0bd530 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f409401aec0 tx=0x7f4094017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f3f8bfff640 1 -- 172.21.15.129:0/2455442276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940c4070 con 0x55e86cfca120 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e86d0bda70 con 0x55e86cfca120 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f3f8bfff640 1 -- 172.21.15.129:0/2455442276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940b5650 con 0x55e86cfca120 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e86d0bdec0 con 0x55e86cfca120 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f3f8bfff640 1 -- 172.21.15.129:0/2455442276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940b58f0 con 0x55e86cfca120 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 Processor -- start 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 -- start start 2024-02-18T16:22:36.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a6290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e86ce6ef20 con 0x55e86d0ca510 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a45ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a45ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56584/0 (socket says 172.21.15.129:56584) 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f3f8bfff640 1 -- 172.21.15.129:0/2455442276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f40940a8070 con 0x55e86cfca120 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a45ac640 1 -- 172.21.15.129:0/1619644787 learned_addr learned my addr 172.21.15.129:0/1619644787 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f3f8bfff640 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f8c0342b0 0x7f3f8c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f3f8bfff640 1 -- 172.21.15.129:0/2455442276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f40940e3810 con 0x55e86cfca120 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a3dab640 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f8c0342b0 0x7f3f8c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a45ac640 1 -- 172.21.15.129:0/1619644787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e86d0cae70 con 0x55e86d0ca510 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.896+0000 7f40a45ac640 1 --2- 172.21.15.129:0/1619644787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0ca930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f409c00a440 tx=0x7f409c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac7b4b9cf38cc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a3dab640 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f8c0342b0 0x7f3f8c036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f40940a9040 tx=0x7f40940b4f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f89ffb640 1 -- 172.21.15.129:0/1619644787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409c008850 con 0x55e86d0ca510 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f89ffb640 1 -- 172.21.15.129:0/1619644787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c0089d0 con 0x55e86d0ca510 2024-02-18T16:22:36.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f89ffb640 1 -- 172.21.15.129:0/1619644787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409c008cb0 con 0x55e86d0ca510 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1619644787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 msgr2=0x55e86d0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 --2- 172.21.15.129:0/1619644787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0ca930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f409c00a440 tx=0x7f409c00a900 comp rx=0 tx=0).stop 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1619644787 shutdown_connections 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 --2- 172.21.15.129:0/1619644787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0ca930 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1619644787 >> 172.21.15.129:0/1619644787 conn(0x55e86cfcaa40 msgr2=0x55e86d0c5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1619644787 shutdown_connections 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1619644787 wait complete. 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 Processor -- start 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- start start 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e86ce62790 con 0x55e86d0ca510 2024-02-18T16:22:36.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a45ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a45ac640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56600/0 (socket says 172.21.15.129:56600) 2024-02-18T16:22:36.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a45ac640 1 -- 172.21.15.129:0/1168588568 learned_addr learned my addr 172.21.15.129:0/1168588568 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a45ac640 1 -- 172.21.15.129:0/1168588568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c005cd0 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a45ac640 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0d1520 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55e86d0cb2f0 tx=0x7f409c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f83fff640 1 -- 172.21.15.129:0/1168588568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409c013aa0 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e86d0d1a60 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f83fff640 1 -- 172.21.15.129:0/1168588568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c013c00 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f83fff640 1 -- 172.21.15.129:0/1168588568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409c013ea0 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e86d0d1e90 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f3f83fff640 1 -- 172.21.15.129:0/1168588568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f409c01e420 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.900+0000 7f40a6290980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f83fff640 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f7c0342b0 0x7f3f7c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f83fff640 1 -- 172.21.15.129:0/1168588568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f409c0499d0 con 0x55e86d0ca510 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a6290980 1 Processor -- start 2024-02-18T16:22:36.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a45ac640 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f7c0342b0 0x7f3f7c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a6290980 1 -- start start 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a6290980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 0x55e86d0eb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a6290980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e86d0ebad0 con 0x55e86d0eb170 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a45ac640 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f7c0342b0 0x7f3f7c036770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f409c013730 tx=0x7f409c027a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a3dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 0x55e86d0eb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a3dab640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 0x55e86d0eb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56602/0 (socket says 172.21.15.129:56602) 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a3dab640 1 -- 172.21.15.129:0/536651265 learned_addr learned my addr 172.21.15.129:0/536651265 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:36.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a3dab640 1 -- 172.21.15.129:0/536651265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e86d0ebc10 con 0x55e86d0eb170 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a3dab640 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 0x55e86d0eb590 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f40940c7e30 tx=0x7f40940a9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f03fff640 1 -- 172.21.15.129:0/536651265 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940c7ea0 con 0x55e86d0eb170 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e86d0ec570 con 0x55e86d0eb170 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f03fff640 1 -- 172.21.15.129:0/536651265 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940d6070 con 0x55e86d0eb170 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f03fff640 1 -- 172.21.15.129:0/536651265 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40940b5e20 con 0x55e86d0eb170 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e86d0ec9a0 con 0x55e86d0eb170 2024-02-18T16:22:36.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f03fff640 1 -- 172.21.15.129:0/536651265 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f40940e3b20 con 0x55e86d0eb170 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f03fff640 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc034260 0x7f3edc036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f3f03fff640 1 -- 172.21.15.129:0/536651265 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f40940edd20 con 0x55e86d0eb170 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.904+0000 7f40a35aa640 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc034260 0x7f3edc036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f3f01ffb640 20 reqs_thread_entry: start 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e86d0c1350 0x55e86d0f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e86d0f2770 con 0x55e86d0c1350 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a35aa640 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc034260 0x7f3edc036720 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f408c000f70 tx=0x7f408c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a45ac640 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e86d0c1350 0x55e86d0f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a45ac640 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e86d0c1350 0x55e86d0f2160 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a45ac640 1 -- 172.21.15.129:0/2455442276 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f409c024020 con 0x55e86d0c1350 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e86d0f2c20 con 0x55e86d0c1350 2024-02-18T16:22:36.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a45ac640 1 -- 172.21.15.129:0/2455442276 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f409c024020 con 0x55e86d0c1350 2024-02-18T16:22:36.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e86d0f44b0 con 0x55e86d0c1350 2024-02-18T16:22:36.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a45ac640 1 -- 172.21.15.129:0/2455442276 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f409c024020 con 0x55e86d0c1350 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f7c0342b0 msgr2=0x7f3f7c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f7c0342b0 0x7f3f7c036770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f409c013730 tx=0x7f409c027a30 comp rx=0 tx=0).stop 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 msgr2=0x55e86d0d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0d1520 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55e86d0cb2f0 tx=0x7f409c003000 comp rx=0 tx=0).stop 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 shutdown_connections 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f7c0342b0 0x7f3f7c036770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/1168588568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0ca510 0x55e86d0d1520 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 >> 172.21.15.129:0/1168588568 conn(0x55e86cfcaa40 msgr2=0x55e86d0c4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 shutdown_connections 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/1168588568 wait complete. 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc034260 msgr2=0x7f3edc036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc034260 0x7f3edc036720 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f408c000f70 tx=0x7f408c0013a0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 msgr2=0x55e86d0eb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.919 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 0x55e86d0eb590 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f40940c7e30 tx=0x7f40940a9f20 comp rx=0 tx=0).stop 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 shutdown_connections 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3edc034260 0x7f3edc036720 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/536651265 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86d0eb170 0x55e86d0eb590 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 >> 172.21.15.129:0/536651265 conn(0x55e86d0dff40 msgr2=0x55e86d0e0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 shutdown_connections 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/536651265 wait complete. 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e86d0c1350 msgr2=0x55e86d0f2160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e86d0c1350 0x55e86d0f2160 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f8c0342b0 msgr2=0x7f3f8c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f8c0342b0 0x7f3f8c036770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f40940a9040 tx=0x7f40940b4f30 comp rx=0 tx=0).stop 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 msgr2=0x55e86d0bd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86d0bd530 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f409401aec0 tx=0x7f4094017e30 comp rx=0 tx=0).stop 2024-02-18T16:22:36.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 shutdown_connections 2024-02-18T16:22:36.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55e86d0c1350 0x55e86d0f2160 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3f8c0342b0 0x7f3f8c036770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 --2- 172.21.15.129:0/2455442276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e86cfca120 0x55e86d0bd530 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:36.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 >> 172.21.15.129:0/2455442276 conn(0x55e86cfc59f0 msgr2=0x55e86cf3f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:36.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 shutdown_connections 2024-02-18T16:22:36.921 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:36.908+0000 7f40a6290980 1 -- 172.21.15.129:0/2455442276 wait complete. 2024-02-18T16:22:36.926 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"5cf777d6-7609-4766-9b82-6394139fd65a","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","zones":[{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-02-18T16:22:36.926 DEBUG:tasks.util.rgw: json result: {'id': '5cf777d6-7609-4766-9b82-6394139fd65a', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'zones': [{'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-02-18T16:22:36.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-18T16:22:36.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-18T16:22:36.927 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-02-18T16:22:37.011 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:37.011 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cec73c980 1 Processor -- start 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cec73c980 1 -- start start 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cec73c980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fa57874400 0x55fa578747e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cec73c980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fa577be460 con 0x55fa57874d20 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cec73c980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fa57785180 con 0x55fa57874400 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cea257640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fa57874400 0x55fa578747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cea257640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55fa57874400 0x55fa578747e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56604/0 (socket says 172.21.15.129:56604) 2024-02-18T16:22:37.013 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cea257640 1 -- 172.21.15.129:0/2528760670 learned_addr learned my addr 172.21.15.129:0/2528760670 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cea257640 1 -- 172.21.15.129:0/2528760670 >> v1:172.21.15.80:6789/0 conn(0x55fa57874d20 legacy=0x55fa578756e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.004+0000 7f2cea257640 1 -- 172.21.15.129:0/2528760670 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa57875f10 con 0x55fa57874400 2024-02-18T16:22:37.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cea257640 1 --2- 172.21.15.129:0/2528760670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa578747e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00a4e0 tx=0x7f2cdc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16d7b4f6fc268bb server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2ce9255640 1 -- 172.21.15.129:0/2528760670 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0aa540 con 0x55fa57874400 2024-02-18T16:22:37.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2ce9255640 1 -- 172.21.15.129:0/2528760670 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0a6070 con 0x55fa57874400 2024-02-18T16:22:37.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2ce9255640 1 -- 172.21.15.129:0/2528760670 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0aa850 con 0x55fa57874400 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 -- 172.21.15.129:0/2528760670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 msgr2=0x55fa578747e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 --2- 172.21.15.129:0/2528760670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa578747e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00a4e0 tx=0x7f2cdc01b090 comp rx=0 tx=0).stop 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 -- 172.21.15.129:0/2528760670 shutdown_connections 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 --2- 172.21.15.129:0/2528760670 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa578747e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 -- 172.21.15.129:0/2528760670 >> 172.21.15.129:0/2528760670 conn(0x55fa577e7b50 msgr2=0x55fa577e7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 -- 172.21.15.129:0/2528760670 shutdown_connections 2024-02-18T16:22:37.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.008+0000 7f2cec73c980 1 -- 172.21.15.129:0/2528760670 wait complete. 2024-02-18T16:22:37.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.020+0000 7f2cec73c980 1 Processor -- start 2024-02-18T16:22:37.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.020+0000 7f2cec73c980 1 -- start start 2024-02-18T16:22:37.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.020+0000 7f2cec73c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa5795ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.020+0000 7f2cec73c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa577826b0 con 0x55fa57874400 2024-02-18T16:22:37.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa5795ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa5795ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56610/0 (socket says 172.21.15.129:56610) 2024-02-18T16:22:37.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 -- 172.21.15.129:0/76971578 learned_addr learned my addr 172.21.15.129:0/76971578 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 -- 172.21.15.129:0/76971578 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc00a1c0 con 0x55fa57874400 2024-02-18T16:22:37.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 --2- 172.21.15.129:0/76971578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa5795ea20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc017ca0 tx=0x7f2cdc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e03056558b9c37 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2bd8608640 1 -- 172.21.15.129:0/76971578 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0aa750 con 0x55fa57874400 2024-02-18T16:22:37.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2bd8608640 1 -- 172.21.15.129:0/76971578 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0aa8b0 con 0x55fa57874400 2024-02-18T16:22:37.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2bd8608640 1 -- 172.21.15.129:0/76971578 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0aab70 con 0x55fa57874400 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- 172.21.15.129:0/76971578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 msgr2=0x55fa5795ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 --2- 172.21.15.129:0/76971578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa5795ea20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc017ca0 tx=0x7f2cdc0033b0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- 172.21.15.129:0/76971578 shutdown_connections 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 --2- 172.21.15.129:0/76971578 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa5795ea20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- 172.21.15.129:0/76971578 >> 172.21.15.129:0/76971578 conn(0x55fa577e7b50 msgr2=0x55fa5795a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- 172.21.15.129:0/76971578 shutdown_connections 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- 172.21.15.129:0/76971578 wait complete. 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 Processor -- start 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- start start 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa57965700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cec73c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5777de90 con 0x55fa57874400 2024-02-18T16:22:37.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa57965700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa57965700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56612/0 (socket says 172.21.15.129:56612) 2024-02-18T16:22:37.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 -- 172.21.15.129:0/416831369 learned_addr learned my addr 172.21.15.129:0/416831369 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.024+0000 7f2cea257640 1 -- 172.21.15.129:0/416831369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa57875f10 con 0x55fa57874400 2024-02-18T16:22:37.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cea257640 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa57965700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc01b930 tx=0x7f2cdc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd6e05640 1 -- 172.21.15.129:0/416831369 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0c4070 con 0x55fa57874400 2024-02-18T16:22:37.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa57965c40 con 0x55fa57874400 2024-02-18T16:22:37.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd6e05640 1 -- 172.21.15.129:0/416831369 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0c8580 con 0x55fa57874400 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd6e05640 1 -- 172.21.15.129:0/416831369 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0c8820 con 0x55fa57874400 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa57966070 con 0x55fa57874400 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 Processor -- start 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- start start 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa57972b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa57716f20 con 0x55fa579726e0 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa57972b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd6e05640 1 -- 172.21.15.129:0/416831369 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2cdc0a8070 con 0x55fa57874400 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa57972b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56614/0 (socket says 172.21.15.129:56614) 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 -- 172.21.15.129:0/2402253526 learned_addr learned my addr 172.21.15.129:0/2402253526 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd6e05640 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bd00342b0 0x7f2bd0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd6e05640 1 -- 172.21.15.129:0/416831369 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2cdc0e3980 con 0x55fa57874400 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cea257640 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bd00342b0 0x7f2bd0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 -- 172.21.15.129:0/2402253526 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa57973040 con 0x55fa579726e0 2024-02-18T16:22:37.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cea257640 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bd00342b0 0x7f2bd0036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0b4510 tx=0x7f2cdc0b43a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 --2- 172.21.15.129:0/2402253526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa57972b00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a440 tx=0x7f2ce400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae9e16f75f795fd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd4e01640 1 -- 172.21.15.129:0/2402253526 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4008850 con 0x55fa579726e0 2024-02-18T16:22:37.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd4e01640 1 -- 172.21.15.129:0/2402253526 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40089d0 con 0x55fa579726e0 2024-02-18T16:22:37.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2bd4e01640 1 -- 172.21.15.129:0/2402253526 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4008cb0 con 0x55fa579726e0 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/2402253526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 msgr2=0x55fa57972b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 --2- 172.21.15.129:0/2402253526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa57972b00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a440 tx=0x7f2ce400a900 comp rx=0 tx=0).stop 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/2402253526 shutdown_connections 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 --2- 172.21.15.129:0/2402253526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa57972b00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/2402253526 >> 172.21.15.129:0/2402253526 conn(0x55fa57874d20 msgr2=0x55fa5796db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/2402253526 shutdown_connections 2024-02-18T16:22:37.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- 172.21.15.129:0/2402253526 wait complete. 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 Processor -- start 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- start start 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa579796f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2cec73c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5770a790 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa579796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa579796f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56630/0 (socket says 172.21.15.129:56630) 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.028+0000 7f2ceaa58640 1 -- 172.21.15.129:0/3477106887 learned_addr learned my addr 172.21.15.129:0/3477106887 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2ceaa58640 1 -- 172.21.15.129:0/3477106887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4005cd0 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2ceaa58640 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa579796f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55fa579734c0 tx=0x7f2ce4003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2bceffd640 1 -- 172.21.15.129:0/3477106887 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4013aa0 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2bceffd640 1 -- 172.21.15.129:0/3477106887 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4013c00 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa57979c30 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2bceffd640 1 -- 172.21.15.129:0/3477106887 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4013ea0 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa5797a060 con 0x55fa579726e0 2024-02-18T16:22:37.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2bceffd640 1 -- 172.21.15.129:0/3477106887 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2ce4028460 con 0x55fa579726e0 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2bceffd640 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bc40342b0 0x7f2bc4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2bceffd640 1 -- 172.21.15.129:0/3477106887 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2ce4049880 con 0x55fa579726e0 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 1 Processor -- start 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2ceaa58640 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bc40342b0 0x7f2bc4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 1 -- start start 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 0x55fa579937b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cec73c980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa57993cf0 con 0x55fa57993390 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2ceaa58640 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bc40342b0 0x7f2bc4036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40058b0 tx=0x7f2ce4028710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cea257640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 0x55fa579937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cea257640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 0x55fa579937b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:56644/0 (socket says 172.21.15.129:56644) 2024-02-18T16:22:37.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cea257640 1 -- 172.21.15.129:0/4253329323 learned_addr learned my addr 172.21.15.129:0/4253329323 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.032+0000 7f2cea257640 1 -- 172.21.15.129:0/4253329323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa57993e30 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cea257640 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 0x55fa579937b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005720 tx=0x7f2cdc0e1c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2baefe5640 1 -- 172.21.15.129:0/4253329323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0a9e20 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa57994740 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2baefe5640 1 -- 172.21.15.129:0/4253329323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0c79f0 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2baefe5640 1 -- 172.21.15.129:0/4253329323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc0c7c90 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa57994740 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2baefe5640 1 -- 172.21.15.129:0/4253329323 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2cdc0b5440 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2baefe5640 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2b2c0342b0 0x7f2b2c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2baefe5640 1 -- 172.21.15.129:0/4253329323 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2cdc0f2a80 con 0x55fa57993390 2024-02-18T16:22:37.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2ce9a56640 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2b2c0342b0 0x7f2b2c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2bacfe1640 20 reqs_thread_entry: start 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fa57998320 0x55fa5799a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fa5799ac50 con 0x55fa57998320 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2ce9a56640 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2b2c0342b0 0x7f2b2c036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55fa5796e790 tx=0x7f2cd4001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2ceaa58640 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fa57998320 0x55fa5799a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2ceaa58640 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fa57998320 0x55fa5799a710 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2ceaa58640 1 -- 172.21.15.129:0/416831369 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ce4024020 con 0x55fa57998320 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fa5799bfc0 con 0x55fa57998320 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2ceaa58640 1 -- 172.21.15.129:0/416831369 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~398 out=398b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2ce4024020 con 0x55fa57998320 2024-02-18T16:22:37.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.036+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fa579a0800 con 0x55fa57998320 2024-02-18T16:22:37.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2ceaa58640 1 -- 172.21.15.129:0/416831369 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [stat,call,call,writefull 0~421] v32'5 uv5 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f2ce4024020 con 0x55fa57998320 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bc40342b0 msgr2=0x7f2bc4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bc40342b0 0x7f2bc4036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40058b0 tx=0x7f2ce4028710 comp rx=0 tx=0).stop 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 msgr2=0x55fa579796f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa579796f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55fa579734c0 tx=0x7f2ce4003000 comp rx=0 tx=0).stop 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 shutdown_connections 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bc40342b0 0x7f2bc4036770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/3477106887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa579726e0 0x55fa579796f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 >> 172.21.15.129:0/3477106887 conn(0x55fa57874d20 msgr2=0x55fa5796c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 shutdown_connections 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/3477106887 wait complete. 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2b2c0342b0 msgr2=0x7f2b2c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.050 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2b2c0342b0 0x7f2b2c036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55fa5796e790 tx=0x7f2cd4001320 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 msgr2=0x55fa579937b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 0x55fa579937b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005720 tx=0x7f2cdc0e1c20 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 shutdown_connections 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2b2c0342b0 0x7f2b2c036770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/4253329323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57993390 0x55fa579937b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 >> 172.21.15.129:0/4253329323 conn(0x55fa57988110 msgr2=0x55fa57988b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 shutdown_connections 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/4253329323 wait complete. 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fa57998320 msgr2=0x55fa5799a710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fa57998320 0x55fa5799a710 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bd00342b0 msgr2=0x7f2bd0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bd00342b0 0x7f2bd0036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0b4510 tx=0x7f2cdc0b43a0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 msgr2=0x55fa57965700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa57965700 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc01b930 tx=0x7f2cdc017e30 comp rx=0 tx=0).stop 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 shutdown_connections 2024-02-18T16:22:37.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55fa57998320 0x55fa5799a710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2bd00342b0 0x7f2bd0036770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 --2- 172.21.15.129:0/416831369 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55fa57874400 0x55fa57965700 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 >> 172.21.15.129:0/416831369 conn(0x55fa577e7b50 msgr2=0x55fa579590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 shutdown_connections 2024-02-18T16:22:37.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.040+0000 7f2cec73c980 1 -- 172.21.15.129:0/416831369 wait complete. 2024-02-18T16:22:37.058 INFO:teuthology.orchestra.run.smithi129.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-02-18T16:22:37.059 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-02-18T16:22:37.059 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-18T16:22:37.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-18T16:22:37.059 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-02-18T16:22:37.144 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:37.144 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:37.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.136+0000 7f13bd773980 1 Processor -- start 2024-02-18T16:22:37.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.136+0000 7f13bd773980 1 -- start start 2024-02-18T16:22:37.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.136+0000 7f13bd773980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ba2ec819c0 0x55ba2ec83db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.136+0000 7f13bd773980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ba2ebc7460 con 0x55ba2ebef210 2024-02-18T16:22:37.145 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.136+0000 7f13bd773980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ba2eb8e180 con 0x55ba2ec819c0 2024-02-18T16:22:37.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13baa8d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55ba2ec819c0 0x55ba2ec83db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13bb28e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x55ba2ebef210 0x55ba2ec802a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.129:57188/0 (socket says 172.21.15.129:57188) 2024-02-18T16:22:37.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13bb28e640 1 -- 172.21.15.129:0/771443906 learned_addr learned my addr 172.21.15.129:0/771443906 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-02-18T16:22:37.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13baa8d640 1 -- 172.21.15.129:0/771443906 >> v1:172.21.15.80:6789/0 conn(0x55ba2ebef210 legacy=0x55ba2ec802a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13baa8d640 1 -- 172.21.15.129:0/771443906 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba2ec85300 con 0x55ba2ec819c0 2024-02-18T16:22:37.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13baa8d640 1 --2- 172.21.15.129:0/771443906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ec819c0 0x55ba2ec83db0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f13a400a420 tx=0x7f13a401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6d91c38944f4e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13ba28c640 1 -- 172.21.15.129:0/771443906 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a40aa530 con 0x55ba2ec819c0 2024-02-18T16:22:37.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13ba28c640 1 -- 172.21.15.129:0/771443906 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40a6050 con 0x55ba2ec819c0 2024-02-18T16:22:37.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.140+0000 7f13ba28c640 1 -- 172.21.15.129:0/771443906 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a40aa800 con 0x55ba2ec819c0 2024-02-18T16:22:37.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 -- 172.21.15.129:0/771443906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ec819c0 msgr2=0x55ba2ec83db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 --2- 172.21.15.129:0/771443906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ec819c0 0x55ba2ec83db0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f13a400a420 tx=0x7f13a401afd0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 -- 172.21.15.129:0/771443906 shutdown_connections 2024-02-18T16:22:37.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 --2- 172.21.15.129:0/771443906 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ec819c0 0x55ba2ec83db0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 -- 172.21.15.129:0/771443906 >> 172.21.15.129:0/771443906 conn(0x55ba2ec75980 msgr2=0x55ba2ec77da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 -- 172.21.15.129:0/771443906 shutdown_connections 2024-02-18T16:22:37.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.144+0000 7f13bd773980 1 -- 172.21.15.129:0/771443906 wait complete. 2024-02-18T16:22:37.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bd773980 1 Processor -- start 2024-02-18T16:22:37.164 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bd773980 1 -- start start 2024-02-18T16:22:37.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bd773980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed67450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bd773980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2eb8b6b0 con 0x55ba2ebef210 2024-02-18T16:22:37.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bb28e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed67450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bb28e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed67450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41670/0 (socket says 172.21.15.129:41670) 2024-02-18T16:22:37.165 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bb28e640 1 -- 172.21.15.129:0/1224173953 learned_addr learned my addr 172.21.15.129:0/1224173953 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bb28e640 1 -- 172.21.15.129:0/1224173953 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a400a100 con 0x55ba2ebef210 2024-02-18T16:22:37.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f13bb28e640 1 --2- 172.21.15.129:0/1224173953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed67450 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f13ac001c00 tx=0x7f13ac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fbc0b4fc640f75 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f12a960a640 1 -- 172.21.15.129:0/1224173953 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13ac00e690 con 0x55ba2ebef210 2024-02-18T16:22:37.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f12a960a640 1 -- 172.21.15.129:0/1224173953 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00e810 con 0x55ba2ebef210 2024-02-18T16:22:37.166 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.156+0000 7f12a960a640 1 -- 172.21.15.129:0/1224173953 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13ac00eb30 con 0x55ba2ebef210 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1224173953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 msgr2=0x55ba2ed67450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 --2- 172.21.15.129:0/1224173953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed67450 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f13ac001c00 tx=0x7f13ac00b6d0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1224173953 shutdown_connections 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 --2- 172.21.15.129:0/1224173953 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed67450 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1224173953 >> 172.21.15.129:0/1224173953 conn(0x55ba2ec75980 msgr2=0x55ba2ed62fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1224173953 shutdown_connections 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1224173953 wait complete. 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 Processor -- start 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- start start 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed6e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2eb86e90 con 0x55ba2ebef210 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bb28e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed6e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.168 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bb28e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed6e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41682/0 (socket says 172.21.15.129:41682) 2024-02-18T16:22:37.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bb28e640 1 -- 172.21.15.129:0/1007906567 learned_addr learned my addr 172.21.15.129:0/1007906567 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bb28e640 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba2ebc7460 con 0x55ba2ebef210 2024-02-18T16:22:37.169 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bb28e640 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed6e2a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00b710 tx=0x7f13ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f12a7e07640 1 -- 172.21.15.129:0/1007906567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13ac01f070 con 0x55ba2ebef210 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba2ed6e7e0 con 0x55ba2ebef210 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f12a7e07640 1 -- 172.21.15.129:0/1007906567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac01a910 con 0x55ba2ebef210 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f12a7e07640 1 -- 172.21.15.129:0/1007906567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13ac01abf0 con 0x55ba2ebef210 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba2ed6ec10 con 0x55ba2ebef210 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 Processor -- start 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- start start 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bd773980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2eb1ff20 con 0x55ba2ed7b280 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f12a7e07640 1 -- 172.21.15.129:0/1007906567 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f13ac00a040 con 0x55ba2ebef210 2024-02-18T16:22:37.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bba8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bba8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed7b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41692/0 (socket says 172.21.15.129:41692) 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.160+0000 7f13bba8f640 1 -- 172.21.15.129:0/3698074946 learned_addr learned my addr 172.21.15.129:0/3698074946 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f12a7e07640 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f12a00342b0 0x7f12a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f12a7e07640 1 -- 172.21.15.129:0/1007906567 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f13ac04a0c0 con 0x55ba2ebef210 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bb28e640 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f12a00342b0 0x7f12a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 -- 172.21.15.129:0/3698074946 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba2ed7bbe0 con 0x55ba2ed7b280 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bb28e640 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f12a00342b0 0x7f12a0036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f13ac024eb0 tx=0x7f13ac00df50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 --2- 172.21.15.129:0/3698074946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed7b6a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f13b400a440 tx=0x7f13b400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96403bd24d306803 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f12a5e03640 1 -- 172.21.15.129:0/3698074946 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13b4008850 con 0x55ba2ed7b280 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f12a5e03640 1 -- 172.21.15.129:0/3698074946 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b40089d0 con 0x55ba2ed7b280 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f12a5e03640 1 -- 172.21.15.129:0/3698074946 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13b4008cb0 con 0x55ba2ed7b280 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3698074946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 msgr2=0x55ba2ed7b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 --2- 172.21.15.129:0/3698074946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed7b6a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f13b400a440 tx=0x7f13b400a900 comp rx=0 tx=0).stop 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3698074946 shutdown_connections 2024-02-18T16:22:37.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 --2- 172.21.15.129:0/3698074946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed7b6a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3698074946 >> 172.21.15.129:0/3698074946 conn(0x55ba2ec819c0 msgr2=0x55ba2ed766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3698074946 shutdown_connections 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3698074946 wait complete. 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 Processor -- start 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- start start 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed821b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.174 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2eb13790 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed821b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41704/0 (socket says 172.21.15.129:41704) 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 -- 172.21.15.129:0/3735827572 learned_addr learned my addr 172.21.15.129:0/3735827572 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 -- 172.21.15.129:0/3735827572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4005cd0 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bba8f640 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed821b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55ba2ed7c060 tx=0x7f13b4003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f1297fff640 1 -- 172.21.15.129:0/3735827572 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13b4013aa0 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba2ed826f0 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f1297fff640 1 -- 172.21.15.129:0/3735827572 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b4013c00 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f1297fff640 1 -- 172.21.15.129:0/3735827572 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13b4013ea0 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.164+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba2ed82b20 con 0x55ba2ed7b280 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:37.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f1297fff640 1 -- 172.21.15.129:0/3735827572 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f13b4028460 con 0x55ba2ed7b280 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 1 Processor -- start 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f1297fff640 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f129c0342b0 0x7f129c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f1297fff640 1 -- 172.21.15.129:0/3735827572 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f13b4049900 con 0x55ba2ed7b280 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 1 -- start start 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bba8f640 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f129c0342b0 0x7f129c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 0x55ba2ed9c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2ed9c890 con 0x55ba2ed9bf30 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bba8f640 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f129c0342b0 0x7f129c036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f13b40058b0 tx=0x7f13b4028810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bb28e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 0x55ba2ed9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bb28e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 0x55ba2ed9c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41710/0 (socket says 172.21.15.129:41710) 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bb28e640 1 -- 172.21.15.129:0/4020237271 learned_addr learned my addr 172.21.15.129:0/4020237271 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bb28e640 1 -- 172.21.15.129:0/4020237271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba2ed9c9d0 con 0x55ba2ed9bf30 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bb28e640 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 0x55ba2ed9c350 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f13ac014040 tx=0x7f13ac00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.178 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f121bfff640 1 -- 172.21.15.129:0/4020237271 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13ac02de70 con 0x55ba2ed9bf30 2024-02-18T16:22:37.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f121bfff640 1 -- 172.21.15.129:0/4020237271 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac048120 con 0x55ba2ed9bf30 2024-02-18T16:22:37.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba2ed9d2c0 con 0x55ba2ed9bf30 2024-02-18T16:22:37.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f121bfff640 1 -- 172.21.15.129:0/4020237271 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13ac024940 con 0x55ba2ed9bf30 2024-02-18T16:22:37.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.168+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba2ed9d2c0 con 0x55ba2ed9bf30 2024-02-18T16:22:37.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f121bfff640 1 -- 172.21.15.129:0/4020237271 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f13ac02da10 con 0x55ba2ed9bf30 2024-02-18T16:22:37.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f121bfff640 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f11f40342b0 0x7f11f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.181 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f121bfff640 1 -- 172.21.15.129:0/4020237271 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f13ac041040 con 0x55ba2ed9bf30 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13baa8d640 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f11f40342b0 0x7f11f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f1219ffb640 20 reqs_thread_entry: start 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ba2eda0ea0 0x55ba2eda3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ba2eda37d0 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13baa8d640 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f11f40342b0 0x7f11f4036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ac000 tx=0x7f13a40a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ba2eda0ea0 0x55ba2eda3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ba2eda0ea0 0x55ba2eda3290 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 -- 172.21.15.129:0/1007906567 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f13b4024020 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ba2eda4b40 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 -- 172.21.15.129:0/1007906567 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f13b4024020 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ba2eda3fd0 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 -- 172.21.15.129:0/1007906567 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13b4024020 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ba2eda4380 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 -- 172.21.15.129:0/1007906567 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f13b4024020 con 0x55ba2eda0ea0 2024-02-18T16:22:37.182 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ba2eda4790 con 0x55ba2eda0ea0 2024-02-18T16:22:37.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bba8f640 1 -- 172.21.15.129:0/1007906567 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~421 out=421b] v0'0 uv5 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f13b4024020 con 0x55ba2eda0ea0 2024-02-18T16:22:37.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55ba2eb1fd10 con 0x55ba2ed7b280 2024-02-18T16:22:37.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f1297fff640 1 -- 172.21.15.129:0/3735827572 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13b401e420 con 0x55ba2ed7b280 2024-02-18T16:22:37.183 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.172+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:6 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~921 in=921b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ba2edaa390 con 0x55ba2eda0ea0 2024-02-18T16:22:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bba8f640 1 -- 172.21.15.129:0/1007906567 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(6 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [stat,call,call,writefull 0~921] v32'5 uv5 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f13b4024020 con 0x55ba2eda0ea0 2024-02-18T16:22:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f129c0342b0 msgr2=0x7f129c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f129c0342b0 0x7f129c036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f13b40058b0 tx=0x7f13b4028810 comp rx=0 tx=0).stop 2024-02-18T16:22:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 msgr2=0x55ba2ed821b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed821b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55ba2ed7c060 tx=0x7f13b4003000 comp rx=0 tx=0).stop 2024-02-18T16:22:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 shutdown_connections 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f129c0342b0 0x7f129c036770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/3735827572 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed7b280 0x55ba2ed821b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 >> 172.21.15.129:0/3735827572 conn(0x55ba2ec819c0 msgr2=0x55ba2ed754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 shutdown_connections 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/3735827572 wait complete. 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f11f40342b0 msgr2=0x7f11f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f11f40342b0 0x7f11f4036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ac000 tx=0x7f13a40a5000 comp rx=0 tx=0).stop 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 msgr2=0x55ba2ed9c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 0x55ba2ed9c350 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f13ac014040 tx=0x7f13ac00d7b0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 shutdown_connections 2024-02-18T16:22:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f11f40342b0 0x7f11f4036770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/4020237271 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ed9bf30 0x55ba2ed9c350 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 >> 172.21.15.129:0/4020237271 conn(0x55ba2ed90c50 msgr2=0x55ba2ed91670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 shutdown_connections 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/4020237271 wait complete. 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ba2eda0ea0 msgr2=0x55ba2eda3290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ba2eda0ea0 0x55ba2eda3290 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f12a00342b0 msgr2=0x7f12a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f12a00342b0 0x7f12a0036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f13ac024eb0 tx=0x7f13ac00df50 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 msgr2=0x55ba2ed6e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed6e2a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00b710 tx=0x7f13ac000bd0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 shutdown_connections 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55ba2eda0ea0 0x55ba2eda3290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f12a00342b0 0x7f12a0036770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 --2- 172.21.15.129:0/1007906567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55ba2ebef210 0x55ba2ed6e2a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 >> 172.21.15.129:0/1007906567 conn(0x55ba2ec75980 msgr2=0x55ba2ed61af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 shutdown_connections 2024-02-18T16:22:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:37.176+0000 7f13bd773980 1 -- 172.21.15.129:0/1007906567 wait complete. 2024-02-18T16:22:37.194 INFO:teuthology.orchestra.run.smithi129.stdout:{"id":"4654bfe8-cc1b-4e5c-898b-5aaaee650498","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-18T16:22:37.194 DEBUG:tasks.util.rgw: json result: {'id': '4654bfe8-cc1b-4e5c-898b-5aaaee650498', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-18T16:22:37.197 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_02db01d0a75058abf10a307d548d1e1e71b47eeb/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000720387af4375c46c-0065d22ecd-4224-default4224-default-default 2024-02-18T16:22:37.480 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0698f2d68e7e4c2c97e30e2aae5d9f5f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_02db01d0a75058abf10a307d548d1e1e71b47eeb/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000720387af4375c46c-0065d22ecd-4224-default4224-default-default 2024-02-18T16:22:37.481 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-18T16:22:37.491 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-18T16:22:37.491 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:22:37.503 INFO:tasks.rgw.client.0.smithi129.stdout:2024-02-18T16:22:37.484+0000 7fc015c33640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28432) UID: 0 2024-02-18T16:22:37.503 INFO:tasks.rgw.client.0.smithi129.stdout:2024-02-18T16:22:37.484+0000 7fc01947ba40 -1 shutting down 2024-02-18T16:22:40.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-02-18T16:22:43.593 INFO:tasks.rgw.client.0:Stopped 2024-02-18T16:22:43.594 DEBUG:teuthology.orchestra.run.smithi129:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-18T16:22:43.600 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /etc/ceph/vault-root-token 2024-02-18T16:22:43.655 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-02-18T16:22:43.710 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-18T16:22:43.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-18T16:22:43.711 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-18T16:22:43.789 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-02-18T16:22:43.790 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-02-18T16:22:43.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccdbb7980 1 Processor -- start 2024-02-18T16:22:43.792 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccdbb7980 1 -- start start 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccdbb7980 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cf7a515080 0x55cf7a515490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccdbb7980 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cf7a4e84c0 con 0x55cf7a512b80 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccdbb7980 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cf7a4af180 con 0x55cf7a515080 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccaed1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cf7a515080 0x55cf7a515490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccaed1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x55cf7a515080 0x55cf7a515490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41712/0 (socket says 172.21.15.129:41712) 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccaed1640 1 -- 172.21.15.129:0/1953398147 learned_addr learned my addr 172.21.15.129:0/1953398147 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:43.793 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccaed1640 1 -- 172.21.15.129:0/1953398147 >> v1:172.21.15.80:6789/0 conn(0x55cf7a512b80 legacy=0x55cf7a512f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:43.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.784+0000 7fdccaed1640 1 -- 172.21.15.129:0/1953398147 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7a5169e0 con 0x55cf7a515080 2024-02-18T16:22:43.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccaed1640 1 --2- 172.21.15.129:0/1953398147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a515080 0x55cf7a515490 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000a5c0 tx=0x7fdcc001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77f8b78cf410bfc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdcca6d0640 1 -- 172.21.15.129:0/1953398147 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00aa470 con 0x55cf7a515080 2024-02-18T16:22:43.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdcca6d0640 1 -- 172.21.15.129:0/1953398147 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00aa5d0 con 0x55cf7a515080 2024-02-18T16:22:43.796 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdcca6d0640 1 -- 172.21.15.129:0/1953398147 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00aa890 con 0x55cf7a515080 2024-02-18T16:22:43.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1953398147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a515080 msgr2=0x55cf7a515490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:43.797 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1953398147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a515080 0x55cf7a515490 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000a5c0 tx=0x7fdcc001b340 comp rx=0 tx=0).stop 2024-02-18T16:22:43.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1953398147 shutdown_connections 2024-02-18T16:22:43.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1953398147 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a515080 0x55cf7a515490 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:43.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1953398147 >> 172.21.15.129:0/1953398147 conn(0x55cf7a511a40 msgr2=0x55cf7a511e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:43.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1953398147 shutdown_connections 2024-02-18T16:22:43.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.788+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1953398147 wait complete. 2024-02-18T16:22:43.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.804+0000 7fdccdbb7980 1 Processor -- start 2024-02-18T16:22:43.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.804+0000 7fdccdbb7980 1 -- start start 2024-02-18T16:22:43.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.804+0000 7fdccdbb7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a68c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.814 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.804+0000 7fdccdbb7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7a4ac6b0 con 0x55cf7a512b80 2024-02-18T16:22:43.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a68c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a68c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41722/0 (socket says 172.21.15.129:41722) 2024-02-18T16:22:43.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 -- 172.21.15.129:0/4139183114 learned_addr learned my addr 172.21.15.129:0/4139183114 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:43.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 -- 172.21.15.129:0/4139183114 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0005df0 con 0x55cf7a512b80 2024-02-18T16:22:43.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 --2- 172.21.15.129:0/4139183114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a68c810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001d60 tx=0x7fdcbc00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b45108ab9b071 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdbb960a640 1 -- 172.21.15.129:0/4139183114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc014070 con 0x55cf7a512b80 2024-02-18T16:22:43.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdbb960a640 1 -- 172.21.15.129:0/4139183114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00f540 con 0x55cf7a512b80 2024-02-18T16:22:43.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdbb960a640 1 -- 172.21.15.129:0/4139183114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc00f820 con 0x55cf7a512b80 2024-02-18T16:22:43.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- 172.21.15.129:0/4139183114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 msgr2=0x55cf7a68c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:43.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/4139183114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a68c810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001d60 tx=0x7fdcbc00b5c0 comp rx=0 tx=0).stop 2024-02-18T16:22:43.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- 172.21.15.129:0/4139183114 shutdown_connections 2024-02-18T16:22:43.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/4139183114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a68c810 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:43.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- 172.21.15.129:0/4139183114 >> 172.21.15.129:0/4139183114 conn(0x55cf7a511a40 msgr2=0x55cf7a688300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:43.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- 172.21.15.129:0/4139183114 shutdown_connections 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- 172.21.15.129:0/4139183114 wait complete. 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 Processor -- start 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- start start 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a693660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccdbb7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7a4a7e90 con 0x55cf7a512b80 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a693660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a693660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41732/0 (socket says 172.21.15.129:41732) 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 -- 172.21.15.129:0/3078135148 learned_addr learned my addr 172.21.15.129:0/3078135148 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7a4e84c0 con 0x55cf7a512b80 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.808+0000 7fdccb6d2640 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a693660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00f510 tx=0x7fdcbc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdbb7e07640 1 -- 172.21.15.129:0/3078135148 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc014050 con 0x55cf7a512b80 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdbb7e07640 1 -- 172.21.15.129:0/3078135148 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc001300 con 0x55cf7a512b80 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf7a693ba0 con 0x55cf7a512b80 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdbb7e07640 1 -- 172.21.15.129:0/3078135148 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc01bb20 con 0x55cf7a512b80 2024-02-18T16:22:43.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf7a694030 con 0x55cf7a512b80 2024-02-18T16:22:43.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdbb7e07640 1 -- 172.21.15.129:0/3078135148 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdcbc022020 con 0x55cf7a512b80 2024-02-18T16:22:43.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdbb7e07640 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdbb0034300 0x7fdbb00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdbb7e07640 1 -- 172.21.15.129:0/3078135148 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdcbc048f90 con 0x55cf7a512b80 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccaed1640 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdbb0034300 0x7fdbb00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6982d0 0x55cf7a69a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a69ac00 con 0x55cf7a6982d0 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccbed3640 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6982d0 0x55cf7a69a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccaed1640 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdbb0034300 0x7fdbb00367c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00ae000 tx=0x7fdcc00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.826 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccbed3640 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6982d0 0x55cf7a69a6c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccbed3640 1 -- 172.21.15.129:0/3078135148 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdcc400a4d0 con 0x55cf7a6982d0 2024-02-18T16:22:43.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a69afc0 con 0x55cf7a6982d0 2024-02-18T16:22:43.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccbed3640 1 -- 172.21.15.129:0/3078135148 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdcc400a4d0 con 0x55cf7a6982d0 2024-02-18T16:22:43.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a69c870 con 0x55cf7a6982d0 2024-02-18T16:22:43.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.812+0000 7fdccbed3640 1 -- 172.21.15.129:0/3078135148 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [call out=48b,read 0~921 out=921b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+969 (crc 0 0 0) 0x7fdcc400a4d0 con 0x55cf7a6982d0 2024-02-18T16:22:43.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a69bb30 con 0x55cf7a6982d0 2024-02-18T16:22:43.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccbed3640 1 -- 172.21.15.129:0/3078135148 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdcc400a4d0 con 0x55cf7a6982d0 2024-02-18T16:22:43.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a69bf40 con 0x55cf7a6982d0 2024-02-18T16:22:43.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccbed3640 1 -- 172.21.15.129:0/3078135148 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [call out=48b,read 0~421 out=421b] v0'0 uv5 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7fdcc400a4d0 con 0x55cf7a6982d0 2024-02-18T16:22:43.829 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 Processor -- start 2024-02-18T16:22:43.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 -- start start 2024-02-18T16:22:43.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 0x55cf7a6ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7a440f20 con 0x55cf7a6aac90 2024-02-18T16:22:43.830 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccaed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 0x55cf7a6ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccaed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 0x55cf7a6ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41742/0 (socket says 172.21.15.129:41742) 2024-02-18T16:22:43.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccaed1640 1 -- 172.21.15.129:0/688953624 learned_addr learned my addr 172.21.15.129:0/688953624 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:43.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccaed1640 1 -- 172.21.15.129:0/688953624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7a6ab5f0 con 0x55cf7a6aac90 2024-02-18T16:22:43.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccaed1640 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 0x55cf7a6ab0b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0096f40 tx=0x7fdcc00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdbb5602640 1 -- 172.21.15.129:0/688953624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00b3b90 con 0x55cf7a6aac90 2024-02-18T16:22:43.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdbb5602640 1 -- 172.21.15.129:0/688953624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00c3070 con 0x55cf7a6aac90 2024-02-18T16:22:43.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf7a6ab7e0 con 0x55cf7a6aac90 2024-02-18T16:22:43.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdbb5602640 1 -- 172.21.15.129:0/688953624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00b3e20 con 0x55cf7a6aac90 2024-02-18T16:22:43.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.816+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf7a6ac2d0 con 0x55cf7a6aac90 2024-02-18T16:22:43.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdbb5602640 1 -- 172.21.15.129:0/688953624 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdcc00c5030 con 0x55cf7a6aac90 2024-02-18T16:22:43.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdbb5602640 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdba40342b0 0x7fdba4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdbb5602640 1 -- 172.21.15.129:0/688953624 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdcc00e67c0 con 0x55cf7a6aac90 2024-02-18T16:22:43.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccbed3640 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdba40342b0 0x7fdba4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 Processor -- start 2024-02-18T16:22:43.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- start start 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7a434790 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccbed3640 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdba40342b0 0x7fdba4036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55cf7a69b4b0 tx=0x7fdcc4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6b80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41754/0 (socket says 172.21.15.129:41754) 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 -- 172.21.15.129:0/2709972249 learned_addr learned my addr 172.21.15.129:0/2709972249 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:43.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 -- 172.21.15.129:0/2709972249 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7a6b8690 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 --2- 172.21.15.129:0/2709972249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6b80c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00e4b80 tx=0x7fdcc00c7490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7737bfe60185c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdbaeffd640 1 -- 172.21.15.129:0/2709972249 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00d6040 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdbaeffd640 1 -- 172.21.15.129:0/2709972249 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00b4050 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdbaeffd640 1 -- 172.21.15.129:0/2709972249 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00c7b20 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- 172.21.15.129:0/2709972249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 msgr2=0x55cf7a6b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/2709972249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6b80c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00e4b80 tx=0x7fdcc00c7490 comp rx=0 tx=0).stop 2024-02-18T16:22:43.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- 172.21.15.129:0/2709972249 shutdown_connections 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/2709972249 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6b80c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- 172.21.15.129:0/2709972249 >> 172.21.15.129:0/2709972249 conn(0x55cf7a6b4020 msgr2=0x55cf7a6b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- 172.21.15.129:0/2709972249 shutdown_connections 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- 172.21.15.129:0/2709972249 wait complete. 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 Processor -- start 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- start start 2024-02-18T16:22:43.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccdbb7980 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7a6bf0f0 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6bebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.129:41766/0 (socket says 172.21.15.129:41766) 2024-02-18T16:22:43.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.820+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 learned_addr learned my addr 172.21.15.129:0/1791072589 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-02-18T16:22:43.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7a6ac2d0 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccaed1640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6bebb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00de040 tx=0x7fdcc00e4ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdbad7fa640 1 -- 172.21.15.129:0/1791072589 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00e6e60 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdbad7fa640 1 -- 172.21.15.129:0/1791072589 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00ea070 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf7a6bf2f0 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdbad7fa640 1 -- 172.21.15.129:0/1791072589 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcc00bdb00 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf7a6bf2f0 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdbad7fa640 1 -- 172.21.15.129:0/1791072589 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdcc00e2050 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdbad7fa640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdb940342b0 0x7fdb94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdbad7fa640 1 -- 172.21.15.129:0/1791072589 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdcc00ec070 con 0x55cf7a6b7ce0 2024-02-18T16:22:43.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccbed3640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdb940342b0 0x7fdb94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6c9e20 0x55cf7a6cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6cc9e0 con 0x55cf7a6c9e20 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccb6d2640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6c9e20 0x55cf7a6cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccbed3640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdb940342b0 0x7fdb94036770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55cf7a69b570 tx=0x7fdcc4020000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccb6d2640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6c9e20 0x55cf7a6cc2e0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 20 realm 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ccdb0 con 0x55cf7a6c9e20 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.824+0000 7fdccdbb7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6cd630 con 0x55cf7a6c9e20 2024-02-18T16:22:43.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6cd990 con 0x55cf7a6c9e20 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:5 5.18 5:1ea12447:::zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x55cf7a6c9e20 2024-02-18T16:22:43.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 5 ==== osd_op_reply(5 zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 [read 0~921 out=921b] v0'0 uv5 ondisk = 0) v8 ==== 190+0+921 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 rados_obj.operate() r=0 bl.length=921 2024-02-18T16:22:43.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 20 searching for the correct realm 2024-02-18T16:22:43.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cf7a6d00e0 0x55cf7a6d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d2ba0 con 0x55cf7a6d00e0 2024-02-18T16:22:43.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccaed1640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cf7a6d00e0 0x55cf7a6d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccaed1640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cf7a6d00e0 0x55cf7a6d24d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccaed1640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc00bc3b0 0x7fdcc00073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d2ba0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccbed3640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc00bc3b0 0x7fdcc00073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccbed3640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc00bc3b0 0x7fdcc00073f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc400a4d0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccbed3640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdcc40141e0 0x7fdcc4015940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:43.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d2ba0 con 0x7fdcc40141e0 2024-02-18T16:22:43.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccb6d2640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdcc40141e0 0x7fdcc4015940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:43.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.828+0000 7fdccb6d2640 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdcc40141e0 0x7fdcc4015940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:43.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc016070 con 0x7fdcc40141e0 2024-02-18T16:22:43.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x55cf7a6c9e20 2024-02-18T16:22:43.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'5 uv5 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x55cf7a6c9e20 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc016070 con 0x55cf7a6c9e20 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x7fdcc40141e0 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x7fdcc40141e0 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc400a4d0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6ce190 con 0x55cf7a6d00e0 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.832+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc40141e0 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc40141e0 2024-02-18T16:22:43.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.836+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc40141e0 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc40141e0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6d00e0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v32'5 uv5 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fdcc0107040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccdbb7980 20 RGWRados::pool_iterate: got zone_info.4654bfe8-cc1b-4e5c-898b-5aaaee650498 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccdbb7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccdbb7980 20 RGWRados::pool_iterate: got default.zone. 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccdbb7980 20 RGWRados::pool_iterate: got zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccdbb7980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-18T16:22:43.879 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.840+0000 7fdccdbb7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-18T16:22:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6cea50 con 0x55cf7a6c9e20 2024-02-18T16:22:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6cee00 con 0x55cf7a6c9e20 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados_obj.operate() r=0 bl.length=46 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:40 5.f 5:f381381d:::zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6cee00 con 0x55cf7a6c9e20 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 16 ==== osd_op_reply(40 zonegroup_info.5cf777d6-7609-4766-9b82-6394139fd65a [read 0~421 out=421b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados_obj.operate() r=0 bl.length=421 2024-02-18T16:22:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 zone default found 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 4 Realm: () 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 4 ZoneGroup: default (5cf777d6-7609-4766-9b82-6394139fd65a) 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 4 Zone: default (4654bfe8-cc1b-4e5c-898b-5aaaee650498) 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 zonegroup default 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d2fe0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d49c0 con 0x55cf7a6d00e0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados->read ofs=0 len=0 2024-02-18T16:22:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d4d20 con 0x55cf7a6d00e0 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 started sync module instance, tier type = 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 20 started zone id=4654bfe8-cc1b-4e5c-898b-5aaaee650498 (name=default) with tier type = 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d42a0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 10 ==== osd_op_reply(44 notify.0 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94349600570880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d4650 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.844+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d4280 con 0x55cf7a6c9e20 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.848+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94349600570880] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.848+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 17 ==== osd_op_reply(46 notify.1 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.848+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94349600575616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d5a10 con 0x55cf7a6c9e20 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.848+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d6380 con 0x55cf7a6d00e0 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94349600575616] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 12 ==== osd_op_reply(48 notify.2 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94349600579296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d66e0 con 0x55cf7a6d00e0 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d7050 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 12 ==== osd_op_reply(50 notify.3 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94349600582848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d78d0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d82c0 con 0x55cf7a6c9e20 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.852+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94349600579296] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94349600582848] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 19 ==== osd_op_reply(52 notify.4 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94349600587168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d7430 con 0x55cf7a6c9e20 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d8b10 con 0x7fdcc40141e0 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94349600587168] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 8 ==== osd_op_reply(54 notify.5 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94349600576672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d7430 con 0x7fdcc40141e0 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.856+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d8fb0 con 0x7fdcc40141e0 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.860+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94349600576672] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.860+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 10 ==== osd_op_reply(56 notify.6 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.860+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94349600590512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d8f70 con 0x7fdcc40141e0 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.860+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d9970 con 0x7fdcc40141e0 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94349600590512] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 12 ==== osd_op_reply(58 notify.7 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94349600593008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d9930 con 0x7fdcc40141e0 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=0 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=1 2024-02-18T16:22:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=2 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=3 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=4 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=5 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=6 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94349600593008] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 20 add_watcher() i=7 2024-02-18T16:22:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 2 all 8 watchers are set, enabling cache 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6dcde0 con 0x55cf7a6c9e20 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.864+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94349600588880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6da2c0 con 0x55cf7a6c9e20 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94349600588880] v32'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdb81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdccdbb7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-18T16:22:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdccdbb7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-18T16:22:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6dc740 con 0x55cf7a6c9e20 2024-02-18T16:22:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.868+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6dc700 con 0x7fdcc40141e0 2024-02-18T16:22:43.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.872+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.872+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e5e40 con 0x55cf7a6d00e0 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.872+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.872+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e62e0 con 0x55cf7a6c9e20 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.876+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'241 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.876+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e6540 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.876+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.876+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e6b10 con 0x55cf7a6d00e0 2024-02-18T16:22:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.876+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.876+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.880+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.880+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7040 con 0x7fdcc40141e0 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.880+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.880+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.884+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.884+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7590 con 0x55cf7a6d00e0 2024-02-18T16:22:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.884+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.884+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7ac0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.884+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.884+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7ff0 con 0x7fdcc40141e0 2024-02-18T16:22:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.888+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.888+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e7ff0 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.888+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.888+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc40141e0 2024-02-18T16:22:43.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.892+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.892+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6c9e20 2024-02-18T16:22:43.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.892+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'242 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.892+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.892+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.901 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.892+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.902 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.896+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.896+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.896+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.896+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6c9e20 2024-02-18T16:22:43.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.900+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.900+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6c9e20 2024-02-18T16:22:43.907 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.900+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'243 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.900+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.900+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.900+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.904+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.904+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.904+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.912 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.904+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.904+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.904+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.908+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.908+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.908+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.908+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc40141e0 2024-02-18T16:22:43.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.908+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.908+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.912+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'33 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.918 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.912+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc40141e0 2024-02-18T16:22:43.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.912+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.920 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.912+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x55cf7a6d00e0 2024-02-18T16:22:43.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.916+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.922 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.916+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc40141e0 2024-02-18T16:22:43.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.916+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.924 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.916+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e8490 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdb80fe1640 20 reqs_thread_entry: start 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 20 init_complete bucket index max shards: 11 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 20 Filter name: none 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdafa7fc640 20 reqs_thread_entry: start 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:94 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 21 ==== osd_op_reply(94 gc.16 [call] v32'80 uv80 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:95 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 22 ==== osd_op_reply(95 gc.16 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:96 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 23 ==== osd_op_reply(96 gc.16 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:97 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 24 ==== osd_op_reply(97 gc.16 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.932 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:98 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 25 ==== osd_op_reply(98 gc.16 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.920+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:99 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 26 ==== osd_op_reply(99 gc.16 [call] v32'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-18T16:22:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:100 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.935 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 26 ==== osd_op_reply(100 gc.17 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:101 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 27 ==== osd_op_reply(101 gc.17 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:102 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 28 ==== osd_op_reply(102 gc.17 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:103 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 29 ==== osd_op_reply(103 gc.17 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:104 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 30 ==== osd_op_reply(104 gc.17 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.924+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:105 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.937 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 31 ==== osd_op_reply(105 gc.17 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-18T16:22:43.938 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:106 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 29 ==== osd_op_reply(106 gc.18 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:107 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 30 ==== osd_op_reply(107 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:108 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6c9e20 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 31 ==== osd_op_reply(108 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.928+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:109 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 32 ==== osd_op_reply(109 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:110 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 33 ==== osd_op_reply(110 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:111 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 34 ==== osd_op_reply(111 gc.18 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-18T16:22:43.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.932+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:112 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 35 ==== osd_op_reply(112 gc.19 [call] v32'244 uv244 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:113 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 36 ==== osd_op_reply(113 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:114 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6c9e20 2024-02-18T16:22:43.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 37 ==== osd_op_reply(114 gc.19 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:115 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 38 ==== osd_op_reply(115 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:116 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 39 ==== osd_op_reply(116 gc.19 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:117 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:43.948 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 40 ==== osd_op_reply(117 gc.19 [call] v32'245 uv245 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.936+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:118 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 32 ==== osd_op_reply(118 gc.20 [call] v32'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:119 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 33 ==== osd_op_reply(119 gc.20 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:120 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 34 ==== osd_op_reply(120 gc.20 [call out=24b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:121 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 35 ==== osd_op_reply(121 gc.20 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:122 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 36 ==== osd_op_reply(122 gc.20 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.950 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.940+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:123 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 37 ==== osd_op_reply(123 gc.20 [call] v32'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-18T16:22:43.951 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:124 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 27 ==== osd_op_reply(124 gc.21 [call] v32'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.952 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:125 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 28 ==== osd_op_reply(125 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.953 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:126 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 29 ==== osd_op_reply(126 gc.21 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:127 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 30 ==== osd_op_reply(127 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.954 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.944+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:128 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 31 ==== osd_op_reply(128 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:129 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.955 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 32 ==== osd_op_reply(129 gc.21 [call] v32'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:43.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-18T16:22:43.956 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:130 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 38 ==== osd_op_reply(130 gc.22 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:131 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 39 ==== osd_op_reply(131 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:132 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.957 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 40 ==== osd_op_reply(132 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:133 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.958 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 41 ==== osd_op_reply(133 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.948+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:134 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 42 ==== osd_op_reply(134 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.959 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:135 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 43 ==== osd_op_reply(135 gc.22 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-18T16:22:43.960 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:136 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 44 ==== osd_op_reply(136 gc.23 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.961 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:137 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 45 ==== osd_op_reply(137 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.952+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:138 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.962 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 46 ==== osd_op_reply(138 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:139 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 47 ==== osd_op_reply(139 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.963 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:140 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 48 ==== osd_op_reply(140 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:141 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 49 ==== osd_op_reply(141 gc.23 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.964 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-18T16:22:43.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:142 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 50 ==== osd_op_reply(142 gc.24 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.956+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:143 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 51 ==== osd_op_reply(143 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:144 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 52 ==== osd_op_reply(144 gc.24 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:145 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 53 ==== osd_op_reply(145 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:146 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 54 ==== osd_op_reply(146 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.968 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:147 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 55 ==== osd_op_reply(147 gc.24 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-18T16:22:43.969 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.960+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:148 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 56 ==== osd_op_reply(148 gc.25 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.970 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:149 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 57 ==== osd_op_reply(149 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:150 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 58 ==== osd_op_reply(150 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:151 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 59 ==== osd_op_reply(151 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.972 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:152 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 60 ==== osd_op_reply(152 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.973 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:153 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 61 ==== osd_op_reply(153 gc.25 [call] v32'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-18T16:22:43.974 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.964+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:154 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 21 ==== osd_op_reply(154 gc.26 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.975 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:155 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 22 ==== osd_op_reply(155 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.976 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:43.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 23 ==== osd_op_reply(156 gc.26 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.977 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 24 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.968+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.972+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 25 ==== osd_op_reply(158 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.972+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.972+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:159 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.972+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 26 ==== osd_op_reply(159 gc.26 [call] v32'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.972+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-18T16:22:43.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.972+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:160 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 62 ==== osd_op_reply(160 gc.27 [call] v32'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:161 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 63 ==== osd_op_reply(161 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:162 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 64 ==== osd_op_reply(162 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:163 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 65 ==== osd_op_reply(163 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:164 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 66 ==== osd_op_reply(164 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:165 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 67 ==== osd_op_reply(165 gc.27 [call] v32'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.986 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-18T16:22:43.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.976+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:166 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 27 ==== osd_op_reply(166 gc.28 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:167 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 28 ==== osd_op_reply(167 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:168 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:43.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 29 ==== osd_op_reply(168 gc.28 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:169 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:43.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 30 ==== osd_op_reply(169 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.980+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:170 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:43.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.984+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 31 ==== osd_op_reply(170 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.984+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.984+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:171 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:43.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.984+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 32 ==== osd_op_reply(171 gc.28 [call] v32'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:43.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.984+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-18T16:22:43.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.984+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:172 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 68 ==== osd_op_reply(172 gc.29 [call] v32'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:173 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 69 ==== osd_op_reply(173 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:174 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:43.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 70 ==== osd_op_reply(174 gc.29 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:175 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 71 ==== osd_op_reply(175 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:43.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:176 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 72 ==== osd_op_reply(176 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:43.997 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.988+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:177 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:43.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 73 ==== osd_op_reply(177 gc.29 [call] v32'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:43.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-18T16:22:43.998 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:178 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 33 ==== osd_op_reply(178 gc.30 [call] v32'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.000 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:179 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 34 ==== osd_op_reply(179 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.001 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:180 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 35 ==== osd_op_reply(180 gc.30 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.992+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:181 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 36 ==== osd_op_reply(181 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:182 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 37 ==== osd_op_reply(182 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:183 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 38 ==== osd_op_reply(183 gc.30 [call] v32'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-18T16:22:44.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:43.996+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:184 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 33 ==== osd_op_reply(184 gc.31 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:185 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 34 ==== osd_op_reply(185 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:186 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 35 ==== osd_op_reply(186 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.009 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 37 ==== osd_op_reply(188 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.010 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.000+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.004+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 38 ==== osd_op_reply(189 gc.31 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.004+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-18T16:22:44.011 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.004+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:190 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.004+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 41 ==== osd_op_reply(190 gc.0 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:191 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.014 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 42 ==== osd_op_reply(191 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.015 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:192 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6c9e20 2024-02-18T16:22:44.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 43 ==== osd_op_reply(192 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:193 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 44 ==== osd_op_reply(193 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.016 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:194 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 45 ==== osd_op_reply(194 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.017 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.008+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:195 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 46 ==== osd_op_reply(195 gc.0 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-18T16:22:44.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:196 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.020 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 39 ==== osd_op_reply(196 gc.1 [call] v32'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:197 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 40 ==== osd_op_reply(197 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.021 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.012+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:198 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 41 ==== osd_op_reply(198 gc.1 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.022 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:199 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 42 ==== osd_op_reply(199 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.023 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:200 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 43 ==== osd_op_reply(200 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.024 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.016+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:201 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 44 ==== osd_op_reply(201 gc.1 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.026 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-18T16:22:44.027 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:202 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 74 ==== osd_op_reply(202 gc.2 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:203 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.028 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 75 ==== osd_op_reply(203 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.029 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 76 ==== osd_op_reply(204 gc.2 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.030 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 77 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 78 ==== osd_op_reply(206 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.031 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.020+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:207 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 79 ==== osd_op_reply(207 gc.2 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-18T16:22:44.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:208 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 47 ==== osd_op_reply(208 gc.3 [call] v32'246 uv246 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.033 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:209 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.034 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 48 ==== osd_op_reply(209 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.024+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:210 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6c9e20 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 49 ==== osd_op_reply(210 gc.3 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:211 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 50 ==== osd_op_reply(211 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:212 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 51 ==== osd_op_reply(212 gc.3 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.036 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:213 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 52 ==== osd_op_reply(213 gc.3 [call] v32'247 uv247 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-18T16:22:44.037 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.028+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:214 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 39 ==== osd_op_reply(214 gc.4 [call] v32'82 uv82 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.038 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:215 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 40 ==== osd_op_reply(215 gc.4 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:216 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 41 ==== osd_op_reply(216 gc.4 [call out=24b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:217 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 42 ==== osd_op_reply(217 gc.4 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:218 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 43 ==== osd_op_reply(218 gc.4 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:219 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 44 ==== osd_op_reply(219 gc.4 [call] v32'83 uv83 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-18T16:22:44.043 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.032+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:220 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 80 ==== osd_op_reply(220 gc.5 [call] v32'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:221 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 81 ==== osd_op_reply(221 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.044 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:222 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 82 ==== osd_op_reply(222 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:223 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 83 ==== osd_op_reply(223 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:224 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 84 ==== osd_op_reply(224 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.036+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:225 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.040+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 85 ==== osd_op_reply(225 gc.5 [call] v32'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.047 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.040+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-18T16:22:44.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.040+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:226 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.040+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 53 ==== osd_op_reply(226 gc.6 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.049 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.040+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:227 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 54 ==== osd_op_reply(227 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.051 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:228 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6c9e20 2024-02-18T16:22:44.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 55 ==== osd_op_reply(228 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:229 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 56 ==== osd_op_reply(229 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:230 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 57 ==== osd_op_reply(230 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.053 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.044+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:231 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 58 ==== osd_op_reply(231 gc.6 [call] v32'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-18T16:22:44.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:232 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 45 ==== osd_op_reply(232 gc.7 [call] v32'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:233 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 46 ==== osd_op_reply(233 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.048+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:234 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 47 ==== osd_op_reply(234 gc.7 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:235 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 48 ==== osd_op_reply(235 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:236 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 49 ==== osd_op_reply(236 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.052+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:237 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.056+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 50 ==== osd_op_reply(237 gc.7 [call] v32'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.056+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-18T16:22:44.064 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.056+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:238 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 45 ==== osd_op_reply(238 gc.8 [call] v32'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.066 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:239 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 46 ==== osd_op_reply(239 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:240 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 47 ==== osd_op_reply(240 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.067 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:241 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 48 ==== osd_op_reply(241 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.068 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:242 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 49 ==== osd_op_reply(242 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.069 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.060+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:243 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.064+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 50 ==== osd_op_reply(243 gc.8 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.064+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-18T16:22:44.073 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.064+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:244 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.074 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 86 ==== osd_op_reply(244 gc.9 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:245 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.075 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 87 ==== osd_op_reply(245 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:246 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 88 ==== osd_op_reply(246 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:247 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 89 ==== osd_op_reply(247 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:248 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 90 ==== osd_op_reply(248 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.068+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:249 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.072+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 91 ==== osd_op_reply(249 gc.9 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.072+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-18T16:22:44.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.072+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:250 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.072+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 51 ==== osd_op_reply(250 gc.10 [call] v32'84 uv84 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.072+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:251 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 52 ==== osd_op_reply(251 gc.10 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:252 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 53 ==== osd_op_reply(252 gc.10 [call out=24b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:253 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 54 ==== osd_op_reply(253 gc.10 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:254 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 55 ==== osd_op_reply(254 gc.10 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.085 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.076+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:255 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.080+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 56 ==== osd_op_reply(255 gc.10 [call] v32'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.080+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-18T16:22:44.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.080+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:256 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.080+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 51 ==== osd_op_reply(256 gc.11 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.080+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:257 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 52 ==== osd_op_reply(257 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:258 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 53 ==== osd_op_reply(258 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:259 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 54 ==== osd_op_reply(259 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:260 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 55 ==== osd_op_reply(260 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.084+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:261 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.088+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 56 ==== osd_op_reply(261 gc.11 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.088+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-18T16:22:44.095 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.088+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:262 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.088+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 57 ==== osd_op_reply(262 gc.12 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.097 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.088+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:263 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 58 ==== osd_op_reply(263 gc.12 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.098 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:264 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 59 ==== osd_op_reply(264 gc.12 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.099 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:265 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 60 ==== osd_op_reply(265 gc.12 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:266 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.100 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 61 ==== osd_op_reply(266 gc.12 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.101 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.092+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:267 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.102 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.096+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 62 ==== osd_op_reply(267 gc.12 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.096+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-18T16:22:44.103 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.096+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:268 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.096+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 57 ==== osd_op_reply(268 gc.13 [call] v32'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.105 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.096+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:269 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 58 ==== osd_op_reply(269 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:270 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x7fdcc40141e0 2024-02-18T16:22:44.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 59 ==== osd_op_reply(270 gc.13 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:271 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 60 ==== osd_op_reply(271 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:272 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 61 ==== osd_op_reply(272 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.108 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.109 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.100+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:273 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x7fdcc40141e0 2024-02-18T16:22:44.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.104+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 62 ==== osd_op_reply(273 gc.13 [call] v32'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.104+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-18T16:22:44.111 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.104+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:274 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.104+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 59 ==== osd_op_reply(274 gc.14 [call] v32'248 uv248 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.104+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:275 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 60 ==== osd_op_reply(275 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.114 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:276 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6c9e20 2024-02-18T16:22:44.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 61 ==== osd_op_reply(276 gc.14 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.115 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:277 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 62 ==== osd_op_reply(277 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.116 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:278 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 63 ==== osd_op_reply(278 gc.14 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.108+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:279 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6c9e20 2024-02-18T16:22:44.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.112+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 64 ==== osd_op_reply(279 gc.14 [call] v32'249 uv249 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.112+0000 7fdccdbb7980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-18T16:22:44.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.112+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:280 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.112+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 92 ==== osd_op_reply(280 gc.15 [call] v32'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.112+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:281 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 93 ==== osd_op_reply(281 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:282 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 94 ==== osd_op_reply(282 gc.15 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:283 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 95 ==== osd_op_reply(283 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-18T16:22:44.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:284 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e3750 con 0x55cf7a6d00e0 2024-02-18T16:22:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 96 ==== osd_op_reply(284 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-18T16:22:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.116+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:285 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e4760 con 0x55cf7a6d00e0 2024-02-18T16:22:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.120+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 97 ==== osd_op_reply(285 gc.15 [call] v32'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.120+0000 7fdb81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-18T16:22:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.120+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94349600588880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6e2130 con 0x55cf7a6c9e20 2024-02-18T16:22:44.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.124+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 65 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94349600588880] v32'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.131 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.124+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94349600570880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d8450 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.124+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 63 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94349600570880] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.124+0000 7fdccdbb7980 20 remove_watcher() i=0 2024-02-18T16:22:44.133 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.124+0000 7fdccdbb7980 2 removed watcher, disabling cache 2024-02-18T16:22:44.134 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.124+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94349600575616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d3e00 con 0x55cf7a6c9e20 2024-02-18T16:22:44.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.128+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 66 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94349600575616] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.128+0000 7fdccdbb7980 20 remove_watcher() i=1 2024-02-18T16:22:44.136 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.128+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94349600579296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d3e00 con 0x55cf7a6d00e0 2024-02-18T16:22:44.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.132+0000 7fdccaed1640 1 -- 172.21.15.129:0/1791072589 <== osd.3 v2:172.21.15.129:6800/2085458436 98 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94349600579296] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc00b0020 con 0x55cf7a6d00e0 2024-02-18T16:22:44.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.132+0000 7fdccdbb7980 20 remove_watcher() i=2 2024-02-18T16:22:44.138 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.132+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94349600582848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d3e00 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.132+0000 7fdccbed3640 1 -- 172.21.15.129:0/1791072589 <== osd.2 v2:172.21.15.129:6808/222672308 64 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94349600582848] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcc403a040 con 0x7fdcc00bc3b0 2024-02-18T16:22:44.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.132+0000 7fdccdbb7980 20 remove_watcher() i=3 2024-02-18T16:22:44.140 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.132+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94349600587168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d6cc0 con 0x55cf7a6c9e20 2024-02-18T16:22:44.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.136+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.1 v2:172.21.15.129:6816/834716550 67 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94349600587168] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x55cf7a6c9e20 2024-02-18T16:22:44.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.136+0000 7fdccdbb7980 20 remove_watcher() i=4 2024-02-18T16:22:44.143 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.136+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94349600576672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d3e00 con 0x7fdcc40141e0 2024-02-18T16:22:44.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.140+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 63 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94349600576672] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.140+0000 7fdccdbb7980 20 remove_watcher() i=5 2024-02-18T16:22:44.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.140+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94349600590512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d3e00 con 0x7fdcc40141e0 2024-02-18T16:22:44.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.140+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 64 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94349600590512] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.140+0000 7fdccdbb7980 20 remove_watcher() i=6 2024-02-18T16:22:44.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.140+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94349600593008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf7a6d3e00 con 0x7fdcc40141e0 2024-02-18T16:22:44.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 <== osd.0 v2:172.21.15.80:6800/4245413050 65 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94349600593008] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdcbc04a040 con 0x7fdcc40141e0 2024-02-18T16:22:44.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 20 remove_watcher() i=7 2024-02-18T16:22:44.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdcc40141e0 msgr2=0x7fdcc4015940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fdcc40141e0 0x7fdcc4015940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6c9e20 msgr2=0x55cf7a6cc2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6c9e20 0x55cf7a6cc2e0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc00bc3b0 msgr2=0x7fdcc00073f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7fdcc00bc3b0 0x7fdcc00073f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cf7a6d00e0 msgr2=0x55cf7a6d24d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x55cf7a6d00e0 0x55cf7a6d24d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdb940342b0 msgr2=0x7fdb94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdb940342b0 0x7fdb94036770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55cf7a69b570 tx=0x7fdcc4020000 comp rx=0 tx=0).stop 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 msgr2=0x55cf7a6bebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/1791072589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6b7ce0 0x55cf7a6bebb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00de040 tx=0x7fdcc00e4ae0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 reap_dead start 2024-02-18T16:22:44.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccb6d2640 1 -- 172.21.15.129:0/1791072589 reap_dead start 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 shutdown_connections 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 >> 172.21.15.129:0/1791072589 conn(0x55cf7a6b4020 msgr2=0x55cf7a6b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 shutdown_connections 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/1791072589 wait complete. 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdba40342b0 msgr2=0x7fdba4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdba40342b0 0x7fdba4036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55cf7a69b4b0 tx=0x7fdcc4005850 comp rx=0 tx=0).stop 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 msgr2=0x55cf7a6ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.144+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 0x55cf7a6ab0b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0096f40 tx=0x7fdcc00180e0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 shutdown_connections 2024-02-18T16:22:44.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdba40342b0 0x7fdba4036770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/688953624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a6aac90 0x55cf7a6ab0b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 >> 172.21.15.129:0/688953624 conn(0x7fdcc4010000 msgr2=0x55cf7a6a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:44.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 shutdown_connections 2024-02-18T16:22:44.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/688953624 wait complete. 2024-02-18T16:22:44.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6982d0 msgr2=0x55cf7a69a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6982d0 0x55cf7a69a6c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdbb0034300 msgr2=0x7fdbb00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdbb0034300 0x7fdbb00367c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00ae000 tx=0x7fdcc00a6000 comp rx=0 tx=0).stop 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 msgr2=0x55cf7a693660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a693660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00f510 tx=0x7fdcbc000ee0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 shutdown_connections 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x55cf7a6982d0 0x55cf7a69a6c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdbb0034300 0x7fdbb00367c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 --2- 172.21.15.129:0/3078135148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55cf7a512b80 0x55cf7a693660 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 >> 172.21.15.129:0/3078135148 conn(0x55cf7a511a40 msgr2=0x55cf7a686e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:44.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 shutdown_connections 2024-02-18T16:22:44.160 INFO:teuthology.orchestra.run.smithi129.stderr:2024-02-18T16:22:44.148+0000 7fdccdbb7980 1 -- 172.21.15.129:0/3078135148 wait complete. 2024-02-18T16:22:44.170 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-18T16:22:44.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-18T16:22:44.179 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:22:44.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.300+0000 7fa08bcea640 1 Processor -- start 2024-02-18T16:22:44.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.300+0000 7fa08bcea640 1 -- start start 2024-02-18T16:22:44.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa08bcea640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa08409d7e0 0x7fa0841332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa08bcea640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa084099d80 con 0x7fa084098910 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa08bcea640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08409a340 con 0x7fa08409d7e0 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa089a86640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa084098910 0x7fa084098cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36598/0 (socket says 172.21.15.80:36598) 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa089285640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa08409d7e0 0x7fa0841332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa089a86640 1 -- 172.21.15.80:0/509562733 learned_addr learned my addr 172.21.15.80:0/509562733 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa088a84640 1 -- 172.21.15.80:0/509562733 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287568778 0 0) 0x7fa084099d80 con 0x7fa084098910 2024-02-18T16:22:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa088a84640 1 -- 172.21.15.80:0/509562733 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa070003530 con 0x7fa084098910 2024-02-18T16:22:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa089285640 1 -- 172.21.15.80:0/509562733 >> v1:172.21.15.80:6789/0 conn(0x7fa084098910 legacy=0x7fa084098cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa088a84640 1 -- 172.21.15.80:0/509562733 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3298924638 0 0) 0x7fa070003530 con 0x7fa084098910 2024-02-18T16:22:44.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.304+0000 7fa089285640 1 -- 172.21.15.80:0/509562733 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08409a5e0 con 0x7fa08409d7e0 2024-02-18T16:22:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa089285640 1 --2- 172.21.15.80:0/509562733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa08409d7e0 0x7fa0841332f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa074009740 tx=0x7fa07401c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b997a2563dfd37c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa088a84640 1 -- 172.21.15.80:0/509562733 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa080001930 con 0x7fa08409d7e0 2024-02-18T16:22:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa088a84640 1 -- 172.21.15.80:0/509562733 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0740a7050 con 0x7fa08409d7e0 2024-02-18T16:22:44.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa088a84640 1 -- 172.21.15.80:0/509562733 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0740ab550 con 0x7fa08409d7e0 2024-02-18T16:22:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 -- 172.21.15.80:0/509562733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa08409d7e0 msgr2=0x7fa0841332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 --2- 172.21.15.80:0/509562733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa08409d7e0 0x7fa0841332f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa074009740 tx=0x7fa07401c290 comp rx=0 tx=0).stop 2024-02-18T16:22:44.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 -- 172.21.15.80:0/509562733 shutdown_connections 2024-02-18T16:22:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 --2- 172.21.15.80:0/509562733 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa08409d7e0 0x7fa0841332f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 -- 172.21.15.80:0/509562733 >> 172.21.15.80:0/509562733 conn(0x7fa0840a0a00 msgr2=0x7fa08409cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 -- 172.21.15.80:0/509562733 shutdown_connections 2024-02-18T16:22:44.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.308+0000 7fa08bcea640 1 -- 172.21.15.80:0/509562733 wait complete. 2024-02-18T16:22:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 Processor -- start 2024-02-18T16:22:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 -- start start 2024-02-18T16:22:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 0x7fa0841c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084132af0 con 0x7fa084098910 2024-02-18T16:22:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089a86640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 0x7fa0841c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089a86640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 0x7fa0841c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52804/0 (socket says 172.21.15.80:52804) 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089a86640 1 -- 172.21.15.80:0/3201884102 learned_addr learned my addr 172.21.15.80:0/3201884102 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089a86640 1 -- 172.21.15.80:0/3201884102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009420 con 0x7fa084098910 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089a86640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 0x7fa0841c5940 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa08000cfc0 tx=0x7fa08000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa08000ad70 con 0x7fa084098910 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa080012400 con 0x7fa084098910 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0841323b0 con 0x7fa084098910 2024-02-18T16:22:44.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0800125b0 con 0x7fa084098910 2024-02-18T16:22:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa084131640 con 0x7fa084098910 2024-02-18T16:22:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa084131ae0 con 0x7fa084098910 2024-02-18T16:22:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa080007070 con 0x7fa084098910 2024-02-18T16:22:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa07a7fc640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa068035a10 0x7fa068037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:44.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fa0800489c0 con 0x7fa084098910 2024-02-18T16:22:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089285640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa068035a10 0x7fa068037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:44.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.312+0000 7fa089285640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa068035a10 0x7fa068037ed0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0740ad000 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:44.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.316+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0800198b0 con 0x7fa084098910 2024-02-18T16:22:44.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.472+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa084062860 con 0x7fa068035a10 2024-02-18T16:22:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.616+0000 7fa07a7fc640 1 -- 172.21.15.80:0/3201884102 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673657 (secure 0 0 0) 0x7fa084062860 con 0x7fa068035a10 2024-02-18T16:22:44.631 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:22:44.638 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:22:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa068035a10 msgr2=0x7fa068037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa068035a10 0x7fa068037ed0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0740ad000 tx=0x7fa074008040 comp rx=0 tx=0).stop 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 msgr2=0x7fa0841c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 0x7fa0841c5940 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa08000cfc0 tx=0x7fa08000a430 comp rx=0 tx=0).stop 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 shutdown_connections 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fa068035a10 0x7fa068037ed0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 --2- 172.21.15.80:0/3201884102 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa084098910 0x7fa0841c5940 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 >> 172.21.15.80:0/3201884102 conn(0x7fa0840a0a00 msgr2=0x7fa08412bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 shutdown_connections 2024-02-18T16:22:44.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.624+0000 7fa08bcea640 1 -- 172.21.15.80:0/3201884102 wait complete. 2024-02-18T16:22:44.666 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-18T16:22:43.804876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950367+0000","last_change":"2024-02-18T16:20:59.848322+0000","last_active":"2024-02-18T16:21:40.950367+0000","last_peered":"2024-02-18T16:21:40.950367+0000","last_clean":"2024-02-18T16:21:40.950367+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:21:40.950367+0000","last_undegraded":"2024-02-18T16:21:40.950367+0000","last_fullsized":"2024-02-18T16:21:40.950367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436673+0000","last_change":"2024-02-18T16:21:01.837422+0000","last_active":"2024-02-18T16:21:46.436673+0000","last_peered":"2024-02-18T16:21:46.436673+0000","last_clean":"2024-02-18T16:21:46.436673+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:21:46.436673+0000","last_undegraded":"2024-02-18T16:21:46.436673+0000","last_fullsized":"2024-02-18T16:21:46.436673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180695+0000","last_change":"2024-02-18T16:20:59.862127+0000","last_active":"2024-02-18T16:21:41.180695+0000","last_peered":"2024-02-18T16:21:41.180695+0000","last_clean":"2024-02-18T16:21:41.180695+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:21:41.180695+0000","last_undegraded":"2024-02-18T16:21:41.180695+0000","last_fullsized":"2024-02-18T16:21:41.180695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165685+0000","last_change":"2024-02-18T16:21:01.856123+0000","last_active":"2024-02-18T16:21:47.165685+0000","last_peered":"2024-02-18T16:21:47.165685+0000","last_clean":"2024-02-18T16:21:47.165685+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:21:47.165685+0000","last_undegraded":"2024-02-18T16:21:47.165685+0000","last_fullsized":"2024-02-18T16:21:47.165685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:42.640579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952271+0000","last_change":"2024-02-18T16:20:59.872708+0000","last_active":"2024-02-18T16:21:40.952271+0000","last_peered":"2024-02-18T16:21:40.952271+0000","last_clean":"2024-02-18T16:21:40.952271+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:21:40.952271+0000","last_undegraded":"2024-02-18T16:21:40.952271+0000","last_fullsized":"2024-02-18T16:21:40.952271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:12.199846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456931+0000","last_change":"2024-02-18T16:21:01.856474+0000","last_active":"2024-02-18T16:22:30.456931+0000","last_peered":"2024-02-18T16:22:30.456931+0000","last_clean":"2024-02-18T16:22:30.456931+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:22:30.456931+0000","last_undegraded":"2024-02-18T16:22:30.456931+0000","last_fullsized":"2024-02-18T16:22:30.456931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:13.748546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938237+0000","last_change":"2024-02-18T16:20:59.833010+0000","last_active":"2024-02-18T16:21:40.938237+0000","last_peered":"2024-02-18T16:21:40.938237+0000","last_clean":"2024-02-18T16:21:40.938237+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:21:40.938237+0000","last_undegraded":"2024-02-18T16:21:40.938237+0000","last_fullsized":"2024-02-18T16:21:40.938237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457019+0000","last_change":"2024-02-18T16:21:01.857441+0000","last_active":"2024-02-18T16:22:30.457019+0000","last_peered":"2024-02-18T16:22:30.457019+0000","last_clean":"2024-02-18T16:22:30.457019+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:22:30.457019+0000","last_undegraded":"2024-02-18T16:22:30.457019+0000","last_fullsized":"2024-02-18T16:22:30.457019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:02.458464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949134+0000","last_change":"2024-02-18T16:20:59.868597+0000","last_active":"2024-02-18T16:21:40.949134+0000","last_peered":"2024-02-18T16:21:40.949134+0000","last_clean":"2024-02-18T16:21:40.949134+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:21:40.949134+0000","last_undegraded":"2024-02-18T16:21:40.949134+0000","last_fullsized":"2024-02-18T16:21:40.949134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:31.249657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085312+0000","last_change":"2024-02-18T16:21:01.836895+0000","last_active":"2024-02-18T16:22:36.085312+0000","last_peered":"2024-02-18T16:22:36.085312+0000","last_clean":"2024-02-18T16:22:36.085312+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:22:36.085312+0000","last_undegraded":"2024-02-18T16:22:36.085312+0000","last_fullsized":"2024-02-18T16:22:36.085312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:15.712412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937535+0000","last_change":"2024-02-18T16:20:59.827833+0000","last_active":"2024-02-18T16:21:40.937535+0000","last_peered":"2024-02-18T16:21:40.937535+0000","last_clean":"2024-02-18T16:21:40.937535+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:21:40.937535+0000","last_undegraded":"2024-02-18T16:21:40.937535+0000","last_fullsized":"2024-02-18T16:21:40.937535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.868753+0000","last_change":"2024-02-18T16:21:01.856191+0000","last_active":"2024-02-18T16:21:47.868753+0000","last_peered":"2024-02-18T16:21:47.868753+0000","last_clean":"2024-02-18T16:21:47.868753+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:21:47.868753+0000","last_undegraded":"2024-02-18T16:21:47.868753+0000","last_fullsized":"2024-02-18T16:21:47.868753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:03.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.077672+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:36.077672+0000","last_peered":"2024-02-18T16:22:36.077672+0000","last_clean":"2024-02-18T16:22:36.077672+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:36.077672+0000","last_undegraded":"2024-02-18T16:22:36.077672+0000","last_fullsized":"2024-02-18T16:22:36.077672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:39:01.643786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085590+0000","last_change":"2024-02-18T16:21:01.831792+0000","last_active":"2024-02-18T16:22:36.085590+0000","last_peered":"2024-02-18T16:22:36.085590+0000","last_clean":"2024-02-18T16:22:36.085590+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:22:36.085590+0000","last_undegraded":"2024-02-18T16:22:36.085590+0000","last_fullsized":"2024-02-18T16:22:36.085590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174557+0000","last_change":"2024-02-18T16:20:59.851482+0000","last_active":"2024-02-18T16:21:41.174557+0000","last_peered":"2024-02-18T16:21:41.174557+0000","last_clean":"2024-02-18T16:21:41.174557+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:21:41.174557+0000","last_undegraded":"2024-02-18T16:21:41.174557+0000","last_fullsized":"2024-02-18T16:21:41.174557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871870+0000","last_change":"2024-02-18T16:21:01.845622+0000","last_active":"2024-02-18T16:21:46.871870+0000","last_peered":"2024-02-18T16:21:46.871870+0000","last_clean":"2024-02-18T16:21:46.871870+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:21:46.871870+0000","last_undegraded":"2024-02-18T16:21:46.871870+0000","last_fullsized":"2024-02-18T16:21:46.871870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471613+0000","last_change":"2024-02-18T16:21:01.852206+0000","last_active":"2024-02-18T16:22:30.471613+0000","last_peered":"2024-02-18T16:22:30.471613+0000","last_clean":"2024-02-18T16:22:30.471613+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:22:30.471613+0000","last_undegraded":"2024-02-18T16:22:30.471613+0000","last_fullsized":"2024-02-18T16:22:30.471613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:45.548759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946674+0000","last_change":"2024-02-18T16:20:59.861096+0000","last_active":"2024-02-18T16:21:40.946674+0000","last_peered":"2024-02-18T16:21:40.946674+0000","last_clean":"2024-02-18T16:21:40.946674+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:21:40.946674+0000","last_undegraded":"2024-02-18T16:21:40.946674+0000","last_fullsized":"2024-02-18T16:21:40.946674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457228+0000","last_change":"2024-02-18T16:21:01.833772+0000","last_active":"2024-02-18T16:22:30.457228+0000","last_peered":"2024-02-18T16:22:30.457228+0000","last_clean":"2024-02-18T16:22:30.457228+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:22:30.457228+0000","last_undegraded":"2024-02-18T16:22:30.457228+0000","last_fullsized":"2024-02-18T16:22:30.457228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954107+0000","last_change":"2024-02-18T16:20:59.858318+0000","last_active":"2024-02-18T16:21:40.954107+0000","last_peered":"2024-02-18T16:21:40.954107+0000","last_clean":"2024-02-18T16:21:40.954107+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:21:40.954107+0000","last_undegraded":"2024-02-18T16:21:40.954107+0000","last_fullsized":"2024-02-18T16:21:40.954107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085421+0000","last_change":"2024-02-18T16:21:01.848259+0000","last_active":"2024-02-18T16:22:36.085421+0000","last_peered":"2024-02-18T16:22:36.085421+0000","last_clean":"2024-02-18T16:22:36.085421+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:22:36.085421+0000","last_undegraded":"2024-02-18T16:22:36.085421+0000","last_fullsized":"2024-02-18T16:22:36.085421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.151295+0000","last_change":"2024-02-18T16:20:59.862404+0000","last_active":"2024-02-18T16:21:47.151295+0000","last_peered":"2024-02-18T16:21:47.151295+0000","last_clean":"2024-02-18T16:21:47.151295+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:21:47.151295+0000","last_undegraded":"2024-02-18T16:21:47.151295+0000","last_fullsized":"2024-02-18T16:21:47.151295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085319+0000","last_change":"2024-02-18T16:21:01.844448+0000","last_active":"2024-02-18T16:22:36.085319+0000","last_peered":"2024-02-18T16:22:36.085319+0000","last_clean":"2024-02-18T16:22:36.085319+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:22:36.085319+0000","last_undegraded":"2024-02-18T16:22:36.085319+0000","last_fullsized":"2024-02-18T16:22:36.085319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929557+0000","last_change":"2024-02-18T16:20:59.861087+0000","last_active":"2024-02-18T16:21:40.929557+0000","last_peered":"2024-02-18T16:21:40.929557+0000","last_clean":"2024-02-18T16:21:40.929557+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:21:40.929557+0000","last_undegraded":"2024-02-18T16:21:40.929557+0000","last_fullsized":"2024-02-18T16:21:40.929557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605978+0000","last_change":"2024-02-18T16:21:01.849052+0000","last_active":"2024-02-18T16:22:29.605978+0000","last_peered":"2024-02-18T16:22:29.605978+0000","last_clean":"2024-02-18T16:22:29.605978+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:22:29.605978+0000","last_undegraded":"2024-02-18T16:22:29.605978+0000","last_fullsized":"2024-02-18T16:22:29.605978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.157404+0000","last_change":"2024-02-18T16:20:59.860613+0000","last_active":"2024-02-18T16:21:47.157404+0000","last_peered":"2024-02-18T16:21:47.157404+0000","last_clean":"2024-02-18T16:21:47.157404+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:21:47.157404+0000","last_undegraded":"2024-02-18T16:21:47.157404+0000","last_fullsized":"2024-02-18T16:21:47.157404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085347+0000","last_change":"2024-02-18T16:21:01.838527+0000","last_active":"2024-02-18T16:22:36.085347+0000","last_peered":"2024-02-18T16:22:36.085347+0000","last_clean":"2024-02-18T16:22:36.085347+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:22:36.085347+0000","last_undegraded":"2024-02-18T16:22:36.085347+0000","last_fullsized":"2024-02-18T16:22:36.085347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:26.235100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940659+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:21:40.940659+0000","last_peered":"2024-02-18T16:21:40.940659+0000","last_clean":"2024-02-18T16:21:40.940659+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:21:40.940659+0000","last_undegraded":"2024-02-18T16:21:40.940659+0000","last_fullsized":"2024-02-18T16:21:40.940659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.743095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.071636+0000","last_change":"2024-02-18T16:21:09.915975+0000","last_active":"2024-02-18T16:22:36.071636+0000","last_peered":"2024-02-18T16:22:36.071636+0000","last_clean":"2024-02-18T16:22:36.071636+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:22:36.071636+0000","last_undegraded":"2024-02-18T16:22:36.071636+0000","last_fullsized":"2024-02-18T16:22:36.071636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:47.379422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605701+0000","last_change":"2024-02-18T16:21:01.853570+0000","last_active":"2024-02-18T16:22:29.605701+0000","last_peered":"2024-02-18T16:22:29.605701+0000","last_clean":"2024-02-18T16:22:29.605701+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:22:29.605701+0000","last_undegraded":"2024-02-18T16:22:29.605701+0000","last_fullsized":"2024-02-18T16:22:29.605701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:25.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.140958+0000","last_change":"2024-02-18T16:20:59.871560+0000","last_active":"2024-02-18T16:21:47.140958+0000","last_peered":"2024-02-18T16:21:47.140958+0000","last_clean":"2024-02-18T16:21:47.140958+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:21:47.140958+0000","last_undegraded":"2024-02-18T16:21:47.140958+0000","last_fullsized":"2024-02-18T16:21:47.140958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:22.719740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950984+0000","last_change":"2024-02-18T16:21:03.855757+0000","last_active":"2024-02-18T16:21:40.950984+0000","last_peered":"2024-02-18T16:21:40.950984+0000","last_clean":"2024-02-18T16:21:40.950984+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:21:40.950984+0000","last_undegraded":"2024-02-18T16:21:40.950984+0000","last_fullsized":"2024-02-18T16:21:40.950984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:32.293153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.407799+0000","last_change":"2024-02-18T16:21:05.901603+0000","last_active":"2024-02-18T16:22:30.407799+0000","last_peered":"2024-02-18T16:22:30.407799+0000","last_clean":"2024-02-18T16:22:30.407799+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:22:30.407799+0000","last_undegraded":"2024-02-18T16:22:30.407799+0000","last_fullsized":"2024-02-18T16:22:30.407799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:06:03.628864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946001+0000","last_change":"2024-02-18T16:21:07.918527+0000","last_active":"2024-02-18T16:21:40.946001+0000","last_peered":"2024-02-18T16:21:40.946001+0000","last_clean":"2024-02-18T16:21:40.946001+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:21:40.946001+0000","last_undegraded":"2024-02-18T16:21:40.946001+0000","last_fullsized":"2024-02-18T16:21:40.946001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.550475+0000","last_change":"2024-02-18T16:21:09.916272+0000","last_active":"2024-02-18T16:22:24.550475+0000","last_peered":"2024-02-18T16:22:24.550475+0000","last_clean":"2024-02-18T16:22:24.550475+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:22:24.550475+0000","last_undegraded":"2024-02-18T16:22:24.550475+0000","last_fullsized":"2024-02-18T16:22:24.550475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951709+0000","last_change":"2024-02-18T16:21:01.856905+0000","last_active":"2024-02-18T16:21:40.951709+0000","last_peered":"2024-02-18T16:21:40.951709+0000","last_clean":"2024-02-18T16:21:40.951709+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:21:40.951709+0000","last_undegraded":"2024-02-18T16:21:40.951709+0000","last_fullsized":"2024-02-18T16:21:40.951709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:29.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936829+0000","last_change":"2024-02-18T16:20:59.829726+0000","last_active":"2024-02-18T16:21:40.936829+0000","last_peered":"2024-02-18T16:21:40.936829+0000","last_clean":"2024-02-18T16:21:40.936829+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:21:40.936829+0000","last_undegraded":"2024-02-18T16:21:40.936829+0000","last_fullsized":"2024-02-18T16:21:40.936829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175923+0000","last_change":"2024-02-18T16:21:03.852211+0000","last_active":"2024-02-18T16:21:41.175923+0000","last_peered":"2024-02-18T16:21:41.175923+0000","last_clean":"2024-02-18T16:21:41.175923+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:21:41.175923+0000","last_undegraded":"2024-02-18T16:21:41.175923+0000","last_fullsized":"2024-02-18T16:21:41.175923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:26.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944532+0000","last_change":"2024-02-18T16:21:05.875530+0000","last_active":"2024-02-18T16:21:40.944532+0000","last_peered":"2024-02-18T16:21:40.944532+0000","last_clean":"2024-02-18T16:21:40.944532+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:21:40.944532+0000","last_undegraded":"2024-02-18T16:21:40.944532+0000","last_fullsized":"2024-02-18T16:21:40.944532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:31.379508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937157+0000","last_change":"2024-02-18T16:21:07.909691+0000","last_active":"2024-02-18T16:21:40.937157+0000","last_peered":"2024-02-18T16:21:40.937157+0000","last_clean":"2024-02-18T16:21:40.937157+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:21:40.937157+0000","last_undegraded":"2024-02-18T16:21:40.937157+0000","last_fullsized":"2024-02-18T16:21:40.937157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173888+0000","last_change":"2024-02-18T16:21:09.926133+0000","last_active":"2024-02-18T16:21:41.173888+0000","last_peered":"2024-02-18T16:21:41.173888+0000","last_clean":"2024-02-18T16:21:41.173888+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:21:41.173888+0000","last_undegraded":"2024-02-18T16:21:41.173888+0000","last_fullsized":"2024-02-18T16:21:41.173888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098429+0000","last_change":"2024-02-18T16:21:41.176291+0000","last_active":"2024-02-18T16:22:36.098429+0000","last_peered":"2024-02-18T16:22:36.098429+0000","last_clean":"2024-02-18T16:22:36.098429+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:22:36.098429+0000","last_undegraded":"2024-02-18T16:22:36.098429+0000","last_fullsized":"2024-02-18T16:22:36.098429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:36.303877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933821+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:21:40.933821+0000","last_peered":"2024-02-18T16:21:40.933821+0000","last_clean":"2024-02-18T16:21:40.933821+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:21:40.933821+0000","last_undegraded":"2024-02-18T16:21:40.933821+0000","last_fullsized":"2024-02-18T16:21:40.933821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:46:08.501321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956515+0000","last_change":"2024-02-18T16:21:40.955018+0000","last_active":"2024-02-18T16:21:40.956515+0000","last_peered":"2024-02-18T16:21:40.956515+0000","last_clean":"2024-02-18T16:21:40.956515+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:21:40.956515+0000","last_undegraded":"2024-02-18T16:21:40.956515+0000","last_fullsized":"2024-02-18T16:21:40.956515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:41.335446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937307+0000","last_change":"2024-02-18T16:21:05.895213+0000","last_active":"2024-02-18T16:21:40.937307+0000","last_peered":"2024-02-18T16:21:40.937307+0000","last_clean":"2024-02-18T16:21:40.937307+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:21:40.937307+0000","last_undegraded":"2024-02-18T16:21:40.937307+0000","last_fullsized":"2024-02-18T16:21:40.937307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:22.737750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":305,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.301651+0000","last_change":"2024-02-18T16:21:07.917843+0000","last_active":"2024-02-18T16:22:36.301651+0000","last_peered":"2024-02-18T16:22:36.301651+0000","last_clean":"2024-02-18T16:22:36.301651+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:22:36.301651+0000","last_undegraded":"2024-02-18T16:22:36.301651+0000","last_fullsized":"2024-02-18T16:22:36.301651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:42:39.457576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936747+0000","last_change":"2024-02-18T16:21:09.929317+0000","last_active":"2024-02-18T16:21:40.936747+0000","last_peered":"2024-02-18T16:21:40.936747+0000","last_clean":"2024-02-18T16:21:40.936747+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:21:40.936747+0000","last_undegraded":"2024-02-18T16:21:40.936747+0000","last_fullsized":"2024-02-18T16:21:40.936747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:09.795840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183777+0000","last_change":"2024-02-18T16:21:01.841643+0000","last_active":"2024-02-18T16:21:41.183777+0000","last_peered":"2024-02-18T16:21:41.183777+0000","last_clean":"2024-02-18T16:21:41.183777+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:21:41.183777+0000","last_undegraded":"2024-02-18T16:21:41.183777+0000","last_fullsized":"2024-02-18T16:21:41.183777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927879+0000","last_change":"2024-02-18T16:20:59.860132+0000","last_active":"2024-02-18T16:21:40.927879+0000","last_peered":"2024-02-18T16:21:40.927879+0000","last_clean":"2024-02-18T16:21:40.927879+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:21:40.927879+0000","last_undegraded":"2024-02-18T16:21:40.927879+0000","last_fullsized":"2024-02-18T16:21:40.927879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:46:23.673530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.960144+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:21:40.960144+0000","last_peered":"2024-02-18T16:21:40.960144+0000","last_clean":"2024-02-18T16:21:40.960144+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:21:40.960144+0000","last_undegraded":"2024-02-18T16:21:40.960144+0000","last_fullsized":"2024-02-18T16:21:40.960144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:24.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.399232+0000","last_change":"2024-02-18T16:21:05.888007+0000","last_active":"2024-02-18T16:22:30.399232+0000","last_peered":"2024-02-18T16:22:30.399232+0000","last_clean":"2024-02-18T16:22:30.399232+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:30.399232+0000","last_undegraded":"2024-02-18T16:22:30.399232+0000","last_fullsized":"2024-02-18T16:22:30.399232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:15.657774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.307880+0000","last_change":"2024-02-18T16:21:07.907499+0000","last_active":"2024-02-18T16:22:36.307880+0000","last_peered":"2024-02-18T16:22:36.307880+0000","last_clean":"2024-02-18T16:22:36.307880+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:22:36.307880+0000","last_undegraded":"2024-02-18T16:22:36.307880+0000","last_fullsized":"2024-02-18T16:22:36.307880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936628+0000","last_change":"2024-02-18T16:21:01.852914+0000","last_active":"2024-02-18T16:21:40.936628+0000","last_peered":"2024-02-18T16:21:40.936628+0000","last_clean":"2024-02-18T16:21:40.936628+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:21:40.936628+0000","last_undegraded":"2024-02-18T16:21:40.936628+0000","last_fullsized":"2024-02-18T16:21:40.936628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:11.629778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948658+0000","last_change":"2024-02-18T16:20:59.835343+0000","last_active":"2024-02-18T16:21:40.948658+0000","last_peered":"2024-02-18T16:21:40.948658+0000","last_clean":"2024-02-18T16:21:40.948658+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:21:40.948658+0000","last_undegraded":"2024-02-18T16:21:40.948658+0000","last_fullsized":"2024-02-18T16:21:40.948658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928167+0000","last_change":"2024-02-18T16:21:03.865004+0000","last_active":"2024-02-18T16:21:40.928167+0000","last_peered":"2024-02-18T16:21:40.928167+0000","last_clean":"2024-02-18T16:21:40.928167+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:21:40.928167+0000","last_undegraded":"2024-02-18T16:21:40.928167+0000","last_fullsized":"2024-02-18T16:21:40.928167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:19:00.973310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.415467+0000","last_change":"2024-02-18T16:21:05.885363+0000","last_active":"2024-02-18T16:22:30.415467+0000","last_peered":"2024-02-18T16:22:30.415467+0000","last_clean":"2024-02-18T16:22:30.415467+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:22:30.415467+0000","last_undegraded":"2024-02-18T16:22:30.415467+0000","last_fullsized":"2024-02-18T16:22:30.415467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:15.677159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177269+0000","last_change":"2024-02-18T16:21:07.907548+0000","last_active":"2024-02-18T16:21:41.177269+0000","last_peered":"2024-02-18T16:21:41.177269+0000","last_clean":"2024-02-18T16:21:41.177269+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:21:41.177269+0000","last_undegraded":"2024-02-18T16:21:41.177269+0000","last_fullsized":"2024-02-18T16:21:41.177269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:36.323096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.170197+0000","last_change":"2024-02-18T16:21:09.918869+0000","last_active":"2024-02-18T16:22:30.170197+0000","last_peered":"2024-02-18T16:22:30.170197+0000","last_clean":"2024-02-18T16:22:30.170197+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:22:30.170197+0000","last_undegraded":"2024-02-18T16:22:30.170197+0000","last_fullsized":"2024-02-18T16:22:30.170197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:04.707222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929560+0000","last_change":"2024-02-18T16:21:01.843254+0000","last_active":"2024-02-18T16:21:40.929560+0000","last_peered":"2024-02-18T16:21:40.929560+0000","last_clean":"2024-02-18T16:21:40.929560+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:21:40.929560+0000","last_undegraded":"2024-02-18T16:21:40.929560+0000","last_fullsized":"2024-02-18T16:21:40.929560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946541+0000","last_change":"2024-02-18T16:20:59.832949+0000","last_active":"2024-02-18T16:21:40.946541+0000","last_peered":"2024-02-18T16:21:40.946541+0000","last_clean":"2024-02-18T16:21:40.946541+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:21:40.946541+0000","last_undegraded":"2024-02-18T16:21:40.946541+0000","last_fullsized":"2024-02-18T16:21:40.946541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174581+0000","last_change":"2024-02-18T16:21:03.866038+0000","last_active":"2024-02-18T16:21:41.174581+0000","last_peered":"2024-02-18T16:21:41.174581+0000","last_clean":"2024-02-18T16:21:41.174581+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:21:41.174581+0000","last_undegraded":"2024-02-18T16:21:41.174581+0000","last_fullsized":"2024-02-18T16:21:41.174581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:20.723354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.475520+0000","last_change":"2024-02-18T16:21:05.902821+0000","last_active":"2024-02-18T16:22:30.475520+0000","last_peered":"2024-02-18T16:22:30.475520+0000","last_clean":"2024-02-18T16:22:30.475520+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:22:30.475520+0000","last_undegraded":"2024-02-18T16:22:30.475520+0000","last_fullsized":"2024-02-18T16:22:30.475520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:10:54.114055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176144+0000","last_change":"2024-02-18T16:21:07.896519+0000","last_active":"2024-02-18T16:21:41.176144+0000","last_peered":"2024-02-18T16:21:41.176144+0000","last_clean":"2024-02-18T16:21:41.176144+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:21:41.176144+0000","last_undegraded":"2024-02-18T16:21:41.176144+0000","last_fullsized":"2024-02-18T16:21:41.176144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.400852+0000","last_change":"2024-02-18T16:21:09.931902+0000","last_active":"2024-02-18T16:22:24.400852+0000","last_peered":"2024-02-18T16:22:24.400852+0000","last_clean":"2024-02-18T16:22:24.400852+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:22:24.400852+0000","last_undegraded":"2024-02-18T16:22:24.400852+0000","last_fullsized":"2024-02-18T16:22:24.400852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.164976+0000","last_change":"2024-02-18T16:21:01.851100+0000","last_active":"2024-02-18T16:21:47.164976+0000","last_peered":"2024-02-18T16:21:47.164976+0000","last_clean":"2024-02-18T16:21:47.164976+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:21:47.164976+0000","last_undegraded":"2024-02-18T16:21:47.164976+0000","last_fullsized":"2024-02-18T16:21:47.164976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:34.686883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.393724+0000","last_change":"2024-02-18T16:20:59.873014+0000","last_active":"2024-02-18T16:21:46.393724+0000","last_peered":"2024-02-18T16:21:46.393724+0000","last_clean":"2024-02-18T16:21:46.393724+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:21:46.393724+0000","last_undegraded":"2024-02-18T16:21:46.393724+0000","last_fullsized":"2024-02-18T16:21:46.393724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:13.577731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176424+0000","last_change":"2024-02-18T16:21:03.860965+0000","last_active":"2024-02-18T16:21:41.176424+0000","last_peered":"2024-02-18T16:21:41.176424+0000","last_clean":"2024-02-18T16:21:41.176424+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:21:41.176424+0000","last_undegraded":"2024-02-18T16:21:41.176424+0000","last_fullsized":"2024-02-18T16:21:41.176424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:49:52.683114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.418535+0000","last_change":"2024-02-18T16:21:05.886545+0000","last_active":"2024-02-18T16:22:30.418535+0000","last_peered":"2024-02-18T16:22:30.418535+0000","last_clean":"2024-02-18T16:22:30.418535+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:30.418535+0000","last_undegraded":"2024-02-18T16:22:30.418535+0000","last_fullsized":"2024-02-18T16:22:30.418535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:42.523543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.309717+0000","last_change":"2024-02-18T16:21:07.901321+0000","last_active":"2024-02-18T16:22:36.309717+0000","last_peered":"2024-02-18T16:22:36.309717+0000","last_clean":"2024-02-18T16:22:36.309717+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:36.309717+0000","last_undegraded":"2024-02-18T16:22:36.309717+0000","last_fullsized":"2024-02-18T16:22:36.309717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179560+0000","last_change":"2024-02-18T16:21:09.926915+0000","last_active":"2024-02-18T16:21:41.179560+0000","last_peered":"2024-02-18T16:21:41.179560+0000","last_clean":"2024-02-18T16:21:41.179560+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:21:41.179560+0000","last_undegraded":"2024-02-18T16:21:41.179560+0000","last_fullsized":"2024-02-18T16:21:41.179560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:45.424448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165040+0000","last_change":"2024-02-18T16:21:01.837388+0000","last_active":"2024-02-18T16:21:47.165040+0000","last_peered":"2024-02-18T16:21:47.165040+0000","last_clean":"2024-02-18T16:21:47.165040+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:21:47.165040+0000","last_undegraded":"2024-02-18T16:21:47.165040+0000","last_fullsized":"2024-02-18T16:21:47.165040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:54.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951017+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:21:40.951017+0000","last_peered":"2024-02-18T16:21:40.951017+0000","last_clean":"2024-02-18T16:21:40.951017+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:21:40.951017+0000","last_undegraded":"2024-02-18T16:21:40.951017+0000","last_fullsized":"2024-02-18T16:21:40.951017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:50.834394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174589+0000","last_change":"2024-02-18T16:21:03.871286+0000","last_active":"2024-02-18T16:21:41.174589+0000","last_peered":"2024-02-18T16:21:41.174589+0000","last_clean":"2024-02-18T16:21:41.174589+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:21:41.174589+0000","last_undegraded":"2024-02-18T16:21:41.174589+0000","last_fullsized":"2024-02-18T16:21:41.174589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:42.607662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.031258+0000","last_change":"2024-02-18T16:21:05.901392+0000","last_active":"2024-02-18T16:22:36.031258+0000","last_peered":"2024-02-18T16:22:36.031258+0000","last_clean":"2024-02-18T16:22:36.031258+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:22:36.031258+0000","last_undegraded":"2024-02-18T16:22:36.031258+0000","last_fullsized":"2024-02-18T16:22:36.031258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:17:42.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174155+0000","last_change":"2024-02-18T16:21:07.899232+0000","last_active":"2024-02-18T16:21:41.174155+0000","last_peered":"2024-02-18T16:21:41.174155+0000","last_clean":"2024-02-18T16:21:41.174155+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:21:41.174155+0000","last_undegraded":"2024-02-18T16:21:41.174155+0000","last_fullsized":"2024-02-18T16:21:41.174155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182379+0000","last_change":"2024-02-18T16:21:09.901860+0000","last_active":"2024-02-18T16:21:41.182379+0000","last_peered":"2024-02-18T16:21:41.182379+0000","last_clean":"2024-02-18T16:21:41.182379+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:21:41.182379+0000","last_undegraded":"2024-02-18T16:21:41.182379+0000","last_fullsized":"2024-02-18T16:21:41.182379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:12:00.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955531+0000","last_change":"2024-02-18T16:21:40.945387+0000","last_active":"2024-02-18T16:21:40.955531+0000","last_peered":"2024-02-18T16:21:40.955531+0000","last_clean":"2024-02-18T16:21:40.955531+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:21:40.955531+0000","last_undegraded":"2024-02-18T16:21:40.955531+0000","last_fullsized":"2024-02-18T16:21:40.955531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:56.813772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176709+0000","last_change":"2024-02-18T16:20:59.857151+0000","last_active":"2024-02-18T16:21:41.176709+0000","last_peered":"2024-02-18T16:21:41.176709+0000","last_clean":"2024-02-18T16:21:41.176709+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:21:41.176709+0000","last_undegraded":"2024-02-18T16:21:41.176709+0000","last_fullsized":"2024-02-18T16:21:41.176709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941688+0000","last_change":"2024-02-18T16:21:03.858681+0000","last_active":"2024-02-18T16:21:40.941688+0000","last_peered":"2024-02-18T16:21:40.941688+0000","last_clean":"2024-02-18T16:21:40.941688+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:21:40.941688+0000","last_undegraded":"2024-02-18T16:21:40.941688+0000","last_fullsized":"2024-02-18T16:21:40.941688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:12.798570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.388713+0000","last_change":"2024-02-18T16:21:05.883774+0000","last_active":"2024-02-18T16:22:30.388713+0000","last_peered":"2024-02-18T16:22:30.388713+0000","last_clean":"2024-02-18T16:22:30.388713+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:30.388713+0000","last_undegraded":"2024-02-18T16:22:30.388713+0000","last_fullsized":"2024-02-18T16:22:30.388713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:03.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954455+0000","last_change":"2024-02-18T16:21:07.917345+0000","last_active":"2024-02-18T16:21:40.954455+0000","last_peered":"2024-02-18T16:21:40.954455+0000","last_clean":"2024-02-18T16:21:40.954455+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:21:40.954455+0000","last_undegraded":"2024-02-18T16:21:40.954455+0000","last_fullsized":"2024-02-18T16:21:40.954455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:07:30.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931965+0000","last_change":"2024-02-18T16:21:09.920227+0000","last_active":"2024-02-18T16:21:40.931965+0000","last_peered":"2024-02-18T16:21:40.931965+0000","last_clean":"2024-02-18T16:21:40.931965+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:21:40.931965+0000","last_undegraded":"2024-02-18T16:21:40.931965+0000","last_fullsized":"2024-02-18T16:21:40.931965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:48:17.637183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457048+0000","last_change":"2024-02-18T16:21:01.858118+0000","last_active":"2024-02-18T16:22:30.457048+0000","last_peered":"2024-02-18T16:22:30.457048+0000","last_clean":"2024-02-18T16:22:30.457048+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:30.457048+0000","last_undegraded":"2024-02-18T16:22:30.457048+0000","last_fullsized":"2024-02-18T16:22:30.457048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:17.368689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947140+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:21:40.947140+0000","last_peered":"2024-02-18T16:21:40.947140+0000","last_clean":"2024-02-18T16:21:40.947140+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:21:40.947140+0000","last_undegraded":"2024-02-18T16:21:40.947140+0000","last_fullsized":"2024-02-18T16:21:40.947140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:24.038884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176422+0000","last_change":"2024-02-18T16:21:03.865714+0000","last_active":"2024-02-18T16:21:41.176422+0000","last_peered":"2024-02-18T16:21:41.176422+0000","last_clean":"2024-02-18T16:21:41.176422+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:21:41.176422+0000","last_undegraded":"2024-02-18T16:21:41.176422+0000","last_fullsized":"2024-02-18T16:21:41.176422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:14.663950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.434437+0000","last_change":"2024-02-18T16:21:05.875396+0000","last_active":"2024-02-18T16:22:30.434437+0000","last_peered":"2024-02-18T16:22:30.434437+0000","last_clean":"2024-02-18T16:22:30.434437+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:22:30.434437+0000","last_undegraded":"2024-02-18T16:22:30.434437+0000","last_fullsized":"2024-02-18T16:22:30.434437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:46.668575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":321,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.302732+0000","last_change":"2024-02-18T16:21:07.904059+0000","last_active":"2024-02-18T16:22:36.302732+0000","last_peered":"2024-02-18T16:22:36.302732+0000","last_clean":"2024-02-18T16:22:36.302732+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:36.302732+0000","last_undegraded":"2024-02-18T16:22:36.302732+0000","last_fullsized":"2024-02-18T16:22:36.302732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:40.559228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.477263+0000","last_change":"2024-02-18T16:21:09.901476+0000","last_active":"2024-02-18T16:22:30.477263+0000","last_peered":"2024-02-18T16:22:30.477263+0000","last_clean":"2024-02-18T16:22:30.477263+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:22:30.477263+0000","last_undegraded":"2024-02-18T16:22:30.477263+0000","last_fullsized":"2024-02-18T16:22:30.477263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.606451+0000","last_change":"2024-02-18T16:21:01.854526+0000","last_active":"2024-02-18T16:22:29.606451+0000","last_peered":"2024-02-18T16:22:29.606451+0000","last_clean":"2024-02-18T16:22:29.606451+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:22:29.606451+0000","last_undegraded":"2024-02-18T16:22:29.606451+0000","last_fullsized":"2024-02-18T16:22:29.606451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940406+0000","last_change":"2024-02-18T16:20:59.863525+0000","last_active":"2024-02-18T16:21:40.940406+0000","last_peered":"2024-02-18T16:21:40.940406+0000","last_clean":"2024-02-18T16:21:40.940406+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:21:40.940406+0000","last_undegraded":"2024-02-18T16:21:40.940406+0000","last_fullsized":"2024-02-18T16:21:40.940406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:40.125913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":523,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.176575+0000","last_change":"2024-02-18T16:21:03.865047+0000","last_active":"2024-02-18T16:22:37.176575+0000","last_peered":"2024-02-18T16:22:37.176575+0000","last_clean":"2024-02-18T16:22:37.176575+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:22:37.176575+0000","last_undegraded":"2024-02-18T16:22:37.176575+0000","last_fullsized":"2024-02-18T16:22:37.176575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:27.693710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":574,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953466+0000","last_change":"2024-02-18T16:21:05.901561+0000","last_active":"2024-02-18T16:21:40.953466+0000","last_peered":"2024-02-18T16:21:40.953466+0000","last_clean":"2024-02-18T16:21:40.953466+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:21:40.953466+0000","last_undegraded":"2024-02-18T16:21:40.953466+0000","last_fullsized":"2024-02-18T16:21:40.953466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:37.955679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":352,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.304651+0000","last_change":"2024-02-18T16:21:07.894723+0000","last_active":"2024-02-18T16:22:36.304651+0000","last_peered":"2024-02-18T16:22:36.304651+0000","last_clean":"2024-02-18T16:22:36.304651+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:36.304651+0000","last_undegraded":"2024-02-18T16:22:36.304651+0000","last_fullsized":"2024-02-18T16:22:36.304651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939087+0000","last_change":"2024-02-18T16:21:09.907248+0000","last_active":"2024-02-18T16:21:40.939087+0000","last_peered":"2024-02-18T16:21:40.939087+0000","last_clean":"2024-02-18T16:21:40.939087+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:21:40.939087+0000","last_undegraded":"2024-02-18T16:21:40.939087+0000","last_fullsized":"2024-02-18T16:21:40.939087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:20.642816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947627+0000","last_change":"2024-02-18T16:21:01.845972+0000","last_active":"2024-02-18T16:21:40.947627+0000","last_peered":"2024-02-18T16:21:40.947627+0000","last_clean":"2024-02-18T16:21:40.947627+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:21:40.947627+0000","last_undegraded":"2024-02-18T16:21:40.947627+0000","last_fullsized":"2024-02-18T16:21:40.947627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:21:09.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934644+0000","last_change":"2024-02-18T16:20:59.866261+0000","last_active":"2024-02-18T16:21:40.934644+0000","last_peered":"2024-02-18T16:21:40.934644+0000","last_clean":"2024-02-18T16:21:40.934644+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:21:40.934644+0000","last_undegraded":"2024-02-18T16:21:40.934644+0000","last_fullsized":"2024-02-18T16:21:40.934644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:49.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953511+0000","last_change":"2024-02-18T16:21:03.857468+0000","last_active":"2024-02-18T16:21:40.953511+0000","last_peered":"2024-02-18T16:21:40.953511+0000","last_clean":"2024-02-18T16:21:40.953511+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:21:40.953511+0000","last_undegraded":"2024-02-18T16:21:40.953511+0000","last_fullsized":"2024-02-18T16:21:40.953511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:57.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.409997+0000","last_change":"2024-02-18T16:21:05.883765+0000","last_active":"2024-02-18T16:22:30.409997+0000","last_peered":"2024-02-18T16:22:30.409997+0000","last_clean":"2024-02-18T16:22:30.409997+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:30.409997+0000","last_undegraded":"2024-02-18T16:22:30.409997+0000","last_fullsized":"2024-02-18T16:22:30.409997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:38.527945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936924+0000","last_change":"2024-02-18T16:21:07.900271+0000","last_active":"2024-02-18T16:21:40.936924+0000","last_peered":"2024-02-18T16:21:40.936924+0000","last_clean":"2024-02-18T16:21:40.936924+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:21:40.936924+0000","last_undegraded":"2024-02-18T16:21:40.936924+0000","last_fullsized":"2024-02-18T16:21:40.936924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:23.412232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929089+0000","last_change":"2024-02-18T16:21:09.921128+0000","last_active":"2024-02-18T16:21:40.929089+0000","last_peered":"2024-02-18T16:21:40.929089+0000","last_clean":"2024-02-18T16:21:40.929089+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:21:40.929089+0000","last_undegraded":"2024-02-18T16:21:40.929089+0000","last_fullsized":"2024-02-18T16:21:40.929089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:44.361454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085664+0000","last_change":"2024-02-18T16:21:01.857176+0000","last_active":"2024-02-18T16:22:36.085664+0000","last_peered":"2024-02-18T16:22:36.085664+0000","last_clean":"2024-02-18T16:22:36.085664+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:22:36.085664+0000","last_undegraded":"2024-02-18T16:22:36.085664+0000","last_fullsized":"2024-02-18T16:22:36.085664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:50:56.586473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927237+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:21:40.927237+0000","last_peered":"2024-02-18T16:21:40.927237+0000","last_clean":"2024-02-18T16:21:40.927237+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:21:40.927237+0000","last_undegraded":"2024-02-18T16:21:40.927237+0000","last_fullsized":"2024-02-18T16:21:40.927237+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:37.088141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949389+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:21:40.949389+0000","last_peered":"2024-02-18T16:21:40.949389+0000","last_clean":"2024-02-18T16:21:40.949389+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:21:40.949389+0000","last_undegraded":"2024-02-18T16:21:40.949389+0000","last_fullsized":"2024-02-18T16:21:40.949389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:58:17.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939942+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:21:40.939942+0000","last_peered":"2024-02-18T16:21:40.939942+0000","last_clean":"2024-02-18T16:21:40.939942+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:21:40.939942+0000","last_undegraded":"2024-02-18T16:21:40.939942+0000","last_fullsized":"2024-02-18T16:21:40.939942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:33.884874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930956+0000","last_change":"2024-02-18T16:21:03.862227+0000","last_active":"2024-02-18T16:21:40.930956+0000","last_peered":"2024-02-18T16:21:40.930956+0000","last_clean":"2024-02-18T16:21:40.930956+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:21:40.930956+0000","last_undegraded":"2024-02-18T16:21:40.930956+0000","last_fullsized":"2024-02-18T16:21:40.930956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:05.466118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.054236+0000","last_change":"2024-02-18T16:21:05.897156+0000","last_active":"2024-02-18T16:22:36.054236+0000","last_peered":"2024-02-18T16:22:36.054236+0000","last_clean":"2024-02-18T16:22:36.054236+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:22:36.054236+0000","last_undegraded":"2024-02-18T16:22:36.054236+0000","last_fullsized":"2024-02-18T16:22:36.054236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:44:22.601995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179893+0000","last_change":"2024-02-18T16:21:07.900898+0000","last_active":"2024-02-18T16:21:41.179893+0000","last_peered":"2024-02-18T16:21:41.179893+0000","last_clean":"2024-02-18T16:21:41.179893+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:21:41.179893+0000","last_undegraded":"2024-02-18T16:21:41.179893+0000","last_fullsized":"2024-02-18T16:21:41.179893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:59:15.395075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.103257+0000","last_change":"2024-02-18T16:21:09.898538+0000","last_active":"2024-02-18T16:22:36.103257+0000","last_peered":"2024-02-18T16:22:36.103257+0000","last_clean":"2024-02-18T16:22:36.103257+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:36.103257+0000","last_undegraded":"2024-02-18T16:22:36.103257+0000","last_fullsized":"2024-02-18T16:22:36.103257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:33.080540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955558+0000","last_change":"2024-02-18T16:21:01.853487+0000","last_active":"2024-02-18T16:21:40.955558+0000","last_peered":"2024-02-18T16:21:40.955558+0000","last_clean":"2024-02-18T16:21:40.955558+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:21:40.955558+0000","last_undegraded":"2024-02-18T16:21:40.955558+0000","last_fullsized":"2024-02-18T16:21:40.955558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:51.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933083+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:21:40.933083+0000","last_peered":"2024-02-18T16:21:40.933083+0000","last_clean":"2024-02-18T16:21:40.933083+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:21:40.933083+0000","last_undegraded":"2024-02-18T16:21:40.933083+0000","last_fullsized":"2024-02-18T16:21:40.933083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:05:58.537300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174299+0000","last_change":"2024-02-18T16:20:59.848482+0000","last_active":"2024-02-18T16:21:41.174299+0000","last_peered":"2024-02-18T16:21:41.174299+0000","last_clean":"2024-02-18T16:21:41.174299+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:21:41.174299+0000","last_undegraded":"2024-02-18T16:21:41.174299+0000","last_fullsized":"2024-02-18T16:21:41.174299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954843+0000","last_change":"2024-02-18T16:21:03.853258+0000","last_active":"2024-02-18T16:21:40.954843+0000","last_peered":"2024-02-18T16:21:40.954843+0000","last_clean":"2024-02-18T16:21:40.954843+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:21:40.954843+0000","last_undegraded":"2024-02-18T16:21:40.954843+0000","last_fullsized":"2024-02-18T16:21:40.954843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:43:34.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.296165+0000","last_change":"2024-02-18T16:21:05.900069+0000","last_active":"2024-02-18T16:22:36.296165+0000","last_peered":"2024-02-18T16:22:36.296165+0000","last_clean":"2024-02-18T16:22:36.296165+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:36.296165+0000","last_undegraded":"2024-02-18T16:22:36.296165+0000","last_fullsized":"2024-02-18T16:22:36.296165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:29:44.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950461+0000","last_change":"2024-02-18T16:21:07.915843+0000","last_active":"2024-02-18T16:21:40.950461+0000","last_peered":"2024-02-18T16:21:40.950461+0000","last_clean":"2024-02-18T16:21:40.950461+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:21:40.950461+0000","last_undegraded":"2024-02-18T16:21:40.950461+0000","last_fullsized":"2024-02-18T16:21:40.950461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:32:30.258086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.566050+0000","last_change":"2024-02-18T16:21:09.927419+0000","last_active":"2024-02-18T16:22:24.566050+0000","last_peered":"2024-02-18T16:22:24.566050+0000","last_clean":"2024-02-18T16:22:24.566050+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:22:24.566050+0000","last_undegraded":"2024-02-18T16:22:24.566050+0000","last_fullsized":"2024-02-18T16:22:24.566050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:21.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.855571+0000","last_change":"2024-02-18T16:21:01.846415+0000","last_active":"2024-02-18T16:21:47.855571+0000","last_peered":"2024-02-18T16:21:47.855571+0000","last_clean":"2024-02-18T16:21:47.855571+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:21:47.855571+0000","last_undegraded":"2024-02-18T16:21:47.855571+0000","last_fullsized":"2024-02-18T16:21:47.855571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936337+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:21:40.936337+0000","last_peered":"2024-02-18T16:21:40.936337+0000","last_clean":"2024-02-18T16:21:40.936337+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:21:40.936337+0000","last_undegraded":"2024-02-18T16:21:40.936337+0000","last_fullsized":"2024-02-18T16:21:40.936337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:43.102493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173554+0000","last_change":"2024-02-18T16:20:59.850718+0000","last_active":"2024-02-18T16:21:41.173554+0000","last_peered":"2024-02-18T16:21:41.173554+0000","last_clean":"2024-02-18T16:21:41.173554+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:21:41.173554+0000","last_undegraded":"2024-02-18T16:21:41.173554+0000","last_fullsized":"2024-02-18T16:21:41.173554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945273+0000","last_change":"2024-02-18T16:21:03.854140+0000","last_active":"2024-02-18T16:21:40.945273+0000","last_peered":"2024-02-18T16:21:40.945273+0000","last_clean":"2024-02-18T16:21:40.945273+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:21:40.945273+0000","last_undegraded":"2024-02-18T16:21:40.945273+0000","last_fullsized":"2024-02-18T16:21:40.945273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:45.475648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:34.003316+0000","last_change":"2024-02-18T16:21:05.883106+0000","last_active":"2024-02-18T16:22:34.003316+0000","last_peered":"2024-02-18T16:22:34.003316+0000","last_clean":"2024-02-18T16:22:34.003316+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:22:34.003316+0000","last_undegraded":"2024-02-18T16:22:34.003316+0000","last_fullsized":"2024-02-18T16:22:34.003316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:49.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176697+0000","last_change":"2024-02-18T16:21:07.901039+0000","last_active":"2024-02-18T16:21:41.176697+0000","last_peered":"2024-02-18T16:21:41.176697+0000","last_clean":"2024-02-18T16:21:41.176697+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:21:41.176697+0000","last_undegraded":"2024-02-18T16:21:41.176697+0000","last_fullsized":"2024-02-18T16:21:41.176697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:12.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946747+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:21:40.946747+0000","last_peered":"2024-02-18T16:21:40.946747+0000","last_clean":"2024-02-18T16:21:40.946747+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:21:40.946747+0000","last_undegraded":"2024-02-18T16:21:40.946747+0000","last_fullsized":"2024-02-18T16:21:40.946747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:15.833558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179127+0000","last_change":"2024-02-18T16:21:01.841136+0000","last_active":"2024-02-18T16:21:41.179127+0000","last_peered":"2024-02-18T16:21:41.179127+0000","last_clean":"2024-02-18T16:21:41.179127+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:21:41.179127+0000","last_undegraded":"2024-02-18T16:21:41.179127+0000","last_fullsized":"2024-02-18T16:21:41.179127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939268+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:21:40.939268+0000","last_peered":"2024-02-18T16:21:40.939268+0000","last_clean":"2024-02-18T16:21:40.939268+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:21:40.939268+0000","last_undegraded":"2024-02-18T16:21:40.939268+0000","last_fullsized":"2024-02-18T16:21:40.939268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:28:03.856941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939793+0000","last_change":"2024-02-18T16:20:59.855189+0000","last_active":"2024-02-18T16:21:40.939793+0000","last_peered":"2024-02-18T16:21:40.939793+0000","last_clean":"2024-02-18T16:21:40.939793+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:21:40.939793+0000","last_undegraded":"2024-02-18T16:21:40.939793+0000","last_fullsized":"2024-02-18T16:21:40.939793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179358+0000","last_change":"2024-02-18T16:21:03.858464+0000","last_active":"2024-02-18T16:21:41.179358+0000","last_peered":"2024-02-18T16:21:41.179358+0000","last_clean":"2024-02-18T16:21:41.179358+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:21:41.179358+0000","last_undegraded":"2024-02-18T16:21:41.179358+0000","last_fullsized":"2024-02-18T16:21:41.179358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:23:07.857672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952037+0000","last_change":"2024-02-18T16:21:05.897074+0000","last_active":"2024-02-18T16:21:40.952037+0000","last_peered":"2024-02-18T16:21:40.952037+0000","last_clean":"2024-02-18T16:21:40.952037+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:21:40.952037+0000","last_undegraded":"2024-02-18T16:21:40.952037+0000","last_fullsized":"2024-02-18T16:21:40.952037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:04:33.549154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955422+0000","last_change":"2024-02-18T16:21:07.918398+0000","last_active":"2024-02-18T16:21:40.955422+0000","last_peered":"2024-02-18T16:21:40.955422+0000","last_clean":"2024-02-18T16:21:40.955422+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:21:40.955422+0000","last_undegraded":"2024-02-18T16:21:40.955422+0000","last_fullsized":"2024-02-18T16:21:40.955422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:47.114614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.926920+0000","last_change":"2024-02-18T16:21:09.915876+0000","last_active":"2024-02-18T16:21:40.926920+0000","last_peered":"2024-02-18T16:21:40.926920+0000","last_clean":"2024-02-18T16:21:40.926920+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:21:40.926920+0000","last_undegraded":"2024-02-18T16:21:40.926920+0000","last_fullsized":"2024-02-18T16:21:40.926920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:53.323552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858131+0000","last_change":"2024-02-18T16:21:01.844784+0000","last_active":"2024-02-18T16:21:47.858131+0000","last_peered":"2024-02-18T16:21:47.858131+0000","last_clean":"2024-02-18T16:21:47.858131+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:21:47.858131+0000","last_undegraded":"2024-02-18T16:21:47.858131+0000","last_fullsized":"2024-02-18T16:21:47.858131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938015+0000","last_change":"2024-02-18T16:20:59.833465+0000","last_active":"2024-02-18T16:21:40.938015+0000","last_peered":"2024-02-18T16:21:40.938015+0000","last_clean":"2024-02-18T16:21:40.938015+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:21:40.938015+0000","last_undegraded":"2024-02-18T16:21:40.938015+0000","last_fullsized":"2024-02-18T16:21:40.938015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176645+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:21:41.176645+0000","last_peered":"2024-02-18T16:21:41.176645+0000","last_clean":"2024-02-18T16:21:41.176645+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:21:41.176645+0000","last_undegraded":"2024-02-18T16:21:41.176645+0000","last_fullsized":"2024-02-18T16:21:41.176645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:59:56.616913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947011+0000","last_change":"2024-02-18T16:21:40.945591+0000","last_active":"2024-02-18T16:21:40.947011+0000","last_peered":"2024-02-18T16:21:40.947011+0000","last_clean":"2024-02-18T16:21:40.947011+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:21:40.947011+0000","last_undegraded":"2024-02-18T16:21:40.947011+0000","last_fullsized":"2024-02-18T16:21:40.947011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:47.279576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.043805+0000","last_change":"2024-02-18T16:21:05.889484+0000","last_active":"2024-02-18T16:22:36.043805+0000","last_peered":"2024-02-18T16:22:36.043805+0000","last_clean":"2024-02-18T16:22:36.043805+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:36.043805+0000","last_undegraded":"2024-02-18T16:22:36.043805+0000","last_fullsized":"2024-02-18T16:22:36.043805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:15.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932933+0000","last_change":"2024-02-18T16:21:07.902044+0000","last_active":"2024-02-18T16:21:40.932933+0000","last_peered":"2024-02-18T16:21:40.932933+0000","last_clean":"2024-02-18T16:21:40.932933+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:21:40.932933+0000","last_undegraded":"2024-02-18T16:21:40.932933+0000","last_fullsized":"2024-02-18T16:21:40.932933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:08.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.436370+0000","last_change":"2024-02-18T16:21:09.905763+0000","last_active":"2024-02-18T16:22:30.436370+0000","last_peered":"2024-02-18T16:22:30.436370+0000","last_clean":"2024-02-18T16:22:30.436370+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:22:30.436370+0000","last_undegraded":"2024-02-18T16:22:30.436370+0000","last_fullsized":"2024-02-18T16:22:30.436370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:46.553123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.872182+0000","last_change":"2024-02-18T16:21:01.847741+0000","last_active":"2024-02-18T16:21:46.872182+0000","last_peered":"2024-02-18T16:21:46.872182+0000","last_clean":"2024-02-18T16:21:46.872182+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:21:46.872182+0000","last_undegraded":"2024-02-18T16:21:46.872182+0000","last_fullsized":"2024-02-18T16:21:46.872182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:41:45.770571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176949+0000","last_change":"2024-02-18T16:20:59.861790+0000","last_active":"2024-02-18T16:21:41.176949+0000","last_peered":"2024-02-18T16:21:41.176949+0000","last_clean":"2024-02-18T16:21:41.176949+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:21:41.176949+0000","last_undegraded":"2024-02-18T16:21:41.176949+0000","last_fullsized":"2024-02-18T16:21:41.176949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951463+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:21:40.951463+0000","last_peered":"2024-02-18T16:21:40.951463+0000","last_clean":"2024-02-18T16:21:40.951463+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:21:40.951463+0000","last_undegraded":"2024-02-18T16:21:40.951463+0000","last_fullsized":"2024-02-18T16:21:40.951463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:55:06.221596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938609+0000","last_change":"2024-02-18T16:21:03.849021+0000","last_active":"2024-02-18T16:21:40.938609+0000","last_peered":"2024-02-18T16:21:40.938609+0000","last_clean":"2024-02-18T16:21:40.938609+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:21:40.938609+0000","last_undegraded":"2024-02-18T16:21:40.938609+0000","last_fullsized":"2024-02-18T16:21:40.938609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:08.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929054+0000","last_change":"2024-02-18T16:21:05.898616+0000","last_active":"2024-02-18T16:21:40.929054+0000","last_peered":"2024-02-18T16:21:40.929054+0000","last_clean":"2024-02-18T16:21:40.929054+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:21:40.929054+0000","last_undegraded":"2024-02-18T16:21:40.929054+0000","last_fullsized":"2024-02-18T16:21:40.929054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:38.543681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.299293+0000","last_change":"2024-02-18T16:21:07.893283+0000","last_active":"2024-02-18T16:22:36.299293+0000","last_peered":"2024-02-18T16:22:36.299293+0000","last_clean":"2024-02-18T16:22:36.299293+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:36.299293+0000","last_undegraded":"2024-02-18T16:22:36.299293+0000","last_fullsized":"2024-02-18T16:22:36.299293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953932+0000","last_change":"2024-02-18T16:21:09.914553+0000","last_active":"2024-02-18T16:21:40.953932+0000","last_peered":"2024-02-18T16:21:40.953932+0000","last_clean":"2024-02-18T16:21:40.953932+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:21:40.953932+0000","last_undegraded":"2024-02-18T16:21:40.953932+0000","last_fullsized":"2024-02-18T16:21:40.953932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:02:46.246218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456732+0000","last_change":"2024-02-18T16:21:01.853061+0000","last_active":"2024-02-18T16:22:30.456732+0000","last_peered":"2024-02-18T16:22:30.456732+0000","last_clean":"2024-02-18T16:22:30.456732+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:22:30.456732+0000","last_undegraded":"2024-02-18T16:22:30.456732+0000","last_fullsized":"2024-02-18T16:22:30.456732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:44.090520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956980+0000","last_change":"2024-02-18T16:20:59.868556+0000","last_active":"2024-02-18T16:21:40.956980+0000","last_peered":"2024-02-18T16:21:40.956980+0000","last_clean":"2024-02-18T16:21:40.956980+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:21:40.956980+0000","last_undegraded":"2024-02-18T16:21:40.956980+0000","last_fullsized":"2024-02-18T16:21:40.956980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:56.658418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180424+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:21:41.180424+0000","last_peered":"2024-02-18T16:21:41.180424+0000","last_clean":"2024-02-18T16:21:41.180424+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:21:41.180424+0000","last_undegraded":"2024-02-18T16:21:41.180424+0000","last_fullsized":"2024-02-18T16:21:41.180424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:07.695714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933580+0000","last_change":"2024-02-18T16:21:03.852652+0000","last_active":"2024-02-18T16:21:40.933580+0000","last_peered":"2024-02-18T16:21:40.933580+0000","last_clean":"2024-02-18T16:21:40.933580+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:21:40.933580+0000","last_undegraded":"2024-02-18T16:21:40.933580+0000","last_fullsized":"2024-02-18T16:21:40.933580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:23.631357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946439+0000","last_change":"2024-02-18T16:21:05.894104+0000","last_active":"2024-02-18T16:21:40.946439+0000","last_peered":"2024-02-18T16:21:40.946439+0000","last_clean":"2024-02-18T16:21:40.946439+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:21:40.946439+0000","last_undegraded":"2024-02-18T16:21:40.946439+0000","last_fullsized":"2024-02-18T16:21:40.946439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:42.813295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.306039+0000","last_change":"2024-02-18T16:21:07.893288+0000","last_active":"2024-02-18T16:22:36.306039+0000","last_peered":"2024-02-18T16:22:36.306039+0000","last_clean":"2024-02-18T16:22:36.306039+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:36.306039+0000","last_undegraded":"2024-02-18T16:22:36.306039+0000","last_fullsized":"2024-02-18T16:22:36.306039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.859966+0000","last_change":"2024-02-18T16:21:09.917363+0000","last_active":"2024-02-18T16:21:47.859966+0000","last_peered":"2024-02-18T16:21:47.859966+0000","last_clean":"2024-02-18T16:21:47.859966+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:21:47.859966+0000","last_undegraded":"2024-02-18T16:21:47.859966+0000","last_fullsized":"2024-02-18T16:21:47.859966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935139+0000","last_change":"2024-02-18T16:21:01.849433+0000","last_active":"2024-02-18T16:21:40.935139+0000","last_peered":"2024-02-18T16:21:40.935139+0000","last_clean":"2024-02-18T16:21:40.935139+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:21:40.935139+0000","last_undegraded":"2024-02-18T16:21:40.935139+0000","last_fullsized":"2024-02-18T16:21:40.935139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:26.052157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937475+0000","last_change":"2024-02-18T16:20:59.873711+0000","last_active":"2024-02-18T16:21:40.937475+0000","last_peered":"2024-02-18T16:21:40.937475+0000","last_clean":"2024-02-18T16:21:40.937475+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:21:40.937475+0000","last_undegraded":"2024-02-18T16:21:40.937475+0000","last_fullsized":"2024-02-18T16:21:40.937475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956548+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:21:40.956548+0000","last_peered":"2024-02-18T16:21:40.956548+0000","last_clean":"2024-02-18T16:21:40.956548+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:21:40.956548+0000","last_undegraded":"2024-02-18T16:21:40.956548+0000","last_fullsized":"2024-02-18T16:21:40.956548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:28:14.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932706+0000","last_change":"2024-02-18T16:21:03.851642+0000","last_active":"2024-02-18T16:21:40.932706+0000","last_peered":"2024-02-18T16:21:40.932706+0000","last_clean":"2024-02-18T16:21:40.932706+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:21:40.932706+0000","last_undegraded":"2024-02-18T16:21:40.932706+0000","last_fullsized":"2024-02-18T16:21:40.932706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:09:58.409243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.038660+0000","last_change":"2024-02-18T16:21:05.894249+0000","last_active":"2024-02-18T16:22:36.038660+0000","last_peered":"2024-02-18T16:22:36.038660+0000","last_clean":"2024-02-18T16:22:36.038660+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:36.038660+0000","last_undegraded":"2024-02-18T16:22:36.038660+0000","last_fullsized":"2024-02-18T16:22:36.038660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:16.678346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174054+0000","last_change":"2024-02-18T16:21:07.899674+0000","last_active":"2024-02-18T16:21:41.174054+0000","last_peered":"2024-02-18T16:21:41.174054+0000","last_clean":"2024-02-18T16:21:41.174054+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:21:41.174054+0000","last_undegraded":"2024-02-18T16:21:41.174054+0000","last_fullsized":"2024-02-18T16:21:41.174054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:02.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.943250+0000","last_change":"2024-02-18T16:21:09.913278+0000","last_active":"2024-02-18T16:21:40.943250+0000","last_peered":"2024-02-18T16:21:40.943250+0000","last_clean":"2024-02-18T16:21:40.943250+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:21:40.943250+0000","last_undegraded":"2024-02-18T16:21:40.943250+0000","last_fullsized":"2024-02-18T16:21:40.943250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:44.928722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.072534+0000","last_change":"2024-02-18T16:21:09.912010+0000","last_active":"2024-02-18T16:22:36.072534+0000","last_peered":"2024-02-18T16:22:36.072534+0000","last_clean":"2024-02-18T16:22:36.072534+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:22:36.072534+0000","last_undegraded":"2024-02-18T16:22:36.072534+0000","last_fullsized":"2024-02-18T16:22:36.072534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:22.614788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183619+0000","last_change":"2024-02-18T16:21:41.183619+0000","last_active":"2024-02-18T16:21:41.183619+0000","last_peered":"2024-02-18T16:21:41.183619+0000","last_clean":"2024-02-18T16:21:41.183619+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:21:41.183619+0000","last_undegraded":"2024-02-18T16:21:41.183619+0000","last_fullsized":"2024-02-18T16:21:41.183619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:13.035362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951280+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:21:40.951280+0000","last_peered":"2024-02-18T16:21:40.951280+0000","last_clean":"2024-02-18T16:21:40.951280+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:21:40.951280+0000","last_undegraded":"2024-02-18T16:21:40.951280+0000","last_fullsized":"2024-02-18T16:21:40.951280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:18:58.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929562+0000","last_change":"2024-02-18T16:21:03.865820+0000","last_active":"2024-02-18T16:21:40.929562+0000","last_peered":"2024-02-18T16:21:40.929562+0000","last_clean":"2024-02-18T16:21:40.929562+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:21:40.929562+0000","last_undegraded":"2024-02-18T16:21:40.929562+0000","last_fullsized":"2024-02-18T16:21:40.929562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:46.104120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.417194+0000","last_change":"2024-02-18T16:21:05.885905+0000","last_active":"2024-02-18T16:22:30.417194+0000","last_peered":"2024-02-18T16:22:30.417194+0000","last_clean":"2024-02-18T16:22:30.417194+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:30.417194+0000","last_undegraded":"2024-02-18T16:22:30.417194+0000","last_fullsized":"2024-02-18T16:22:30.417194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:28.353159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936858+0000","last_change":"2024-02-18T16:21:07.897703+0000","last_active":"2024-02-18T16:21:40.936858+0000","last_peered":"2024-02-18T16:21:40.936858+0000","last_clean":"2024-02-18T16:21:40.936858+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:21:40.936858+0000","last_undegraded":"2024-02-18T16:21:40.936858+0000","last_fullsized":"2024-02-18T16:21:40.936858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:41.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179155+0000","last_change":"2024-02-18T16:21:09.909919+0000","last_active":"2024-02-18T16:21:41.179155+0000","last_peered":"2024-02-18T16:21:41.179155+0000","last_clean":"2024-02-18T16:21:41.179155+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:21:41.179155+0000","last_undegraded":"2024-02-18T16:21:41.179155+0000","last_fullsized":"2024-02-18T16:21:41.179155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:27.374232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605789+0000","last_change":"2024-02-18T16:21:01.852159+0000","last_active":"2024-02-18T16:22:29.605789+0000","last_peered":"2024-02-18T16:22:29.605789+0000","last_clean":"2024-02-18T16:22:29.605789+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:22:29.605789+0000","last_undegraded":"2024-02-18T16:22:29.605789+0000","last_fullsized":"2024-02-18T16:22:29.605789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941358+0000","last_change":"2024-02-18T16:20:59.833123+0000","last_active":"2024-02-18T16:21:40.941358+0000","last_peered":"2024-02-18T16:21:40.941358+0000","last_clean":"2024-02-18T16:21:40.941358+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:21:40.941358+0000","last_undegraded":"2024-02-18T16:21:40.941358+0000","last_fullsized":"2024-02-18T16:21:40.941358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947671+0000","last_change":"2024-02-18T16:21:03.850309+0000","last_active":"2024-02-18T16:21:40.947671+0000","last_peered":"2024-02-18T16:21:40.947671+0000","last_clean":"2024-02-18T16:21:40.947671+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:21:40.947671+0000","last_undegraded":"2024-02-18T16:21:40.947671+0000","last_fullsized":"2024-02-18T16:21:40.947671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:21.788879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:23.050364+0000","last_change":"2024-02-18T16:21:05.880698+0000","last_active":"2024-02-18T16:22:23.050364+0000","last_peered":"2024-02-18T16:22:23.050364+0000","last_clean":"2024-02-18T16:22:23.050364+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:22:23.050364+0000","last_undegraded":"2024-02-18T16:22:23.050364+0000","last_fullsized":"2024-02-18T16:22:23.050364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:33.384726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935541+0000","last_change":"2024-02-18T16:21:07.900044+0000","last_active":"2024-02-18T16:21:40.935541+0000","last_peered":"2024-02-18T16:21:40.935541+0000","last_clean":"2024-02-18T16:21:40.935541+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:21:40.935541+0000","last_undegraded":"2024-02-18T16:21:40.935541+0000","last_fullsized":"2024-02-18T16:21:40.935541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:14.205593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177117+0000","last_change":"2024-02-18T16:21:09.926381+0000","last_active":"2024-02-18T16:21:41.177117+0000","last_peered":"2024-02-18T16:21:41.177117+0000","last_clean":"2024-02-18T16:21:41.177117+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:21:41.177117+0000","last_undegraded":"2024-02-18T16:21:41.177117+0000","last_fullsized":"2024-02-18T16:21:41.177117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165508+0000","last_change":"2024-02-18T16:21:01.847228+0000","last_active":"2024-02-18T16:21:47.165508+0000","last_peered":"2024-02-18T16:21:47.165508+0000","last_clean":"2024-02-18T16:21:47.165508+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:21:47.165508+0000","last_undegraded":"2024-02-18T16:21:47.165508+0000","last_fullsized":"2024-02-18T16:21:47.165508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952876+0000","last_change":"2024-02-18T16:20:59.839316+0000","last_active":"2024-02-18T16:21:40.952876+0000","last_peered":"2024-02-18T16:21:40.952876+0000","last_clean":"2024-02-18T16:21:40.952876+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:21:40.952876+0000","last_undegraded":"2024-02-18T16:21:40.952876+0000","last_fullsized":"2024-02-18T16:21:40.952876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934519+0000","last_change":"2024-02-18T16:21:03.864201+0000","last_active":"2024-02-18T16:21:40.934519+0000","last_peered":"2024-02-18T16:21:40.934519+0000","last_clean":"2024-02-18T16:21:40.934519+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:21:40.934519+0000","last_undegraded":"2024-02-18T16:21:40.934519+0000","last_fullsized":"2024-02-18T16:21:40.934519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:17.726013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:35.841028+0000","last_change":"2024-02-18T16:21:05.876928+0000","last_active":"2024-02-18T16:22:35.841028+0000","last_peered":"2024-02-18T16:22:35.841028+0000","last_clean":"2024-02-18T16:22:35.841028+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:22:35.841028+0000","last_undegraded":"2024-02-18T16:22:35.841028+0000","last_fullsized":"2024-02-18T16:22:35.841028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:06.486461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928756+0000","last_change":"2024-02-18T16:21:07.894242+0000","last_active":"2024-02-18T16:21:40.928756+0000","last_peered":"2024-02-18T16:21:40.928756+0000","last_clean":"2024-02-18T16:21:40.928756+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:21:40.928756+0000","last_undegraded":"2024-02-18T16:21:40.928756+0000","last_fullsized":"2024-02-18T16:21:40.928756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.128244+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:21:47.128244+0000","last_peered":"2024-02-18T16:21:47.128244+0000","last_clean":"2024-02-18T16:21:47.128244+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:21:47.128244+0000","last_undegraded":"2024-02-18T16:21:47.128244+0000","last_fullsized":"2024-02-18T16:21:47.128244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:15:42.799340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871877+0000","last_change":"2024-02-18T16:21:01.853323+0000","last_active":"2024-02-18T16:21:46.871877+0000","last_peered":"2024-02-18T16:21:46.871877+0000","last_clean":"2024-02-18T16:21:46.871877+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:21:46.871877+0000","last_undegraded":"2024-02-18T16:21:46.871877+0000","last_fullsized":"2024-02-18T16:21:46.871877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:11.618049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945582+0000","last_change":"2024-02-18T16:20:59.853141+0000","last_active":"2024-02-18T16:21:40.945582+0000","last_peered":"2024-02-18T16:21:40.945582+0000","last_clean":"2024-02-18T16:21:40.945582+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:21:40.945582+0000","last_undegraded":"2024-02-18T16:21:40.945582+0000","last_fullsized":"2024-02-18T16:21:40.945582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933353+0000","last_change":"2024-02-18T16:21:03.852896+0000","last_active":"2024-02-18T16:21:40.933353+0000","last_peered":"2024-02-18T16:21:40.933353+0000","last_clean":"2024-02-18T16:21:40.933353+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:21:40.933353+0000","last_undegraded":"2024-02-18T16:21:40.933353+0000","last_fullsized":"2024-02-18T16:21:40.933353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:25.426450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.393010+0000","last_change":"2024-02-18T16:21:05.877090+0000","last_active":"2024-02-18T16:22:30.393010+0000","last_peered":"2024-02-18T16:22:30.393010+0000","last_clean":"2024-02-18T16:22:30.393010+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:22:30.393010+0000","last_undegraded":"2024-02-18T16:22:30.393010+0000","last_fullsized":"2024-02-18T16:22:30.393010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:28.582206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937205+0000","last_change":"2024-02-18T16:21:07.895684+0000","last_active":"2024-02-18T16:21:40.937205+0000","last_peered":"2024-02-18T16:21:40.937205+0000","last_clean":"2024-02-18T16:21:40.937205+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:21:40.937205+0000","last_undegraded":"2024-02-18T16:21:40.937205+0000","last_fullsized":"2024-02-18T16:21:40.937205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:02.630017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956804+0000","last_change":"2024-02-18T16:21:01.852475+0000","last_active":"2024-02-18T16:21:40.956804+0000","last_peered":"2024-02-18T16:21:40.956804+0000","last_clean":"2024-02-18T16:21:40.956804+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:21:40.956804+0000","last_undegraded":"2024-02-18T16:21:40.956804+0000","last_fullsized":"2024-02-18T16:21:40.956804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:27.351511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933470+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:21:40.933470+0000","last_peered":"2024-02-18T16:21:40.933470+0000","last_clean":"2024-02-18T16:21:40.933470+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:21:40.933470+0000","last_undegraded":"2024-02-18T16:21:40.933470+0000","last_fullsized":"2024-02-18T16:21:40.933470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:15:24.659323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180433+0000","last_change":"2024-02-18T16:21:03.857015+0000","last_active":"2024-02-18T16:21:41.180433+0000","last_peered":"2024-02-18T16:21:41.180433+0000","last_clean":"2024-02-18T16:21:41.180433+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:21:41.180433+0000","last_undegraded":"2024-02-18T16:21:41.180433+0000","last_fullsized":"2024-02-18T16:21:41.180433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:13.662764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.034479+0000","last_change":"2024-02-18T16:21:05.880717+0000","last_active":"2024-02-18T16:22:36.034479+0000","last_peered":"2024-02-18T16:22:36.034479+0000","last_clean":"2024-02-18T16:22:36.034479+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:36.034479+0000","last_undegraded":"2024-02-18T16:22:36.034479+0000","last_fullsized":"2024-02-18T16:22:36.034479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:12.190046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936708+0000","last_change":"2024-02-18T16:21:07.890941+0000","last_active":"2024-02-18T16:21:40.936708+0000","last_peered":"2024-02-18T16:21:40.936708+0000","last_clean":"2024-02-18T16:21:40.936708+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:21:40.936708+0000","last_undegraded":"2024-02-18T16:21:40.936708+0000","last_fullsized":"2024-02-18T16:21:40.936708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:57.883612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.748309+0000","last_change":"2024-02-18T16:21:09.926618+0000","last_active":"2024-02-18T16:22:29.748309+0000","last_peered":"2024-02-18T16:22:29.748309+0000","last_clean":"2024-02-18T16:22:29.748309+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:22:29.748309+0000","last_undegraded":"2024-02-18T16:22:29.748309+0000","last_fullsized":"2024-02-18T16:22:29.748309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183335+0000","last_change":"2024-02-18T16:21:01.841268+0000","last_active":"2024-02-18T16:21:41.183335+0000","last_peered":"2024-02-18T16:21:41.183335+0000","last_clean":"2024-02-18T16:21:41.183335+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:21:41.183335+0000","last_undegraded":"2024-02-18T16:21:41.183335+0000","last_fullsized":"2024-02-18T16:21:41.183335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927563+0000","last_change":"2024-02-18T16:20:59.853982+0000","last_active":"2024-02-18T16:21:40.927563+0000","last_peered":"2024-02-18T16:21:40.927563+0000","last_clean":"2024-02-18T16:21:40.927563+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:21:40.927563+0000","last_undegraded":"2024-02-18T16:21:40.927563+0000","last_fullsized":"2024-02-18T16:21:40.927563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950616+0000","last_change":"2024-02-18T16:21:03.854204+0000","last_active":"2024-02-18T16:21:40.950616+0000","last_peered":"2024-02-18T16:21:40.950616+0000","last_clean":"2024-02-18T16:21:40.950616+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:21:40.950616+0000","last_undegraded":"2024-02-18T16:21:40.950616+0000","last_fullsized":"2024-02-18T16:21:40.950616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:28.248701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.394256+0000","last_change":"2024-02-18T16:21:05.897013+0000","last_active":"2024-02-18T16:22:30.394256+0000","last_peered":"2024-02-18T16:22:30.394256+0000","last_clean":"2024-02-18T16:22:30.394256+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:22:30.394256+0000","last_undegraded":"2024-02-18T16:22:30.394256+0000","last_fullsized":"2024-02-18T16:22:30.394256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:16.724717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931649+0000","last_change":"2024-02-18T16:21:07.917711+0000","last_active":"2024-02-18T16:21:40.931649+0000","last_peered":"2024-02-18T16:21:40.931649+0000","last_clean":"2024-02-18T16:21:40.931649+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:21:40.931649+0000","last_undegraded":"2024-02-18T16:21:40.931649+0000","last_fullsized":"2024-02-18T16:21:40.931649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933181+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:21:40.933181+0000","last_peered":"2024-02-18T16:21:40.933181+0000","last_clean":"2024-02-18T16:21:40.933181+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:21:40.933181+0000","last_undegraded":"2024-02-18T16:21:40.933181+0000","last_fullsized":"2024-02-18T16:21:40.933181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:37:16.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952947+0000","last_change":"2024-02-18T16:21:01.858003+0000","last_active":"2024-02-18T16:21:40.952947+0000","last_peered":"2024-02-18T16:21:40.952947+0000","last_clean":"2024-02-18T16:21:40.952947+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:21:40.952947+0000","last_undegraded":"2024-02-18T16:21:40.952947+0000","last_fullsized":"2024-02-18T16:21:40.952947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929693+0000","last_change":"2024-02-18T16:20:59.854045+0000","last_active":"2024-02-18T16:21:40.929693+0000","last_peered":"2024-02-18T16:21:40.929693+0000","last_clean":"2024-02-18T16:21:40.929693+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:21:40.929693+0000","last_undegraded":"2024-02-18T16:21:40.929693+0000","last_fullsized":"2024-02-18T16:21:40.929693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939479+0000","last_change":"2024-02-18T16:21:03.855690+0000","last_active":"2024-02-18T16:21:40.939479+0000","last_peered":"2024-02-18T16:21:40.939479+0000","last_clean":"2024-02-18T16:21:40.939479+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:21:40.939479+0000","last_undegraded":"2024-02-18T16:21:40.939479+0000","last_fullsized":"2024-02-18T16:21:40.939479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:40.744979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.423091+0000","last_change":"2024-02-18T16:21:05.889337+0000","last_active":"2024-02-18T16:22:30.423091+0000","last_peered":"2024-02-18T16:22:30.423091+0000","last_clean":"2024-02-18T16:22:30.423091+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:30.423091+0000","last_undegraded":"2024-02-18T16:22:30.423091+0000","last_fullsized":"2024-02-18T16:22:30.423091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:00.614470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179753+0000","last_change":"2024-02-18T16:21:07.907388+0000","last_active":"2024-02-18T16:21:41.179753+0000","last_peered":"2024-02-18T16:21:41.179753+0000","last_clean":"2024-02-18T16:21:41.179753+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:21:41.179753+0000","last_undegraded":"2024-02-18T16:21:41.179753+0000","last_fullsized":"2024-02-18T16:21:41.179753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:25.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939050+0000","last_change":"2024-02-18T16:21:09.911546+0000","last_active":"2024-02-18T16:21:40.939050+0000","last_peered":"2024-02-18T16:21:40.939050+0000","last_clean":"2024-02-18T16:21:40.939050+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:21:40.939050+0000","last_undegraded":"2024-02-18T16:21:40.939050+0000","last_fullsized":"2024-02-18T16:21:40.939050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:51:41.804331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.856054+0000","last_change":"2024-02-18T16:21:01.840394+0000","last_active":"2024-02-18T16:21:47.856054+0000","last_peered":"2024-02-18T16:21:47.856054+0000","last_clean":"2024-02-18T16:21:47.856054+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:21:47.856054+0000","last_undegraded":"2024-02-18T16:21:47.856054+0000","last_fullsized":"2024-02-18T16:21:47.856054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948852+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:21:40.948852+0000","last_peered":"2024-02-18T16:21:40.948852+0000","last_clean":"2024-02-18T16:21:40.948852+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:21:40.948852+0000","last_undegraded":"2024-02-18T16:21:40.948852+0000","last_fullsized":"2024-02-18T16:21:40.948852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:32.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933457+0000","last_change":"2024-02-18T16:21:03.867900+0000","last_active":"2024-02-18T16:21:40.933457+0000","last_peered":"2024-02-18T16:21:40.933457+0000","last_clean":"2024-02-18T16:21:40.933457+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:21:40.933457+0000","last_undegraded":"2024-02-18T16:21:40.933457+0000","last_fullsized":"2024-02-18T16:21:40.933457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:15.762147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952376+0000","last_change":"2024-02-18T16:21:05.897563+0000","last_active":"2024-02-18T16:21:40.952376+0000","last_peered":"2024-02-18T16:21:40.952376+0000","last_clean":"2024-02-18T16:21:40.952376+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:21:40.952376+0000","last_undegraded":"2024-02-18T16:21:40.952376+0000","last_fullsized":"2024-02-18T16:21:40.952376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:21:22.623751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":304,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.297154+0000","last_change":"2024-02-18T16:21:07.903096+0000","last_active":"2024-02-18T16:22:36.297154+0000","last_peered":"2024-02-18T16:22:36.297154+0000","last_clean":"2024-02-18T16:22:36.297154+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:36.297154+0000","last_undegraded":"2024-02-18T16:22:36.297154+0000","last_fullsized":"2024-02-18T16:22:36.297154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:33.395055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931705+0000","last_change":"2024-02-18T16:21:09.924100+0000","last_active":"2024-02-18T16:21:40.931705+0000","last_peered":"2024-02-18T16:21:40.931705+0000","last_clean":"2024-02-18T16:21:40.931705+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:21:40.931705+0000","last_undegraded":"2024-02-18T16:21:40.931705+0000","last_fullsized":"2024-02-18T16:21:40.931705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:28:24.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940205+0000","last_change":"2024-02-18T16:21:01.837599+0000","last_active":"2024-02-18T16:21:40.940205+0000","last_peered":"2024-02-18T16:21:40.940205+0000","last_clean":"2024-02-18T16:21:40.940205+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:21:40.940205+0000","last_undegraded":"2024-02-18T16:21:40.940205+0000","last_fullsized":"2024-02-18T16:21:40.940205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:07.608465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929848+0000","last_change":"2024-02-18T16:20:59.859857+0000","last_active":"2024-02-18T16:21:40.929848+0000","last_peered":"2024-02-18T16:21:40.929848+0000","last_clean":"2024-02-18T16:21:40.929848+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:21:40.929848+0000","last_undegraded":"2024-02-18T16:21:40.929848+0000","last_fullsized":"2024-02-18T16:21:40.929848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929290+0000","last_change":"2024-02-18T16:21:03.868183+0000","last_active":"2024-02-18T16:21:40.929290+0000","last_peered":"2024-02-18T16:21:40.929290+0000","last_clean":"2024-02-18T16:21:40.929290+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:21:40.929290+0000","last_undegraded":"2024-02-18T16:21:40.929290+0000","last_fullsized":"2024-02-18T16:21:40.929290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:44.654179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.378955+0000","last_change":"2024-02-18T16:21:05.890224+0000","last_active":"2024-02-18T16:22:30.378955+0000","last_peered":"2024-02-18T16:22:30.378955+0000","last_clean":"2024-02-18T16:22:30.378955+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:30.378955+0000","last_undegraded":"2024-02-18T16:22:30.378955+0000","last_fullsized":"2024-02-18T16:22:30.378955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:55.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173856+0000","last_change":"2024-02-18T16:21:07.895448+0000","last_active":"2024-02-18T16:21:41.173856+0000","last_peered":"2024-02-18T16:21:41.173856+0000","last_clean":"2024-02-18T16:21:41.173856+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:21:41.173856+0000","last_undegraded":"2024-02-18T16:21:41.173856+0000","last_fullsized":"2024-02-18T16:21:41.173856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:31.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946969+0000","last_change":"2024-02-18T16:21:09.927008+0000","last_active":"2024-02-18T16:21:40.946969+0000","last_peered":"2024-02-18T16:21:40.946969+0000","last_clean":"2024-02-18T16:21:40.946969+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:21:40.946969+0000","last_undegraded":"2024-02-18T16:21:40.946969+0000","last_fullsized":"2024-02-18T16:21:40.946969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937270+0000","last_change":"2024-02-18T16:21:01.831920+0000","last_active":"2024-02-18T16:21:40.937270+0000","last_peered":"2024-02-18T16:21:40.937270+0000","last_clean":"2024-02-18T16:21:40.937270+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:21:40.937270+0000","last_undegraded":"2024-02-18T16:21:40.937270+0000","last_fullsized":"2024-02-18T16:21:40.937270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951556+0000","last_change":"2024-02-18T16:20:59.872971+0000","last_active":"2024-02-18T16:21:40.951556+0000","last_peered":"2024-02-18T16:21:40.951556+0000","last_clean":"2024-02-18T16:21:40.951556+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:21:40.951556+0000","last_undegraded":"2024-02-18T16:21:40.951556+0000","last_fullsized":"2024-02-18T16:21:40.951556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:31.687324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940611+0000","last_change":"2024-02-18T16:21:03.854122+0000","last_active":"2024-02-18T16:21:40.940611+0000","last_peered":"2024-02-18T16:21:40.940611+0000","last_clean":"2024-02-18T16:21:40.940611+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:21:40.940611+0000","last_undegraded":"2024-02-18T16:21:40.940611+0000","last_fullsized":"2024-02-18T16:21:40.940611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:46.493787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.380857+0000","last_change":"2024-02-18T16:21:05.895074+0000","last_active":"2024-02-18T16:22:30.380857+0000","last_peered":"2024-02-18T16:22:30.380857+0000","last_clean":"2024-02-18T16:22:30.380857+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:30.380857+0000","last_undegraded":"2024-02-18T16:22:30.380857+0000","last_fullsized":"2024-02-18T16:22:30.380857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:29.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932403+0000","last_change":"2024-02-18T16:21:07.908003+0000","last_active":"2024-02-18T16:21:40.932403+0000","last_peered":"2024-02-18T16:21:40.932403+0000","last_clean":"2024-02-18T16:21:40.932403+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:21:40.932403+0000","last_undegraded":"2024-02-18T16:21:40.932403+0000","last_fullsized":"2024-02-18T16:21:40.932403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:07.987144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954186+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:21:40.954186+0000","last_peered":"2024-02-18T16:21:40.954186+0000","last_clean":"2024-02-18T16:21:40.954186+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:21:40.954186+0000","last_undegraded":"2024-02-18T16:21:40.954186+0000","last_fullsized":"2024-02-18T16:21:40.954186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:55:03.922245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.423870+0000","last_change":"2024-02-18T16:21:01.855576+0000","last_active":"2024-02-18T16:21:46.423870+0000","last_peered":"2024-02-18T16:21:46.423870+0000","last_clean":"2024-02-18T16:21:46.423870+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:21:46.423870+0000","last_undegraded":"2024-02-18T16:21:46.423870+0000","last_fullsized":"2024-02-18T16:21:46.423870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:08.162049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180630+0000","last_change":"2024-02-18T16:20:59.862651+0000","last_active":"2024-02-18T16:21:41.180630+0000","last_peered":"2024-02-18T16:21:41.180630+0000","last_clean":"2024-02-18T16:21:41.180630+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:21:41.180630+0000","last_undegraded":"2024-02-18T16:21:41.180630+0000","last_fullsized":"2024-02-18T16:21:41.180630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.176054+0000","last_change":"2024-02-18T16:21:03.858753+0000","last_active":"2024-02-18T16:22:37.176054+0000","last_peered":"2024-02-18T16:22:37.176054+0000","last_clean":"2024-02-18T16:22:37.176054+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:22:37.176054+0000","last_undegraded":"2024-02-18T16:22:37.176054+0000","last_fullsized":"2024-02-18T16:22:37.176054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:47.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.419821+0000","last_change":"2024-02-18T16:21:05.886757+0000","last_active":"2024-02-18T16:22:30.419821+0000","last_peered":"2024-02-18T16:22:30.419821+0000","last_clean":"2024-02-18T16:22:30.419821+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:30.419821+0000","last_undegraded":"2024-02-18T16:22:30.419821+0000","last_fullsized":"2024-02-18T16:22:30.419821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:25:06.744338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938999+0000","last_change":"2024-02-18T16:21:07.912579+0000","last_active":"2024-02-18T16:21:40.938999+0000","last_peered":"2024-02-18T16:21:40.938999+0000","last_clean":"2024-02-18T16:21:40.938999+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:21:40.938999+0000","last_undegraded":"2024-02-18T16:21:40.938999+0000","last_fullsized":"2024-02-18T16:21:40.938999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:03:05.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950786+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:21:40.950786+0000","last_peered":"2024-02-18T16:21:40.950786+0000","last_clean":"2024-02-18T16:21:40.950786+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:21:40.950786+0000","last_undegraded":"2024-02-18T16:21:40.950786+0000","last_fullsized":"2024-02-18T16:21:40.950786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:08.385221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085308+0000","last_change":"2024-02-18T16:21:01.833320+0000","last_active":"2024-02-18T16:22:36.085308+0000","last_peered":"2024-02-18T16:22:36.085308+0000","last_clean":"2024-02-18T16:22:36.085308+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:22:36.085308+0000","last_undegraded":"2024-02-18T16:22:36.085308+0000","last_fullsized":"2024-02-18T16:22:36.085308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:35.898147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946271+0000","last_change":"2024-02-18T16:20:59.855832+0000","last_active":"2024-02-18T16:21:40.946271+0000","last_peered":"2024-02-18T16:21:40.946271+0000","last_clean":"2024-02-18T16:21:40.946271+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:21:40.946271+0000","last_undegraded":"2024-02-18T16:21:40.946271+0000","last_fullsized":"2024-02-18T16:21:40.946271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930567+0000","last_change":"2024-02-18T16:21:03.862714+0000","last_active":"2024-02-18T16:21:40.930567+0000","last_peered":"2024-02-18T16:21:40.930567+0000","last_clean":"2024-02-18T16:21:40.930567+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:21:40.930567+0000","last_undegraded":"2024-02-18T16:21:40.930567+0000","last_fullsized":"2024-02-18T16:21:40.930567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:36.699699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.062152+0000","last_change":"2024-02-18T16:21:05.890834+0000","last_active":"2024-02-18T16:22:36.062152+0000","last_peered":"2024-02-18T16:22:36.062152+0000","last_clean":"2024-02-18T16:22:36.062152+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:22:36.062152+0000","last_undegraded":"2024-02-18T16:22:36.062152+0000","last_fullsized":"2024-02-18T16:22:36.062152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:57:24.200656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":46,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175495+0000","last_change":"2024-02-18T16:21:07.894884+0000","last_active":"2024-02-18T16:21:41.175495+0000","last_peered":"2024-02-18T16:21:41.175495+0000","last_clean":"2024-02-18T16:21:41.175495+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:21:41.175495+0000","last_undegraded":"2024-02-18T16:21:41.175495+0000","last_fullsized":"2024-02-18T16:21:41.175495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.438798+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:30.438798+0000","last_peered":"2024-02-18T16:22:30.438798+0000","last_clean":"2024-02-18T16:22:30.438798+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:30.438798+0000","last_undegraded":"2024-02-18T16:22:30.438798+0000","last_fullsized":"2024-02-18T16:22:30.438798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:31.495612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.845885+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:17:13.639861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932873+0000","last_change":"2024-02-18T16:20:59.838011+0000","last_active":"2024-02-18T16:21:40.932873+0000","last_peered":"2024-02-18T16:21:40.932873+0000","last_clean":"2024-02-18T16:21:40.932873+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:21:40.932873+0000","last_undegraded":"2024-02-18T16:21:40.932873+0000","last_fullsized":"2024-02-18T16:21:40.932873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182948+0000","last_change":"2024-02-18T16:21:01.839946+0000","last_active":"2024-02-18T16:21:41.182948+0000","last_peered":"2024-02-18T16:21:41.182948+0000","last_clean":"2024-02-18T16:21:41.182948+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:21:41.182948+0000","last_undegraded":"2024-02-18T16:21:41.182948+0000","last_fullsized":"2024-02-18T16:21:41.182948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.146551+0000","last_change":"2024-02-18T16:20:59.850717+0000","last_active":"2024-02-18T16:21:47.146551+0000","last_peered":"2024-02-18T16:21:47.146551+0000","last_clean":"2024-02-18T16:21:47.146551+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:21:47.146551+0000","last_undegraded":"2024-02-18T16:21:47.146551+0000","last_fullsized":"2024-02-18T16:21:47.146551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605557+0000","last_change":"2024-02-18T16:21:01.857016+0000","last_active":"2024-02-18T16:22:29.605557+0000","last_peered":"2024-02-18T16:22:29.605557+0000","last_clean":"2024-02-18T16:22:29.605557+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:22:29.605557+0000","last_undegraded":"2024-02-18T16:22:29.605557+0000","last_fullsized":"2024-02-18T16:22:29.605557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:34.686098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.613089+0000","last_change":"2024-02-18T16:20:59.865570+0000","last_active":"2024-02-18T16:22:29.613089+0000","last_peered":"2024-02-18T16:22:29.613089+0000","last_clean":"2024-02-18T16:22:29.613089+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:22:29.613089+0000","last_undegraded":"2024-02-18T16:22:29.613089+0000","last_fullsized":"2024-02-18T16:22:29.613089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:24.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.881324+0000","last_change":"2024-02-18T16:21:01.844340+0000","last_active":"2024-02-18T16:21:46.881324+0000","last_peered":"2024-02-18T16:21:46.881324+0000","last_clean":"2024-02-18T16:21:46.881324+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:21:46.881324+0000","last_undegraded":"2024-02-18T16:21:46.881324+0000","last_fullsized":"2024-02-18T16:21:46.881324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:33.700597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177537+0000","last_change":"2024-02-18T16:20:59.857706+0000","last_active":"2024-02-18T16:21:41.177537+0000","last_peered":"2024-02-18T16:21:41.177537+0000","last_clean":"2024-02-18T16:21:41.177537+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:21:41.177537+0000","last_undegraded":"2024-02-18T16:21:41.177537+0000","last_fullsized":"2024-02-18T16:21:41.177537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:54:03.661573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177027+0000","last_change":"2024-02-18T16:21:01.852407+0000","last_active":"2024-02-18T16:21:41.177027+0000","last_peered":"2024-02-18T16:21:41.177027+0000","last_clean":"2024-02-18T16:21:41.177027+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:21:41.177027+0000","last_undegraded":"2024-02-18T16:21:41.177027+0000","last_fullsized":"2024-02-18T16:21:41.177027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177143+0000","last_change":"2024-02-18T16:20:59.859871+0000","last_active":"2024-02-18T16:21:41.177143+0000","last_peered":"2024-02-18T16:21:41.177143+0000","last_clean":"2024-02-18T16:21:41.177143+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:21:41.177143+0000","last_undegraded":"2024-02-18T16:21:41.177143+0000","last_fullsized":"2024-02-18T16:21:41.177143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085205+0000","last_change":"2024-02-18T16:21:40.963827+0000","last_active":"2024-02-18T16:22:36.085205+0000","last_peered":"2024-02-18T16:22:36.085205+0000","last_clean":"2024-02-18T16:22:36.085205+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:22:36.085205+0000","last_undegraded":"2024-02-18T16:22:36.085205+0000","last_fullsized":"2024-02-18T16:22:36.085205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:13.380313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933696+0000","last_change":"2024-02-18T16:20:59.861914+0000","last_active":"2024-02-18T16:21:40.933696+0000","last_peered":"2024-02-18T16:21:40.933696+0000","last_clean":"2024-02-18T16:21:40.933696+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:21:40.933696+0000","last_undegraded":"2024-02-18T16:21:40.933696+0000","last_fullsized":"2024-02-18T16:21:40.933696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176179+0000","last_change":"2024-02-18T16:21:01.843302+0000","last_active":"2024-02-18T16:21:41.176179+0000","last_peered":"2024-02-18T16:21:41.176179+0000","last_clean":"2024-02-18T16:21:41.176179+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:21:41.176179+0000","last_undegraded":"2024-02-18T16:21:41.176179+0000","last_fullsized":"2024-02-18T16:21:41.176179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953161+0000","last_change":"2024-02-18T16:20:59.835435+0000","last_active":"2024-02-18T16:21:40.953161+0000","last_peered":"2024-02-18T16:21:40.953161+0000","last_clean":"2024-02-18T16:21:40.953161+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:21:40.953161+0000","last_undegraded":"2024-02-18T16:21:40.953161+0000","last_fullsized":"2024-02-18T16:21:40.953161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.424363+0000","last_change":"2024-02-18T16:21:01.838281+0000","last_active":"2024-02-18T16:21:46.424363+0000","last_peered":"2024-02-18T16:21:46.424363+0000","last_clean":"2024-02-18T16:21:46.424363+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:21:46.424363+0000","last_undegraded":"2024-02-18T16:21:46.424363+0000","last_fullsized":"2024-02-18T16:21:46.424363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183281+0000","last_change":"2024-02-18T16:20:59.859552+0000","last_active":"2024-02-18T16:21:41.183281+0000","last_peered":"2024-02-18T16:21:41.183281+0000","last_clean":"2024-02-18T16:21:41.183281+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:21:41.183281+0000","last_undegraded":"2024-02-18T16:21:41.183281+0000","last_fullsized":"2024-02-18T16:21:41.183281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:55:51.749702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947919+0000","last_change":"2024-02-18T16:21:01.840265+0000","last_active":"2024-02-18T16:21:40.947919+0000","last_peered":"2024-02-18T16:21:40.947919+0000","last_clean":"2024-02-18T16:21:40.947919+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:21:40.947919+0000","last_undegraded":"2024-02-18T16:21:40.947919+0000","last_fullsized":"2024-02-18T16:21:40.947919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:26.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934046+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:21:40.934046+0000","last_peered":"2024-02-18T16:21:40.934046+0000","last_clean":"2024-02-18T16:21:40.934046+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:21:40.934046+0000","last_undegraded":"2024-02-18T16:21:40.934046+0000","last_fullsized":"2024-02-18T16:21:40.934046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:53:59.394571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457053+0000","last_change":"2024-02-18T16:21:01.853933+0000","last_active":"2024-02-18T16:22:30.457053+0000","last_peered":"2024-02-18T16:22:30.457053+0000","last_clean":"2024-02-18T16:22:30.457053+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:22:30.457053+0000","last_undegraded":"2024-02-18T16:22:30.457053+0000","last_fullsized":"2024-02-18T16:22:30.457053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.515684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.446026+0000","last_change":"2024-02-18T16:20:59.853659+0000","last_active":"2024-02-18T16:22:30.446026+0000","last_peered":"2024-02-18T16:22:30.446026+0000","last_clean":"2024-02-18T16:22:30.446026+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:22:30.446026+0000","last_undegraded":"2024-02-18T16:22:30.446026+0000","last_fullsized":"2024-02-18T16:22:30.446026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858279+0000","last_change":"2024-02-18T16:21:01.853974+0000","last_active":"2024-02-18T16:21:47.858279+0000","last_peered":"2024-02-18T16:21:47.858279+0000","last_clean":"2024-02-18T16:21:47.858279+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:21:47.858279+0000","last_undegraded":"2024-02-18T16:21:47.858279+0000","last_fullsized":"2024-02-18T16:21:47.858279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930423+0000","last_change":"2024-02-18T16:20:59.859832+0000","last_active":"2024-02-18T16:21:40.930423+0000","last_peered":"2024-02-18T16:21:40.930423+0000","last_clean":"2024-02-18T16:21:40.930423+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:21:40.930423+0000","last_undegraded":"2024-02-18T16:21:40.930423+0000","last_fullsized":"2024-02-18T16:21:40.930423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085223+0000","last_change":"2024-02-18T16:21:01.839367+0000","last_active":"2024-02-18T16:22:36.085223+0000","last_peered":"2024-02-18T16:22:36.085223+0000","last_clean":"2024-02-18T16:22:36.085223+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:22:36.085223+0000","last_undegraded":"2024-02-18T16:22:36.085223+0000","last_fullsized":"2024-02-18T16:22:36.085223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:10.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929055+0000","last_change":"2024-02-18T16:20:59.859222+0000","last_active":"2024-02-18T16:21:40.929055+0000","last_peered":"2024-02-18T16:21:40.929055+0000","last_clean":"2024-02-18T16:21:40.929055+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:21:40.929055+0000","last_undegraded":"2024-02-18T16:21:40.929055+0000","last_fullsized":"2024-02-18T16:21:40.929055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.848741+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951778+0000","last_change":"2024-02-18T16:20:59.863633+0000","last_active":"2024-02-18T16:21:40.951778+0000","last_peered":"2024-02-18T16:21:40.951778+0000","last_clean":"2024-02-18T16:21:40.951778+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:21:40.951778+0000","last_undegraded":"2024-02-18T16:21:40.951778+0000","last_fullsized":"2024-02-18T16:21:40.951778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:52.944418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457179+0000","last_change":"2024-02-18T16:21:01.843918+0000","last_active":"2024-02-18T16:22:30.457179+0000","last_peered":"2024-02-18T16:22:30.457179+0000","last_clean":"2024-02-18T16:22:30.457179+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:22:30.457179+0000","last_undegraded":"2024-02-18T16:22:30.457179+0000","last_fullsized":"2024-02-18T16:22:30.457179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:44.480187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951870+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:21:40.951870+0000","last_peered":"2024-02-18T16:21:40.951870+0000","last_clean":"2024-02-18T16:21:40.951870+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:21:40.951870+0000","last_undegraded":"2024-02-18T16:21:40.951870+0000","last_fullsized":"2024-02-18T16:21:40.951870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:05.595193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939474+0000","last_change":"2024-02-18T16:21:01.855777+0000","last_active":"2024-02-18T16:21:40.939474+0000","last_peered":"2024-02-18T16:21:40.939474+0000","last_clean":"2024-02-18T16:21:40.939474+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:21:40.939474+0000","last_undegraded":"2024-02-18T16:21:40.939474+0000","last_fullsized":"2024-02-18T16:21:40.939474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:58.959710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953859+0000","last_change":"2024-02-18T16:20:59.854737+0000","last_active":"2024-02-18T16:21:40.953859+0000","last_peered":"2024-02-18T16:21:40.953859+0000","last_clean":"2024-02-18T16:21:40.953859+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:21:40.953859+0000","last_undegraded":"2024-02-18T16:21:40.953859+0000","last_fullsized":"2024-02-18T16:21:40.953859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165380+0000","last_change":"2024-02-18T16:21:01.838289+0000","last_active":"2024-02-18T16:21:47.165380+0000","last_peered":"2024-02-18T16:21:47.165380+0000","last_clean":"2024-02-18T16:21:47.165380+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:21:47.165380+0000","last_undegraded":"2024-02-18T16:21:47.165380+0000","last_fullsized":"2024-02-18T16:21:47.165380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955671+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:21:40.955671+0000","last_peered":"2024-02-18T16:21:40.955671+0000","last_clean":"2024-02-18T16:21:40.955671+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:21:40.955671+0000","last_undegraded":"2024-02-18T16:21:40.955671+0000","last_fullsized":"2024-02-18T16:21:40.955671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:18.150893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935916+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:21:40.935916+0000","last_peered":"2024-02-18T16:21:40.935916+0000","last_clean":"2024-02-18T16:21:40.935916+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:21:40.935916+0000","last_undegraded":"2024-02-18T16:21:40.935916+0000","last_fullsized":"2024-02-18T16:21:40.935916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:46:46.292617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.184388+0000","last_change":"2024-02-18T16:21:01.848174+0000","last_active":"2024-02-18T16:21:41.184388+0000","last_peered":"2024-02-18T16:21:41.184388+0000","last_clean":"2024-02-18T16:21:41.184388+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:21:41.184388+0000","last_undegraded":"2024-02-18T16:21:41.184388+0000","last_fullsized":"2024-02-18T16:21:41.184388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:36:39.607508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174728+0000","last_change":"2024-02-18T16:20:59.856141+0000","last_active":"2024-02-18T16:21:41.174728+0000","last_peered":"2024-02-18T16:21:41.174728+0000","last_clean":"2024-02-18T16:21:41.174728+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:21:41.174728+0000","last_undegraded":"2024-02-18T16:21:41.174728+0000","last_fullsized":"2024-02-18T16:21:41.174728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944734+0000","last_change":"2024-02-18T16:21:01.839351+0000","last_active":"2024-02-18T16:21:40.944734+0000","last_peered":"2024-02-18T16:21:40.944734+0000","last_clean":"2024-02-18T16:21:40.944734+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:21:40.944734+0000","last_undegraded":"2024-02-18T16:21:40.944734+0000","last_fullsized":"2024-02-18T16:21:40.944734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:43.462047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.69099999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":18.120999999999999,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.747},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":26.050999999999998,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.71799999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705690,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:22:44.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:22:44.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f894dcfc640 1 Processor -- start 2024-02-18T16:22:44.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f894dcfc640 1 -- start start 2024-02-18T16:22:44.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f894dcfc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8948094500 0x7f8948133510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:44.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f894dcfc640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8948095170 con 0x7f8948093a10 2024-02-18T16:22:44.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f894dcfc640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8948072550 con 0x7f8948094500 2024-02-18T16:22:44.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f8946ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8948094500 0x7f8948133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:44.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f89477fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8948093a10 0x7f8948093df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36610/0 (socket says 172.21.15.80:36610) 2024-02-18T16:22:44.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.824+0000 7f89477fe640 1 -- 172.21.15.80:0/2913298652 learned_addr learned my addr 172.21.15.80:0/2913298652 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:44.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f8946ffd640 1 -- 172.21.15.80:0/2913298652 >> v1:172.21.15.80:6789/0 conn(0x7f8948093a10 legacy=0x7f8948093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f8946ffd640 1 -- 172.21.15.80:0/2913298652 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948094bb0 con 0x7f8948094500 2024-02-18T16:22:44.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f89467fc640 1 -- 172.21.15.80:0/2913298652 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476696089 0 0) 0x7f8948095170 con 0x7f8948093a10 2024-02-18T16:22:44.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f8946ffd640 1 --2- 172.21.15.80:0/2913298652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948094500 0x7f8948133510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f893c009740 tx=0x7f893c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a027c236a3e2b8b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:44.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f89467fc640 1 -- 172.21.15.80:0/2913298652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f893c0ac570 con 0x7f8948094500 2024-02-18T16:22:44.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f89467fc640 1 -- 172.21.15.80:0/2913298652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c0ac6d0 con 0x7f8948094500 2024-02-18T16:22:44.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f89467fc640 1 -- 172.21.15.80:0/2913298652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f893c0ac990 con 0x7f8948094500 2024-02-18T16:22:44.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 -- 172.21.15.80:0/2913298652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948094500 msgr2=0x7f8948133510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:44.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 --2- 172.21.15.80:0/2913298652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948094500 0x7f8948133510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f893c009740 tx=0x7f893c01c370 comp rx=0 tx=0).stop 2024-02-18T16:22:44.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 -- 172.21.15.80:0/2913298652 shutdown_connections 2024-02-18T16:22:44.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 --2- 172.21.15.80:0/2913298652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948094500 0x7f8948133510 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:44.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 -- 172.21.15.80:0/2913298652 >> 172.21.15.80:0/2913298652 conn(0x7f894809a2f0 msgr2=0x7f894809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:44.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 -- 172.21.15.80:0/2913298652 shutdown_connections 2024-02-18T16:22:44.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.828+0000 7f894dcfc640 1 -- 172.21.15.80:0/2913298652 wait complete. 2024-02-18T16:22:44.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 Processor -- start 2024-02-18T16:22:44.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 -- start start 2024-02-18T16:22:44.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 0x7f8948132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:44.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948125a50 con 0x7f8948093a10 2024-02-18T16:22:44.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f89477fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 0x7f8948132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:44.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f89477fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 0x7f8948132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52814/0 (socket says 172.21.15.80:52814) 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f89477fe640 1 -- 172.21.15.80:0/1132909551 learned_addr learned my addr 172.21.15.80:0/1132909551 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f89477fe640 1 -- 172.21.15.80:0/1132909551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009420 con 0x7f8948093a10 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f89477fe640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 0x7f8948132080 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f893800c420 tx=0x7f893800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89380074d0 con 0x7f8948093a10 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938007630 con 0x7f8948093a10 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8948124210 con 0x7f8948093a10 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8938004960 con 0x7f8948093a10 2024-02-18T16:22:44.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948124ea0 con 0x7f8948093a10 2024-02-18T16:22:44.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8948067e00 con 0x7f8948093a10 2024-02-18T16:22:44.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8938004ac0 con 0x7f8948093a10 2024-02-18T16:22:44.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f892ffff640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8934035a10 0x7f8934037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:44.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f8938047e70 con 0x7f8948093a10 2024-02-18T16:22:44.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.832+0000 7f8946ffd640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8934035a10 0x7f8934037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:44.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.836+0000 7f8946ffd640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8934035a10 0x7f8934037ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f893c0ae000 tx=0x7f893c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:44.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.836+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f893801ad70 con 0x7f8948093a10 2024-02-18T16:22:45.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:44.992+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f894808ea80 con 0x7f8934035a10 2024-02-18T16:22:45.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.040+0000 7f892ffff640 1 -- 172.21.15.80:0/1132909551 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673657 (secure 0 0 0) 0x7f894808ea80 con 0x7f8934035a10 2024-02-18T16:22:45.054 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:22:45.060 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8934035a10 msgr2=0x7f8934037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8934035a10 0x7f8934037ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f893c0ae000 tx=0x7f893c008040 comp rx=0 tx=0).stop 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 msgr2=0x7f8948132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 0x7f8948132080 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f893800c420 tx=0x7f893800c8e0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 shutdown_connections 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8934035a10 0x7f8934037ed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 --2- 172.21.15.80:0/1132909551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8948093a10 0x7f8948132080 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 >> 172.21.15.80:0/1132909551 conn(0x7f894809a2f0 msgr2=0x7f894806c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:45.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 shutdown_connections 2024-02-18T16:22:45.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.048+0000 7f894dcfc640 1 -- 172.21.15.80:0/1132909551 wait complete. 2024-02-18T16:22:45.076 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-18T16:22:43.804876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950367+0000","last_change":"2024-02-18T16:20:59.848322+0000","last_active":"2024-02-18T16:21:40.950367+0000","last_peered":"2024-02-18T16:21:40.950367+0000","last_clean":"2024-02-18T16:21:40.950367+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:21:40.950367+0000","last_undegraded":"2024-02-18T16:21:40.950367+0000","last_fullsized":"2024-02-18T16:21:40.950367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436673+0000","last_change":"2024-02-18T16:21:01.837422+0000","last_active":"2024-02-18T16:21:46.436673+0000","last_peered":"2024-02-18T16:21:46.436673+0000","last_clean":"2024-02-18T16:21:46.436673+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:21:46.436673+0000","last_undegraded":"2024-02-18T16:21:46.436673+0000","last_fullsized":"2024-02-18T16:21:46.436673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180695+0000","last_change":"2024-02-18T16:20:59.862127+0000","last_active":"2024-02-18T16:21:41.180695+0000","last_peered":"2024-02-18T16:21:41.180695+0000","last_clean":"2024-02-18T16:21:41.180695+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:21:41.180695+0000","last_undegraded":"2024-02-18T16:21:41.180695+0000","last_fullsized":"2024-02-18T16:21:41.180695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165685+0000","last_change":"2024-02-18T16:21:01.856123+0000","last_active":"2024-02-18T16:21:47.165685+0000","last_peered":"2024-02-18T16:21:47.165685+0000","last_clean":"2024-02-18T16:21:47.165685+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:21:47.165685+0000","last_undegraded":"2024-02-18T16:21:47.165685+0000","last_fullsized":"2024-02-18T16:21:47.165685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:42.640579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952271+0000","last_change":"2024-02-18T16:20:59.872708+0000","last_active":"2024-02-18T16:21:40.952271+0000","last_peered":"2024-02-18T16:21:40.952271+0000","last_clean":"2024-02-18T16:21:40.952271+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:21:40.952271+0000","last_undegraded":"2024-02-18T16:21:40.952271+0000","last_fullsized":"2024-02-18T16:21:40.952271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:12.199846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456931+0000","last_change":"2024-02-18T16:21:01.856474+0000","last_active":"2024-02-18T16:22:30.456931+0000","last_peered":"2024-02-18T16:22:30.456931+0000","last_clean":"2024-02-18T16:22:30.456931+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:22:30.456931+0000","last_undegraded":"2024-02-18T16:22:30.456931+0000","last_fullsized":"2024-02-18T16:22:30.456931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:13.748546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938237+0000","last_change":"2024-02-18T16:20:59.833010+0000","last_active":"2024-02-18T16:21:40.938237+0000","last_peered":"2024-02-18T16:21:40.938237+0000","last_clean":"2024-02-18T16:21:40.938237+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:21:40.938237+0000","last_undegraded":"2024-02-18T16:21:40.938237+0000","last_fullsized":"2024-02-18T16:21:40.938237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457019+0000","last_change":"2024-02-18T16:21:01.857441+0000","last_active":"2024-02-18T16:22:30.457019+0000","last_peered":"2024-02-18T16:22:30.457019+0000","last_clean":"2024-02-18T16:22:30.457019+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:22:30.457019+0000","last_undegraded":"2024-02-18T16:22:30.457019+0000","last_fullsized":"2024-02-18T16:22:30.457019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:02.458464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949134+0000","last_change":"2024-02-18T16:20:59.868597+0000","last_active":"2024-02-18T16:21:40.949134+0000","last_peered":"2024-02-18T16:21:40.949134+0000","last_clean":"2024-02-18T16:21:40.949134+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:21:40.949134+0000","last_undegraded":"2024-02-18T16:21:40.949134+0000","last_fullsized":"2024-02-18T16:21:40.949134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:31.249657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085312+0000","last_change":"2024-02-18T16:21:01.836895+0000","last_active":"2024-02-18T16:22:36.085312+0000","last_peered":"2024-02-18T16:22:36.085312+0000","last_clean":"2024-02-18T16:22:36.085312+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:22:36.085312+0000","last_undegraded":"2024-02-18T16:22:36.085312+0000","last_fullsized":"2024-02-18T16:22:36.085312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:15.712412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937535+0000","last_change":"2024-02-18T16:20:59.827833+0000","last_active":"2024-02-18T16:21:40.937535+0000","last_peered":"2024-02-18T16:21:40.937535+0000","last_clean":"2024-02-18T16:21:40.937535+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:21:40.937535+0000","last_undegraded":"2024-02-18T16:21:40.937535+0000","last_fullsized":"2024-02-18T16:21:40.937535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.868753+0000","last_change":"2024-02-18T16:21:01.856191+0000","last_active":"2024-02-18T16:21:47.868753+0000","last_peered":"2024-02-18T16:21:47.868753+0000","last_clean":"2024-02-18T16:21:47.868753+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:21:47.868753+0000","last_undegraded":"2024-02-18T16:21:47.868753+0000","last_fullsized":"2024-02-18T16:21:47.868753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:03.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.077672+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:36.077672+0000","last_peered":"2024-02-18T16:22:36.077672+0000","last_clean":"2024-02-18T16:22:36.077672+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:36.077672+0000","last_undegraded":"2024-02-18T16:22:36.077672+0000","last_fullsized":"2024-02-18T16:22:36.077672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:39:01.643786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085590+0000","last_change":"2024-02-18T16:21:01.831792+0000","last_active":"2024-02-18T16:22:36.085590+0000","last_peered":"2024-02-18T16:22:36.085590+0000","last_clean":"2024-02-18T16:22:36.085590+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:22:36.085590+0000","last_undegraded":"2024-02-18T16:22:36.085590+0000","last_fullsized":"2024-02-18T16:22:36.085590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174557+0000","last_change":"2024-02-18T16:20:59.851482+0000","last_active":"2024-02-18T16:21:41.174557+0000","last_peered":"2024-02-18T16:21:41.174557+0000","last_clean":"2024-02-18T16:21:41.174557+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:21:41.174557+0000","last_undegraded":"2024-02-18T16:21:41.174557+0000","last_fullsized":"2024-02-18T16:21:41.174557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871870+0000","last_change":"2024-02-18T16:21:01.845622+0000","last_active":"2024-02-18T16:21:46.871870+0000","last_peered":"2024-02-18T16:21:46.871870+0000","last_clean":"2024-02-18T16:21:46.871870+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:21:46.871870+0000","last_undegraded":"2024-02-18T16:21:46.871870+0000","last_fullsized":"2024-02-18T16:21:46.871870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471613+0000","last_change":"2024-02-18T16:21:01.852206+0000","last_active":"2024-02-18T16:22:30.471613+0000","last_peered":"2024-02-18T16:22:30.471613+0000","last_clean":"2024-02-18T16:22:30.471613+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:22:30.471613+0000","last_undegraded":"2024-02-18T16:22:30.471613+0000","last_fullsized":"2024-02-18T16:22:30.471613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:45.548759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946674+0000","last_change":"2024-02-18T16:20:59.861096+0000","last_active":"2024-02-18T16:21:40.946674+0000","last_peered":"2024-02-18T16:21:40.946674+0000","last_clean":"2024-02-18T16:21:40.946674+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:21:40.946674+0000","last_undegraded":"2024-02-18T16:21:40.946674+0000","last_fullsized":"2024-02-18T16:21:40.946674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457228+0000","last_change":"2024-02-18T16:21:01.833772+0000","last_active":"2024-02-18T16:22:30.457228+0000","last_peered":"2024-02-18T16:22:30.457228+0000","last_clean":"2024-02-18T16:22:30.457228+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:22:30.457228+0000","last_undegraded":"2024-02-18T16:22:30.457228+0000","last_fullsized":"2024-02-18T16:22:30.457228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954107+0000","last_change":"2024-02-18T16:20:59.858318+0000","last_active":"2024-02-18T16:21:40.954107+0000","last_peered":"2024-02-18T16:21:40.954107+0000","last_clean":"2024-02-18T16:21:40.954107+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:21:40.954107+0000","last_undegraded":"2024-02-18T16:21:40.954107+0000","last_fullsized":"2024-02-18T16:21:40.954107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085421+0000","last_change":"2024-02-18T16:21:01.848259+0000","last_active":"2024-02-18T16:22:36.085421+0000","last_peered":"2024-02-18T16:22:36.085421+0000","last_clean":"2024-02-18T16:22:36.085421+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:22:36.085421+0000","last_undegraded":"2024-02-18T16:22:36.085421+0000","last_fullsized":"2024-02-18T16:22:36.085421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.151295+0000","last_change":"2024-02-18T16:20:59.862404+0000","last_active":"2024-02-18T16:21:47.151295+0000","last_peered":"2024-02-18T16:21:47.151295+0000","last_clean":"2024-02-18T16:21:47.151295+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:21:47.151295+0000","last_undegraded":"2024-02-18T16:21:47.151295+0000","last_fullsized":"2024-02-18T16:21:47.151295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085319+0000","last_change":"2024-02-18T16:21:01.844448+0000","last_active":"2024-02-18T16:22:36.085319+0000","last_peered":"2024-02-18T16:22:36.085319+0000","last_clean":"2024-02-18T16:22:36.085319+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:22:36.085319+0000","last_undegraded":"2024-02-18T16:22:36.085319+0000","last_fullsized":"2024-02-18T16:22:36.085319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929557+0000","last_change":"2024-02-18T16:20:59.861087+0000","last_active":"2024-02-18T16:21:40.929557+0000","last_peered":"2024-02-18T16:21:40.929557+0000","last_clean":"2024-02-18T16:21:40.929557+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:21:40.929557+0000","last_undegraded":"2024-02-18T16:21:40.929557+0000","last_fullsized":"2024-02-18T16:21:40.929557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605978+0000","last_change":"2024-02-18T16:21:01.849052+0000","last_active":"2024-02-18T16:22:29.605978+0000","last_peered":"2024-02-18T16:22:29.605978+0000","last_clean":"2024-02-18T16:22:29.605978+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:22:29.605978+0000","last_undegraded":"2024-02-18T16:22:29.605978+0000","last_fullsized":"2024-02-18T16:22:29.605978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.157404+0000","last_change":"2024-02-18T16:20:59.860613+0000","last_active":"2024-02-18T16:21:47.157404+0000","last_peered":"2024-02-18T16:21:47.157404+0000","last_clean":"2024-02-18T16:21:47.157404+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:21:47.157404+0000","last_undegraded":"2024-02-18T16:21:47.157404+0000","last_fullsized":"2024-02-18T16:21:47.157404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085347+0000","last_change":"2024-02-18T16:21:01.838527+0000","last_active":"2024-02-18T16:22:36.085347+0000","last_peered":"2024-02-18T16:22:36.085347+0000","last_clean":"2024-02-18T16:22:36.085347+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:22:36.085347+0000","last_undegraded":"2024-02-18T16:22:36.085347+0000","last_fullsized":"2024-02-18T16:22:36.085347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:26.235100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940659+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:21:40.940659+0000","last_peered":"2024-02-18T16:21:40.940659+0000","last_clean":"2024-02-18T16:21:40.940659+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:21:40.940659+0000","last_undegraded":"2024-02-18T16:21:40.940659+0000","last_fullsized":"2024-02-18T16:21:40.940659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.743095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.071636+0000","last_change":"2024-02-18T16:21:09.915975+0000","last_active":"2024-02-18T16:22:36.071636+0000","last_peered":"2024-02-18T16:22:36.071636+0000","last_clean":"2024-02-18T16:22:36.071636+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:22:36.071636+0000","last_undegraded":"2024-02-18T16:22:36.071636+0000","last_fullsized":"2024-02-18T16:22:36.071636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:47.379422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605701+0000","last_change":"2024-02-18T16:21:01.853570+0000","last_active":"2024-02-18T16:22:29.605701+0000","last_peered":"2024-02-18T16:22:29.605701+0000","last_clean":"2024-02-18T16:22:29.605701+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:22:29.605701+0000","last_undegraded":"2024-02-18T16:22:29.605701+0000","last_fullsized":"2024-02-18T16:22:29.605701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:25.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.140958+0000","last_change":"2024-02-18T16:20:59.871560+0000","last_active":"2024-02-18T16:21:47.140958+0000","last_peered":"2024-02-18T16:21:47.140958+0000","last_clean":"2024-02-18T16:21:47.140958+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:21:47.140958+0000","last_undegraded":"2024-02-18T16:21:47.140958+0000","last_fullsized":"2024-02-18T16:21:47.140958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:22.719740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950984+0000","last_change":"2024-02-18T16:21:03.855757+0000","last_active":"2024-02-18T16:21:40.950984+0000","last_peered":"2024-02-18T16:21:40.950984+0000","last_clean":"2024-02-18T16:21:40.950984+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:21:40.950984+0000","last_undegraded":"2024-02-18T16:21:40.950984+0000","last_fullsized":"2024-02-18T16:21:40.950984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:32.293153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.407799+0000","last_change":"2024-02-18T16:21:05.901603+0000","last_active":"2024-02-18T16:22:30.407799+0000","last_peered":"2024-02-18T16:22:30.407799+0000","last_clean":"2024-02-18T16:22:30.407799+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:22:30.407799+0000","last_undegraded":"2024-02-18T16:22:30.407799+0000","last_fullsized":"2024-02-18T16:22:30.407799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:06:03.628864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946001+0000","last_change":"2024-02-18T16:21:07.918527+0000","last_active":"2024-02-18T16:21:40.946001+0000","last_peered":"2024-02-18T16:21:40.946001+0000","last_clean":"2024-02-18T16:21:40.946001+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:21:40.946001+0000","last_undegraded":"2024-02-18T16:21:40.946001+0000","last_fullsized":"2024-02-18T16:21:40.946001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.550475+0000","last_change":"2024-02-18T16:21:09.916272+0000","last_active":"2024-02-18T16:22:24.550475+0000","last_peered":"2024-02-18T16:22:24.550475+0000","last_clean":"2024-02-18T16:22:24.550475+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:22:24.550475+0000","last_undegraded":"2024-02-18T16:22:24.550475+0000","last_fullsized":"2024-02-18T16:22:24.550475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951709+0000","last_change":"2024-02-18T16:21:01.856905+0000","last_active":"2024-02-18T16:21:40.951709+0000","last_peered":"2024-02-18T16:21:40.951709+0000","last_clean":"2024-02-18T16:21:40.951709+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:21:40.951709+0000","last_undegraded":"2024-02-18T16:21:40.951709+0000","last_fullsized":"2024-02-18T16:21:40.951709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:29.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936829+0000","last_change":"2024-02-18T16:20:59.829726+0000","last_active":"2024-02-18T16:21:40.936829+0000","last_peered":"2024-02-18T16:21:40.936829+0000","last_clean":"2024-02-18T16:21:40.936829+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:21:40.936829+0000","last_undegraded":"2024-02-18T16:21:40.936829+0000","last_fullsized":"2024-02-18T16:21:40.936829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175923+0000","last_change":"2024-02-18T16:21:03.852211+0000","last_active":"2024-02-18T16:21:41.175923+0000","last_peered":"2024-02-18T16:21:41.175923+0000","last_clean":"2024-02-18T16:21:41.175923+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:21:41.175923+0000","last_undegraded":"2024-02-18T16:21:41.175923+0000","last_fullsized":"2024-02-18T16:21:41.175923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:26.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944532+0000","last_change":"2024-02-18T16:21:05.875530+0000","last_active":"2024-02-18T16:21:40.944532+0000","last_peered":"2024-02-18T16:21:40.944532+0000","last_clean":"2024-02-18T16:21:40.944532+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:21:40.944532+0000","last_undegraded":"2024-02-18T16:21:40.944532+0000","last_fullsized":"2024-02-18T16:21:40.944532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:31.379508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937157+0000","last_change":"2024-02-18T16:21:07.909691+0000","last_active":"2024-02-18T16:21:40.937157+0000","last_peered":"2024-02-18T16:21:40.937157+0000","last_clean":"2024-02-18T16:21:40.937157+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:21:40.937157+0000","last_undegraded":"2024-02-18T16:21:40.937157+0000","last_fullsized":"2024-02-18T16:21:40.937157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173888+0000","last_change":"2024-02-18T16:21:09.926133+0000","last_active":"2024-02-18T16:21:41.173888+0000","last_peered":"2024-02-18T16:21:41.173888+0000","last_clean":"2024-02-18T16:21:41.173888+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:21:41.173888+0000","last_undegraded":"2024-02-18T16:21:41.173888+0000","last_fullsized":"2024-02-18T16:21:41.173888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098429+0000","last_change":"2024-02-18T16:21:41.176291+0000","last_active":"2024-02-18T16:22:36.098429+0000","last_peered":"2024-02-18T16:22:36.098429+0000","last_clean":"2024-02-18T16:22:36.098429+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:22:36.098429+0000","last_undegraded":"2024-02-18T16:22:36.098429+0000","last_fullsized":"2024-02-18T16:22:36.098429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:36.303877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933821+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:21:40.933821+0000","last_peered":"2024-02-18T16:21:40.933821+0000","last_clean":"2024-02-18T16:21:40.933821+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:21:40.933821+0000","last_undegraded":"2024-02-18T16:21:40.933821+0000","last_fullsized":"2024-02-18T16:21:40.933821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:46:08.501321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956515+0000","last_change":"2024-02-18T16:21:40.955018+0000","last_active":"2024-02-18T16:21:40.956515+0000","last_peered":"2024-02-18T16:21:40.956515+0000","last_clean":"2024-02-18T16:21:40.956515+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:21:40.956515+0000","last_undegraded":"2024-02-18T16:21:40.956515+0000","last_fullsized":"2024-02-18T16:21:40.956515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:41.335446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937307+0000","last_change":"2024-02-18T16:21:05.895213+0000","last_active":"2024-02-18T16:21:40.937307+0000","last_peered":"2024-02-18T16:21:40.937307+0000","last_clean":"2024-02-18T16:21:40.937307+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:21:40.937307+0000","last_undegraded":"2024-02-18T16:21:40.937307+0000","last_fullsized":"2024-02-18T16:21:40.937307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:22.737750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":305,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.301651+0000","last_change":"2024-02-18T16:21:07.917843+0000","last_active":"2024-02-18T16:22:36.301651+0000","last_peered":"2024-02-18T16:22:36.301651+0000","last_clean":"2024-02-18T16:22:36.301651+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:22:36.301651+0000","last_undegraded":"2024-02-18T16:22:36.301651+0000","last_fullsized":"2024-02-18T16:22:36.301651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:42:39.457576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936747+0000","last_change":"2024-02-18T16:21:09.929317+0000","last_active":"2024-02-18T16:21:40.936747+0000","last_peered":"2024-02-18T16:21:40.936747+0000","last_clean":"2024-02-18T16:21:40.936747+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:21:40.936747+0000","last_undegraded":"2024-02-18T16:21:40.936747+0000","last_fullsized":"2024-02-18T16:21:40.936747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:09.795840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183777+0000","last_change":"2024-02-18T16:21:01.841643+0000","last_active":"2024-02-18T16:21:41.183777+0000","last_peered":"2024-02-18T16:21:41.183777+0000","last_clean":"2024-02-18T16:21:41.183777+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:21:41.183777+0000","last_undegraded":"2024-02-18T16:21:41.183777+0000","last_fullsized":"2024-02-18T16:21:41.183777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927879+0000","last_change":"2024-02-18T16:20:59.860132+0000","last_active":"2024-02-18T16:21:40.927879+0000","last_peered":"2024-02-18T16:21:40.927879+0000","last_clean":"2024-02-18T16:21:40.927879+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:21:40.927879+0000","last_undegraded":"2024-02-18T16:21:40.927879+0000","last_fullsized":"2024-02-18T16:21:40.927879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:46:23.673530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.960144+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:21:40.960144+0000","last_peered":"2024-02-18T16:21:40.960144+0000","last_clean":"2024-02-18T16:21:40.960144+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:21:40.960144+0000","last_undegraded":"2024-02-18T16:21:40.960144+0000","last_fullsized":"2024-02-18T16:21:40.960144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:24.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.399232+0000","last_change":"2024-02-18T16:21:05.888007+0000","last_active":"2024-02-18T16:22:30.399232+0000","last_peered":"2024-02-18T16:22:30.399232+0000","last_clean":"2024-02-18T16:22:30.399232+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:30.399232+0000","last_undegraded":"2024-02-18T16:22:30.399232+0000","last_fullsized":"2024-02-18T16:22:30.399232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:15.657774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.307880+0000","last_change":"2024-02-18T16:21:07.907499+0000","last_active":"2024-02-18T16:22:36.307880+0000","last_peered":"2024-02-18T16:22:36.307880+0000","last_clean":"2024-02-18T16:22:36.307880+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:22:36.307880+0000","last_undegraded":"2024-02-18T16:22:36.307880+0000","last_fullsized":"2024-02-18T16:22:36.307880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936628+0000","last_change":"2024-02-18T16:21:01.852914+0000","last_active":"2024-02-18T16:21:40.936628+0000","last_peered":"2024-02-18T16:21:40.936628+0000","last_clean":"2024-02-18T16:21:40.936628+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:21:40.936628+0000","last_undegraded":"2024-02-18T16:21:40.936628+0000","last_fullsized":"2024-02-18T16:21:40.936628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:11.629778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948658+0000","last_change":"2024-02-18T16:20:59.835343+0000","last_active":"2024-02-18T16:21:40.948658+0000","last_peered":"2024-02-18T16:21:40.948658+0000","last_clean":"2024-02-18T16:21:40.948658+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:21:40.948658+0000","last_undegraded":"2024-02-18T16:21:40.948658+0000","last_fullsized":"2024-02-18T16:21:40.948658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928167+0000","last_change":"2024-02-18T16:21:03.865004+0000","last_active":"2024-02-18T16:21:40.928167+0000","last_peered":"2024-02-18T16:21:40.928167+0000","last_clean":"2024-02-18T16:21:40.928167+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:21:40.928167+0000","last_undegraded":"2024-02-18T16:21:40.928167+0000","last_fullsized":"2024-02-18T16:21:40.928167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:19:00.973310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.415467+0000","last_change":"2024-02-18T16:21:05.885363+0000","last_active":"2024-02-18T16:22:30.415467+0000","last_peered":"2024-02-18T16:22:30.415467+0000","last_clean":"2024-02-18T16:22:30.415467+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:22:30.415467+0000","last_undegraded":"2024-02-18T16:22:30.415467+0000","last_fullsized":"2024-02-18T16:22:30.415467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:15.677159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177269+0000","last_change":"2024-02-18T16:21:07.907548+0000","last_active":"2024-02-18T16:21:41.177269+0000","last_peered":"2024-02-18T16:21:41.177269+0000","last_clean":"2024-02-18T16:21:41.177269+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:21:41.177269+0000","last_undegraded":"2024-02-18T16:21:41.177269+0000","last_fullsized":"2024-02-18T16:21:41.177269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:36.323096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.170197+0000","last_change":"2024-02-18T16:21:09.918869+0000","last_active":"2024-02-18T16:22:30.170197+0000","last_peered":"2024-02-18T16:22:30.170197+0000","last_clean":"2024-02-18T16:22:30.170197+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:22:30.170197+0000","last_undegraded":"2024-02-18T16:22:30.170197+0000","last_fullsized":"2024-02-18T16:22:30.170197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:04.707222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929560+0000","last_change":"2024-02-18T16:21:01.843254+0000","last_active":"2024-02-18T16:21:40.929560+0000","last_peered":"2024-02-18T16:21:40.929560+0000","last_clean":"2024-02-18T16:21:40.929560+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:21:40.929560+0000","last_undegraded":"2024-02-18T16:21:40.929560+0000","last_fullsized":"2024-02-18T16:21:40.929560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946541+0000","last_change":"2024-02-18T16:20:59.832949+0000","last_active":"2024-02-18T16:21:40.946541+0000","last_peered":"2024-02-18T16:21:40.946541+0000","last_clean":"2024-02-18T16:21:40.946541+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:21:40.946541+0000","last_undegraded":"2024-02-18T16:21:40.946541+0000","last_fullsized":"2024-02-18T16:21:40.946541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174581+0000","last_change":"2024-02-18T16:21:03.866038+0000","last_active":"2024-02-18T16:21:41.174581+0000","last_peered":"2024-02-18T16:21:41.174581+0000","last_clean":"2024-02-18T16:21:41.174581+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:21:41.174581+0000","last_undegraded":"2024-02-18T16:21:41.174581+0000","last_fullsized":"2024-02-18T16:21:41.174581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:20.723354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.475520+0000","last_change":"2024-02-18T16:21:05.902821+0000","last_active":"2024-02-18T16:22:30.475520+0000","last_peered":"2024-02-18T16:22:30.475520+0000","last_clean":"2024-02-18T16:22:30.475520+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:22:30.475520+0000","last_undegraded":"2024-02-18T16:22:30.475520+0000","last_fullsized":"2024-02-18T16:22:30.475520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:10:54.114055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176144+0000","last_change":"2024-02-18T16:21:07.896519+0000","last_active":"2024-02-18T16:21:41.176144+0000","last_peered":"2024-02-18T16:21:41.176144+0000","last_clean":"2024-02-18T16:21:41.176144+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:21:41.176144+0000","last_undegraded":"2024-02-18T16:21:41.176144+0000","last_fullsized":"2024-02-18T16:21:41.176144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.400852+0000","last_change":"2024-02-18T16:21:09.931902+0000","last_active":"2024-02-18T16:22:24.400852+0000","last_peered":"2024-02-18T16:22:24.400852+0000","last_clean":"2024-02-18T16:22:24.400852+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:22:24.400852+0000","last_undegraded":"2024-02-18T16:22:24.400852+0000","last_fullsized":"2024-02-18T16:22:24.400852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.164976+0000","last_change":"2024-02-18T16:21:01.851100+0000","last_active":"2024-02-18T16:21:47.164976+0000","last_peered":"2024-02-18T16:21:47.164976+0000","last_clean":"2024-02-18T16:21:47.164976+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:21:47.164976+0000","last_undegraded":"2024-02-18T16:21:47.164976+0000","last_fullsized":"2024-02-18T16:21:47.164976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:34.686883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.393724+0000","last_change":"2024-02-18T16:20:59.873014+0000","last_active":"2024-02-18T16:21:46.393724+0000","last_peered":"2024-02-18T16:21:46.393724+0000","last_clean":"2024-02-18T16:21:46.393724+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:21:46.393724+0000","last_undegraded":"2024-02-18T16:21:46.393724+0000","last_fullsized":"2024-02-18T16:21:46.393724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:13.577731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176424+0000","last_change":"2024-02-18T16:21:03.860965+0000","last_active":"2024-02-18T16:21:41.176424+0000","last_peered":"2024-02-18T16:21:41.176424+0000","last_clean":"2024-02-18T16:21:41.176424+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:21:41.176424+0000","last_undegraded":"2024-02-18T16:21:41.176424+0000","last_fullsized":"2024-02-18T16:21:41.176424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:49:52.683114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.418535+0000","last_change":"2024-02-18T16:21:05.886545+0000","last_active":"2024-02-18T16:22:30.418535+0000","last_peered":"2024-02-18T16:22:30.418535+0000","last_clean":"2024-02-18T16:22:30.418535+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:30.418535+0000","last_undegraded":"2024-02-18T16:22:30.418535+0000","last_fullsized":"2024-02-18T16:22:30.418535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:42.523543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.309717+0000","last_change":"2024-02-18T16:21:07.901321+0000","last_active":"2024-02-18T16:22:36.309717+0000","last_peered":"2024-02-18T16:22:36.309717+0000","last_clean":"2024-02-18T16:22:36.309717+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:36.309717+0000","last_undegraded":"2024-02-18T16:22:36.309717+0000","last_fullsized":"2024-02-18T16:22:36.309717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179560+0000","last_change":"2024-02-18T16:21:09.926915+0000","last_active":"2024-02-18T16:21:41.179560+0000","last_peered":"2024-02-18T16:21:41.179560+0000","last_clean":"2024-02-18T16:21:41.179560+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:21:41.179560+0000","last_undegraded":"2024-02-18T16:21:41.179560+0000","last_fullsized":"2024-02-18T16:21:41.179560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:45.424448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165040+0000","last_change":"2024-02-18T16:21:01.837388+0000","last_active":"2024-02-18T16:21:47.165040+0000","last_peered":"2024-02-18T16:21:47.165040+0000","last_clean":"2024-02-18T16:21:47.165040+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:21:47.165040+0000","last_undegraded":"2024-02-18T16:21:47.165040+0000","last_fullsized":"2024-02-18T16:21:47.165040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:54.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951017+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:21:40.951017+0000","last_peered":"2024-02-18T16:21:40.951017+0000","last_clean":"2024-02-18T16:21:40.951017+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:21:40.951017+0000","last_undegraded":"2024-02-18T16:21:40.951017+0000","last_fullsized":"2024-02-18T16:21:40.951017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:50.834394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174589+0000","last_change":"2024-02-18T16:21:03.871286+0000","last_active":"2024-02-18T16:21:41.174589+0000","last_peered":"2024-02-18T16:21:41.174589+0000","last_clean":"2024-02-18T16:21:41.174589+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:21:41.174589+0000","last_undegraded":"2024-02-18T16:21:41.174589+0000","last_fullsized":"2024-02-18T16:21:41.174589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:42.607662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.031258+0000","last_change":"2024-02-18T16:21:05.901392+0000","last_active":"2024-02-18T16:22:36.031258+0000","last_peered":"2024-02-18T16:22:36.031258+0000","last_clean":"2024-02-18T16:22:36.031258+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:22:36.031258+0000","last_undegraded":"2024-02-18T16:22:36.031258+0000","last_fullsized":"2024-02-18T16:22:36.031258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:17:42.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174155+0000","last_change":"2024-02-18T16:21:07.899232+0000","last_active":"2024-02-18T16:21:41.174155+0000","last_peered":"2024-02-18T16:21:41.174155+0000","last_clean":"2024-02-18T16:21:41.174155+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:21:41.174155+0000","last_undegraded":"2024-02-18T16:21:41.174155+0000","last_fullsized":"2024-02-18T16:21:41.174155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182379+0000","last_change":"2024-02-18T16:21:09.901860+0000","last_active":"2024-02-18T16:21:41.182379+0000","last_peered":"2024-02-18T16:21:41.182379+0000","last_clean":"2024-02-18T16:21:41.182379+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:21:41.182379+0000","last_undegraded":"2024-02-18T16:21:41.182379+0000","last_fullsized":"2024-02-18T16:21:41.182379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:12:00.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955531+0000","last_change":"2024-02-18T16:21:40.945387+0000","last_active":"2024-02-18T16:21:40.955531+0000","last_peered":"2024-02-18T16:21:40.955531+0000","last_clean":"2024-02-18T16:21:40.955531+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:21:40.955531+0000","last_undegraded":"2024-02-18T16:21:40.955531+0000","last_fullsized":"2024-02-18T16:21:40.955531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:56.813772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176709+0000","last_change":"2024-02-18T16:20:59.857151+0000","last_active":"2024-02-18T16:21:41.176709+0000","last_peered":"2024-02-18T16:21:41.176709+0000","last_clean":"2024-02-18T16:21:41.176709+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:21:41.176709+0000","last_undegraded":"2024-02-18T16:21:41.176709+0000","last_fullsized":"2024-02-18T16:21:41.176709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941688+0000","last_change":"2024-02-18T16:21:03.858681+0000","last_active":"2024-02-18T16:21:40.941688+0000","last_peered":"2024-02-18T16:21:40.941688+0000","last_clean":"2024-02-18T16:21:40.941688+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:21:40.941688+0000","last_undegraded":"2024-02-18T16:21:40.941688+0000","last_fullsized":"2024-02-18T16:21:40.941688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:12.798570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.388713+0000","last_change":"2024-02-18T16:21:05.883774+0000","last_active":"2024-02-18T16:22:30.388713+0000","last_peered":"2024-02-18T16:22:30.388713+0000","last_clean":"2024-02-18T16:22:30.388713+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:30.388713+0000","last_undegraded":"2024-02-18T16:22:30.388713+0000","last_fullsized":"2024-02-18T16:22:30.388713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:03.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954455+0000","last_change":"2024-02-18T16:21:07.917345+0000","last_active":"2024-02-18T16:21:40.954455+0000","last_peered":"2024-02-18T16:21:40.954455+0000","last_clean":"2024-02-18T16:21:40.954455+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:21:40.954455+0000","last_undegraded":"2024-02-18T16:21:40.954455+0000","last_fullsized":"2024-02-18T16:21:40.954455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:07:30.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931965+0000","last_change":"2024-02-18T16:21:09.920227+0000","last_active":"2024-02-18T16:21:40.931965+0000","last_peered":"2024-02-18T16:21:40.931965+0000","last_clean":"2024-02-18T16:21:40.931965+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:21:40.931965+0000","last_undegraded":"2024-02-18T16:21:40.931965+0000","last_fullsized":"2024-02-18T16:21:40.931965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:48:17.637183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457048+0000","last_change":"2024-02-18T16:21:01.858118+0000","last_active":"2024-02-18T16:22:30.457048+0000","last_peered":"2024-02-18T16:22:30.457048+0000","last_clean":"2024-02-18T16:22:30.457048+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:30.457048+0000","last_undegraded":"2024-02-18T16:22:30.457048+0000","last_fullsized":"2024-02-18T16:22:30.457048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:17.368689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947140+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:21:40.947140+0000","last_peered":"2024-02-18T16:21:40.947140+0000","last_clean":"2024-02-18T16:21:40.947140+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:21:40.947140+0000","last_undegraded":"2024-02-18T16:21:40.947140+0000","last_fullsized":"2024-02-18T16:21:40.947140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:24.038884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176422+0000","last_change":"2024-02-18T16:21:03.865714+0000","last_active":"2024-02-18T16:21:41.176422+0000","last_peered":"2024-02-18T16:21:41.176422+0000","last_clean":"2024-02-18T16:21:41.176422+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:21:41.176422+0000","last_undegraded":"2024-02-18T16:21:41.176422+0000","last_fullsized":"2024-02-18T16:21:41.176422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:14.663950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.434437+0000","last_change":"2024-02-18T16:21:05.875396+0000","last_active":"2024-02-18T16:22:30.434437+0000","last_peered":"2024-02-18T16:22:30.434437+0000","last_clean":"2024-02-18T16:22:30.434437+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:22:30.434437+0000","last_undegraded":"2024-02-18T16:22:30.434437+0000","last_fullsized":"2024-02-18T16:22:30.434437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:46.668575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":321,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.302732+0000","last_change":"2024-02-18T16:21:07.904059+0000","last_active":"2024-02-18T16:22:36.302732+0000","last_peered":"2024-02-18T16:22:36.302732+0000","last_clean":"2024-02-18T16:22:36.302732+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:36.302732+0000","last_undegraded":"2024-02-18T16:22:36.302732+0000","last_fullsized":"2024-02-18T16:22:36.302732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:40.559228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.477263+0000","last_change":"2024-02-18T16:21:09.901476+0000","last_active":"2024-02-18T16:22:30.477263+0000","last_peered":"2024-02-18T16:22:30.477263+0000","last_clean":"2024-02-18T16:22:30.477263+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:22:30.477263+0000","last_undegraded":"2024-02-18T16:22:30.477263+0000","last_fullsized":"2024-02-18T16:22:30.477263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.606451+0000","last_change":"2024-02-18T16:21:01.854526+0000","last_active":"2024-02-18T16:22:29.606451+0000","last_peered":"2024-02-18T16:22:29.606451+0000","last_clean":"2024-02-18T16:22:29.606451+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:22:29.606451+0000","last_undegraded":"2024-02-18T16:22:29.606451+0000","last_fullsized":"2024-02-18T16:22:29.606451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940406+0000","last_change":"2024-02-18T16:20:59.863525+0000","last_active":"2024-02-18T16:21:40.940406+0000","last_peered":"2024-02-18T16:21:40.940406+0000","last_clean":"2024-02-18T16:21:40.940406+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:21:40.940406+0000","last_undegraded":"2024-02-18T16:21:40.940406+0000","last_fullsized":"2024-02-18T16:21:40.940406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:40.125913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":523,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.176575+0000","last_change":"2024-02-18T16:21:03.865047+0000","last_active":"2024-02-18T16:22:37.176575+0000","last_peered":"2024-02-18T16:22:37.176575+0000","last_clean":"2024-02-18T16:22:37.176575+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:22:37.176575+0000","last_undegraded":"2024-02-18T16:22:37.176575+0000","last_fullsized":"2024-02-18T16:22:37.176575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:27.693710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":574,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953466+0000","last_change":"2024-02-18T16:21:05.901561+0000","last_active":"2024-02-18T16:21:40.953466+0000","last_peered":"2024-02-18T16:21:40.953466+0000","last_clean":"2024-02-18T16:21:40.953466+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:21:40.953466+0000","last_undegraded":"2024-02-18T16:21:40.953466+0000","last_fullsized":"2024-02-18T16:21:40.953466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:37.955679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":352,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.304651+0000","last_change":"2024-02-18T16:21:07.894723+0000","last_active":"2024-02-18T16:22:36.304651+0000","last_peered":"2024-02-18T16:22:36.304651+0000","last_clean":"2024-02-18T16:22:36.304651+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:36.304651+0000","last_undegraded":"2024-02-18T16:22:36.304651+0000","last_fullsized":"2024-02-18T16:22:36.304651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939087+0000","last_change":"2024-02-18T16:21:09.907248+0000","last_active":"2024-02-18T16:21:40.939087+0000","last_peered":"2024-02-18T16:21:40.939087+0000","last_clean":"2024-02-18T16:21:40.939087+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:21:40.939087+0000","last_undegraded":"2024-02-18T16:21:40.939087+0000","last_fullsized":"2024-02-18T16:21:40.939087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:20.642816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947627+0000","last_change":"2024-02-18T16:21:01.845972+0000","last_active":"2024-02-18T16:21:40.947627+0000","last_peered":"2024-02-18T16:21:40.947627+0000","last_clean":"2024-02-18T16:21:40.947627+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:21:40.947627+0000","last_undegraded":"2024-02-18T16:21:40.947627+0000","last_fullsized":"2024-02-18T16:21:40.947627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:21:09.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934644+0000","last_change":"2024-02-18T16:20:59.866261+0000","last_active":"2024-02-18T16:21:40.934644+0000","last_peered":"2024-02-18T16:21:40.934644+0000","last_clean":"2024-02-18T16:21:40.934644+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:21:40.934644+0000","last_undegraded":"2024-02-18T16:21:40.934644+0000","last_fullsized":"2024-02-18T16:21:40.934644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:49.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953511+0000","last_change":"2024-02-18T16:21:03.857468+0000","last_active":"2024-02-18T16:21:40.953511+0000","last_peered":"2024-02-18T16:21:40.953511+0000","last_clean":"2024-02-18T16:21:40.953511+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:21:40.953511+0000","last_undegraded":"2024-02-18T16:21:40.953511+0000","last_fullsized":"2024-02-18T16:21:40.953511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:57.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.409997+0000","last_change":"2024-02-18T16:21:05.883765+0000","last_active":"2024-02-18T16:22:30.409997+0000","last_peered":"2024-02-18T16:22:30.409997+0000","last_clean":"2024-02-18T16:22:30.409997+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:30.409997+0000","last_undegraded":"2024-02-18T16:22:30.409997+0000","last_fullsized":"2024-02-18T16:22:30.409997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:38.527945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936924+0000","last_change":"2024-02-18T16:21:07.900271+0000","last_active":"2024-02-18T16:21:40.936924+0000","last_peered":"2024-02-18T16:21:40.936924+0000","last_clean":"2024-02-18T16:21:40.936924+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:21:40.936924+0000","last_undegraded":"2024-02-18T16:21:40.936924+0000","last_fullsized":"2024-02-18T16:21:40.936924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:23.412232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929089+0000","last_change":"2024-02-18T16:21:09.921128+0000","last_active":"2024-02-18T16:21:40.929089+0000","last_peered":"2024-02-18T16:21:40.929089+0000","last_clean":"2024-02-18T16:21:40.929089+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:21:40.929089+0000","last_undegraded":"2024-02-18T16:21:40.929089+0000","last_fullsized":"2024-02-18T16:21:40.929089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:44.361454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085664+0000","last_change":"2024-02-18T16:21:01.857176+0000","last_active":"2024-02-18T16:22:36.085664+0000","last_peered":"2024-02-18T16:22:36.085664+0000","last_clean":"2024-02-18T16:22:36.085664+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:22:36.085664+0000","last_undegraded":"2024-02-18T16:22:36.085664+0000","last_fullsized":"2024-02-18T16:22:36.085664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:50:56.586473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927237+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:21:40.927237+0000","last_peered":"2024-02-18T16:21:40.927237+0000","last_clean":"2024-02-18T16:21:40.927237+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:21:40.927237+0000","last_undegraded":"2024-02-18T16:21:40.927237+0000","last_fullsized":"2024-02-18T16:21:40.927237+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:37.088141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949389+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:21:40.949389+0000","last_peered":"2024-02-18T16:21:40.949389+0000","last_clean":"2024-02-18T16:21:40.949389+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:21:40.949389+0000","last_undegraded":"2024-02-18T16:21:40.949389+0000","last_fullsized":"2024-02-18T16:21:40.949389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:58:17.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939942+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:21:40.939942+0000","last_peered":"2024-02-18T16:21:40.939942+0000","last_clean":"2024-02-18T16:21:40.939942+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:21:40.939942+0000","last_undegraded":"2024-02-18T16:21:40.939942+0000","last_fullsized":"2024-02-18T16:21:40.939942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:33.884874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930956+0000","last_change":"2024-02-18T16:21:03.862227+0000","last_active":"2024-02-18T16:21:40.930956+0000","last_peered":"2024-02-18T16:21:40.930956+0000","last_clean":"2024-02-18T16:21:40.930956+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:21:40.930956+0000","last_undegraded":"2024-02-18T16:21:40.930956+0000","last_fullsized":"2024-02-18T16:21:40.930956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:05.466118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.054236+0000","last_change":"2024-02-18T16:21:05.897156+0000","last_active":"2024-02-18T16:22:36.054236+0000","last_peered":"2024-02-18T16:22:36.054236+0000","last_clean":"2024-02-18T16:22:36.054236+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:22:36.054236+0000","last_undegraded":"2024-02-18T16:22:36.054236+0000","last_fullsized":"2024-02-18T16:22:36.054236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:44:22.601995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179893+0000","last_change":"2024-02-18T16:21:07.900898+0000","last_active":"2024-02-18T16:21:41.179893+0000","last_peered":"2024-02-18T16:21:41.179893+0000","last_clean":"2024-02-18T16:21:41.179893+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:21:41.179893+0000","last_undegraded":"2024-02-18T16:21:41.179893+0000","last_fullsized":"2024-02-18T16:21:41.179893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:59:15.395075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.103257+0000","last_change":"2024-02-18T16:21:09.898538+0000","last_active":"2024-02-18T16:22:36.103257+0000","last_peered":"2024-02-18T16:22:36.103257+0000","last_clean":"2024-02-18T16:22:36.103257+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:36.103257+0000","last_undegraded":"2024-02-18T16:22:36.103257+0000","last_fullsized":"2024-02-18T16:22:36.103257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:33.080540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955558+0000","last_change":"2024-02-18T16:21:01.853487+0000","last_active":"2024-02-18T16:21:40.955558+0000","last_peered":"2024-02-18T16:21:40.955558+0000","last_clean":"2024-02-18T16:21:40.955558+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:21:40.955558+0000","last_undegraded":"2024-02-18T16:21:40.955558+0000","last_fullsized":"2024-02-18T16:21:40.955558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:51.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933083+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:21:40.933083+0000","last_peered":"2024-02-18T16:21:40.933083+0000","last_clean":"2024-02-18T16:21:40.933083+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:21:40.933083+0000","last_undegraded":"2024-02-18T16:21:40.933083+0000","last_fullsized":"2024-02-18T16:21:40.933083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:05:58.537300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174299+0000","last_change":"2024-02-18T16:20:59.848482+0000","last_active":"2024-02-18T16:21:41.174299+0000","last_peered":"2024-02-18T16:21:41.174299+0000","last_clean":"2024-02-18T16:21:41.174299+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:21:41.174299+0000","last_undegraded":"2024-02-18T16:21:41.174299+0000","last_fullsized":"2024-02-18T16:21:41.174299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954843+0000","last_change":"2024-02-18T16:21:03.853258+0000","last_active":"2024-02-18T16:21:40.954843+0000","last_peered":"2024-02-18T16:21:40.954843+0000","last_clean":"2024-02-18T16:21:40.954843+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:21:40.954843+0000","last_undegraded":"2024-02-18T16:21:40.954843+0000","last_fullsized":"2024-02-18T16:21:40.954843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:43:34.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.296165+0000","last_change":"2024-02-18T16:21:05.900069+0000","last_active":"2024-02-18T16:22:36.296165+0000","last_peered":"2024-02-18T16:22:36.296165+0000","last_clean":"2024-02-18T16:22:36.296165+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:36.296165+0000","last_undegraded":"2024-02-18T16:22:36.296165+0000","last_fullsized":"2024-02-18T16:22:36.296165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:29:44.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950461+0000","last_change":"2024-02-18T16:21:07.915843+0000","last_active":"2024-02-18T16:21:40.950461+0000","last_peered":"2024-02-18T16:21:40.950461+0000","last_clean":"2024-02-18T16:21:40.950461+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:21:40.950461+0000","last_undegraded":"2024-02-18T16:21:40.950461+0000","last_fullsized":"2024-02-18T16:21:40.950461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:32:30.258086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.566050+0000","last_change":"2024-02-18T16:21:09.927419+0000","last_active":"2024-02-18T16:22:24.566050+0000","last_peered":"2024-02-18T16:22:24.566050+0000","last_clean":"2024-02-18T16:22:24.566050+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:22:24.566050+0000","last_undegraded":"2024-02-18T16:22:24.566050+0000","last_fullsized":"2024-02-18T16:22:24.566050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:21.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.855571+0000","last_change":"2024-02-18T16:21:01.846415+0000","last_active":"2024-02-18T16:21:47.855571+0000","last_peered":"2024-02-18T16:21:47.855571+0000","last_clean":"2024-02-18T16:21:47.855571+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:21:47.855571+0000","last_undegraded":"2024-02-18T16:21:47.855571+0000","last_fullsized":"2024-02-18T16:21:47.855571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936337+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:21:40.936337+0000","last_peered":"2024-02-18T16:21:40.936337+0000","last_clean":"2024-02-18T16:21:40.936337+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:21:40.936337+0000","last_undegraded":"2024-02-18T16:21:40.936337+0000","last_fullsized":"2024-02-18T16:21:40.936337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:43.102493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173554+0000","last_change":"2024-02-18T16:20:59.850718+0000","last_active":"2024-02-18T16:21:41.173554+0000","last_peered":"2024-02-18T16:21:41.173554+0000","last_clean":"2024-02-18T16:21:41.173554+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:21:41.173554+0000","last_undegraded":"2024-02-18T16:21:41.173554+0000","last_fullsized":"2024-02-18T16:21:41.173554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945273+0000","last_change":"2024-02-18T16:21:03.854140+0000","last_active":"2024-02-18T16:21:40.945273+0000","last_peered":"2024-02-18T16:21:40.945273+0000","last_clean":"2024-02-18T16:21:40.945273+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:21:40.945273+0000","last_undegraded":"2024-02-18T16:21:40.945273+0000","last_fullsized":"2024-02-18T16:21:40.945273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:45.475648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:34.003316+0000","last_change":"2024-02-18T16:21:05.883106+0000","last_active":"2024-02-18T16:22:34.003316+0000","last_peered":"2024-02-18T16:22:34.003316+0000","last_clean":"2024-02-18T16:22:34.003316+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:22:34.003316+0000","last_undegraded":"2024-02-18T16:22:34.003316+0000","last_fullsized":"2024-02-18T16:22:34.003316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:49.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176697+0000","last_change":"2024-02-18T16:21:07.901039+0000","last_active":"2024-02-18T16:21:41.176697+0000","last_peered":"2024-02-18T16:21:41.176697+0000","last_clean":"2024-02-18T16:21:41.176697+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:21:41.176697+0000","last_undegraded":"2024-02-18T16:21:41.176697+0000","last_fullsized":"2024-02-18T16:21:41.176697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:12.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946747+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:21:40.946747+0000","last_peered":"2024-02-18T16:21:40.946747+0000","last_clean":"2024-02-18T16:21:40.946747+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:21:40.946747+0000","last_undegraded":"2024-02-18T16:21:40.946747+0000","last_fullsized":"2024-02-18T16:21:40.946747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:15.833558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179127+0000","last_change":"2024-02-18T16:21:01.841136+0000","last_active":"2024-02-18T16:21:41.179127+0000","last_peered":"2024-02-18T16:21:41.179127+0000","last_clean":"2024-02-18T16:21:41.179127+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:21:41.179127+0000","last_undegraded":"2024-02-18T16:21:41.179127+0000","last_fullsized":"2024-02-18T16:21:41.179127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939268+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:21:40.939268+0000","last_peered":"2024-02-18T16:21:40.939268+0000","last_clean":"2024-02-18T16:21:40.939268+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:21:40.939268+0000","last_undegraded":"2024-02-18T16:21:40.939268+0000","last_fullsized":"2024-02-18T16:21:40.939268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:28:03.856941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939793+0000","last_change":"2024-02-18T16:20:59.855189+0000","last_active":"2024-02-18T16:21:40.939793+0000","last_peered":"2024-02-18T16:21:40.939793+0000","last_clean":"2024-02-18T16:21:40.939793+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:21:40.939793+0000","last_undegraded":"2024-02-18T16:21:40.939793+0000","last_fullsized":"2024-02-18T16:21:40.939793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179358+0000","last_change":"2024-02-18T16:21:03.858464+0000","last_active":"2024-02-18T16:21:41.179358+0000","last_peered":"2024-02-18T16:21:41.179358+0000","last_clean":"2024-02-18T16:21:41.179358+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:21:41.179358+0000","last_undegraded":"2024-02-18T16:21:41.179358+0000","last_fullsized":"2024-02-18T16:21:41.179358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:23:07.857672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952037+0000","last_change":"2024-02-18T16:21:05.897074+0000","last_active":"2024-02-18T16:21:40.952037+0000","last_peered":"2024-02-18T16:21:40.952037+0000","last_clean":"2024-02-18T16:21:40.952037+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:21:40.952037+0000","last_undegraded":"2024-02-18T16:21:40.952037+0000","last_fullsized":"2024-02-18T16:21:40.952037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:04:33.549154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955422+0000","last_change":"2024-02-18T16:21:07.918398+0000","last_active":"2024-02-18T16:21:40.955422+0000","last_peered":"2024-02-18T16:21:40.955422+0000","last_clean":"2024-02-18T16:21:40.955422+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:21:40.955422+0000","last_undegraded":"2024-02-18T16:21:40.955422+0000","last_fullsized":"2024-02-18T16:21:40.955422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:47.114614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.926920+0000","last_change":"2024-02-18T16:21:09.915876+0000","last_active":"2024-02-18T16:21:40.926920+0000","last_peered":"2024-02-18T16:21:40.926920+0000","last_clean":"2024-02-18T16:21:40.926920+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:21:40.926920+0000","last_undegraded":"2024-02-18T16:21:40.926920+0000","last_fullsized":"2024-02-18T16:21:40.926920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:53.323552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858131+0000","last_change":"2024-02-18T16:21:01.844784+0000","last_active":"2024-02-18T16:21:47.858131+0000","last_peered":"2024-02-18T16:21:47.858131+0000","last_clean":"2024-02-18T16:21:47.858131+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:21:47.858131+0000","last_undegraded":"2024-02-18T16:21:47.858131+0000","last_fullsized":"2024-02-18T16:21:47.858131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938015+0000","last_change":"2024-02-18T16:20:59.833465+0000","last_active":"2024-02-18T16:21:40.938015+0000","last_peered":"2024-02-18T16:21:40.938015+0000","last_clean":"2024-02-18T16:21:40.938015+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:21:40.938015+0000","last_undegraded":"2024-02-18T16:21:40.938015+0000","last_fullsized":"2024-02-18T16:21:40.938015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176645+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:21:41.176645+0000","last_peered":"2024-02-18T16:21:41.176645+0000","last_clean":"2024-02-18T16:21:41.176645+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:21:41.176645+0000","last_undegraded":"2024-02-18T16:21:41.176645+0000","last_fullsized":"2024-02-18T16:21:41.176645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:59:56.616913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947011+0000","last_change":"2024-02-18T16:21:40.945591+0000","last_active":"2024-02-18T16:21:40.947011+0000","last_peered":"2024-02-18T16:21:40.947011+0000","last_clean":"2024-02-18T16:21:40.947011+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:21:40.947011+0000","last_undegraded":"2024-02-18T16:21:40.947011+0000","last_fullsized":"2024-02-18T16:21:40.947011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:47.279576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.043805+0000","last_change":"2024-02-18T16:21:05.889484+0000","last_active":"2024-02-18T16:22:36.043805+0000","last_peered":"2024-02-18T16:22:36.043805+0000","last_clean":"2024-02-18T16:22:36.043805+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:36.043805+0000","last_undegraded":"2024-02-18T16:22:36.043805+0000","last_fullsized":"2024-02-18T16:22:36.043805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:15.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932933+0000","last_change":"2024-02-18T16:21:07.902044+0000","last_active":"2024-02-18T16:21:40.932933+0000","last_peered":"2024-02-18T16:21:40.932933+0000","last_clean":"2024-02-18T16:21:40.932933+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:21:40.932933+0000","last_undegraded":"2024-02-18T16:21:40.932933+0000","last_fullsized":"2024-02-18T16:21:40.932933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:08.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.436370+0000","last_change":"2024-02-18T16:21:09.905763+0000","last_active":"2024-02-18T16:22:30.436370+0000","last_peered":"2024-02-18T16:22:30.436370+0000","last_clean":"2024-02-18T16:22:30.436370+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:22:30.436370+0000","last_undegraded":"2024-02-18T16:22:30.436370+0000","last_fullsized":"2024-02-18T16:22:30.436370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:46.553123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.872182+0000","last_change":"2024-02-18T16:21:01.847741+0000","last_active":"2024-02-18T16:21:46.872182+0000","last_peered":"2024-02-18T16:21:46.872182+0000","last_clean":"2024-02-18T16:21:46.872182+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:21:46.872182+0000","last_undegraded":"2024-02-18T16:21:46.872182+0000","last_fullsized":"2024-02-18T16:21:46.872182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:41:45.770571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176949+0000","last_change":"2024-02-18T16:20:59.861790+0000","last_active":"2024-02-18T16:21:41.176949+0000","last_peered":"2024-02-18T16:21:41.176949+0000","last_clean":"2024-02-18T16:21:41.176949+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:21:41.176949+0000","last_undegraded":"2024-02-18T16:21:41.176949+0000","last_fullsized":"2024-02-18T16:21:41.176949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951463+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:21:40.951463+0000","last_peered":"2024-02-18T16:21:40.951463+0000","last_clean":"2024-02-18T16:21:40.951463+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:21:40.951463+0000","last_undegraded":"2024-02-18T16:21:40.951463+0000","last_fullsized":"2024-02-18T16:21:40.951463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:55:06.221596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938609+0000","last_change":"2024-02-18T16:21:03.849021+0000","last_active":"2024-02-18T16:21:40.938609+0000","last_peered":"2024-02-18T16:21:40.938609+0000","last_clean":"2024-02-18T16:21:40.938609+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:21:40.938609+0000","last_undegraded":"2024-02-18T16:21:40.938609+0000","last_fullsized":"2024-02-18T16:21:40.938609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:08.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929054+0000","last_change":"2024-02-18T16:21:05.898616+0000","last_active":"2024-02-18T16:21:40.929054+0000","last_peered":"2024-02-18T16:21:40.929054+0000","last_clean":"2024-02-18T16:21:40.929054+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:21:40.929054+0000","last_undegraded":"2024-02-18T16:21:40.929054+0000","last_fullsized":"2024-02-18T16:21:40.929054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:38.543681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.299293+0000","last_change":"2024-02-18T16:21:07.893283+0000","last_active":"2024-02-18T16:22:36.299293+0000","last_peered":"2024-02-18T16:22:36.299293+0000","last_clean":"2024-02-18T16:22:36.299293+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:36.299293+0000","last_undegraded":"2024-02-18T16:22:36.299293+0000","last_fullsized":"2024-02-18T16:22:36.299293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953932+0000","last_change":"2024-02-18T16:21:09.914553+0000","last_active":"2024-02-18T16:21:40.953932+0000","last_peered":"2024-02-18T16:21:40.953932+0000","last_clean":"2024-02-18T16:21:40.953932+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:21:40.953932+0000","last_undegraded":"2024-02-18T16:21:40.953932+0000","last_fullsized":"2024-02-18T16:21:40.953932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:02:46.246218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456732+0000","last_change":"2024-02-18T16:21:01.853061+0000","last_active":"2024-02-18T16:22:30.456732+0000","last_peered":"2024-02-18T16:22:30.456732+0000","last_clean":"2024-02-18T16:22:30.456732+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:22:30.456732+0000","last_undegraded":"2024-02-18T16:22:30.456732+0000","last_fullsized":"2024-02-18T16:22:30.456732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:44.090520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956980+0000","last_change":"2024-02-18T16:20:59.868556+0000","last_active":"2024-02-18T16:21:40.956980+0000","last_peered":"2024-02-18T16:21:40.956980+0000","last_clean":"2024-02-18T16:21:40.956980+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:21:40.956980+0000","last_undegraded":"2024-02-18T16:21:40.956980+0000","last_fullsized":"2024-02-18T16:21:40.956980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:56.658418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180424+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:21:41.180424+0000","last_peered":"2024-02-18T16:21:41.180424+0000","last_clean":"2024-02-18T16:21:41.180424+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:21:41.180424+0000","last_undegraded":"2024-02-18T16:21:41.180424+0000","last_fullsized":"2024-02-18T16:21:41.180424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:07.695714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933580+0000","last_change":"2024-02-18T16:21:03.852652+0000","last_active":"2024-02-18T16:21:40.933580+0000","last_peered":"2024-02-18T16:21:40.933580+0000","last_clean":"2024-02-18T16:21:40.933580+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:21:40.933580+0000","last_undegraded":"2024-02-18T16:21:40.933580+0000","last_fullsized":"2024-02-18T16:21:40.933580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:23.631357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946439+0000","last_change":"2024-02-18T16:21:05.894104+0000","last_active":"2024-02-18T16:21:40.946439+0000","last_peered":"2024-02-18T16:21:40.946439+0000","last_clean":"2024-02-18T16:21:40.946439+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:21:40.946439+0000","last_undegraded":"2024-02-18T16:21:40.946439+0000","last_fullsized":"2024-02-18T16:21:40.946439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:42.813295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.306039+0000","last_change":"2024-02-18T16:21:07.893288+0000","last_active":"2024-02-18T16:22:36.306039+0000","last_peered":"2024-02-18T16:22:36.306039+0000","last_clean":"2024-02-18T16:22:36.306039+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:36.306039+0000","last_undegraded":"2024-02-18T16:22:36.306039+0000","last_fullsized":"2024-02-18T16:22:36.306039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.859966+0000","last_change":"2024-02-18T16:21:09.917363+0000","last_active":"2024-02-18T16:21:47.859966+0000","last_peered":"2024-02-18T16:21:47.859966+0000","last_clean":"2024-02-18T16:21:47.859966+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:21:47.859966+0000","last_undegraded":"2024-02-18T16:21:47.859966+0000","last_fullsized":"2024-02-18T16:21:47.859966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935139+0000","last_change":"2024-02-18T16:21:01.849433+0000","last_active":"2024-02-18T16:21:40.935139+0000","last_peered":"2024-02-18T16:21:40.935139+0000","last_clean":"2024-02-18T16:21:40.935139+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:21:40.935139+0000","last_undegraded":"2024-02-18T16:21:40.935139+0000","last_fullsized":"2024-02-18T16:21:40.935139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:26.052157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937475+0000","last_change":"2024-02-18T16:20:59.873711+0000","last_active":"2024-02-18T16:21:40.937475+0000","last_peered":"2024-02-18T16:21:40.937475+0000","last_clean":"2024-02-18T16:21:40.937475+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:21:40.937475+0000","last_undegraded":"2024-02-18T16:21:40.937475+0000","last_fullsized":"2024-02-18T16:21:40.937475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956548+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:21:40.956548+0000","last_peered":"2024-02-18T16:21:40.956548+0000","last_clean":"2024-02-18T16:21:40.956548+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:21:40.956548+0000","last_undegraded":"2024-02-18T16:21:40.956548+0000","last_fullsized":"2024-02-18T16:21:40.956548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:28:14.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932706+0000","last_change":"2024-02-18T16:21:03.851642+0000","last_active":"2024-02-18T16:21:40.932706+0000","last_peered":"2024-02-18T16:21:40.932706+0000","last_clean":"2024-02-18T16:21:40.932706+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:21:40.932706+0000","last_undegraded":"2024-02-18T16:21:40.932706+0000","last_fullsized":"2024-02-18T16:21:40.932706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:09:58.409243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.038660+0000","last_change":"2024-02-18T16:21:05.894249+0000","last_active":"2024-02-18T16:22:36.038660+0000","last_peered":"2024-02-18T16:22:36.038660+0000","last_clean":"2024-02-18T16:22:36.038660+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:36.038660+0000","last_undegraded":"2024-02-18T16:22:36.038660+0000","last_fullsized":"2024-02-18T16:22:36.038660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:16.678346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174054+0000","last_change":"2024-02-18T16:21:07.899674+0000","last_active":"2024-02-18T16:21:41.174054+0000","last_peered":"2024-02-18T16:21:41.174054+0000","last_clean":"2024-02-18T16:21:41.174054+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:21:41.174054+0000","last_undegraded":"2024-02-18T16:21:41.174054+0000","last_fullsized":"2024-02-18T16:21:41.174054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:02.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.943250+0000","last_change":"2024-02-18T16:21:09.913278+0000","last_active":"2024-02-18T16:21:40.943250+0000","last_peered":"2024-02-18T16:21:40.943250+0000","last_clean":"2024-02-18T16:21:40.943250+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:21:40.943250+0000","last_undegraded":"2024-02-18T16:21:40.943250+0000","last_fullsized":"2024-02-18T16:21:40.943250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:44.928722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.072534+0000","last_change":"2024-02-18T16:21:09.912010+0000","last_active":"2024-02-18T16:22:36.072534+0000","last_peered":"2024-02-18T16:22:36.072534+0000","last_clean":"2024-02-18T16:22:36.072534+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:22:36.072534+0000","last_undegraded":"2024-02-18T16:22:36.072534+0000","last_fullsized":"2024-02-18T16:22:36.072534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:22.614788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183619+0000","last_change":"2024-02-18T16:21:41.183619+0000","last_active":"2024-02-18T16:21:41.183619+0000","last_peered":"2024-02-18T16:21:41.183619+0000","last_clean":"2024-02-18T16:21:41.183619+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:21:41.183619+0000","last_undegraded":"2024-02-18T16:21:41.183619+0000","last_fullsized":"2024-02-18T16:21:41.183619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:13.035362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951280+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:21:40.951280+0000","last_peered":"2024-02-18T16:21:40.951280+0000","last_clean":"2024-02-18T16:21:40.951280+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:21:40.951280+0000","last_undegraded":"2024-02-18T16:21:40.951280+0000","last_fullsized":"2024-02-18T16:21:40.951280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:18:58.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929562+0000","last_change":"2024-02-18T16:21:03.865820+0000","last_active":"2024-02-18T16:21:40.929562+0000","last_peered":"2024-02-18T16:21:40.929562+0000","last_clean":"2024-02-18T16:21:40.929562+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:21:40.929562+0000","last_undegraded":"2024-02-18T16:21:40.929562+0000","last_fullsized":"2024-02-18T16:21:40.929562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:46.104120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.417194+0000","last_change":"2024-02-18T16:21:05.885905+0000","last_active":"2024-02-18T16:22:30.417194+0000","last_peered":"2024-02-18T16:22:30.417194+0000","last_clean":"2024-02-18T16:22:30.417194+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:30.417194+0000","last_undegraded":"2024-02-18T16:22:30.417194+0000","last_fullsized":"2024-02-18T16:22:30.417194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:28.353159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936858+0000","last_change":"2024-02-18T16:21:07.897703+0000","last_active":"2024-02-18T16:21:40.936858+0000","last_peered":"2024-02-18T16:21:40.936858+0000","last_clean":"2024-02-18T16:21:40.936858+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:21:40.936858+0000","last_undegraded":"2024-02-18T16:21:40.936858+0000","last_fullsized":"2024-02-18T16:21:40.936858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:41.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179155+0000","last_change":"2024-02-18T16:21:09.909919+0000","last_active":"2024-02-18T16:21:41.179155+0000","last_peered":"2024-02-18T16:21:41.179155+0000","last_clean":"2024-02-18T16:21:41.179155+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:21:41.179155+0000","last_undegraded":"2024-02-18T16:21:41.179155+0000","last_fullsized":"2024-02-18T16:21:41.179155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:27.374232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605789+0000","last_change":"2024-02-18T16:21:01.852159+0000","last_active":"2024-02-18T16:22:29.605789+0000","last_peered":"2024-02-18T16:22:29.605789+0000","last_clean":"2024-02-18T16:22:29.605789+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:22:29.605789+0000","last_undegraded":"2024-02-18T16:22:29.605789+0000","last_fullsized":"2024-02-18T16:22:29.605789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941358+0000","last_change":"2024-02-18T16:20:59.833123+0000","last_active":"2024-02-18T16:21:40.941358+0000","last_peered":"2024-02-18T16:21:40.941358+0000","last_clean":"2024-02-18T16:21:40.941358+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:21:40.941358+0000","last_undegraded":"2024-02-18T16:21:40.941358+0000","last_fullsized":"2024-02-18T16:21:40.941358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947671+0000","last_change":"2024-02-18T16:21:03.850309+0000","last_active":"2024-02-18T16:21:40.947671+0000","last_peered":"2024-02-18T16:21:40.947671+0000","last_clean":"2024-02-18T16:21:40.947671+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:21:40.947671+0000","last_undegraded":"2024-02-18T16:21:40.947671+0000","last_fullsized":"2024-02-18T16:21:40.947671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:21.788879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:23.050364+0000","last_change":"2024-02-18T16:21:05.880698+0000","last_active":"2024-02-18T16:22:23.050364+0000","last_peered":"2024-02-18T16:22:23.050364+0000","last_clean":"2024-02-18T16:22:23.050364+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:22:23.050364+0000","last_undegraded":"2024-02-18T16:22:23.050364+0000","last_fullsized":"2024-02-18T16:22:23.050364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:33.384726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935541+0000","last_change":"2024-02-18T16:21:07.900044+0000","last_active":"2024-02-18T16:21:40.935541+0000","last_peered":"2024-02-18T16:21:40.935541+0000","last_clean":"2024-02-18T16:21:40.935541+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:21:40.935541+0000","last_undegraded":"2024-02-18T16:21:40.935541+0000","last_fullsized":"2024-02-18T16:21:40.935541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:14.205593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177117+0000","last_change":"2024-02-18T16:21:09.926381+0000","last_active":"2024-02-18T16:21:41.177117+0000","last_peered":"2024-02-18T16:21:41.177117+0000","last_clean":"2024-02-18T16:21:41.177117+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:21:41.177117+0000","last_undegraded":"2024-02-18T16:21:41.177117+0000","last_fullsized":"2024-02-18T16:21:41.177117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165508+0000","last_change":"2024-02-18T16:21:01.847228+0000","last_active":"2024-02-18T16:21:47.165508+0000","last_peered":"2024-02-18T16:21:47.165508+0000","last_clean":"2024-02-18T16:21:47.165508+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:21:47.165508+0000","last_undegraded":"2024-02-18T16:21:47.165508+0000","last_fullsized":"2024-02-18T16:21:47.165508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952876+0000","last_change":"2024-02-18T16:20:59.839316+0000","last_active":"2024-02-18T16:21:40.952876+0000","last_peered":"2024-02-18T16:21:40.952876+0000","last_clean":"2024-02-18T16:21:40.952876+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:21:40.952876+0000","last_undegraded":"2024-02-18T16:21:40.952876+0000","last_fullsized":"2024-02-18T16:21:40.952876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934519+0000","last_change":"2024-02-18T16:21:03.864201+0000","last_active":"2024-02-18T16:21:40.934519+0000","last_peered":"2024-02-18T16:21:40.934519+0000","last_clean":"2024-02-18T16:21:40.934519+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:21:40.934519+0000","last_undegraded":"2024-02-18T16:21:40.934519+0000","last_fullsized":"2024-02-18T16:21:40.934519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:17.726013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:35.841028+0000","last_change":"2024-02-18T16:21:05.876928+0000","last_active":"2024-02-18T16:22:35.841028+0000","last_peered":"2024-02-18T16:22:35.841028+0000","last_clean":"2024-02-18T16:22:35.841028+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:22:35.841028+0000","last_undegraded":"2024-02-18T16:22:35.841028+0000","last_fullsized":"2024-02-18T16:22:35.841028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:06.486461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928756+0000","last_change":"2024-02-18T16:21:07.894242+0000","last_active":"2024-02-18T16:21:40.928756+0000","last_peered":"2024-02-18T16:21:40.928756+0000","last_clean":"2024-02-18T16:21:40.928756+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:21:40.928756+0000","last_undegraded":"2024-02-18T16:21:40.928756+0000","last_fullsized":"2024-02-18T16:21:40.928756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.128244+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:21:47.128244+0000","last_peered":"2024-02-18T16:21:47.128244+0000","last_clean":"2024-02-18T16:21:47.128244+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:21:47.128244+0000","last_undegraded":"2024-02-18T16:21:47.128244+0000","last_fullsized":"2024-02-18T16:21:47.128244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:15:42.799340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871877+0000","last_change":"2024-02-18T16:21:01.853323+0000","last_active":"2024-02-18T16:21:46.871877+0000","last_peered":"2024-02-18T16:21:46.871877+0000","last_clean":"2024-02-18T16:21:46.871877+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:21:46.871877+0000","last_undegraded":"2024-02-18T16:21:46.871877+0000","last_fullsized":"2024-02-18T16:21:46.871877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:11.618049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945582+0000","last_change":"2024-02-18T16:20:59.853141+0000","last_active":"2024-02-18T16:21:40.945582+0000","last_peered":"2024-02-18T16:21:40.945582+0000","last_clean":"2024-02-18T16:21:40.945582+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:21:40.945582+0000","last_undegraded":"2024-02-18T16:21:40.945582+0000","last_fullsized":"2024-02-18T16:21:40.945582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933353+0000","last_change":"2024-02-18T16:21:03.852896+0000","last_active":"2024-02-18T16:21:40.933353+0000","last_peered":"2024-02-18T16:21:40.933353+0000","last_clean":"2024-02-18T16:21:40.933353+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:21:40.933353+0000","last_undegraded":"2024-02-18T16:21:40.933353+0000","last_fullsized":"2024-02-18T16:21:40.933353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:25.426450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.393010+0000","last_change":"2024-02-18T16:21:05.877090+0000","last_active":"2024-02-18T16:22:30.393010+0000","last_peered":"2024-02-18T16:22:30.393010+0000","last_clean":"2024-02-18T16:22:30.393010+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:22:30.393010+0000","last_undegraded":"2024-02-18T16:22:30.393010+0000","last_fullsized":"2024-02-18T16:22:30.393010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:28.582206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937205+0000","last_change":"2024-02-18T16:21:07.895684+0000","last_active":"2024-02-18T16:21:40.937205+0000","last_peered":"2024-02-18T16:21:40.937205+0000","last_clean":"2024-02-18T16:21:40.937205+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:21:40.937205+0000","last_undegraded":"2024-02-18T16:21:40.937205+0000","last_fullsized":"2024-02-18T16:21:40.937205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:02.630017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956804+0000","last_change":"2024-02-18T16:21:01.852475+0000","last_active":"2024-02-18T16:21:40.956804+0000","last_peered":"2024-02-18T16:21:40.956804+0000","last_clean":"2024-02-18T16:21:40.956804+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:21:40.956804+0000","last_undegraded":"2024-02-18T16:21:40.956804+0000","last_fullsized":"2024-02-18T16:21:40.956804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:27.351511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933470+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:21:40.933470+0000","last_peered":"2024-02-18T16:21:40.933470+0000","last_clean":"2024-02-18T16:21:40.933470+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:21:40.933470+0000","last_undegraded":"2024-02-18T16:21:40.933470+0000","last_fullsized":"2024-02-18T16:21:40.933470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:15:24.659323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180433+0000","last_change":"2024-02-18T16:21:03.857015+0000","last_active":"2024-02-18T16:21:41.180433+0000","last_peered":"2024-02-18T16:21:41.180433+0000","last_clean":"2024-02-18T16:21:41.180433+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:21:41.180433+0000","last_undegraded":"2024-02-18T16:21:41.180433+0000","last_fullsized":"2024-02-18T16:21:41.180433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:13.662764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.034479+0000","last_change":"2024-02-18T16:21:05.880717+0000","last_active":"2024-02-18T16:22:36.034479+0000","last_peered":"2024-02-18T16:22:36.034479+0000","last_clean":"2024-02-18T16:22:36.034479+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:36.034479+0000","last_undegraded":"2024-02-18T16:22:36.034479+0000","last_fullsized":"2024-02-18T16:22:36.034479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:12.190046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936708+0000","last_change":"2024-02-18T16:21:07.890941+0000","last_active":"2024-02-18T16:21:40.936708+0000","last_peered":"2024-02-18T16:21:40.936708+0000","last_clean":"2024-02-18T16:21:40.936708+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:21:40.936708+0000","last_undegraded":"2024-02-18T16:21:40.936708+0000","last_fullsized":"2024-02-18T16:21:40.936708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:57.883612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.748309+0000","last_change":"2024-02-18T16:21:09.926618+0000","last_active":"2024-02-18T16:22:29.748309+0000","last_peered":"2024-02-18T16:22:29.748309+0000","last_clean":"2024-02-18T16:22:29.748309+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:22:29.748309+0000","last_undegraded":"2024-02-18T16:22:29.748309+0000","last_fullsized":"2024-02-18T16:22:29.748309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183335+0000","last_change":"2024-02-18T16:21:01.841268+0000","last_active":"2024-02-18T16:21:41.183335+0000","last_peered":"2024-02-18T16:21:41.183335+0000","last_clean":"2024-02-18T16:21:41.183335+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:21:41.183335+0000","last_undegraded":"2024-02-18T16:21:41.183335+0000","last_fullsized":"2024-02-18T16:21:41.183335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927563+0000","last_change":"2024-02-18T16:20:59.853982+0000","last_active":"2024-02-18T16:21:40.927563+0000","last_peered":"2024-02-18T16:21:40.927563+0000","last_clean":"2024-02-18T16:21:40.927563+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:21:40.927563+0000","last_undegraded":"2024-02-18T16:21:40.927563+0000","last_fullsized":"2024-02-18T16:21:40.927563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950616+0000","last_change":"2024-02-18T16:21:03.854204+0000","last_active":"2024-02-18T16:21:40.950616+0000","last_peered":"2024-02-18T16:21:40.950616+0000","last_clean":"2024-02-18T16:21:40.950616+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:21:40.950616+0000","last_undegraded":"2024-02-18T16:21:40.950616+0000","last_fullsized":"2024-02-18T16:21:40.950616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:28.248701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.394256+0000","last_change":"2024-02-18T16:21:05.897013+0000","last_active":"2024-02-18T16:22:30.394256+0000","last_peered":"2024-02-18T16:22:30.394256+0000","last_clean":"2024-02-18T16:22:30.394256+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:22:30.394256+0000","last_undegraded":"2024-02-18T16:22:30.394256+0000","last_fullsized":"2024-02-18T16:22:30.394256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:16.724717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931649+0000","last_change":"2024-02-18T16:21:07.917711+0000","last_active":"2024-02-18T16:21:40.931649+0000","last_peered":"2024-02-18T16:21:40.931649+0000","last_clean":"2024-02-18T16:21:40.931649+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:21:40.931649+0000","last_undegraded":"2024-02-18T16:21:40.931649+0000","last_fullsized":"2024-02-18T16:21:40.931649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933181+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:21:40.933181+0000","last_peered":"2024-02-18T16:21:40.933181+0000","last_clean":"2024-02-18T16:21:40.933181+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:21:40.933181+0000","last_undegraded":"2024-02-18T16:21:40.933181+0000","last_fullsized":"2024-02-18T16:21:40.933181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:37:16.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952947+0000","last_change":"2024-02-18T16:21:01.858003+0000","last_active":"2024-02-18T16:21:40.952947+0000","last_peered":"2024-02-18T16:21:40.952947+0000","last_clean":"2024-02-18T16:21:40.952947+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:21:40.952947+0000","last_undegraded":"2024-02-18T16:21:40.952947+0000","last_fullsized":"2024-02-18T16:21:40.952947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929693+0000","last_change":"2024-02-18T16:20:59.854045+0000","last_active":"2024-02-18T16:21:40.929693+0000","last_peered":"2024-02-18T16:21:40.929693+0000","last_clean":"2024-02-18T16:21:40.929693+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:21:40.929693+0000","last_undegraded":"2024-02-18T16:21:40.929693+0000","last_fullsized":"2024-02-18T16:21:40.929693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939479+0000","last_change":"2024-02-18T16:21:03.855690+0000","last_active":"2024-02-18T16:21:40.939479+0000","last_peered":"2024-02-18T16:21:40.939479+0000","last_clean":"2024-02-18T16:21:40.939479+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:21:40.939479+0000","last_undegraded":"2024-02-18T16:21:40.939479+0000","last_fullsized":"2024-02-18T16:21:40.939479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:40.744979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.423091+0000","last_change":"2024-02-18T16:21:05.889337+0000","last_active":"2024-02-18T16:22:30.423091+0000","last_peered":"2024-02-18T16:22:30.423091+0000","last_clean":"2024-02-18T16:22:30.423091+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:30.423091+0000","last_undegraded":"2024-02-18T16:22:30.423091+0000","last_fullsized":"2024-02-18T16:22:30.423091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:00.614470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179753+0000","last_change":"2024-02-18T16:21:07.907388+0000","last_active":"2024-02-18T16:21:41.179753+0000","last_peered":"2024-02-18T16:21:41.179753+0000","last_clean":"2024-02-18T16:21:41.179753+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:21:41.179753+0000","last_undegraded":"2024-02-18T16:21:41.179753+0000","last_fullsized":"2024-02-18T16:21:41.179753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:25.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939050+0000","last_change":"2024-02-18T16:21:09.911546+0000","last_active":"2024-02-18T16:21:40.939050+0000","last_peered":"2024-02-18T16:21:40.939050+0000","last_clean":"2024-02-18T16:21:40.939050+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:21:40.939050+0000","last_undegraded":"2024-02-18T16:21:40.939050+0000","last_fullsized":"2024-02-18T16:21:40.939050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:51:41.804331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.856054+0000","last_change":"2024-02-18T16:21:01.840394+0000","last_active":"2024-02-18T16:21:47.856054+0000","last_peered":"2024-02-18T16:21:47.856054+0000","last_clean":"2024-02-18T16:21:47.856054+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:21:47.856054+0000","last_undegraded":"2024-02-18T16:21:47.856054+0000","last_fullsized":"2024-02-18T16:21:47.856054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948852+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:21:40.948852+0000","last_peered":"2024-02-18T16:21:40.948852+0000","last_clean":"2024-02-18T16:21:40.948852+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:21:40.948852+0000","last_undegraded":"2024-02-18T16:21:40.948852+0000","last_fullsized":"2024-02-18T16:21:40.948852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:32.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933457+0000","last_change":"2024-02-18T16:21:03.867900+0000","last_active":"2024-02-18T16:21:40.933457+0000","last_peered":"2024-02-18T16:21:40.933457+0000","last_clean":"2024-02-18T16:21:40.933457+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:21:40.933457+0000","last_undegraded":"2024-02-18T16:21:40.933457+0000","last_fullsized":"2024-02-18T16:21:40.933457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:15.762147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952376+0000","last_change":"2024-02-18T16:21:05.897563+0000","last_active":"2024-02-18T16:21:40.952376+0000","last_peered":"2024-02-18T16:21:40.952376+0000","last_clean":"2024-02-18T16:21:40.952376+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:21:40.952376+0000","last_undegraded":"2024-02-18T16:21:40.952376+0000","last_fullsized":"2024-02-18T16:21:40.952376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:21:22.623751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":304,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.297154+0000","last_change":"2024-02-18T16:21:07.903096+0000","last_active":"2024-02-18T16:22:36.297154+0000","last_peered":"2024-02-18T16:22:36.297154+0000","last_clean":"2024-02-18T16:22:36.297154+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:36.297154+0000","last_undegraded":"2024-02-18T16:22:36.297154+0000","last_fullsized":"2024-02-18T16:22:36.297154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:33.395055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931705+0000","last_change":"2024-02-18T16:21:09.924100+0000","last_active":"2024-02-18T16:21:40.931705+0000","last_peered":"2024-02-18T16:21:40.931705+0000","last_clean":"2024-02-18T16:21:40.931705+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:21:40.931705+0000","last_undegraded":"2024-02-18T16:21:40.931705+0000","last_fullsized":"2024-02-18T16:21:40.931705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:28:24.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940205+0000","last_change":"2024-02-18T16:21:01.837599+0000","last_active":"2024-02-18T16:21:40.940205+0000","last_peered":"2024-02-18T16:21:40.940205+0000","last_clean":"2024-02-18T16:21:40.940205+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:21:40.940205+0000","last_undegraded":"2024-02-18T16:21:40.940205+0000","last_fullsized":"2024-02-18T16:21:40.940205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:07.608465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929848+0000","last_change":"2024-02-18T16:20:59.859857+0000","last_active":"2024-02-18T16:21:40.929848+0000","last_peered":"2024-02-18T16:21:40.929848+0000","last_clean":"2024-02-18T16:21:40.929848+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:21:40.929848+0000","last_undegraded":"2024-02-18T16:21:40.929848+0000","last_fullsized":"2024-02-18T16:21:40.929848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929290+0000","last_change":"2024-02-18T16:21:03.868183+0000","last_active":"2024-02-18T16:21:40.929290+0000","last_peered":"2024-02-18T16:21:40.929290+0000","last_clean":"2024-02-18T16:21:40.929290+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:21:40.929290+0000","last_undegraded":"2024-02-18T16:21:40.929290+0000","last_fullsized":"2024-02-18T16:21:40.929290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:44.654179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.378955+0000","last_change":"2024-02-18T16:21:05.890224+0000","last_active":"2024-02-18T16:22:30.378955+0000","last_peered":"2024-02-18T16:22:30.378955+0000","last_clean":"2024-02-18T16:22:30.378955+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:30.378955+0000","last_undegraded":"2024-02-18T16:22:30.378955+0000","last_fullsized":"2024-02-18T16:22:30.378955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:55.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173856+0000","last_change":"2024-02-18T16:21:07.895448+0000","last_active":"2024-02-18T16:21:41.173856+0000","last_peered":"2024-02-18T16:21:41.173856+0000","last_clean":"2024-02-18T16:21:41.173856+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:21:41.173856+0000","last_undegraded":"2024-02-18T16:21:41.173856+0000","last_fullsized":"2024-02-18T16:21:41.173856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:31.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946969+0000","last_change":"2024-02-18T16:21:09.927008+0000","last_active":"2024-02-18T16:21:40.946969+0000","last_peered":"2024-02-18T16:21:40.946969+0000","last_clean":"2024-02-18T16:21:40.946969+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:21:40.946969+0000","last_undegraded":"2024-02-18T16:21:40.946969+0000","last_fullsized":"2024-02-18T16:21:40.946969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937270+0000","last_change":"2024-02-18T16:21:01.831920+0000","last_active":"2024-02-18T16:21:40.937270+0000","last_peered":"2024-02-18T16:21:40.937270+0000","last_clean":"2024-02-18T16:21:40.937270+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:21:40.937270+0000","last_undegraded":"2024-02-18T16:21:40.937270+0000","last_fullsized":"2024-02-18T16:21:40.937270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951556+0000","last_change":"2024-02-18T16:20:59.872971+0000","last_active":"2024-02-18T16:21:40.951556+0000","last_peered":"2024-02-18T16:21:40.951556+0000","last_clean":"2024-02-18T16:21:40.951556+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:21:40.951556+0000","last_undegraded":"2024-02-18T16:21:40.951556+0000","last_fullsized":"2024-02-18T16:21:40.951556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:31.687324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940611+0000","last_change":"2024-02-18T16:21:03.854122+0000","last_active":"2024-02-18T16:21:40.940611+0000","last_peered":"2024-02-18T16:21:40.940611+0000","last_clean":"2024-02-18T16:21:40.940611+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:21:40.940611+0000","last_undegraded":"2024-02-18T16:21:40.940611+0000","last_fullsized":"2024-02-18T16:21:40.940611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:46.493787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.380857+0000","last_change":"2024-02-18T16:21:05.895074+0000","last_active":"2024-02-18T16:22:30.380857+0000","last_peered":"2024-02-18T16:22:30.380857+0000","last_clean":"2024-02-18T16:22:30.380857+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:30.380857+0000","last_undegraded":"2024-02-18T16:22:30.380857+0000","last_fullsized":"2024-02-18T16:22:30.380857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:29.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932403+0000","last_change":"2024-02-18T16:21:07.908003+0000","last_active":"2024-02-18T16:21:40.932403+0000","last_peered":"2024-02-18T16:21:40.932403+0000","last_clean":"2024-02-18T16:21:40.932403+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:21:40.932403+0000","last_undegraded":"2024-02-18T16:21:40.932403+0000","last_fullsized":"2024-02-18T16:21:40.932403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:07.987144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954186+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:21:40.954186+0000","last_peered":"2024-02-18T16:21:40.954186+0000","last_clean":"2024-02-18T16:21:40.954186+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:21:40.954186+0000","last_undegraded":"2024-02-18T16:21:40.954186+0000","last_fullsized":"2024-02-18T16:21:40.954186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:55:03.922245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.423870+0000","last_change":"2024-02-18T16:21:01.855576+0000","last_active":"2024-02-18T16:21:46.423870+0000","last_peered":"2024-02-18T16:21:46.423870+0000","last_clean":"2024-02-18T16:21:46.423870+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:21:46.423870+0000","last_undegraded":"2024-02-18T16:21:46.423870+0000","last_fullsized":"2024-02-18T16:21:46.423870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:08.162049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180630+0000","last_change":"2024-02-18T16:20:59.862651+0000","last_active":"2024-02-18T16:21:41.180630+0000","last_peered":"2024-02-18T16:21:41.180630+0000","last_clean":"2024-02-18T16:21:41.180630+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:21:41.180630+0000","last_undegraded":"2024-02-18T16:21:41.180630+0000","last_fullsized":"2024-02-18T16:21:41.180630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.176054+0000","last_change":"2024-02-18T16:21:03.858753+0000","last_active":"2024-02-18T16:22:37.176054+0000","last_peered":"2024-02-18T16:22:37.176054+0000","last_clean":"2024-02-18T16:22:37.176054+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:22:37.176054+0000","last_undegraded":"2024-02-18T16:22:37.176054+0000","last_fullsized":"2024-02-18T16:22:37.176054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:47.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.419821+0000","last_change":"2024-02-18T16:21:05.886757+0000","last_active":"2024-02-18T16:22:30.419821+0000","last_peered":"2024-02-18T16:22:30.419821+0000","last_clean":"2024-02-18T16:22:30.419821+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:30.419821+0000","last_undegraded":"2024-02-18T16:22:30.419821+0000","last_fullsized":"2024-02-18T16:22:30.419821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:25:06.744338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938999+0000","last_change":"2024-02-18T16:21:07.912579+0000","last_active":"2024-02-18T16:21:40.938999+0000","last_peered":"2024-02-18T16:21:40.938999+0000","last_clean":"2024-02-18T16:21:40.938999+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:21:40.938999+0000","last_undegraded":"2024-02-18T16:21:40.938999+0000","last_fullsized":"2024-02-18T16:21:40.938999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:03:05.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950786+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:21:40.950786+0000","last_peered":"2024-02-18T16:21:40.950786+0000","last_clean":"2024-02-18T16:21:40.950786+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:21:40.950786+0000","last_undegraded":"2024-02-18T16:21:40.950786+0000","last_fullsized":"2024-02-18T16:21:40.950786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:08.385221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085308+0000","last_change":"2024-02-18T16:21:01.833320+0000","last_active":"2024-02-18T16:22:36.085308+0000","last_peered":"2024-02-18T16:22:36.085308+0000","last_clean":"2024-02-18T16:22:36.085308+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:22:36.085308+0000","last_undegraded":"2024-02-18T16:22:36.085308+0000","last_fullsized":"2024-02-18T16:22:36.085308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:35.898147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946271+0000","last_change":"2024-02-18T16:20:59.855832+0000","last_active":"2024-02-18T16:21:40.946271+0000","last_peered":"2024-02-18T16:21:40.946271+0000","last_clean":"2024-02-18T16:21:40.946271+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:21:40.946271+0000","last_undegraded":"2024-02-18T16:21:40.946271+0000","last_fullsized":"2024-02-18T16:21:40.946271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930567+0000","last_change":"2024-02-18T16:21:03.862714+0000","last_active":"2024-02-18T16:21:40.930567+0000","last_peered":"2024-02-18T16:21:40.930567+0000","last_clean":"2024-02-18T16:21:40.930567+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:21:40.930567+0000","last_undegraded":"2024-02-18T16:21:40.930567+0000","last_fullsized":"2024-02-18T16:21:40.930567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:36.699699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.062152+0000","last_change":"2024-02-18T16:21:05.890834+0000","last_active":"2024-02-18T16:22:36.062152+0000","last_peered":"2024-02-18T16:22:36.062152+0000","last_clean":"2024-02-18T16:22:36.062152+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:22:36.062152+0000","last_undegraded":"2024-02-18T16:22:36.062152+0000","last_fullsized":"2024-02-18T16:22:36.062152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:57:24.200656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":46,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175495+0000","last_change":"2024-02-18T16:21:07.894884+0000","last_active":"2024-02-18T16:21:41.175495+0000","last_peered":"2024-02-18T16:21:41.175495+0000","last_clean":"2024-02-18T16:21:41.175495+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:21:41.175495+0000","last_undegraded":"2024-02-18T16:21:41.175495+0000","last_fullsized":"2024-02-18T16:21:41.175495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.438798+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:30.438798+0000","last_peered":"2024-02-18T16:22:30.438798+0000","last_clean":"2024-02-18T16:22:30.438798+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:30.438798+0000","last_undegraded":"2024-02-18T16:22:30.438798+0000","last_fullsized":"2024-02-18T16:22:30.438798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:31.495612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.845885+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:17:13.639861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932873+0000","last_change":"2024-02-18T16:20:59.838011+0000","last_active":"2024-02-18T16:21:40.932873+0000","last_peered":"2024-02-18T16:21:40.932873+0000","last_clean":"2024-02-18T16:21:40.932873+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:21:40.932873+0000","last_undegraded":"2024-02-18T16:21:40.932873+0000","last_fullsized":"2024-02-18T16:21:40.932873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182948+0000","last_change":"2024-02-18T16:21:01.839946+0000","last_active":"2024-02-18T16:21:41.182948+0000","last_peered":"2024-02-18T16:21:41.182948+0000","last_clean":"2024-02-18T16:21:41.182948+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:21:41.182948+0000","last_undegraded":"2024-02-18T16:21:41.182948+0000","last_fullsized":"2024-02-18T16:21:41.182948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.146551+0000","last_change":"2024-02-18T16:20:59.850717+0000","last_active":"2024-02-18T16:21:47.146551+0000","last_peered":"2024-02-18T16:21:47.146551+0000","last_clean":"2024-02-18T16:21:47.146551+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:21:47.146551+0000","last_undegraded":"2024-02-18T16:21:47.146551+0000","last_fullsized":"2024-02-18T16:21:47.146551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605557+0000","last_change":"2024-02-18T16:21:01.857016+0000","last_active":"2024-02-18T16:22:29.605557+0000","last_peered":"2024-02-18T16:22:29.605557+0000","last_clean":"2024-02-18T16:22:29.605557+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:22:29.605557+0000","last_undegraded":"2024-02-18T16:22:29.605557+0000","last_fullsized":"2024-02-18T16:22:29.605557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:34.686098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.613089+0000","last_change":"2024-02-18T16:20:59.865570+0000","last_active":"2024-02-18T16:22:29.613089+0000","last_peered":"2024-02-18T16:22:29.613089+0000","last_clean":"2024-02-18T16:22:29.613089+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:22:29.613089+0000","last_undegraded":"2024-02-18T16:22:29.613089+0000","last_fullsized":"2024-02-18T16:22:29.613089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:24.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.881324+0000","last_change":"2024-02-18T16:21:01.844340+0000","last_active":"2024-02-18T16:21:46.881324+0000","last_peered":"2024-02-18T16:21:46.881324+0000","last_clean":"2024-02-18T16:21:46.881324+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:21:46.881324+0000","last_undegraded":"2024-02-18T16:21:46.881324+0000","last_fullsized":"2024-02-18T16:21:46.881324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:33.700597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177537+0000","last_change":"2024-02-18T16:20:59.857706+0000","last_active":"2024-02-18T16:21:41.177537+0000","last_peered":"2024-02-18T16:21:41.177537+0000","last_clean":"2024-02-18T16:21:41.177537+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:21:41.177537+0000","last_undegraded":"2024-02-18T16:21:41.177537+0000","last_fullsized":"2024-02-18T16:21:41.177537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:54:03.661573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177027+0000","last_change":"2024-02-18T16:21:01.852407+0000","last_active":"2024-02-18T16:21:41.177027+0000","last_peered":"2024-02-18T16:21:41.177027+0000","last_clean":"2024-02-18T16:21:41.177027+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:21:41.177027+0000","last_undegraded":"2024-02-18T16:21:41.177027+0000","last_fullsized":"2024-02-18T16:21:41.177027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177143+0000","last_change":"2024-02-18T16:20:59.859871+0000","last_active":"2024-02-18T16:21:41.177143+0000","last_peered":"2024-02-18T16:21:41.177143+0000","last_clean":"2024-02-18T16:21:41.177143+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:21:41.177143+0000","last_undegraded":"2024-02-18T16:21:41.177143+0000","last_fullsized":"2024-02-18T16:21:41.177143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085205+0000","last_change":"2024-02-18T16:21:40.963827+0000","last_active":"2024-02-18T16:22:36.085205+0000","last_peered":"2024-02-18T16:22:36.085205+0000","last_clean":"2024-02-18T16:22:36.085205+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:22:36.085205+0000","last_undegraded":"2024-02-18T16:22:36.085205+0000","last_fullsized":"2024-02-18T16:22:36.085205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:13.380313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933696+0000","last_change":"2024-02-18T16:20:59.861914+0000","last_active":"2024-02-18T16:21:40.933696+0000","last_peered":"2024-02-18T16:21:40.933696+0000","last_clean":"2024-02-18T16:21:40.933696+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:21:40.933696+0000","last_undegraded":"2024-02-18T16:21:40.933696+0000","last_fullsized":"2024-02-18T16:21:40.933696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176179+0000","last_change":"2024-02-18T16:21:01.843302+0000","last_active":"2024-02-18T16:21:41.176179+0000","last_peered":"2024-02-18T16:21:41.176179+0000","last_clean":"2024-02-18T16:21:41.176179+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:21:41.176179+0000","last_undegraded":"2024-02-18T16:21:41.176179+0000","last_fullsized":"2024-02-18T16:21:41.176179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953161+0000","last_change":"2024-02-18T16:20:59.835435+0000","last_active":"2024-02-18T16:21:40.953161+0000","last_peered":"2024-02-18T16:21:40.953161+0000","last_clean":"2024-02-18T16:21:40.953161+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:21:40.953161+0000","last_undegraded":"2024-02-18T16:21:40.953161+0000","last_fullsized":"2024-02-18T16:21:40.953161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.424363+0000","last_change":"2024-02-18T16:21:01.838281+0000","last_active":"2024-02-18T16:21:46.424363+0000","last_peered":"2024-02-18T16:21:46.424363+0000","last_clean":"2024-02-18T16:21:46.424363+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:21:46.424363+0000","last_undegraded":"2024-02-18T16:21:46.424363+0000","last_fullsized":"2024-02-18T16:21:46.424363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183281+0000","last_change":"2024-02-18T16:20:59.859552+0000","last_active":"2024-02-18T16:21:41.183281+0000","last_peered":"2024-02-18T16:21:41.183281+0000","last_clean":"2024-02-18T16:21:41.183281+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:21:41.183281+0000","last_undegraded":"2024-02-18T16:21:41.183281+0000","last_fullsized":"2024-02-18T16:21:41.183281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:55:51.749702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947919+0000","last_change":"2024-02-18T16:21:01.840265+0000","last_active":"2024-02-18T16:21:40.947919+0000","last_peered":"2024-02-18T16:21:40.947919+0000","last_clean":"2024-02-18T16:21:40.947919+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:21:40.947919+0000","last_undegraded":"2024-02-18T16:21:40.947919+0000","last_fullsized":"2024-02-18T16:21:40.947919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:26.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934046+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:21:40.934046+0000","last_peered":"2024-02-18T16:21:40.934046+0000","last_clean":"2024-02-18T16:21:40.934046+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:21:40.934046+0000","last_undegraded":"2024-02-18T16:21:40.934046+0000","last_fullsized":"2024-02-18T16:21:40.934046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:53:59.394571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457053+0000","last_change":"2024-02-18T16:21:01.853933+0000","last_active":"2024-02-18T16:22:30.457053+0000","last_peered":"2024-02-18T16:22:30.457053+0000","last_clean":"2024-02-18T16:22:30.457053+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:22:30.457053+0000","last_undegraded":"2024-02-18T16:22:30.457053+0000","last_fullsized":"2024-02-18T16:22:30.457053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.515684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.446026+0000","last_change":"2024-02-18T16:20:59.853659+0000","last_active":"2024-02-18T16:22:30.446026+0000","last_peered":"2024-02-18T16:22:30.446026+0000","last_clean":"2024-02-18T16:22:30.446026+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:22:30.446026+0000","last_undegraded":"2024-02-18T16:22:30.446026+0000","last_fullsized":"2024-02-18T16:22:30.446026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858279+0000","last_change":"2024-02-18T16:21:01.853974+0000","last_active":"2024-02-18T16:21:47.858279+0000","last_peered":"2024-02-18T16:21:47.858279+0000","last_clean":"2024-02-18T16:21:47.858279+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:21:47.858279+0000","last_undegraded":"2024-02-18T16:21:47.858279+0000","last_fullsized":"2024-02-18T16:21:47.858279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930423+0000","last_change":"2024-02-18T16:20:59.859832+0000","last_active":"2024-02-18T16:21:40.930423+0000","last_peered":"2024-02-18T16:21:40.930423+0000","last_clean":"2024-02-18T16:21:40.930423+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:21:40.930423+0000","last_undegraded":"2024-02-18T16:21:40.930423+0000","last_fullsized":"2024-02-18T16:21:40.930423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085223+0000","last_change":"2024-02-18T16:21:01.839367+0000","last_active":"2024-02-18T16:22:36.085223+0000","last_peered":"2024-02-18T16:22:36.085223+0000","last_clean":"2024-02-18T16:22:36.085223+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:22:36.085223+0000","last_undegraded":"2024-02-18T16:22:36.085223+0000","last_fullsized":"2024-02-18T16:22:36.085223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:10.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929055+0000","last_change":"2024-02-18T16:20:59.859222+0000","last_active":"2024-02-18T16:21:40.929055+0000","last_peered":"2024-02-18T16:21:40.929055+0000","last_clean":"2024-02-18T16:21:40.929055+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:21:40.929055+0000","last_undegraded":"2024-02-18T16:21:40.929055+0000","last_fullsized":"2024-02-18T16:21:40.929055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.848741+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951778+0000","last_change":"2024-02-18T16:20:59.863633+0000","last_active":"2024-02-18T16:21:40.951778+0000","last_peered":"2024-02-18T16:21:40.951778+0000","last_clean":"2024-02-18T16:21:40.951778+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:21:40.951778+0000","last_undegraded":"2024-02-18T16:21:40.951778+0000","last_fullsized":"2024-02-18T16:21:40.951778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:52.944418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457179+0000","last_change":"2024-02-18T16:21:01.843918+0000","last_active":"2024-02-18T16:22:30.457179+0000","last_peered":"2024-02-18T16:22:30.457179+0000","last_clean":"2024-02-18T16:22:30.457179+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:22:30.457179+0000","last_undegraded":"2024-02-18T16:22:30.457179+0000","last_fullsized":"2024-02-18T16:22:30.457179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:44.480187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951870+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:21:40.951870+0000","last_peered":"2024-02-18T16:21:40.951870+0000","last_clean":"2024-02-18T16:21:40.951870+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:21:40.951870+0000","last_undegraded":"2024-02-18T16:21:40.951870+0000","last_fullsized":"2024-02-18T16:21:40.951870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:05.595193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939474+0000","last_change":"2024-02-18T16:21:01.855777+0000","last_active":"2024-02-18T16:21:40.939474+0000","last_peered":"2024-02-18T16:21:40.939474+0000","last_clean":"2024-02-18T16:21:40.939474+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:21:40.939474+0000","last_undegraded":"2024-02-18T16:21:40.939474+0000","last_fullsized":"2024-02-18T16:21:40.939474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:58.959710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953859+0000","last_change":"2024-02-18T16:20:59.854737+0000","last_active":"2024-02-18T16:21:40.953859+0000","last_peered":"2024-02-18T16:21:40.953859+0000","last_clean":"2024-02-18T16:21:40.953859+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:21:40.953859+0000","last_undegraded":"2024-02-18T16:21:40.953859+0000","last_fullsized":"2024-02-18T16:21:40.953859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165380+0000","last_change":"2024-02-18T16:21:01.838289+0000","last_active":"2024-02-18T16:21:47.165380+0000","last_peered":"2024-02-18T16:21:47.165380+0000","last_clean":"2024-02-18T16:21:47.165380+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:21:47.165380+0000","last_undegraded":"2024-02-18T16:21:47.165380+0000","last_fullsized":"2024-02-18T16:21:47.165380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955671+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:21:40.955671+0000","last_peered":"2024-02-18T16:21:40.955671+0000","last_clean":"2024-02-18T16:21:40.955671+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:21:40.955671+0000","last_undegraded":"2024-02-18T16:21:40.955671+0000","last_fullsized":"2024-02-18T16:21:40.955671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:18.150893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935916+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:21:40.935916+0000","last_peered":"2024-02-18T16:21:40.935916+0000","last_clean":"2024-02-18T16:21:40.935916+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:21:40.935916+0000","last_undegraded":"2024-02-18T16:21:40.935916+0000","last_fullsized":"2024-02-18T16:21:40.935916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:46:46.292617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.184388+0000","last_change":"2024-02-18T16:21:01.848174+0000","last_active":"2024-02-18T16:21:41.184388+0000","last_peered":"2024-02-18T16:21:41.184388+0000","last_clean":"2024-02-18T16:21:41.184388+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:21:41.184388+0000","last_undegraded":"2024-02-18T16:21:41.184388+0000","last_fullsized":"2024-02-18T16:21:41.184388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:36:39.607508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174728+0000","last_change":"2024-02-18T16:20:59.856141+0000","last_active":"2024-02-18T16:21:41.174728+0000","last_peered":"2024-02-18T16:21:41.174728+0000","last_clean":"2024-02-18T16:21:41.174728+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:21:41.174728+0000","last_undegraded":"2024-02-18T16:21:41.174728+0000","last_fullsized":"2024-02-18T16:21:41.174728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944734+0000","last_change":"2024-02-18T16:21:01.839351+0000","last_active":"2024-02-18T16:21:40.944734+0000","last_peered":"2024-02-18T16:21:40.944734+0000","last_clean":"2024-02-18T16:21:40.944734+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:21:40.944734+0000","last_undegraded":"2024-02-18T16:21:40.944734+0000","last_fullsized":"2024-02-18T16:21:40.944734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:43.462047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.69099999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":18.120999999999999,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.747},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":26.050999999999998,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.71799999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705690,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:22:45.086 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-18T16:22:45.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:22:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdae0bb5640 1 Processor -- start 2024-02-18T16:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdae0bb5640 1 -- start start 2024-02-18T16:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdae0bb5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdadc093a10 0x7fdadc093df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdae0bb5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc095170 con 0x7fdadc094330 2024-02-18T16:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdae0bb5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc072550 con 0x7fdadc093a10 2024-02-18T16:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdada59c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdadc093a10 0x7fdadc093df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdad9d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdadc094330 0x7fdadc12e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36612/0 (socket says 172.21.15.80:36612) 2024-02-18T16:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.232+0000 7fdad9d9b640 1 -- 172.21.15.80:0/4257405050 learned_addr learned my addr 172.21.15.80:0/4257405050 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdada59c640 1 -- 172.21.15.80:0/4257405050 >> v1:172.21.15.80:6789/0 conn(0x7fdadc094330 legacy=0x7fdadc12e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdada59c640 1 -- 172.21.15.80:0/4257405050 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc094bb0 con 0x7fdadc093a10 2024-02-18T16:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdada59c640 1 --2- 172.21.15.80:0/4257405050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc093df0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009740 tx=0x7fdad001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c23f298c78a32cf server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdad959a640 1 -- 172.21.15.80:0/4257405050 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad00ab530 con 0x7fdadc093a10 2024-02-18T16:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdad959a640 1 -- 172.21.15.80:0/4257405050 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad00a7050 con 0x7fdadc093a10 2024-02-18T16:22:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdad959a640 1 -- 172.21.15.80:0/4257405050 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad00ab7e0 con 0x7fdadc093a10 2024-02-18T16:22:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 -- 172.21.15.80:0/4257405050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 msgr2=0x7fdadc093df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 --2- 172.21.15.80:0/4257405050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc093df0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009740 tx=0x7fdad001c370 comp rx=0 tx=0).stop 2024-02-18T16:22:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 -- 172.21.15.80:0/4257405050 shutdown_connections 2024-02-18T16:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 --2- 172.21.15.80:0/4257405050 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc093df0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 -- 172.21.15.80:0/4257405050 >> 172.21.15.80:0/4257405050 conn(0x7fdadc09a2f0 msgr2=0x7fdadc09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 -- 172.21.15.80:0/4257405050 shutdown_connections 2024-02-18T16:22:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.236+0000 7fdae0bb5640 1 -- 172.21.15.80:0/4257405050 wait complete. 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 Processor -- start 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 -- start start 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc12d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc070c00 con 0x7fdadc093a10 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdada59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc12d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdada59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc12d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52820/0 (socket says 172.21.15.80:52820) 2024-02-18T16:22:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdada59c640 1 -- 172.21.15.80:0/972268252 learned_addr learned my addr 172.21.15.80:0/972268252 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdada59c640 1 -- 172.21.15.80:0/972268252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0009420 con 0x7fdadc093a10 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdada59c640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc12d3d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdad0019fa0 tx=0x7fdad001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad00b7450 con 0x7fdadc093a10 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad00b75b0 con 0x7fdadc093a10 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc071930 con 0x7fdadc093a10 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad00b7850 con 0x7fdadc093a10 2024-02-18T16:22:45.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc070540 con 0x7fdadc093a10 2024-02-18T16:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdad00b79b0 con 0x7fdadc093a10 2024-02-18T16:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc067e00 con 0x7fdadc093a10 2024-02-18T16:22:45.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdacaffd640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdabc035a10 0x7fdabc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fdad00e3170 con 0x7fdadc093a10 2024-02-18T16:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.240+0000 7fdad9d9b640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdabc035a10 0x7fdabc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:45.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.244+0000 7fdad9d9b640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdabc035a10 0x7fdabc037ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdacc001610 tx=0x7fdacc007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:45.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.244+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdad00c74e0 con 0x7fdadc093a10 2024-02-18T16:22:45.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.400+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdadc062860 con 0x7fdabc035a10 2024-02-18T16:22:45.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.444+0000 7fdacaffd640 1 -- 172.21.15.80:0/972268252 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673657 (secure 0 0 0) 0x7fdadc062860 con 0x7fdabc035a10 2024-02-18T16:22:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:22:45.467 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdabc035a10 msgr2=0x7fdabc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdabc035a10 0x7fdabc037ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdacc001610 tx=0x7fdacc007ad0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 msgr2=0x7fdadc12d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc12d3d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdad0019fa0 tx=0x7fdad001abb0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 shutdown_connections 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fdabc035a10 0x7fdabc037ed0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 --2- 172.21.15.80:0/972268252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdadc093a10 0x7fdadc12d3d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 >> 172.21.15.80:0/972268252 conn(0x7fdadc09a2f0 msgr2=0x7fdadc12f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 shutdown_connections 2024-02-18T16:22:45.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.452+0000 7fdae0bb5640 1 -- 172.21.15.80:0/972268252 wait complete. 2024-02-18T16:22:45.484 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-18T16:22:43.804876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3814,"num_read_kb":3457,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950367+0000","last_change":"2024-02-18T16:20:59.848322+0000","last_active":"2024-02-18T16:21:40.950367+0000","last_peered":"2024-02-18T16:21:40.950367+0000","last_clean":"2024-02-18T16:21:40.950367+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:21:40.950367+0000","last_undegraded":"2024-02-18T16:21:40.950367+0000","last_fullsized":"2024-02-18T16:21:40.950367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436673+0000","last_change":"2024-02-18T16:21:01.837422+0000","last_active":"2024-02-18T16:21:46.436673+0000","last_peered":"2024-02-18T16:21:46.436673+0000","last_clean":"2024-02-18T16:21:46.436673+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:21:46.436673+0000","last_undegraded":"2024-02-18T16:21:46.436673+0000","last_fullsized":"2024-02-18T16:21:46.436673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180695+0000","last_change":"2024-02-18T16:20:59.862127+0000","last_active":"2024-02-18T16:21:41.180695+0000","last_peered":"2024-02-18T16:21:41.180695+0000","last_clean":"2024-02-18T16:21:41.180695+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:21:41.180695+0000","last_undegraded":"2024-02-18T16:21:41.180695+0000","last_fullsized":"2024-02-18T16:21:41.180695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165685+0000","last_change":"2024-02-18T16:21:01.856123+0000","last_active":"2024-02-18T16:21:47.165685+0000","last_peered":"2024-02-18T16:21:47.165685+0000","last_clean":"2024-02-18T16:21:47.165685+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:21:47.165685+0000","last_undegraded":"2024-02-18T16:21:47.165685+0000","last_fullsized":"2024-02-18T16:21:47.165685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:42.640579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952271+0000","last_change":"2024-02-18T16:20:59.872708+0000","last_active":"2024-02-18T16:21:40.952271+0000","last_peered":"2024-02-18T16:21:40.952271+0000","last_clean":"2024-02-18T16:21:40.952271+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:21:40.952271+0000","last_undegraded":"2024-02-18T16:21:40.952271+0000","last_fullsized":"2024-02-18T16:21:40.952271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:12.199846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456931+0000","last_change":"2024-02-18T16:21:01.856474+0000","last_active":"2024-02-18T16:22:30.456931+0000","last_peered":"2024-02-18T16:22:30.456931+0000","last_clean":"2024-02-18T16:22:30.456931+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:22:30.456931+0000","last_undegraded":"2024-02-18T16:22:30.456931+0000","last_fullsized":"2024-02-18T16:22:30.456931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:13.748546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938237+0000","last_change":"2024-02-18T16:20:59.833010+0000","last_active":"2024-02-18T16:21:40.938237+0000","last_peered":"2024-02-18T16:21:40.938237+0000","last_clean":"2024-02-18T16:21:40.938237+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:21:40.938237+0000","last_undegraded":"2024-02-18T16:21:40.938237+0000","last_fullsized":"2024-02-18T16:21:40.938237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457019+0000","last_change":"2024-02-18T16:21:01.857441+0000","last_active":"2024-02-18T16:22:30.457019+0000","last_peered":"2024-02-18T16:22:30.457019+0000","last_clean":"2024-02-18T16:22:30.457019+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:22:30.457019+0000","last_undegraded":"2024-02-18T16:22:30.457019+0000","last_fullsized":"2024-02-18T16:22:30.457019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:02.458464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949134+0000","last_change":"2024-02-18T16:20:59.868597+0000","last_active":"2024-02-18T16:21:40.949134+0000","last_peered":"2024-02-18T16:21:40.949134+0000","last_clean":"2024-02-18T16:21:40.949134+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:21:40.949134+0000","last_undegraded":"2024-02-18T16:21:40.949134+0000","last_fullsized":"2024-02-18T16:21:40.949134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:31.249657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085312+0000","last_change":"2024-02-18T16:21:01.836895+0000","last_active":"2024-02-18T16:22:36.085312+0000","last_peered":"2024-02-18T16:22:36.085312+0000","last_clean":"2024-02-18T16:22:36.085312+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:22:36.085312+0000","last_undegraded":"2024-02-18T16:22:36.085312+0000","last_fullsized":"2024-02-18T16:22:36.085312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:15.712412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937535+0000","last_change":"2024-02-18T16:20:59.827833+0000","last_active":"2024-02-18T16:21:40.937535+0000","last_peered":"2024-02-18T16:21:40.937535+0000","last_clean":"2024-02-18T16:21:40.937535+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:21:40.937535+0000","last_undegraded":"2024-02-18T16:21:40.937535+0000","last_fullsized":"2024-02-18T16:21:40.937535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.868753+0000","last_change":"2024-02-18T16:21:01.856191+0000","last_active":"2024-02-18T16:21:47.868753+0000","last_peered":"2024-02-18T16:21:47.868753+0000","last_clean":"2024-02-18T16:21:47.868753+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:21:47.868753+0000","last_undegraded":"2024-02-18T16:21:47.868753+0000","last_fullsized":"2024-02-18T16:21:47.868753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:03.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.077672+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:36.077672+0000","last_peered":"2024-02-18T16:22:36.077672+0000","last_clean":"2024-02-18T16:22:36.077672+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:36.077672+0000","last_undegraded":"2024-02-18T16:22:36.077672+0000","last_fullsized":"2024-02-18T16:22:36.077672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:39:01.643786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085590+0000","last_change":"2024-02-18T16:21:01.831792+0000","last_active":"2024-02-18T16:22:36.085590+0000","last_peered":"2024-02-18T16:22:36.085590+0000","last_clean":"2024-02-18T16:22:36.085590+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:22:36.085590+0000","last_undegraded":"2024-02-18T16:22:36.085590+0000","last_fullsized":"2024-02-18T16:22:36.085590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174557+0000","last_change":"2024-02-18T16:20:59.851482+0000","last_active":"2024-02-18T16:21:41.174557+0000","last_peered":"2024-02-18T16:21:41.174557+0000","last_clean":"2024-02-18T16:21:41.174557+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:21:41.174557+0000","last_undegraded":"2024-02-18T16:21:41.174557+0000","last_fullsized":"2024-02-18T16:21:41.174557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871870+0000","last_change":"2024-02-18T16:21:01.845622+0000","last_active":"2024-02-18T16:21:46.871870+0000","last_peered":"2024-02-18T16:21:46.871870+0000","last_clean":"2024-02-18T16:21:46.871870+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:21:46.871870+0000","last_undegraded":"2024-02-18T16:21:46.871870+0000","last_fullsized":"2024-02-18T16:21:46.871870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471613+0000","last_change":"2024-02-18T16:21:01.852206+0000","last_active":"2024-02-18T16:22:30.471613+0000","last_peered":"2024-02-18T16:22:30.471613+0000","last_clean":"2024-02-18T16:22:30.471613+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:22:30.471613+0000","last_undegraded":"2024-02-18T16:22:30.471613+0000","last_fullsized":"2024-02-18T16:22:30.471613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:45.548759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946674+0000","last_change":"2024-02-18T16:20:59.861096+0000","last_active":"2024-02-18T16:21:40.946674+0000","last_peered":"2024-02-18T16:21:40.946674+0000","last_clean":"2024-02-18T16:21:40.946674+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:21:40.946674+0000","last_undegraded":"2024-02-18T16:21:40.946674+0000","last_fullsized":"2024-02-18T16:21:40.946674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457228+0000","last_change":"2024-02-18T16:21:01.833772+0000","last_active":"2024-02-18T16:22:30.457228+0000","last_peered":"2024-02-18T16:22:30.457228+0000","last_clean":"2024-02-18T16:22:30.457228+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:22:30.457228+0000","last_undegraded":"2024-02-18T16:22:30.457228+0000","last_fullsized":"2024-02-18T16:22:30.457228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954107+0000","last_change":"2024-02-18T16:20:59.858318+0000","last_active":"2024-02-18T16:21:40.954107+0000","last_peered":"2024-02-18T16:21:40.954107+0000","last_clean":"2024-02-18T16:21:40.954107+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:21:40.954107+0000","last_undegraded":"2024-02-18T16:21:40.954107+0000","last_fullsized":"2024-02-18T16:21:40.954107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085421+0000","last_change":"2024-02-18T16:21:01.848259+0000","last_active":"2024-02-18T16:22:36.085421+0000","last_peered":"2024-02-18T16:22:36.085421+0000","last_clean":"2024-02-18T16:22:36.085421+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:22:36.085421+0000","last_undegraded":"2024-02-18T16:22:36.085421+0000","last_fullsized":"2024-02-18T16:22:36.085421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.151295+0000","last_change":"2024-02-18T16:20:59.862404+0000","last_active":"2024-02-18T16:21:47.151295+0000","last_peered":"2024-02-18T16:21:47.151295+0000","last_clean":"2024-02-18T16:21:47.151295+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:21:47.151295+0000","last_undegraded":"2024-02-18T16:21:47.151295+0000","last_fullsized":"2024-02-18T16:21:47.151295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085319+0000","last_change":"2024-02-18T16:21:01.844448+0000","last_active":"2024-02-18T16:22:36.085319+0000","last_peered":"2024-02-18T16:22:36.085319+0000","last_clean":"2024-02-18T16:22:36.085319+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:22:36.085319+0000","last_undegraded":"2024-02-18T16:22:36.085319+0000","last_fullsized":"2024-02-18T16:22:36.085319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929557+0000","last_change":"2024-02-18T16:20:59.861087+0000","last_active":"2024-02-18T16:21:40.929557+0000","last_peered":"2024-02-18T16:21:40.929557+0000","last_clean":"2024-02-18T16:21:40.929557+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:21:40.929557+0000","last_undegraded":"2024-02-18T16:21:40.929557+0000","last_fullsized":"2024-02-18T16:21:40.929557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605978+0000","last_change":"2024-02-18T16:21:01.849052+0000","last_active":"2024-02-18T16:22:29.605978+0000","last_peered":"2024-02-18T16:22:29.605978+0000","last_clean":"2024-02-18T16:22:29.605978+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:22:29.605978+0000","last_undegraded":"2024-02-18T16:22:29.605978+0000","last_fullsized":"2024-02-18T16:22:29.605978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.157404+0000","last_change":"2024-02-18T16:20:59.860613+0000","last_active":"2024-02-18T16:21:47.157404+0000","last_peered":"2024-02-18T16:21:47.157404+0000","last_clean":"2024-02-18T16:21:47.157404+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:21:47.157404+0000","last_undegraded":"2024-02-18T16:21:47.157404+0000","last_fullsized":"2024-02-18T16:21:47.157404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085347+0000","last_change":"2024-02-18T16:21:01.838527+0000","last_active":"2024-02-18T16:22:36.085347+0000","last_peered":"2024-02-18T16:22:36.085347+0000","last_clean":"2024-02-18T16:22:36.085347+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:22:36.085347+0000","last_undegraded":"2024-02-18T16:22:36.085347+0000","last_fullsized":"2024-02-18T16:22:36.085347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:26.235100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940659+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:21:40.940659+0000","last_peered":"2024-02-18T16:21:40.940659+0000","last_clean":"2024-02-18T16:21:40.940659+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:21:40.940659+0000","last_undegraded":"2024-02-18T16:21:40.940659+0000","last_fullsized":"2024-02-18T16:21:40.940659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.743095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.071636+0000","last_change":"2024-02-18T16:21:09.915975+0000","last_active":"2024-02-18T16:22:36.071636+0000","last_peered":"2024-02-18T16:22:36.071636+0000","last_clean":"2024-02-18T16:22:36.071636+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:22:36.071636+0000","last_undegraded":"2024-02-18T16:22:36.071636+0000","last_fullsized":"2024-02-18T16:22:36.071636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:47.379422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605701+0000","last_change":"2024-02-18T16:21:01.853570+0000","last_active":"2024-02-18T16:22:29.605701+0000","last_peered":"2024-02-18T16:22:29.605701+0000","last_clean":"2024-02-18T16:22:29.605701+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:22:29.605701+0000","last_undegraded":"2024-02-18T16:22:29.605701+0000","last_fullsized":"2024-02-18T16:22:29.605701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:25.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.140958+0000","last_change":"2024-02-18T16:20:59.871560+0000","last_active":"2024-02-18T16:21:47.140958+0000","last_peered":"2024-02-18T16:21:47.140958+0000","last_clean":"2024-02-18T16:21:47.140958+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:21:47.140958+0000","last_undegraded":"2024-02-18T16:21:47.140958+0000","last_fullsized":"2024-02-18T16:21:47.140958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:22.719740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950984+0000","last_change":"2024-02-18T16:21:03.855757+0000","last_active":"2024-02-18T16:21:40.950984+0000","last_peered":"2024-02-18T16:21:40.950984+0000","last_clean":"2024-02-18T16:21:40.950984+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:21:40.950984+0000","last_undegraded":"2024-02-18T16:21:40.950984+0000","last_fullsized":"2024-02-18T16:21:40.950984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:32.293153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.407799+0000","last_change":"2024-02-18T16:21:05.901603+0000","last_active":"2024-02-18T16:22:30.407799+0000","last_peered":"2024-02-18T16:22:30.407799+0000","last_clean":"2024-02-18T16:22:30.407799+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:22:30.407799+0000","last_undegraded":"2024-02-18T16:22:30.407799+0000","last_fullsized":"2024-02-18T16:22:30.407799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:06:03.628864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946001+0000","last_change":"2024-02-18T16:21:07.918527+0000","last_active":"2024-02-18T16:21:40.946001+0000","last_peered":"2024-02-18T16:21:40.946001+0000","last_clean":"2024-02-18T16:21:40.946001+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:21:40.946001+0000","last_undegraded":"2024-02-18T16:21:40.946001+0000","last_fullsized":"2024-02-18T16:21:40.946001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.550475+0000","last_change":"2024-02-18T16:21:09.916272+0000","last_active":"2024-02-18T16:22:24.550475+0000","last_peered":"2024-02-18T16:22:24.550475+0000","last_clean":"2024-02-18T16:22:24.550475+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:22:24.550475+0000","last_undegraded":"2024-02-18T16:22:24.550475+0000","last_fullsized":"2024-02-18T16:22:24.550475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951709+0000","last_change":"2024-02-18T16:21:01.856905+0000","last_active":"2024-02-18T16:21:40.951709+0000","last_peered":"2024-02-18T16:21:40.951709+0000","last_clean":"2024-02-18T16:21:40.951709+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:21:40.951709+0000","last_undegraded":"2024-02-18T16:21:40.951709+0000","last_fullsized":"2024-02-18T16:21:40.951709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:29.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936829+0000","last_change":"2024-02-18T16:20:59.829726+0000","last_active":"2024-02-18T16:21:40.936829+0000","last_peered":"2024-02-18T16:21:40.936829+0000","last_clean":"2024-02-18T16:21:40.936829+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:21:40.936829+0000","last_undegraded":"2024-02-18T16:21:40.936829+0000","last_fullsized":"2024-02-18T16:21:40.936829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175923+0000","last_change":"2024-02-18T16:21:03.852211+0000","last_active":"2024-02-18T16:21:41.175923+0000","last_peered":"2024-02-18T16:21:41.175923+0000","last_clean":"2024-02-18T16:21:41.175923+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:21:41.175923+0000","last_undegraded":"2024-02-18T16:21:41.175923+0000","last_fullsized":"2024-02-18T16:21:41.175923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:26.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944532+0000","last_change":"2024-02-18T16:21:05.875530+0000","last_active":"2024-02-18T16:21:40.944532+0000","last_peered":"2024-02-18T16:21:40.944532+0000","last_clean":"2024-02-18T16:21:40.944532+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:21:40.944532+0000","last_undegraded":"2024-02-18T16:21:40.944532+0000","last_fullsized":"2024-02-18T16:21:40.944532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:31.379508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937157+0000","last_change":"2024-02-18T16:21:07.909691+0000","last_active":"2024-02-18T16:21:40.937157+0000","last_peered":"2024-02-18T16:21:40.937157+0000","last_clean":"2024-02-18T16:21:40.937157+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:21:40.937157+0000","last_undegraded":"2024-02-18T16:21:40.937157+0000","last_fullsized":"2024-02-18T16:21:40.937157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173888+0000","last_change":"2024-02-18T16:21:09.926133+0000","last_active":"2024-02-18T16:21:41.173888+0000","last_peered":"2024-02-18T16:21:41.173888+0000","last_clean":"2024-02-18T16:21:41.173888+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:21:41.173888+0000","last_undegraded":"2024-02-18T16:21:41.173888+0000","last_fullsized":"2024-02-18T16:21:41.173888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098429+0000","last_change":"2024-02-18T16:21:41.176291+0000","last_active":"2024-02-18T16:22:36.098429+0000","last_peered":"2024-02-18T16:22:36.098429+0000","last_clean":"2024-02-18T16:22:36.098429+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:22:36.098429+0000","last_undegraded":"2024-02-18T16:22:36.098429+0000","last_fullsized":"2024-02-18T16:22:36.098429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:36.303877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933821+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:21:40.933821+0000","last_peered":"2024-02-18T16:21:40.933821+0000","last_clean":"2024-02-18T16:21:40.933821+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:21:40.933821+0000","last_undegraded":"2024-02-18T16:21:40.933821+0000","last_fullsized":"2024-02-18T16:21:40.933821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:46:08.501321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956515+0000","last_change":"2024-02-18T16:21:40.955018+0000","last_active":"2024-02-18T16:21:40.956515+0000","last_peered":"2024-02-18T16:21:40.956515+0000","last_clean":"2024-02-18T16:21:40.956515+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:21:40.956515+0000","last_undegraded":"2024-02-18T16:21:40.956515+0000","last_fullsized":"2024-02-18T16:21:40.956515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:41.335446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937307+0000","last_change":"2024-02-18T16:21:05.895213+0000","last_active":"2024-02-18T16:21:40.937307+0000","last_peered":"2024-02-18T16:21:40.937307+0000","last_clean":"2024-02-18T16:21:40.937307+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:21:40.937307+0000","last_undegraded":"2024-02-18T16:21:40.937307+0000","last_fullsized":"2024-02-18T16:21:40.937307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:22.737750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":305,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.301651+0000","last_change":"2024-02-18T16:21:07.917843+0000","last_active":"2024-02-18T16:22:36.301651+0000","last_peered":"2024-02-18T16:22:36.301651+0000","last_clean":"2024-02-18T16:22:36.301651+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:22:36.301651+0000","last_undegraded":"2024-02-18T16:22:36.301651+0000","last_fullsized":"2024-02-18T16:22:36.301651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:42:39.457576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936747+0000","last_change":"2024-02-18T16:21:09.929317+0000","last_active":"2024-02-18T16:21:40.936747+0000","last_peered":"2024-02-18T16:21:40.936747+0000","last_clean":"2024-02-18T16:21:40.936747+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:21:40.936747+0000","last_undegraded":"2024-02-18T16:21:40.936747+0000","last_fullsized":"2024-02-18T16:21:40.936747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:09.795840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183777+0000","last_change":"2024-02-18T16:21:01.841643+0000","last_active":"2024-02-18T16:21:41.183777+0000","last_peered":"2024-02-18T16:21:41.183777+0000","last_clean":"2024-02-18T16:21:41.183777+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:21:41.183777+0000","last_undegraded":"2024-02-18T16:21:41.183777+0000","last_fullsized":"2024-02-18T16:21:41.183777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927879+0000","last_change":"2024-02-18T16:20:59.860132+0000","last_active":"2024-02-18T16:21:40.927879+0000","last_peered":"2024-02-18T16:21:40.927879+0000","last_clean":"2024-02-18T16:21:40.927879+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:21:40.927879+0000","last_undegraded":"2024-02-18T16:21:40.927879+0000","last_fullsized":"2024-02-18T16:21:40.927879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:46:23.673530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.960144+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:21:40.960144+0000","last_peered":"2024-02-18T16:21:40.960144+0000","last_clean":"2024-02-18T16:21:40.960144+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:21:40.960144+0000","last_undegraded":"2024-02-18T16:21:40.960144+0000","last_fullsized":"2024-02-18T16:21:40.960144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:24.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.399232+0000","last_change":"2024-02-18T16:21:05.888007+0000","last_active":"2024-02-18T16:22:30.399232+0000","last_peered":"2024-02-18T16:22:30.399232+0000","last_clean":"2024-02-18T16:22:30.399232+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:30.399232+0000","last_undegraded":"2024-02-18T16:22:30.399232+0000","last_fullsized":"2024-02-18T16:22:30.399232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:15.657774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.307880+0000","last_change":"2024-02-18T16:21:07.907499+0000","last_active":"2024-02-18T16:22:36.307880+0000","last_peered":"2024-02-18T16:22:36.307880+0000","last_clean":"2024-02-18T16:22:36.307880+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:22:36.307880+0000","last_undegraded":"2024-02-18T16:22:36.307880+0000","last_fullsized":"2024-02-18T16:22:36.307880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936628+0000","last_change":"2024-02-18T16:21:01.852914+0000","last_active":"2024-02-18T16:21:40.936628+0000","last_peered":"2024-02-18T16:21:40.936628+0000","last_clean":"2024-02-18T16:21:40.936628+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:21:40.936628+0000","last_undegraded":"2024-02-18T16:21:40.936628+0000","last_fullsized":"2024-02-18T16:21:40.936628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:11.629778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948658+0000","last_change":"2024-02-18T16:20:59.835343+0000","last_active":"2024-02-18T16:21:40.948658+0000","last_peered":"2024-02-18T16:21:40.948658+0000","last_clean":"2024-02-18T16:21:40.948658+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:21:40.948658+0000","last_undegraded":"2024-02-18T16:21:40.948658+0000","last_fullsized":"2024-02-18T16:21:40.948658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928167+0000","last_change":"2024-02-18T16:21:03.865004+0000","last_active":"2024-02-18T16:21:40.928167+0000","last_peered":"2024-02-18T16:21:40.928167+0000","last_clean":"2024-02-18T16:21:40.928167+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:21:40.928167+0000","last_undegraded":"2024-02-18T16:21:40.928167+0000","last_fullsized":"2024-02-18T16:21:40.928167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:19:00.973310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.415467+0000","last_change":"2024-02-18T16:21:05.885363+0000","last_active":"2024-02-18T16:22:30.415467+0000","last_peered":"2024-02-18T16:22:30.415467+0000","last_clean":"2024-02-18T16:22:30.415467+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:22:30.415467+0000","last_undegraded":"2024-02-18T16:22:30.415467+0000","last_fullsized":"2024-02-18T16:22:30.415467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:15.677159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177269+0000","last_change":"2024-02-18T16:21:07.907548+0000","last_active":"2024-02-18T16:21:41.177269+0000","last_peered":"2024-02-18T16:21:41.177269+0000","last_clean":"2024-02-18T16:21:41.177269+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:21:41.177269+0000","last_undegraded":"2024-02-18T16:21:41.177269+0000","last_fullsized":"2024-02-18T16:21:41.177269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:36.323096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.170197+0000","last_change":"2024-02-18T16:21:09.918869+0000","last_active":"2024-02-18T16:22:30.170197+0000","last_peered":"2024-02-18T16:22:30.170197+0000","last_clean":"2024-02-18T16:22:30.170197+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:22:30.170197+0000","last_undegraded":"2024-02-18T16:22:30.170197+0000","last_fullsized":"2024-02-18T16:22:30.170197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:04.707222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929560+0000","last_change":"2024-02-18T16:21:01.843254+0000","last_active":"2024-02-18T16:21:40.929560+0000","last_peered":"2024-02-18T16:21:40.929560+0000","last_clean":"2024-02-18T16:21:40.929560+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:21:40.929560+0000","last_undegraded":"2024-02-18T16:21:40.929560+0000","last_fullsized":"2024-02-18T16:21:40.929560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946541+0000","last_change":"2024-02-18T16:20:59.832949+0000","last_active":"2024-02-18T16:21:40.946541+0000","last_peered":"2024-02-18T16:21:40.946541+0000","last_clean":"2024-02-18T16:21:40.946541+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:21:40.946541+0000","last_undegraded":"2024-02-18T16:21:40.946541+0000","last_fullsized":"2024-02-18T16:21:40.946541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174581+0000","last_change":"2024-02-18T16:21:03.866038+0000","last_active":"2024-02-18T16:21:41.174581+0000","last_peered":"2024-02-18T16:21:41.174581+0000","last_clean":"2024-02-18T16:21:41.174581+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:21:41.174581+0000","last_undegraded":"2024-02-18T16:21:41.174581+0000","last_fullsized":"2024-02-18T16:21:41.174581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:20.723354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.475520+0000","last_change":"2024-02-18T16:21:05.902821+0000","last_active":"2024-02-18T16:22:30.475520+0000","last_peered":"2024-02-18T16:22:30.475520+0000","last_clean":"2024-02-18T16:22:30.475520+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:22:30.475520+0000","last_undegraded":"2024-02-18T16:22:30.475520+0000","last_fullsized":"2024-02-18T16:22:30.475520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:10:54.114055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176144+0000","last_change":"2024-02-18T16:21:07.896519+0000","last_active":"2024-02-18T16:21:41.176144+0000","last_peered":"2024-02-18T16:21:41.176144+0000","last_clean":"2024-02-18T16:21:41.176144+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:21:41.176144+0000","last_undegraded":"2024-02-18T16:21:41.176144+0000","last_fullsized":"2024-02-18T16:21:41.176144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.400852+0000","last_change":"2024-02-18T16:21:09.931902+0000","last_active":"2024-02-18T16:22:24.400852+0000","last_peered":"2024-02-18T16:22:24.400852+0000","last_clean":"2024-02-18T16:22:24.400852+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:22:24.400852+0000","last_undegraded":"2024-02-18T16:22:24.400852+0000","last_fullsized":"2024-02-18T16:22:24.400852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.164976+0000","last_change":"2024-02-18T16:21:01.851100+0000","last_active":"2024-02-18T16:21:47.164976+0000","last_peered":"2024-02-18T16:21:47.164976+0000","last_clean":"2024-02-18T16:21:47.164976+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:21:47.164976+0000","last_undegraded":"2024-02-18T16:21:47.164976+0000","last_fullsized":"2024-02-18T16:21:47.164976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:34.686883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.393724+0000","last_change":"2024-02-18T16:20:59.873014+0000","last_active":"2024-02-18T16:21:46.393724+0000","last_peered":"2024-02-18T16:21:46.393724+0000","last_clean":"2024-02-18T16:21:46.393724+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:21:46.393724+0000","last_undegraded":"2024-02-18T16:21:46.393724+0000","last_fullsized":"2024-02-18T16:21:46.393724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:13.577731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176424+0000","last_change":"2024-02-18T16:21:03.860965+0000","last_active":"2024-02-18T16:21:41.176424+0000","last_peered":"2024-02-18T16:21:41.176424+0000","last_clean":"2024-02-18T16:21:41.176424+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:21:41.176424+0000","last_undegraded":"2024-02-18T16:21:41.176424+0000","last_fullsized":"2024-02-18T16:21:41.176424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:49:52.683114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.418535+0000","last_change":"2024-02-18T16:21:05.886545+0000","last_active":"2024-02-18T16:22:30.418535+0000","last_peered":"2024-02-18T16:22:30.418535+0000","last_clean":"2024-02-18T16:22:30.418535+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:30.418535+0000","last_undegraded":"2024-02-18T16:22:30.418535+0000","last_fullsized":"2024-02-18T16:22:30.418535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:42.523543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.309717+0000","last_change":"2024-02-18T16:21:07.901321+0000","last_active":"2024-02-18T16:22:36.309717+0000","last_peered":"2024-02-18T16:22:36.309717+0000","last_clean":"2024-02-18T16:22:36.309717+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:36.309717+0000","last_undegraded":"2024-02-18T16:22:36.309717+0000","last_fullsized":"2024-02-18T16:22:36.309717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179560+0000","last_change":"2024-02-18T16:21:09.926915+0000","last_active":"2024-02-18T16:21:41.179560+0000","last_peered":"2024-02-18T16:21:41.179560+0000","last_clean":"2024-02-18T16:21:41.179560+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:21:41.179560+0000","last_undegraded":"2024-02-18T16:21:41.179560+0000","last_fullsized":"2024-02-18T16:21:41.179560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:45.424448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165040+0000","last_change":"2024-02-18T16:21:01.837388+0000","last_active":"2024-02-18T16:21:47.165040+0000","last_peered":"2024-02-18T16:21:47.165040+0000","last_clean":"2024-02-18T16:21:47.165040+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:21:47.165040+0000","last_undegraded":"2024-02-18T16:21:47.165040+0000","last_fullsized":"2024-02-18T16:21:47.165040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:54.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951017+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:21:40.951017+0000","last_peered":"2024-02-18T16:21:40.951017+0000","last_clean":"2024-02-18T16:21:40.951017+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:21:40.951017+0000","last_undegraded":"2024-02-18T16:21:40.951017+0000","last_fullsized":"2024-02-18T16:21:40.951017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:50.834394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174589+0000","last_change":"2024-02-18T16:21:03.871286+0000","last_active":"2024-02-18T16:21:41.174589+0000","last_peered":"2024-02-18T16:21:41.174589+0000","last_clean":"2024-02-18T16:21:41.174589+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:21:41.174589+0000","last_undegraded":"2024-02-18T16:21:41.174589+0000","last_fullsized":"2024-02-18T16:21:41.174589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:42.607662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.031258+0000","last_change":"2024-02-18T16:21:05.901392+0000","last_active":"2024-02-18T16:22:36.031258+0000","last_peered":"2024-02-18T16:22:36.031258+0000","last_clean":"2024-02-18T16:22:36.031258+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:22:36.031258+0000","last_undegraded":"2024-02-18T16:22:36.031258+0000","last_fullsized":"2024-02-18T16:22:36.031258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:17:42.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174155+0000","last_change":"2024-02-18T16:21:07.899232+0000","last_active":"2024-02-18T16:21:41.174155+0000","last_peered":"2024-02-18T16:21:41.174155+0000","last_clean":"2024-02-18T16:21:41.174155+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:21:41.174155+0000","last_undegraded":"2024-02-18T16:21:41.174155+0000","last_fullsized":"2024-02-18T16:21:41.174155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182379+0000","last_change":"2024-02-18T16:21:09.901860+0000","last_active":"2024-02-18T16:21:41.182379+0000","last_peered":"2024-02-18T16:21:41.182379+0000","last_clean":"2024-02-18T16:21:41.182379+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:21:41.182379+0000","last_undegraded":"2024-02-18T16:21:41.182379+0000","last_fullsized":"2024-02-18T16:21:41.182379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:12:00.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955531+0000","last_change":"2024-02-18T16:21:40.945387+0000","last_active":"2024-02-18T16:21:40.955531+0000","last_peered":"2024-02-18T16:21:40.955531+0000","last_clean":"2024-02-18T16:21:40.955531+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:21:40.955531+0000","last_undegraded":"2024-02-18T16:21:40.955531+0000","last_fullsized":"2024-02-18T16:21:40.955531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:56.813772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176709+0000","last_change":"2024-02-18T16:20:59.857151+0000","last_active":"2024-02-18T16:21:41.176709+0000","last_peered":"2024-02-18T16:21:41.176709+0000","last_clean":"2024-02-18T16:21:41.176709+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:21:41.176709+0000","last_undegraded":"2024-02-18T16:21:41.176709+0000","last_fullsized":"2024-02-18T16:21:41.176709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941688+0000","last_change":"2024-02-18T16:21:03.858681+0000","last_active":"2024-02-18T16:21:40.941688+0000","last_peered":"2024-02-18T16:21:40.941688+0000","last_clean":"2024-02-18T16:21:40.941688+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:21:40.941688+0000","last_undegraded":"2024-02-18T16:21:40.941688+0000","last_fullsized":"2024-02-18T16:21:40.941688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:12.798570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.388713+0000","last_change":"2024-02-18T16:21:05.883774+0000","last_active":"2024-02-18T16:22:30.388713+0000","last_peered":"2024-02-18T16:22:30.388713+0000","last_clean":"2024-02-18T16:22:30.388713+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:30.388713+0000","last_undegraded":"2024-02-18T16:22:30.388713+0000","last_fullsized":"2024-02-18T16:22:30.388713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:03.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954455+0000","last_change":"2024-02-18T16:21:07.917345+0000","last_active":"2024-02-18T16:21:40.954455+0000","last_peered":"2024-02-18T16:21:40.954455+0000","last_clean":"2024-02-18T16:21:40.954455+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:21:40.954455+0000","last_undegraded":"2024-02-18T16:21:40.954455+0000","last_fullsized":"2024-02-18T16:21:40.954455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:07:30.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931965+0000","last_change":"2024-02-18T16:21:09.920227+0000","last_active":"2024-02-18T16:21:40.931965+0000","last_peered":"2024-02-18T16:21:40.931965+0000","last_clean":"2024-02-18T16:21:40.931965+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:21:40.931965+0000","last_undegraded":"2024-02-18T16:21:40.931965+0000","last_fullsized":"2024-02-18T16:21:40.931965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:48:17.637183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457048+0000","last_change":"2024-02-18T16:21:01.858118+0000","last_active":"2024-02-18T16:22:30.457048+0000","last_peered":"2024-02-18T16:22:30.457048+0000","last_clean":"2024-02-18T16:22:30.457048+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:30.457048+0000","last_undegraded":"2024-02-18T16:22:30.457048+0000","last_fullsized":"2024-02-18T16:22:30.457048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:17.368689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947140+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:21:40.947140+0000","last_peered":"2024-02-18T16:21:40.947140+0000","last_clean":"2024-02-18T16:21:40.947140+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:21:40.947140+0000","last_undegraded":"2024-02-18T16:21:40.947140+0000","last_fullsized":"2024-02-18T16:21:40.947140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:24.038884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176422+0000","last_change":"2024-02-18T16:21:03.865714+0000","last_active":"2024-02-18T16:21:41.176422+0000","last_peered":"2024-02-18T16:21:41.176422+0000","last_clean":"2024-02-18T16:21:41.176422+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:21:41.176422+0000","last_undegraded":"2024-02-18T16:21:41.176422+0000","last_fullsized":"2024-02-18T16:21:41.176422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:14.663950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.434437+0000","last_change":"2024-02-18T16:21:05.875396+0000","last_active":"2024-02-18T16:22:30.434437+0000","last_peered":"2024-02-18T16:22:30.434437+0000","last_clean":"2024-02-18T16:22:30.434437+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:22:30.434437+0000","last_undegraded":"2024-02-18T16:22:30.434437+0000","last_fullsized":"2024-02-18T16:22:30.434437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:46.668575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":321,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.302732+0000","last_change":"2024-02-18T16:21:07.904059+0000","last_active":"2024-02-18T16:22:36.302732+0000","last_peered":"2024-02-18T16:22:36.302732+0000","last_clean":"2024-02-18T16:22:36.302732+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:36.302732+0000","last_undegraded":"2024-02-18T16:22:36.302732+0000","last_fullsized":"2024-02-18T16:22:36.302732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:40.559228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.477263+0000","last_change":"2024-02-18T16:21:09.901476+0000","last_active":"2024-02-18T16:22:30.477263+0000","last_peered":"2024-02-18T16:22:30.477263+0000","last_clean":"2024-02-18T16:22:30.477263+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:22:30.477263+0000","last_undegraded":"2024-02-18T16:22:30.477263+0000","last_fullsized":"2024-02-18T16:22:30.477263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.606451+0000","last_change":"2024-02-18T16:21:01.854526+0000","last_active":"2024-02-18T16:22:29.606451+0000","last_peered":"2024-02-18T16:22:29.606451+0000","last_clean":"2024-02-18T16:22:29.606451+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:22:29.606451+0000","last_undegraded":"2024-02-18T16:22:29.606451+0000","last_fullsized":"2024-02-18T16:22:29.606451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940406+0000","last_change":"2024-02-18T16:20:59.863525+0000","last_active":"2024-02-18T16:21:40.940406+0000","last_peered":"2024-02-18T16:21:40.940406+0000","last_clean":"2024-02-18T16:21:40.940406+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:21:40.940406+0000","last_undegraded":"2024-02-18T16:21:40.940406+0000","last_fullsized":"2024-02-18T16:21:40.940406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:40.125913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":523,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.176575+0000","last_change":"2024-02-18T16:21:03.865047+0000","last_active":"2024-02-18T16:22:37.176575+0000","last_peered":"2024-02-18T16:22:37.176575+0000","last_clean":"2024-02-18T16:22:37.176575+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:22:37.176575+0000","last_undegraded":"2024-02-18T16:22:37.176575+0000","last_fullsized":"2024-02-18T16:22:37.176575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:27.693710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":574,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953466+0000","last_change":"2024-02-18T16:21:05.901561+0000","last_active":"2024-02-18T16:21:40.953466+0000","last_peered":"2024-02-18T16:21:40.953466+0000","last_clean":"2024-02-18T16:21:40.953466+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:21:40.953466+0000","last_undegraded":"2024-02-18T16:21:40.953466+0000","last_fullsized":"2024-02-18T16:21:40.953466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:37.955679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":352,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.304651+0000","last_change":"2024-02-18T16:21:07.894723+0000","last_active":"2024-02-18T16:22:36.304651+0000","last_peered":"2024-02-18T16:22:36.304651+0000","last_clean":"2024-02-18T16:22:36.304651+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:36.304651+0000","last_undegraded":"2024-02-18T16:22:36.304651+0000","last_fullsized":"2024-02-18T16:22:36.304651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939087+0000","last_change":"2024-02-18T16:21:09.907248+0000","last_active":"2024-02-18T16:21:40.939087+0000","last_peered":"2024-02-18T16:21:40.939087+0000","last_clean":"2024-02-18T16:21:40.939087+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:21:40.939087+0000","last_undegraded":"2024-02-18T16:21:40.939087+0000","last_fullsized":"2024-02-18T16:21:40.939087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:20.642816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947627+0000","last_change":"2024-02-18T16:21:01.845972+0000","last_active":"2024-02-18T16:21:40.947627+0000","last_peered":"2024-02-18T16:21:40.947627+0000","last_clean":"2024-02-18T16:21:40.947627+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:21:40.947627+0000","last_undegraded":"2024-02-18T16:21:40.947627+0000","last_fullsized":"2024-02-18T16:21:40.947627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:21:09.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934644+0000","last_change":"2024-02-18T16:20:59.866261+0000","last_active":"2024-02-18T16:21:40.934644+0000","last_peered":"2024-02-18T16:21:40.934644+0000","last_clean":"2024-02-18T16:21:40.934644+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:21:40.934644+0000","last_undegraded":"2024-02-18T16:21:40.934644+0000","last_fullsized":"2024-02-18T16:21:40.934644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:49.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953511+0000","last_change":"2024-02-18T16:21:03.857468+0000","last_active":"2024-02-18T16:21:40.953511+0000","last_peered":"2024-02-18T16:21:40.953511+0000","last_clean":"2024-02-18T16:21:40.953511+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:21:40.953511+0000","last_undegraded":"2024-02-18T16:21:40.953511+0000","last_fullsized":"2024-02-18T16:21:40.953511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:57.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.409997+0000","last_change":"2024-02-18T16:21:05.883765+0000","last_active":"2024-02-18T16:22:30.409997+0000","last_peered":"2024-02-18T16:22:30.409997+0000","last_clean":"2024-02-18T16:22:30.409997+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:30.409997+0000","last_undegraded":"2024-02-18T16:22:30.409997+0000","last_fullsized":"2024-02-18T16:22:30.409997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:38.527945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936924+0000","last_change":"2024-02-18T16:21:07.900271+0000","last_active":"2024-02-18T16:21:40.936924+0000","last_peered":"2024-02-18T16:21:40.936924+0000","last_clean":"2024-02-18T16:21:40.936924+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:21:40.936924+0000","last_undegraded":"2024-02-18T16:21:40.936924+0000","last_fullsized":"2024-02-18T16:21:40.936924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:23.412232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929089+0000","last_change":"2024-02-18T16:21:09.921128+0000","last_active":"2024-02-18T16:21:40.929089+0000","last_peered":"2024-02-18T16:21:40.929089+0000","last_clean":"2024-02-18T16:21:40.929089+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:21:40.929089+0000","last_undegraded":"2024-02-18T16:21:40.929089+0000","last_fullsized":"2024-02-18T16:21:40.929089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:44.361454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085664+0000","last_change":"2024-02-18T16:21:01.857176+0000","last_active":"2024-02-18T16:22:36.085664+0000","last_peered":"2024-02-18T16:22:36.085664+0000","last_clean":"2024-02-18T16:22:36.085664+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:22:36.085664+0000","last_undegraded":"2024-02-18T16:22:36.085664+0000","last_fullsized":"2024-02-18T16:22:36.085664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:50:56.586473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927237+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:21:40.927237+0000","last_peered":"2024-02-18T16:21:40.927237+0000","last_clean":"2024-02-18T16:21:40.927237+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:21:40.927237+0000","last_undegraded":"2024-02-18T16:21:40.927237+0000","last_fullsized":"2024-02-18T16:21:40.927237+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:37.088141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949389+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:21:40.949389+0000","last_peered":"2024-02-18T16:21:40.949389+0000","last_clean":"2024-02-18T16:21:40.949389+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:21:40.949389+0000","last_undegraded":"2024-02-18T16:21:40.949389+0000","last_fullsized":"2024-02-18T16:21:40.949389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:58:17.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939942+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:21:40.939942+0000","last_peered":"2024-02-18T16:21:40.939942+0000","last_clean":"2024-02-18T16:21:40.939942+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:21:40.939942+0000","last_undegraded":"2024-02-18T16:21:40.939942+0000","last_fullsized":"2024-02-18T16:21:40.939942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:33.884874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930956+0000","last_change":"2024-02-18T16:21:03.862227+0000","last_active":"2024-02-18T16:21:40.930956+0000","last_peered":"2024-02-18T16:21:40.930956+0000","last_clean":"2024-02-18T16:21:40.930956+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:21:40.930956+0000","last_undegraded":"2024-02-18T16:21:40.930956+0000","last_fullsized":"2024-02-18T16:21:40.930956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:05.466118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.054236+0000","last_change":"2024-02-18T16:21:05.897156+0000","last_active":"2024-02-18T16:22:36.054236+0000","last_peered":"2024-02-18T16:22:36.054236+0000","last_clean":"2024-02-18T16:22:36.054236+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:22:36.054236+0000","last_undegraded":"2024-02-18T16:22:36.054236+0000","last_fullsized":"2024-02-18T16:22:36.054236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:44:22.601995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179893+0000","last_change":"2024-02-18T16:21:07.900898+0000","last_active":"2024-02-18T16:21:41.179893+0000","last_peered":"2024-02-18T16:21:41.179893+0000","last_clean":"2024-02-18T16:21:41.179893+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:21:41.179893+0000","last_undegraded":"2024-02-18T16:21:41.179893+0000","last_fullsized":"2024-02-18T16:21:41.179893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:59:15.395075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.103257+0000","last_change":"2024-02-18T16:21:09.898538+0000","last_active":"2024-02-18T16:22:36.103257+0000","last_peered":"2024-02-18T16:22:36.103257+0000","last_clean":"2024-02-18T16:22:36.103257+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:36.103257+0000","last_undegraded":"2024-02-18T16:22:36.103257+0000","last_fullsized":"2024-02-18T16:22:36.103257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:33.080540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955558+0000","last_change":"2024-02-18T16:21:01.853487+0000","last_active":"2024-02-18T16:21:40.955558+0000","last_peered":"2024-02-18T16:21:40.955558+0000","last_clean":"2024-02-18T16:21:40.955558+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:21:40.955558+0000","last_undegraded":"2024-02-18T16:21:40.955558+0000","last_fullsized":"2024-02-18T16:21:40.955558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:51.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933083+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:21:40.933083+0000","last_peered":"2024-02-18T16:21:40.933083+0000","last_clean":"2024-02-18T16:21:40.933083+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:21:40.933083+0000","last_undegraded":"2024-02-18T16:21:40.933083+0000","last_fullsized":"2024-02-18T16:21:40.933083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:05:58.537300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174299+0000","last_change":"2024-02-18T16:20:59.848482+0000","last_active":"2024-02-18T16:21:41.174299+0000","last_peered":"2024-02-18T16:21:41.174299+0000","last_clean":"2024-02-18T16:21:41.174299+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:21:41.174299+0000","last_undegraded":"2024-02-18T16:21:41.174299+0000","last_fullsized":"2024-02-18T16:21:41.174299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954843+0000","last_change":"2024-02-18T16:21:03.853258+0000","last_active":"2024-02-18T16:21:40.954843+0000","last_peered":"2024-02-18T16:21:40.954843+0000","last_clean":"2024-02-18T16:21:40.954843+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:21:40.954843+0000","last_undegraded":"2024-02-18T16:21:40.954843+0000","last_fullsized":"2024-02-18T16:21:40.954843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:43:34.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.296165+0000","last_change":"2024-02-18T16:21:05.900069+0000","last_active":"2024-02-18T16:22:36.296165+0000","last_peered":"2024-02-18T16:22:36.296165+0000","last_clean":"2024-02-18T16:22:36.296165+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:36.296165+0000","last_undegraded":"2024-02-18T16:22:36.296165+0000","last_fullsized":"2024-02-18T16:22:36.296165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:29:44.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950461+0000","last_change":"2024-02-18T16:21:07.915843+0000","last_active":"2024-02-18T16:21:40.950461+0000","last_peered":"2024-02-18T16:21:40.950461+0000","last_clean":"2024-02-18T16:21:40.950461+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:21:40.950461+0000","last_undegraded":"2024-02-18T16:21:40.950461+0000","last_fullsized":"2024-02-18T16:21:40.950461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:32:30.258086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.566050+0000","last_change":"2024-02-18T16:21:09.927419+0000","last_active":"2024-02-18T16:22:24.566050+0000","last_peered":"2024-02-18T16:22:24.566050+0000","last_clean":"2024-02-18T16:22:24.566050+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:22:24.566050+0000","last_undegraded":"2024-02-18T16:22:24.566050+0000","last_fullsized":"2024-02-18T16:22:24.566050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:21.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.855571+0000","last_change":"2024-02-18T16:21:01.846415+0000","last_active":"2024-02-18T16:21:47.855571+0000","last_peered":"2024-02-18T16:21:47.855571+0000","last_clean":"2024-02-18T16:21:47.855571+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:21:47.855571+0000","last_undegraded":"2024-02-18T16:21:47.855571+0000","last_fullsized":"2024-02-18T16:21:47.855571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936337+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:21:40.936337+0000","last_peered":"2024-02-18T16:21:40.936337+0000","last_clean":"2024-02-18T16:21:40.936337+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:21:40.936337+0000","last_undegraded":"2024-02-18T16:21:40.936337+0000","last_fullsized":"2024-02-18T16:21:40.936337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:43.102493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173554+0000","last_change":"2024-02-18T16:20:59.850718+0000","last_active":"2024-02-18T16:21:41.173554+0000","last_peered":"2024-02-18T16:21:41.173554+0000","last_clean":"2024-02-18T16:21:41.173554+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:21:41.173554+0000","last_undegraded":"2024-02-18T16:21:41.173554+0000","last_fullsized":"2024-02-18T16:21:41.173554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945273+0000","last_change":"2024-02-18T16:21:03.854140+0000","last_active":"2024-02-18T16:21:40.945273+0000","last_peered":"2024-02-18T16:21:40.945273+0000","last_clean":"2024-02-18T16:21:40.945273+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:21:40.945273+0000","last_undegraded":"2024-02-18T16:21:40.945273+0000","last_fullsized":"2024-02-18T16:21:40.945273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:45.475648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:34.003316+0000","last_change":"2024-02-18T16:21:05.883106+0000","last_active":"2024-02-18T16:22:34.003316+0000","last_peered":"2024-02-18T16:22:34.003316+0000","last_clean":"2024-02-18T16:22:34.003316+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:22:34.003316+0000","last_undegraded":"2024-02-18T16:22:34.003316+0000","last_fullsized":"2024-02-18T16:22:34.003316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:49.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176697+0000","last_change":"2024-02-18T16:21:07.901039+0000","last_active":"2024-02-18T16:21:41.176697+0000","last_peered":"2024-02-18T16:21:41.176697+0000","last_clean":"2024-02-18T16:21:41.176697+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:21:41.176697+0000","last_undegraded":"2024-02-18T16:21:41.176697+0000","last_fullsized":"2024-02-18T16:21:41.176697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:12.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946747+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:21:40.946747+0000","last_peered":"2024-02-18T16:21:40.946747+0000","last_clean":"2024-02-18T16:21:40.946747+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:21:40.946747+0000","last_undegraded":"2024-02-18T16:21:40.946747+0000","last_fullsized":"2024-02-18T16:21:40.946747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:15.833558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179127+0000","last_change":"2024-02-18T16:21:01.841136+0000","last_active":"2024-02-18T16:21:41.179127+0000","last_peered":"2024-02-18T16:21:41.179127+0000","last_clean":"2024-02-18T16:21:41.179127+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:21:41.179127+0000","last_undegraded":"2024-02-18T16:21:41.179127+0000","last_fullsized":"2024-02-18T16:21:41.179127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939268+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:21:40.939268+0000","last_peered":"2024-02-18T16:21:40.939268+0000","last_clean":"2024-02-18T16:21:40.939268+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:21:40.939268+0000","last_undegraded":"2024-02-18T16:21:40.939268+0000","last_fullsized":"2024-02-18T16:21:40.939268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:28:03.856941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939793+0000","last_change":"2024-02-18T16:20:59.855189+0000","last_active":"2024-02-18T16:21:40.939793+0000","last_peered":"2024-02-18T16:21:40.939793+0000","last_clean":"2024-02-18T16:21:40.939793+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:21:40.939793+0000","last_undegraded":"2024-02-18T16:21:40.939793+0000","last_fullsized":"2024-02-18T16:21:40.939793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179358+0000","last_change":"2024-02-18T16:21:03.858464+0000","last_active":"2024-02-18T16:21:41.179358+0000","last_peered":"2024-02-18T16:21:41.179358+0000","last_clean":"2024-02-18T16:21:41.179358+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:21:41.179358+0000","last_undegraded":"2024-02-18T16:21:41.179358+0000","last_fullsized":"2024-02-18T16:21:41.179358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:23:07.857672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952037+0000","last_change":"2024-02-18T16:21:05.897074+0000","last_active":"2024-02-18T16:21:40.952037+0000","last_peered":"2024-02-18T16:21:40.952037+0000","last_clean":"2024-02-18T16:21:40.952037+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:21:40.952037+0000","last_undegraded":"2024-02-18T16:21:40.952037+0000","last_fullsized":"2024-02-18T16:21:40.952037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:04:33.549154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955422+0000","last_change":"2024-02-18T16:21:07.918398+0000","last_active":"2024-02-18T16:21:40.955422+0000","last_peered":"2024-02-18T16:21:40.955422+0000","last_clean":"2024-02-18T16:21:40.955422+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:21:40.955422+0000","last_undegraded":"2024-02-18T16:21:40.955422+0000","last_fullsized":"2024-02-18T16:21:40.955422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:47.114614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.926920+0000","last_change":"2024-02-18T16:21:09.915876+0000","last_active":"2024-02-18T16:21:40.926920+0000","last_peered":"2024-02-18T16:21:40.926920+0000","last_clean":"2024-02-18T16:21:40.926920+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:21:40.926920+0000","last_undegraded":"2024-02-18T16:21:40.926920+0000","last_fullsized":"2024-02-18T16:21:40.926920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:53.323552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858131+0000","last_change":"2024-02-18T16:21:01.844784+0000","last_active":"2024-02-18T16:21:47.858131+0000","last_peered":"2024-02-18T16:21:47.858131+0000","last_clean":"2024-02-18T16:21:47.858131+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:21:47.858131+0000","last_undegraded":"2024-02-18T16:21:47.858131+0000","last_fullsized":"2024-02-18T16:21:47.858131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938015+0000","last_change":"2024-02-18T16:20:59.833465+0000","last_active":"2024-02-18T16:21:40.938015+0000","last_peered":"2024-02-18T16:21:40.938015+0000","last_clean":"2024-02-18T16:21:40.938015+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:21:40.938015+0000","last_undegraded":"2024-02-18T16:21:40.938015+0000","last_fullsized":"2024-02-18T16:21:40.938015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176645+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:21:41.176645+0000","last_peered":"2024-02-18T16:21:41.176645+0000","last_clean":"2024-02-18T16:21:41.176645+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:21:41.176645+0000","last_undegraded":"2024-02-18T16:21:41.176645+0000","last_fullsized":"2024-02-18T16:21:41.176645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:59:56.616913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947011+0000","last_change":"2024-02-18T16:21:40.945591+0000","last_active":"2024-02-18T16:21:40.947011+0000","last_peered":"2024-02-18T16:21:40.947011+0000","last_clean":"2024-02-18T16:21:40.947011+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:21:40.947011+0000","last_undegraded":"2024-02-18T16:21:40.947011+0000","last_fullsized":"2024-02-18T16:21:40.947011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:47.279576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.043805+0000","last_change":"2024-02-18T16:21:05.889484+0000","last_active":"2024-02-18T16:22:36.043805+0000","last_peered":"2024-02-18T16:22:36.043805+0000","last_clean":"2024-02-18T16:22:36.043805+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:36.043805+0000","last_undegraded":"2024-02-18T16:22:36.043805+0000","last_fullsized":"2024-02-18T16:22:36.043805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:15.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932933+0000","last_change":"2024-02-18T16:21:07.902044+0000","last_active":"2024-02-18T16:21:40.932933+0000","last_peered":"2024-02-18T16:21:40.932933+0000","last_clean":"2024-02-18T16:21:40.932933+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:21:40.932933+0000","last_undegraded":"2024-02-18T16:21:40.932933+0000","last_fullsized":"2024-02-18T16:21:40.932933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:08.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.436370+0000","last_change":"2024-02-18T16:21:09.905763+0000","last_active":"2024-02-18T16:22:30.436370+0000","last_peered":"2024-02-18T16:22:30.436370+0000","last_clean":"2024-02-18T16:22:30.436370+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:22:30.436370+0000","last_undegraded":"2024-02-18T16:22:30.436370+0000","last_fullsized":"2024-02-18T16:22:30.436370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:46.553123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.872182+0000","last_change":"2024-02-18T16:21:01.847741+0000","last_active":"2024-02-18T16:21:46.872182+0000","last_peered":"2024-02-18T16:21:46.872182+0000","last_clean":"2024-02-18T16:21:46.872182+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:21:46.872182+0000","last_undegraded":"2024-02-18T16:21:46.872182+0000","last_fullsized":"2024-02-18T16:21:46.872182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:41:45.770571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176949+0000","last_change":"2024-02-18T16:20:59.861790+0000","last_active":"2024-02-18T16:21:41.176949+0000","last_peered":"2024-02-18T16:21:41.176949+0000","last_clean":"2024-02-18T16:21:41.176949+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:21:41.176949+0000","last_undegraded":"2024-02-18T16:21:41.176949+0000","last_fullsized":"2024-02-18T16:21:41.176949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951463+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:21:40.951463+0000","last_peered":"2024-02-18T16:21:40.951463+0000","last_clean":"2024-02-18T16:21:40.951463+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:21:40.951463+0000","last_undegraded":"2024-02-18T16:21:40.951463+0000","last_fullsized":"2024-02-18T16:21:40.951463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:55:06.221596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938609+0000","last_change":"2024-02-18T16:21:03.849021+0000","last_active":"2024-02-18T16:21:40.938609+0000","last_peered":"2024-02-18T16:21:40.938609+0000","last_clean":"2024-02-18T16:21:40.938609+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:21:40.938609+0000","last_undegraded":"2024-02-18T16:21:40.938609+0000","last_fullsized":"2024-02-18T16:21:40.938609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:08.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929054+0000","last_change":"2024-02-18T16:21:05.898616+0000","last_active":"2024-02-18T16:21:40.929054+0000","last_peered":"2024-02-18T16:21:40.929054+0000","last_clean":"2024-02-18T16:21:40.929054+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:21:40.929054+0000","last_undegraded":"2024-02-18T16:21:40.929054+0000","last_fullsized":"2024-02-18T16:21:40.929054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:38.543681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.299293+0000","last_change":"2024-02-18T16:21:07.893283+0000","last_active":"2024-02-18T16:22:36.299293+0000","last_peered":"2024-02-18T16:22:36.299293+0000","last_clean":"2024-02-18T16:22:36.299293+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:36.299293+0000","last_undegraded":"2024-02-18T16:22:36.299293+0000","last_fullsized":"2024-02-18T16:22:36.299293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953932+0000","last_change":"2024-02-18T16:21:09.914553+0000","last_active":"2024-02-18T16:21:40.953932+0000","last_peered":"2024-02-18T16:21:40.953932+0000","last_clean":"2024-02-18T16:21:40.953932+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:21:40.953932+0000","last_undegraded":"2024-02-18T16:21:40.953932+0000","last_fullsized":"2024-02-18T16:21:40.953932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:02:46.246218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456732+0000","last_change":"2024-02-18T16:21:01.853061+0000","last_active":"2024-02-18T16:22:30.456732+0000","last_peered":"2024-02-18T16:22:30.456732+0000","last_clean":"2024-02-18T16:22:30.456732+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:22:30.456732+0000","last_undegraded":"2024-02-18T16:22:30.456732+0000","last_fullsized":"2024-02-18T16:22:30.456732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:44.090520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956980+0000","last_change":"2024-02-18T16:20:59.868556+0000","last_active":"2024-02-18T16:21:40.956980+0000","last_peered":"2024-02-18T16:21:40.956980+0000","last_clean":"2024-02-18T16:21:40.956980+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:21:40.956980+0000","last_undegraded":"2024-02-18T16:21:40.956980+0000","last_fullsized":"2024-02-18T16:21:40.956980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:56.658418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180424+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:21:41.180424+0000","last_peered":"2024-02-18T16:21:41.180424+0000","last_clean":"2024-02-18T16:21:41.180424+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:21:41.180424+0000","last_undegraded":"2024-02-18T16:21:41.180424+0000","last_fullsized":"2024-02-18T16:21:41.180424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:07.695714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933580+0000","last_change":"2024-02-18T16:21:03.852652+0000","last_active":"2024-02-18T16:21:40.933580+0000","last_peered":"2024-02-18T16:21:40.933580+0000","last_clean":"2024-02-18T16:21:40.933580+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:21:40.933580+0000","last_undegraded":"2024-02-18T16:21:40.933580+0000","last_fullsized":"2024-02-18T16:21:40.933580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:23.631357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946439+0000","last_change":"2024-02-18T16:21:05.894104+0000","last_active":"2024-02-18T16:21:40.946439+0000","last_peered":"2024-02-18T16:21:40.946439+0000","last_clean":"2024-02-18T16:21:40.946439+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:21:40.946439+0000","last_undegraded":"2024-02-18T16:21:40.946439+0000","last_fullsized":"2024-02-18T16:21:40.946439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:42.813295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.306039+0000","last_change":"2024-02-18T16:21:07.893288+0000","last_active":"2024-02-18T16:22:36.306039+0000","last_peered":"2024-02-18T16:22:36.306039+0000","last_clean":"2024-02-18T16:22:36.306039+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:36.306039+0000","last_undegraded":"2024-02-18T16:22:36.306039+0000","last_fullsized":"2024-02-18T16:22:36.306039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.859966+0000","last_change":"2024-02-18T16:21:09.917363+0000","last_active":"2024-02-18T16:21:47.859966+0000","last_peered":"2024-02-18T16:21:47.859966+0000","last_clean":"2024-02-18T16:21:47.859966+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:21:47.859966+0000","last_undegraded":"2024-02-18T16:21:47.859966+0000","last_fullsized":"2024-02-18T16:21:47.859966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935139+0000","last_change":"2024-02-18T16:21:01.849433+0000","last_active":"2024-02-18T16:21:40.935139+0000","last_peered":"2024-02-18T16:21:40.935139+0000","last_clean":"2024-02-18T16:21:40.935139+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:21:40.935139+0000","last_undegraded":"2024-02-18T16:21:40.935139+0000","last_fullsized":"2024-02-18T16:21:40.935139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:26.052157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937475+0000","last_change":"2024-02-18T16:20:59.873711+0000","last_active":"2024-02-18T16:21:40.937475+0000","last_peered":"2024-02-18T16:21:40.937475+0000","last_clean":"2024-02-18T16:21:40.937475+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:21:40.937475+0000","last_undegraded":"2024-02-18T16:21:40.937475+0000","last_fullsized":"2024-02-18T16:21:40.937475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956548+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:21:40.956548+0000","last_peered":"2024-02-18T16:21:40.956548+0000","last_clean":"2024-02-18T16:21:40.956548+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:21:40.956548+0000","last_undegraded":"2024-02-18T16:21:40.956548+0000","last_fullsized":"2024-02-18T16:21:40.956548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:28:14.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932706+0000","last_change":"2024-02-18T16:21:03.851642+0000","last_active":"2024-02-18T16:21:40.932706+0000","last_peered":"2024-02-18T16:21:40.932706+0000","last_clean":"2024-02-18T16:21:40.932706+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:21:40.932706+0000","last_undegraded":"2024-02-18T16:21:40.932706+0000","last_fullsized":"2024-02-18T16:21:40.932706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:09:58.409243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.038660+0000","last_change":"2024-02-18T16:21:05.894249+0000","last_active":"2024-02-18T16:22:36.038660+0000","last_peered":"2024-02-18T16:22:36.038660+0000","last_clean":"2024-02-18T16:22:36.038660+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:36.038660+0000","last_undegraded":"2024-02-18T16:22:36.038660+0000","last_fullsized":"2024-02-18T16:22:36.038660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:16.678346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174054+0000","last_change":"2024-02-18T16:21:07.899674+0000","last_active":"2024-02-18T16:21:41.174054+0000","last_peered":"2024-02-18T16:21:41.174054+0000","last_clean":"2024-02-18T16:21:41.174054+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:21:41.174054+0000","last_undegraded":"2024-02-18T16:21:41.174054+0000","last_fullsized":"2024-02-18T16:21:41.174054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:02.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.943250+0000","last_change":"2024-02-18T16:21:09.913278+0000","last_active":"2024-02-18T16:21:40.943250+0000","last_peered":"2024-02-18T16:21:40.943250+0000","last_clean":"2024-02-18T16:21:40.943250+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:21:40.943250+0000","last_undegraded":"2024-02-18T16:21:40.943250+0000","last_fullsized":"2024-02-18T16:21:40.943250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:44.928722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.072534+0000","last_change":"2024-02-18T16:21:09.912010+0000","last_active":"2024-02-18T16:22:36.072534+0000","last_peered":"2024-02-18T16:22:36.072534+0000","last_clean":"2024-02-18T16:22:36.072534+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:22:36.072534+0000","last_undegraded":"2024-02-18T16:22:36.072534+0000","last_fullsized":"2024-02-18T16:22:36.072534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:22.614788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183619+0000","last_change":"2024-02-18T16:21:41.183619+0000","last_active":"2024-02-18T16:21:41.183619+0000","last_peered":"2024-02-18T16:21:41.183619+0000","last_clean":"2024-02-18T16:21:41.183619+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:21:41.183619+0000","last_undegraded":"2024-02-18T16:21:41.183619+0000","last_fullsized":"2024-02-18T16:21:41.183619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:13.035362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951280+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:21:40.951280+0000","last_peered":"2024-02-18T16:21:40.951280+0000","last_clean":"2024-02-18T16:21:40.951280+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:21:40.951280+0000","last_undegraded":"2024-02-18T16:21:40.951280+0000","last_fullsized":"2024-02-18T16:21:40.951280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:18:58.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929562+0000","last_change":"2024-02-18T16:21:03.865820+0000","last_active":"2024-02-18T16:21:40.929562+0000","last_peered":"2024-02-18T16:21:40.929562+0000","last_clean":"2024-02-18T16:21:40.929562+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:21:40.929562+0000","last_undegraded":"2024-02-18T16:21:40.929562+0000","last_fullsized":"2024-02-18T16:21:40.929562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:46.104120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.417194+0000","last_change":"2024-02-18T16:21:05.885905+0000","last_active":"2024-02-18T16:22:30.417194+0000","last_peered":"2024-02-18T16:22:30.417194+0000","last_clean":"2024-02-18T16:22:30.417194+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:30.417194+0000","last_undegraded":"2024-02-18T16:22:30.417194+0000","last_fullsized":"2024-02-18T16:22:30.417194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:28.353159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936858+0000","last_change":"2024-02-18T16:21:07.897703+0000","last_active":"2024-02-18T16:21:40.936858+0000","last_peered":"2024-02-18T16:21:40.936858+0000","last_clean":"2024-02-18T16:21:40.936858+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:21:40.936858+0000","last_undegraded":"2024-02-18T16:21:40.936858+0000","last_fullsized":"2024-02-18T16:21:40.936858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:41.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179155+0000","last_change":"2024-02-18T16:21:09.909919+0000","last_active":"2024-02-18T16:21:41.179155+0000","last_peered":"2024-02-18T16:21:41.179155+0000","last_clean":"2024-02-18T16:21:41.179155+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:21:41.179155+0000","last_undegraded":"2024-02-18T16:21:41.179155+0000","last_fullsized":"2024-02-18T16:21:41.179155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:27.374232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605789+0000","last_change":"2024-02-18T16:21:01.852159+0000","last_active":"2024-02-18T16:22:29.605789+0000","last_peered":"2024-02-18T16:22:29.605789+0000","last_clean":"2024-02-18T16:22:29.605789+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:22:29.605789+0000","last_undegraded":"2024-02-18T16:22:29.605789+0000","last_fullsized":"2024-02-18T16:22:29.605789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941358+0000","last_change":"2024-02-18T16:20:59.833123+0000","last_active":"2024-02-18T16:21:40.941358+0000","last_peered":"2024-02-18T16:21:40.941358+0000","last_clean":"2024-02-18T16:21:40.941358+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:21:40.941358+0000","last_undegraded":"2024-02-18T16:21:40.941358+0000","last_fullsized":"2024-02-18T16:21:40.941358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947671+0000","last_change":"2024-02-18T16:21:03.850309+0000","last_active":"2024-02-18T16:21:40.947671+0000","last_peered":"2024-02-18T16:21:40.947671+0000","last_clean":"2024-02-18T16:21:40.947671+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:21:40.947671+0000","last_undegraded":"2024-02-18T16:21:40.947671+0000","last_fullsized":"2024-02-18T16:21:40.947671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:21.788879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:23.050364+0000","last_change":"2024-02-18T16:21:05.880698+0000","last_active":"2024-02-18T16:22:23.050364+0000","last_peered":"2024-02-18T16:22:23.050364+0000","last_clean":"2024-02-18T16:22:23.050364+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:22:23.050364+0000","last_undegraded":"2024-02-18T16:22:23.050364+0000","last_fullsized":"2024-02-18T16:22:23.050364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:33.384726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935541+0000","last_change":"2024-02-18T16:21:07.900044+0000","last_active":"2024-02-18T16:21:40.935541+0000","last_peered":"2024-02-18T16:21:40.935541+0000","last_clean":"2024-02-18T16:21:40.935541+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:21:40.935541+0000","last_undegraded":"2024-02-18T16:21:40.935541+0000","last_fullsized":"2024-02-18T16:21:40.935541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:14.205593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177117+0000","last_change":"2024-02-18T16:21:09.926381+0000","last_active":"2024-02-18T16:21:41.177117+0000","last_peered":"2024-02-18T16:21:41.177117+0000","last_clean":"2024-02-18T16:21:41.177117+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:21:41.177117+0000","last_undegraded":"2024-02-18T16:21:41.177117+0000","last_fullsized":"2024-02-18T16:21:41.177117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165508+0000","last_change":"2024-02-18T16:21:01.847228+0000","last_active":"2024-02-18T16:21:47.165508+0000","last_peered":"2024-02-18T16:21:47.165508+0000","last_clean":"2024-02-18T16:21:47.165508+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:21:47.165508+0000","last_undegraded":"2024-02-18T16:21:47.165508+0000","last_fullsized":"2024-02-18T16:21:47.165508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952876+0000","last_change":"2024-02-18T16:20:59.839316+0000","last_active":"2024-02-18T16:21:40.952876+0000","last_peered":"2024-02-18T16:21:40.952876+0000","last_clean":"2024-02-18T16:21:40.952876+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:21:40.952876+0000","last_undegraded":"2024-02-18T16:21:40.952876+0000","last_fullsized":"2024-02-18T16:21:40.952876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934519+0000","last_change":"2024-02-18T16:21:03.864201+0000","last_active":"2024-02-18T16:21:40.934519+0000","last_peered":"2024-02-18T16:21:40.934519+0000","last_clean":"2024-02-18T16:21:40.934519+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:21:40.934519+0000","last_undegraded":"2024-02-18T16:21:40.934519+0000","last_fullsized":"2024-02-18T16:21:40.934519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:17.726013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:35.841028+0000","last_change":"2024-02-18T16:21:05.876928+0000","last_active":"2024-02-18T16:22:35.841028+0000","last_peered":"2024-02-18T16:22:35.841028+0000","last_clean":"2024-02-18T16:22:35.841028+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:22:35.841028+0000","last_undegraded":"2024-02-18T16:22:35.841028+0000","last_fullsized":"2024-02-18T16:22:35.841028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:06.486461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928756+0000","last_change":"2024-02-18T16:21:07.894242+0000","last_active":"2024-02-18T16:21:40.928756+0000","last_peered":"2024-02-18T16:21:40.928756+0000","last_clean":"2024-02-18T16:21:40.928756+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:21:40.928756+0000","last_undegraded":"2024-02-18T16:21:40.928756+0000","last_fullsized":"2024-02-18T16:21:40.928756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.128244+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:21:47.128244+0000","last_peered":"2024-02-18T16:21:47.128244+0000","last_clean":"2024-02-18T16:21:47.128244+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:21:47.128244+0000","last_undegraded":"2024-02-18T16:21:47.128244+0000","last_fullsized":"2024-02-18T16:21:47.128244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:15:42.799340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871877+0000","last_change":"2024-02-18T16:21:01.853323+0000","last_active":"2024-02-18T16:21:46.871877+0000","last_peered":"2024-02-18T16:21:46.871877+0000","last_clean":"2024-02-18T16:21:46.871877+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:21:46.871877+0000","last_undegraded":"2024-02-18T16:21:46.871877+0000","last_fullsized":"2024-02-18T16:21:46.871877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:11.618049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945582+0000","last_change":"2024-02-18T16:20:59.853141+0000","last_active":"2024-02-18T16:21:40.945582+0000","last_peered":"2024-02-18T16:21:40.945582+0000","last_clean":"2024-02-18T16:21:40.945582+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:21:40.945582+0000","last_undegraded":"2024-02-18T16:21:40.945582+0000","last_fullsized":"2024-02-18T16:21:40.945582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933353+0000","last_change":"2024-02-18T16:21:03.852896+0000","last_active":"2024-02-18T16:21:40.933353+0000","last_peered":"2024-02-18T16:21:40.933353+0000","last_clean":"2024-02-18T16:21:40.933353+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:21:40.933353+0000","last_undegraded":"2024-02-18T16:21:40.933353+0000","last_fullsized":"2024-02-18T16:21:40.933353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:25.426450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.393010+0000","last_change":"2024-02-18T16:21:05.877090+0000","last_active":"2024-02-18T16:22:30.393010+0000","last_peered":"2024-02-18T16:22:30.393010+0000","last_clean":"2024-02-18T16:22:30.393010+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:22:30.393010+0000","last_undegraded":"2024-02-18T16:22:30.393010+0000","last_fullsized":"2024-02-18T16:22:30.393010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:28.582206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937205+0000","last_change":"2024-02-18T16:21:07.895684+0000","last_active":"2024-02-18T16:21:40.937205+0000","last_peered":"2024-02-18T16:21:40.937205+0000","last_clean":"2024-02-18T16:21:40.937205+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:21:40.937205+0000","last_undegraded":"2024-02-18T16:21:40.937205+0000","last_fullsized":"2024-02-18T16:21:40.937205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:02.630017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956804+0000","last_change":"2024-02-18T16:21:01.852475+0000","last_active":"2024-02-18T16:21:40.956804+0000","last_peered":"2024-02-18T16:21:40.956804+0000","last_clean":"2024-02-18T16:21:40.956804+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:21:40.956804+0000","last_undegraded":"2024-02-18T16:21:40.956804+0000","last_fullsized":"2024-02-18T16:21:40.956804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:27.351511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933470+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:21:40.933470+0000","last_peered":"2024-02-18T16:21:40.933470+0000","last_clean":"2024-02-18T16:21:40.933470+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:21:40.933470+0000","last_undegraded":"2024-02-18T16:21:40.933470+0000","last_fullsized":"2024-02-18T16:21:40.933470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:15:24.659323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180433+0000","last_change":"2024-02-18T16:21:03.857015+0000","last_active":"2024-02-18T16:21:41.180433+0000","last_peered":"2024-02-18T16:21:41.180433+0000","last_clean":"2024-02-18T16:21:41.180433+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:21:41.180433+0000","last_undegraded":"2024-02-18T16:21:41.180433+0000","last_fullsized":"2024-02-18T16:21:41.180433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:13.662764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.034479+0000","last_change":"2024-02-18T16:21:05.880717+0000","last_active":"2024-02-18T16:22:36.034479+0000","last_peered":"2024-02-18T16:22:36.034479+0000","last_clean":"2024-02-18T16:22:36.034479+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:36.034479+0000","last_undegraded":"2024-02-18T16:22:36.034479+0000","last_fullsized":"2024-02-18T16:22:36.034479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:12.190046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936708+0000","last_change":"2024-02-18T16:21:07.890941+0000","last_active":"2024-02-18T16:21:40.936708+0000","last_peered":"2024-02-18T16:21:40.936708+0000","last_clean":"2024-02-18T16:21:40.936708+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:21:40.936708+0000","last_undegraded":"2024-02-18T16:21:40.936708+0000","last_fullsized":"2024-02-18T16:21:40.936708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:57.883612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.748309+0000","last_change":"2024-02-18T16:21:09.926618+0000","last_active":"2024-02-18T16:22:29.748309+0000","last_peered":"2024-02-18T16:22:29.748309+0000","last_clean":"2024-02-18T16:22:29.748309+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:22:29.748309+0000","last_undegraded":"2024-02-18T16:22:29.748309+0000","last_fullsized":"2024-02-18T16:22:29.748309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183335+0000","last_change":"2024-02-18T16:21:01.841268+0000","last_active":"2024-02-18T16:21:41.183335+0000","last_peered":"2024-02-18T16:21:41.183335+0000","last_clean":"2024-02-18T16:21:41.183335+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:21:41.183335+0000","last_undegraded":"2024-02-18T16:21:41.183335+0000","last_fullsized":"2024-02-18T16:21:41.183335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927563+0000","last_change":"2024-02-18T16:20:59.853982+0000","last_active":"2024-02-18T16:21:40.927563+0000","last_peered":"2024-02-18T16:21:40.927563+0000","last_clean":"2024-02-18T16:21:40.927563+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:21:40.927563+0000","last_undegraded":"2024-02-18T16:21:40.927563+0000","last_fullsized":"2024-02-18T16:21:40.927563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950616+0000","last_change":"2024-02-18T16:21:03.854204+0000","last_active":"2024-02-18T16:21:40.950616+0000","last_peered":"2024-02-18T16:21:40.950616+0000","last_clean":"2024-02-18T16:21:40.950616+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:21:40.950616+0000","last_undegraded":"2024-02-18T16:21:40.950616+0000","last_fullsized":"2024-02-18T16:21:40.950616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:28.248701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.394256+0000","last_change":"2024-02-18T16:21:05.897013+0000","last_active":"2024-02-18T16:22:30.394256+0000","last_peered":"2024-02-18T16:22:30.394256+0000","last_clean":"2024-02-18T16:22:30.394256+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:22:30.394256+0000","last_undegraded":"2024-02-18T16:22:30.394256+0000","last_fullsized":"2024-02-18T16:22:30.394256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:16.724717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931649+0000","last_change":"2024-02-18T16:21:07.917711+0000","last_active":"2024-02-18T16:21:40.931649+0000","last_peered":"2024-02-18T16:21:40.931649+0000","last_clean":"2024-02-18T16:21:40.931649+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:21:40.931649+0000","last_undegraded":"2024-02-18T16:21:40.931649+0000","last_fullsized":"2024-02-18T16:21:40.931649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933181+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:21:40.933181+0000","last_peered":"2024-02-18T16:21:40.933181+0000","last_clean":"2024-02-18T16:21:40.933181+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:21:40.933181+0000","last_undegraded":"2024-02-18T16:21:40.933181+0000","last_fullsized":"2024-02-18T16:21:40.933181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:37:16.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952947+0000","last_change":"2024-02-18T16:21:01.858003+0000","last_active":"2024-02-18T16:21:40.952947+0000","last_peered":"2024-02-18T16:21:40.952947+0000","last_clean":"2024-02-18T16:21:40.952947+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:21:40.952947+0000","last_undegraded":"2024-02-18T16:21:40.952947+0000","last_fullsized":"2024-02-18T16:21:40.952947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929693+0000","last_change":"2024-02-18T16:20:59.854045+0000","last_active":"2024-02-18T16:21:40.929693+0000","last_peered":"2024-02-18T16:21:40.929693+0000","last_clean":"2024-02-18T16:21:40.929693+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:21:40.929693+0000","last_undegraded":"2024-02-18T16:21:40.929693+0000","last_fullsized":"2024-02-18T16:21:40.929693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939479+0000","last_change":"2024-02-18T16:21:03.855690+0000","last_active":"2024-02-18T16:21:40.939479+0000","last_peered":"2024-02-18T16:21:40.939479+0000","last_clean":"2024-02-18T16:21:40.939479+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:21:40.939479+0000","last_undegraded":"2024-02-18T16:21:40.939479+0000","last_fullsized":"2024-02-18T16:21:40.939479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:40.744979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.423091+0000","last_change":"2024-02-18T16:21:05.889337+0000","last_active":"2024-02-18T16:22:30.423091+0000","last_peered":"2024-02-18T16:22:30.423091+0000","last_clean":"2024-02-18T16:22:30.423091+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:30.423091+0000","last_undegraded":"2024-02-18T16:22:30.423091+0000","last_fullsized":"2024-02-18T16:22:30.423091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:00.614470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179753+0000","last_change":"2024-02-18T16:21:07.907388+0000","last_active":"2024-02-18T16:21:41.179753+0000","last_peered":"2024-02-18T16:21:41.179753+0000","last_clean":"2024-02-18T16:21:41.179753+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:21:41.179753+0000","last_undegraded":"2024-02-18T16:21:41.179753+0000","last_fullsized":"2024-02-18T16:21:41.179753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:25.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939050+0000","last_change":"2024-02-18T16:21:09.911546+0000","last_active":"2024-02-18T16:21:40.939050+0000","last_peered":"2024-02-18T16:21:40.939050+0000","last_clean":"2024-02-18T16:21:40.939050+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:21:40.939050+0000","last_undegraded":"2024-02-18T16:21:40.939050+0000","last_fullsized":"2024-02-18T16:21:40.939050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:51:41.804331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.856054+0000","last_change":"2024-02-18T16:21:01.840394+0000","last_active":"2024-02-18T16:21:47.856054+0000","last_peered":"2024-02-18T16:21:47.856054+0000","last_clean":"2024-02-18T16:21:47.856054+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:21:47.856054+0000","last_undegraded":"2024-02-18T16:21:47.856054+0000","last_fullsized":"2024-02-18T16:21:47.856054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948852+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:21:40.948852+0000","last_peered":"2024-02-18T16:21:40.948852+0000","last_clean":"2024-02-18T16:21:40.948852+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:21:40.948852+0000","last_undegraded":"2024-02-18T16:21:40.948852+0000","last_fullsized":"2024-02-18T16:21:40.948852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:32.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933457+0000","last_change":"2024-02-18T16:21:03.867900+0000","last_active":"2024-02-18T16:21:40.933457+0000","last_peered":"2024-02-18T16:21:40.933457+0000","last_clean":"2024-02-18T16:21:40.933457+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:21:40.933457+0000","last_undegraded":"2024-02-18T16:21:40.933457+0000","last_fullsized":"2024-02-18T16:21:40.933457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:15.762147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952376+0000","last_change":"2024-02-18T16:21:05.897563+0000","last_active":"2024-02-18T16:21:40.952376+0000","last_peered":"2024-02-18T16:21:40.952376+0000","last_clean":"2024-02-18T16:21:40.952376+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:21:40.952376+0000","last_undegraded":"2024-02-18T16:21:40.952376+0000","last_fullsized":"2024-02-18T16:21:40.952376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:21:22.623751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":304,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.297154+0000","last_change":"2024-02-18T16:21:07.903096+0000","last_active":"2024-02-18T16:22:36.297154+0000","last_peered":"2024-02-18T16:22:36.297154+0000","last_clean":"2024-02-18T16:22:36.297154+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:36.297154+0000","last_undegraded":"2024-02-18T16:22:36.297154+0000","last_fullsized":"2024-02-18T16:22:36.297154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:33.395055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931705+0000","last_change":"2024-02-18T16:21:09.924100+0000","last_active":"2024-02-18T16:21:40.931705+0000","last_peered":"2024-02-18T16:21:40.931705+0000","last_clean":"2024-02-18T16:21:40.931705+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:21:40.931705+0000","last_undegraded":"2024-02-18T16:21:40.931705+0000","last_fullsized":"2024-02-18T16:21:40.931705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:28:24.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940205+0000","last_change":"2024-02-18T16:21:01.837599+0000","last_active":"2024-02-18T16:21:40.940205+0000","last_peered":"2024-02-18T16:21:40.940205+0000","last_clean":"2024-02-18T16:21:40.940205+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:21:40.940205+0000","last_undegraded":"2024-02-18T16:21:40.940205+0000","last_fullsized":"2024-02-18T16:21:40.940205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:07.608465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929848+0000","last_change":"2024-02-18T16:20:59.859857+0000","last_active":"2024-02-18T16:21:40.929848+0000","last_peered":"2024-02-18T16:21:40.929848+0000","last_clean":"2024-02-18T16:21:40.929848+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:21:40.929848+0000","last_undegraded":"2024-02-18T16:21:40.929848+0000","last_fullsized":"2024-02-18T16:21:40.929848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929290+0000","last_change":"2024-02-18T16:21:03.868183+0000","last_active":"2024-02-18T16:21:40.929290+0000","last_peered":"2024-02-18T16:21:40.929290+0000","last_clean":"2024-02-18T16:21:40.929290+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:21:40.929290+0000","last_undegraded":"2024-02-18T16:21:40.929290+0000","last_fullsized":"2024-02-18T16:21:40.929290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:44.654179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.378955+0000","last_change":"2024-02-18T16:21:05.890224+0000","last_active":"2024-02-18T16:22:30.378955+0000","last_peered":"2024-02-18T16:22:30.378955+0000","last_clean":"2024-02-18T16:22:30.378955+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:30.378955+0000","last_undegraded":"2024-02-18T16:22:30.378955+0000","last_fullsized":"2024-02-18T16:22:30.378955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:55.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173856+0000","last_change":"2024-02-18T16:21:07.895448+0000","last_active":"2024-02-18T16:21:41.173856+0000","last_peered":"2024-02-18T16:21:41.173856+0000","last_clean":"2024-02-18T16:21:41.173856+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:21:41.173856+0000","last_undegraded":"2024-02-18T16:21:41.173856+0000","last_fullsized":"2024-02-18T16:21:41.173856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:31.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946969+0000","last_change":"2024-02-18T16:21:09.927008+0000","last_active":"2024-02-18T16:21:40.946969+0000","last_peered":"2024-02-18T16:21:40.946969+0000","last_clean":"2024-02-18T16:21:40.946969+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:21:40.946969+0000","last_undegraded":"2024-02-18T16:21:40.946969+0000","last_fullsized":"2024-02-18T16:21:40.946969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937270+0000","last_change":"2024-02-18T16:21:01.831920+0000","last_active":"2024-02-18T16:21:40.937270+0000","last_peered":"2024-02-18T16:21:40.937270+0000","last_clean":"2024-02-18T16:21:40.937270+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:21:40.937270+0000","last_undegraded":"2024-02-18T16:21:40.937270+0000","last_fullsized":"2024-02-18T16:21:40.937270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951556+0000","last_change":"2024-02-18T16:20:59.872971+0000","last_active":"2024-02-18T16:21:40.951556+0000","last_peered":"2024-02-18T16:21:40.951556+0000","last_clean":"2024-02-18T16:21:40.951556+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:21:40.951556+0000","last_undegraded":"2024-02-18T16:21:40.951556+0000","last_fullsized":"2024-02-18T16:21:40.951556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:31.687324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940611+0000","last_change":"2024-02-18T16:21:03.854122+0000","last_active":"2024-02-18T16:21:40.940611+0000","last_peered":"2024-02-18T16:21:40.940611+0000","last_clean":"2024-02-18T16:21:40.940611+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:21:40.940611+0000","last_undegraded":"2024-02-18T16:21:40.940611+0000","last_fullsized":"2024-02-18T16:21:40.940611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:46.493787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.380857+0000","last_change":"2024-02-18T16:21:05.895074+0000","last_active":"2024-02-18T16:22:30.380857+0000","last_peered":"2024-02-18T16:22:30.380857+0000","last_clean":"2024-02-18T16:22:30.380857+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:30.380857+0000","last_undegraded":"2024-02-18T16:22:30.380857+0000","last_fullsized":"2024-02-18T16:22:30.380857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:29.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932403+0000","last_change":"2024-02-18T16:21:07.908003+0000","last_active":"2024-02-18T16:21:40.932403+0000","last_peered":"2024-02-18T16:21:40.932403+0000","last_clean":"2024-02-18T16:21:40.932403+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:21:40.932403+0000","last_undegraded":"2024-02-18T16:21:40.932403+0000","last_fullsized":"2024-02-18T16:21:40.932403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:07.987144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954186+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:21:40.954186+0000","last_peered":"2024-02-18T16:21:40.954186+0000","last_clean":"2024-02-18T16:21:40.954186+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:21:40.954186+0000","last_undegraded":"2024-02-18T16:21:40.954186+0000","last_fullsized":"2024-02-18T16:21:40.954186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:55:03.922245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.423870+0000","last_change":"2024-02-18T16:21:01.855576+0000","last_active":"2024-02-18T16:21:46.423870+0000","last_peered":"2024-02-18T16:21:46.423870+0000","last_clean":"2024-02-18T16:21:46.423870+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:21:46.423870+0000","last_undegraded":"2024-02-18T16:21:46.423870+0000","last_fullsized":"2024-02-18T16:21:46.423870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:08.162049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180630+0000","last_change":"2024-02-18T16:20:59.862651+0000","last_active":"2024-02-18T16:21:41.180630+0000","last_peered":"2024-02-18T16:21:41.180630+0000","last_clean":"2024-02-18T16:21:41.180630+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:21:41.180630+0000","last_undegraded":"2024-02-18T16:21:41.180630+0000","last_fullsized":"2024-02-18T16:21:41.180630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.176054+0000","last_change":"2024-02-18T16:21:03.858753+0000","last_active":"2024-02-18T16:22:37.176054+0000","last_peered":"2024-02-18T16:22:37.176054+0000","last_clean":"2024-02-18T16:22:37.176054+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:22:37.176054+0000","last_undegraded":"2024-02-18T16:22:37.176054+0000","last_fullsized":"2024-02-18T16:22:37.176054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:47.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.419821+0000","last_change":"2024-02-18T16:21:05.886757+0000","last_active":"2024-02-18T16:22:30.419821+0000","last_peered":"2024-02-18T16:22:30.419821+0000","last_clean":"2024-02-18T16:22:30.419821+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:30.419821+0000","last_undegraded":"2024-02-18T16:22:30.419821+0000","last_fullsized":"2024-02-18T16:22:30.419821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:25:06.744338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938999+0000","last_change":"2024-02-18T16:21:07.912579+0000","last_active":"2024-02-18T16:21:40.938999+0000","last_peered":"2024-02-18T16:21:40.938999+0000","last_clean":"2024-02-18T16:21:40.938999+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:21:40.938999+0000","last_undegraded":"2024-02-18T16:21:40.938999+0000","last_fullsized":"2024-02-18T16:21:40.938999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:03:05.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950786+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:21:40.950786+0000","last_peered":"2024-02-18T16:21:40.950786+0000","last_clean":"2024-02-18T16:21:40.950786+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:21:40.950786+0000","last_undegraded":"2024-02-18T16:21:40.950786+0000","last_fullsized":"2024-02-18T16:21:40.950786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:08.385221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085308+0000","last_change":"2024-02-18T16:21:01.833320+0000","last_active":"2024-02-18T16:22:36.085308+0000","last_peered":"2024-02-18T16:22:36.085308+0000","last_clean":"2024-02-18T16:22:36.085308+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:22:36.085308+0000","last_undegraded":"2024-02-18T16:22:36.085308+0000","last_fullsized":"2024-02-18T16:22:36.085308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:35.898147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946271+0000","last_change":"2024-02-18T16:20:59.855832+0000","last_active":"2024-02-18T16:21:40.946271+0000","last_peered":"2024-02-18T16:21:40.946271+0000","last_clean":"2024-02-18T16:21:40.946271+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:21:40.946271+0000","last_undegraded":"2024-02-18T16:21:40.946271+0000","last_fullsized":"2024-02-18T16:21:40.946271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930567+0000","last_change":"2024-02-18T16:21:03.862714+0000","last_active":"2024-02-18T16:21:40.930567+0000","last_peered":"2024-02-18T16:21:40.930567+0000","last_clean":"2024-02-18T16:21:40.930567+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:21:40.930567+0000","last_undegraded":"2024-02-18T16:21:40.930567+0000","last_fullsized":"2024-02-18T16:21:40.930567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:36.699699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.062152+0000","last_change":"2024-02-18T16:21:05.890834+0000","last_active":"2024-02-18T16:22:36.062152+0000","last_peered":"2024-02-18T16:22:36.062152+0000","last_clean":"2024-02-18T16:22:36.062152+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:22:36.062152+0000","last_undegraded":"2024-02-18T16:22:36.062152+0000","last_fullsized":"2024-02-18T16:22:36.062152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:57:24.200656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":46,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175495+0000","last_change":"2024-02-18T16:21:07.894884+0000","last_active":"2024-02-18T16:21:41.175495+0000","last_peered":"2024-02-18T16:21:41.175495+0000","last_clean":"2024-02-18T16:21:41.175495+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:21:41.175495+0000","last_undegraded":"2024-02-18T16:21:41.175495+0000","last_fullsized":"2024-02-18T16:21:41.175495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.438798+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:30.438798+0000","last_peered":"2024-02-18T16:22:30.438798+0000","last_clean":"2024-02-18T16:22:30.438798+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:30.438798+0000","last_undegraded":"2024-02-18T16:22:30.438798+0000","last_fullsized":"2024-02-18T16:22:30.438798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:31.495612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.845885+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:17:13.639861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932873+0000","last_change":"2024-02-18T16:20:59.838011+0000","last_active":"2024-02-18T16:21:40.932873+0000","last_peered":"2024-02-18T16:21:40.932873+0000","last_clean":"2024-02-18T16:21:40.932873+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:21:40.932873+0000","last_undegraded":"2024-02-18T16:21:40.932873+0000","last_fullsized":"2024-02-18T16:21:40.932873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182948+0000","last_change":"2024-02-18T16:21:01.839946+0000","last_active":"2024-02-18T16:21:41.182948+0000","last_peered":"2024-02-18T16:21:41.182948+0000","last_clean":"2024-02-18T16:21:41.182948+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:21:41.182948+0000","last_undegraded":"2024-02-18T16:21:41.182948+0000","last_fullsized":"2024-02-18T16:21:41.182948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.146551+0000","last_change":"2024-02-18T16:20:59.850717+0000","last_active":"2024-02-18T16:21:47.146551+0000","last_peered":"2024-02-18T16:21:47.146551+0000","last_clean":"2024-02-18T16:21:47.146551+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:21:47.146551+0000","last_undegraded":"2024-02-18T16:21:47.146551+0000","last_fullsized":"2024-02-18T16:21:47.146551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605557+0000","last_change":"2024-02-18T16:21:01.857016+0000","last_active":"2024-02-18T16:22:29.605557+0000","last_peered":"2024-02-18T16:22:29.605557+0000","last_clean":"2024-02-18T16:22:29.605557+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:22:29.605557+0000","last_undegraded":"2024-02-18T16:22:29.605557+0000","last_fullsized":"2024-02-18T16:22:29.605557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:34.686098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.613089+0000","last_change":"2024-02-18T16:20:59.865570+0000","last_active":"2024-02-18T16:22:29.613089+0000","last_peered":"2024-02-18T16:22:29.613089+0000","last_clean":"2024-02-18T16:22:29.613089+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:22:29.613089+0000","last_undegraded":"2024-02-18T16:22:29.613089+0000","last_fullsized":"2024-02-18T16:22:29.613089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:24.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.881324+0000","last_change":"2024-02-18T16:21:01.844340+0000","last_active":"2024-02-18T16:21:46.881324+0000","last_peered":"2024-02-18T16:21:46.881324+0000","last_clean":"2024-02-18T16:21:46.881324+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:21:46.881324+0000","last_undegraded":"2024-02-18T16:21:46.881324+0000","last_fullsized":"2024-02-18T16:21:46.881324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:33.700597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177537+0000","last_change":"2024-02-18T16:20:59.857706+0000","last_active":"2024-02-18T16:21:41.177537+0000","last_peered":"2024-02-18T16:21:41.177537+0000","last_clean":"2024-02-18T16:21:41.177537+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:21:41.177537+0000","last_undegraded":"2024-02-18T16:21:41.177537+0000","last_fullsized":"2024-02-18T16:21:41.177537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:54:03.661573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177027+0000","last_change":"2024-02-18T16:21:01.852407+0000","last_active":"2024-02-18T16:21:41.177027+0000","last_peered":"2024-02-18T16:21:41.177027+0000","last_clean":"2024-02-18T16:21:41.177027+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:21:41.177027+0000","last_undegraded":"2024-02-18T16:21:41.177027+0000","last_fullsized":"2024-02-18T16:21:41.177027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177143+0000","last_change":"2024-02-18T16:20:59.859871+0000","last_active":"2024-02-18T16:21:41.177143+0000","last_peered":"2024-02-18T16:21:41.177143+0000","last_clean":"2024-02-18T16:21:41.177143+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:21:41.177143+0000","last_undegraded":"2024-02-18T16:21:41.177143+0000","last_fullsized":"2024-02-18T16:21:41.177143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085205+0000","last_change":"2024-02-18T16:21:40.963827+0000","last_active":"2024-02-18T16:22:36.085205+0000","last_peered":"2024-02-18T16:22:36.085205+0000","last_clean":"2024-02-18T16:22:36.085205+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:22:36.085205+0000","last_undegraded":"2024-02-18T16:22:36.085205+0000","last_fullsized":"2024-02-18T16:22:36.085205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:13.380313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933696+0000","last_change":"2024-02-18T16:20:59.861914+0000","last_active":"2024-02-18T16:21:40.933696+0000","last_peered":"2024-02-18T16:21:40.933696+0000","last_clean":"2024-02-18T16:21:40.933696+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:21:40.933696+0000","last_undegraded":"2024-02-18T16:21:40.933696+0000","last_fullsized":"2024-02-18T16:21:40.933696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176179+0000","last_change":"2024-02-18T16:21:01.843302+0000","last_active":"2024-02-18T16:21:41.176179+0000","last_peered":"2024-02-18T16:21:41.176179+0000","last_clean":"2024-02-18T16:21:41.176179+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:21:41.176179+0000","last_undegraded":"2024-02-18T16:21:41.176179+0000","last_fullsized":"2024-02-18T16:21:41.176179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953161+0000","last_change":"2024-02-18T16:20:59.835435+0000","last_active":"2024-02-18T16:21:40.953161+0000","last_peered":"2024-02-18T16:21:40.953161+0000","last_clean":"2024-02-18T16:21:40.953161+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:21:40.953161+0000","last_undegraded":"2024-02-18T16:21:40.953161+0000","last_fullsized":"2024-02-18T16:21:40.953161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.424363+0000","last_change":"2024-02-18T16:21:01.838281+0000","last_active":"2024-02-18T16:21:46.424363+0000","last_peered":"2024-02-18T16:21:46.424363+0000","last_clean":"2024-02-18T16:21:46.424363+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:21:46.424363+0000","last_undegraded":"2024-02-18T16:21:46.424363+0000","last_fullsized":"2024-02-18T16:21:46.424363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183281+0000","last_change":"2024-02-18T16:20:59.859552+0000","last_active":"2024-02-18T16:21:41.183281+0000","last_peered":"2024-02-18T16:21:41.183281+0000","last_clean":"2024-02-18T16:21:41.183281+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:21:41.183281+0000","last_undegraded":"2024-02-18T16:21:41.183281+0000","last_fullsized":"2024-02-18T16:21:41.183281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:55:51.749702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947919+0000","last_change":"2024-02-18T16:21:01.840265+0000","last_active":"2024-02-18T16:21:40.947919+0000","last_peered":"2024-02-18T16:21:40.947919+0000","last_clean":"2024-02-18T16:21:40.947919+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:21:40.947919+0000","last_undegraded":"2024-02-18T16:21:40.947919+0000","last_fullsized":"2024-02-18T16:21:40.947919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:26.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934046+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:21:40.934046+0000","last_peered":"2024-02-18T16:21:40.934046+0000","last_clean":"2024-02-18T16:21:40.934046+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:21:40.934046+0000","last_undegraded":"2024-02-18T16:21:40.934046+0000","last_fullsized":"2024-02-18T16:21:40.934046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:53:59.394571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457053+0000","last_change":"2024-02-18T16:21:01.853933+0000","last_active":"2024-02-18T16:22:30.457053+0000","last_peered":"2024-02-18T16:22:30.457053+0000","last_clean":"2024-02-18T16:22:30.457053+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:22:30.457053+0000","last_undegraded":"2024-02-18T16:22:30.457053+0000","last_fullsized":"2024-02-18T16:22:30.457053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.515684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.446026+0000","last_change":"2024-02-18T16:20:59.853659+0000","last_active":"2024-02-18T16:22:30.446026+0000","last_peered":"2024-02-18T16:22:30.446026+0000","last_clean":"2024-02-18T16:22:30.446026+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:22:30.446026+0000","last_undegraded":"2024-02-18T16:22:30.446026+0000","last_fullsized":"2024-02-18T16:22:30.446026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858279+0000","last_change":"2024-02-18T16:21:01.853974+0000","last_active":"2024-02-18T16:21:47.858279+0000","last_peered":"2024-02-18T16:21:47.858279+0000","last_clean":"2024-02-18T16:21:47.858279+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:21:47.858279+0000","last_undegraded":"2024-02-18T16:21:47.858279+0000","last_fullsized":"2024-02-18T16:21:47.858279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930423+0000","last_change":"2024-02-18T16:20:59.859832+0000","last_active":"2024-02-18T16:21:40.930423+0000","last_peered":"2024-02-18T16:21:40.930423+0000","last_clean":"2024-02-18T16:21:40.930423+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:21:40.930423+0000","last_undegraded":"2024-02-18T16:21:40.930423+0000","last_fullsized":"2024-02-18T16:21:40.930423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085223+0000","last_change":"2024-02-18T16:21:01.839367+0000","last_active":"2024-02-18T16:22:36.085223+0000","last_peered":"2024-02-18T16:22:36.085223+0000","last_clean":"2024-02-18T16:22:36.085223+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:22:36.085223+0000","last_undegraded":"2024-02-18T16:22:36.085223+0000","last_fullsized":"2024-02-18T16:22:36.085223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:10.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929055+0000","last_change":"2024-02-18T16:20:59.859222+0000","last_active":"2024-02-18T16:21:40.929055+0000","last_peered":"2024-02-18T16:21:40.929055+0000","last_clean":"2024-02-18T16:21:40.929055+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:21:40.929055+0000","last_undegraded":"2024-02-18T16:21:40.929055+0000","last_fullsized":"2024-02-18T16:21:40.929055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.848741+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951778+0000","last_change":"2024-02-18T16:20:59.863633+0000","last_active":"2024-02-18T16:21:40.951778+0000","last_peered":"2024-02-18T16:21:40.951778+0000","last_clean":"2024-02-18T16:21:40.951778+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:21:40.951778+0000","last_undegraded":"2024-02-18T16:21:40.951778+0000","last_fullsized":"2024-02-18T16:21:40.951778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:52.944418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457179+0000","last_change":"2024-02-18T16:21:01.843918+0000","last_active":"2024-02-18T16:22:30.457179+0000","last_peered":"2024-02-18T16:22:30.457179+0000","last_clean":"2024-02-18T16:22:30.457179+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:22:30.457179+0000","last_undegraded":"2024-02-18T16:22:30.457179+0000","last_fullsized":"2024-02-18T16:22:30.457179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:44.480187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951870+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:21:40.951870+0000","last_peered":"2024-02-18T16:21:40.951870+0000","last_clean":"2024-02-18T16:21:40.951870+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:21:40.951870+0000","last_undegraded":"2024-02-18T16:21:40.951870+0000","last_fullsized":"2024-02-18T16:21:40.951870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:05.595193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939474+0000","last_change":"2024-02-18T16:21:01.855777+0000","last_active":"2024-02-18T16:21:40.939474+0000","last_peered":"2024-02-18T16:21:40.939474+0000","last_clean":"2024-02-18T16:21:40.939474+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:21:40.939474+0000","last_undegraded":"2024-02-18T16:21:40.939474+0000","last_fullsized":"2024-02-18T16:21:40.939474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:58.959710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953859+0000","last_change":"2024-02-18T16:20:59.854737+0000","last_active":"2024-02-18T16:21:40.953859+0000","last_peered":"2024-02-18T16:21:40.953859+0000","last_clean":"2024-02-18T16:21:40.953859+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:21:40.953859+0000","last_undegraded":"2024-02-18T16:21:40.953859+0000","last_fullsized":"2024-02-18T16:21:40.953859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165380+0000","last_change":"2024-02-18T16:21:01.838289+0000","last_active":"2024-02-18T16:21:47.165380+0000","last_peered":"2024-02-18T16:21:47.165380+0000","last_clean":"2024-02-18T16:21:47.165380+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:21:47.165380+0000","last_undegraded":"2024-02-18T16:21:47.165380+0000","last_fullsized":"2024-02-18T16:21:47.165380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955671+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:21:40.955671+0000","last_peered":"2024-02-18T16:21:40.955671+0000","last_clean":"2024-02-18T16:21:40.955671+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:21:40.955671+0000","last_undegraded":"2024-02-18T16:21:40.955671+0000","last_fullsized":"2024-02-18T16:21:40.955671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:18.150893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935916+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:21:40.935916+0000","last_peered":"2024-02-18T16:21:40.935916+0000","last_clean":"2024-02-18T16:21:40.935916+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:21:40.935916+0000","last_undegraded":"2024-02-18T16:21:40.935916+0000","last_fullsized":"2024-02-18T16:21:40.935916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:46:46.292617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.184388+0000","last_change":"2024-02-18T16:21:01.848174+0000","last_active":"2024-02-18T16:21:41.184388+0000","last_peered":"2024-02-18T16:21:41.184388+0000","last_clean":"2024-02-18T16:21:41.184388+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:21:41.184388+0000","last_undegraded":"2024-02-18T16:21:41.184388+0000","last_fullsized":"2024-02-18T16:21:41.184388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:36:39.607508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174728+0000","last_change":"2024-02-18T16:20:59.856141+0000","last_active":"2024-02-18T16:21:41.174728+0000","last_peered":"2024-02-18T16:21:41.174728+0000","last_clean":"2024-02-18T16:21:41.174728+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:21:41.174728+0000","last_undegraded":"2024-02-18T16:21:41.174728+0000","last_fullsized":"2024-02-18T16:21:41.174728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944734+0000","last_change":"2024-02-18T16:21:01.839351+0000","last_active":"2024-02-18T16:21:40.944734+0000","last_peered":"2024-02-18T16:21:40.944734+0000","last_clean":"2024-02-18T16:21:40.944734+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:21:40.944734+0000","last_undegraded":"2024-02-18T16:21:40.944734+0000","last_fullsized":"2024-02-18T16:21:40.944734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:43.462047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.69099999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":18.120999999999999,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.747},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":26.050999999999998,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.71799999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705690,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.751},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.629},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:22:45.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T16:22:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbbe168640 1 Processor -- start 2024-02-18T16:22:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbbe168640 1 -- start start 2024-02-18T16:22:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbbe168640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbb81290f0 0x7ffbb812c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbbe168640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb8095ee0 con 0x7ffbb8128d10 2024-02-18T16:22:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbbe168640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb8096320 con 0x7ffbb81290f0 2024-02-18T16:22:45.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb6ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffbb81290f0 0x7ffbb812c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffbb8128d10 0x7ffbb812bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36618/0 (socket says 172.21.15.80:36618) 2024-02-18T16:22:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb77fe640 1 -- 172.21.15.80:0/3657908447 learned_addr learned my addr 172.21.15.80:0/3657908447 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:45.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb67fc640 1 -- 172.21.15.80:0/3657908447 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865950721 0 0) 0x7ffbb8095ee0 con 0x7ffbb8128d10 2024-02-18T16:22:45.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb67fc640 1 -- 172.21.15.80:0/3657908447 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffba4003530 con 0x7ffbb8128d10 2024-02-18T16:22:45.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb6ffd640 1 -- 172.21.15.80:0/3657908447 >> v1:172.21.15.80:6789/0 conn(0x7ffbb8128d10 legacy=0x7ffbb812bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb6ffd640 1 -- 172.21.15.80:0/3657908447 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8128620 con 0x7ffbb81290f0 2024-02-18T16:22:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb6ffd640 1 --2- 172.21.15.80:0/3657908447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb81290f0 0x7ffbb812c230 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009740 tx=0x7ffba801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618e7dc39d8d1153 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb67fc640 1 -- 172.21.15.80:0/3657908447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba80ac530 con 0x7ffbb81290f0 2024-02-18T16:22:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb67fc640 1 -- 172.21.15.80:0/3657908447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba80a8050 con 0x7ffbb81290f0 2024-02-18T16:22:45.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.648+0000 7ffbb67fc640 1 -- 172.21.15.80:0/3657908447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba80ac7e0 con 0x7ffbb81290f0 2024-02-18T16:22:45.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3657908447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb81290f0 msgr2=0x7ffbb812c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 --2- 172.21.15.80:0/3657908447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb81290f0 0x7ffbb812c230 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009740 tx=0x7ffba801c490 comp rx=0 tx=0).stop 2024-02-18T16:22:45.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3657908447 shutdown_connections 2024-02-18T16:22:45.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 --2- 172.21.15.80:0/3657908447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb81290f0 0x7ffbb812c230 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3657908447 >> 172.21.15.80:0/3657908447 conn(0x7ffbb809a2f0 msgr2=0x7ffbb809a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:45.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3657908447 shutdown_connections 2024-02-18T16:22:45.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3657908447 wait complete. 2024-02-18T16:22:45.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 Processor -- start 2024-02-18T16:22:45.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- start start 2024-02-18T16:22:45.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 0x7ffbb81c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:45.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8130ba0 con 0x7ffbb8128d10 2024-02-18T16:22:45.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 0x7ffbb81c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:45.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 0x7ffbb81c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52852/0 (socket says 172.21.15.80:52852) 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbb77fe640 1 -- 172.21.15.80:0/3362279654 learned_addr learned my addr 172.21.15.80:0/3362279654 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbb77fe640 1 -- 172.21.15.80:0/3362279654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8009420 con 0x7ffbb8128d10 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbb77fe640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 0x7ffbb81c3010 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffba000c450 tx=0x7ffba000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba0005c20 con 0x7ffbb8128d10 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba0005d80 con 0x7ffbb8128d10 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba00071a0 con 0x7ffbb8128d10 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb81307d0 con 0x7ffbb8128d10 2024-02-18T16:22:45.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb8098040 con 0x7ffbb8128d10 2024-02-18T16:22:45.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffba0007300 con 0x7ffbb8128d10 2024-02-18T16:22:45.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb8067e00 con 0x7ffbb8128d10 2024-02-18T16:22:45.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbaffff640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ffb98035a10 0x7ffb98037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:45.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.652+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7ffba0047d70 con 0x7ffbb8128d10 2024-02-18T16:22:45.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.656+0000 7ffbb6ffd640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ffb98035a10 0x7ffb98037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:45.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.656+0000 7ffbb6ffd640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ffb98035a10 0x7ffb98037ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffba80ae000 tx=0x7ffba80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:45.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.660+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffba0010c20 con 0x7ffbb8128d10 2024-02-18T16:22:45.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.804+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbb8062860 con 0x7ffbb8128d10 2024-02-18T16:22:45.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbaffff640 1 -- 172.21.15.80:0/3362279654 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+21022 (secure 0 0 0) 0x7ffba0017070 con 0x7ffbb8128d10 2024-02-18T16:22:45.815 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:22:45.816 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":32,"fsid":"ac02793c-3733-4042-8a10-93627d56bc80","created":"2024-02-18T16:20:34.936357+0000","modified":"2024-02-18T16:21:40.919122+0000","last_up_change":"2024-02-18T16:20:43.736890+0000","last_in_change":"2024-02-18T16:20:36.134256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T16:20:43.836552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-18T16:20:50.707832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-02-18T16:20:57.831426+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-02-18T16:21:00.193968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-02-18T16:21:02.107302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-02-18T16:21:03.998880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-02-18T16:21:05.943089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-02-18T16:21:08.073831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77a1e3d7-2624-4145-98ac-6a2032a27533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6801","nonce":4245413050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6803","nonce":4245413050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6807","nonce":4245413050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":4245413050},{"type":"v1","addr":"172.21.15.80:6805","nonce":4245413050}]},"public_addr":"172.21.15.80:6801/4245413050","cluster_addr":"172.21.15.80:6803/4245413050","heartbeat_back_addr":"172.21.15.80:6807/4245413050","heartbeat_front_addr":"172.21.15.80:6805/4245413050","state":["exists","up"]},{"osd":1,"uuid":"a80c19e3-9d70-47cd-9538-04c67607ba11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6817","nonce":834716550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6819","nonce":834716550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6823","nonce":834716550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":834716550},{"type":"v1","addr":"172.21.15.129:6821","nonce":834716550}]},"public_addr":"172.21.15.129:6817/834716550","cluster_addr":"172.21.15.129:6819/834716550","heartbeat_back_addr":"172.21.15.129:6823/834716550","heartbeat_front_addr":"172.21.15.129:6821/834716550","state":["exists","up"]},{"osd":2,"uuid":"53707962-fe35-44e8-a5ea-08f8c69343ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6809","nonce":222672308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6811","nonce":222672308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6815","nonce":222672308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":222672308},{"type":"v1","addr":"172.21.15.129:6813","nonce":222672308}]},"public_addr":"172.21.15.129:6809/222672308","cluster_addr":"172.21.15.129:6811/222672308","heartbeat_back_addr":"172.21.15.129:6815/222672308","heartbeat_front_addr":"172.21.15.129:6813/222672308","state":["exists","up"]},{"osd":3,"uuid":"e7de7c5f-16d2-4989-9f9a-1f55679624a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6801","nonce":2085458436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6803","nonce":2085458436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6807","nonce":2085458436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2085458436},{"type":"v1","addr":"172.21.15.129:6805","nonce":2085458436}]},"public_addr":"172.21.15.129:6801/2085458436","cluster_addr":"172.21.15.129:6803/2085458436","heartbeat_back_addr":"172.21.15.129:6807/2085458436","heartbeat_front_addr":"172.21.15.129:6805/2085458436","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.403254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.666337+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.547176+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T16:20:41.636781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.22","mappings":[{"from":1,"to":2}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.16","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ffb98035a10 msgr2=0x7ffb98037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ffb98035a10 0x7ffb98037ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffba80ae000 tx=0x7ffba80a7000 comp rx=0 tx=0).stop 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 msgr2=0x7ffbb81c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 0x7ffbb81c3010 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffba000c450 tx=0x7ffba000c910 comp rx=0 tx=0).stop 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 shutdown_connections 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7ffb98035a10 0x7ffb98037ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 --2- 172.21.15.80:0/3362279654 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbb8128d10 0x7ffbb81c3010 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:45.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 >> 172.21.15.80:0/3362279654 conn(0x7ffbb809a2f0 msgr2=0x7ffbb8121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:45.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 shutdown_connections 2024-02-18T16:22:45.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:45.808+0000 7ffbbe168640 1 -- 172.21.15.80:0/3362279654 wait complete. 2024-02-18T16:22:46.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-02-18T16:22:46.833 INFO:tasks.ceph:Scrubbing osd.0 2024-02-18T16:22:46.833 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-18T16:22:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe964427640 1 Processor -- start 2024-02-18T16:22:46.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe964427640 1 -- start start 2024-02-18T16:22:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe964427640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe95c06cbc0 0x7fe95c133220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:46.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe964427640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c0721d0 con 0x7fe95c06c0d0 2024-02-18T16:22:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe964427640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c0727a0 con 0x7fe95c06cbc0 2024-02-18T16:22:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe9619c2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe95c06cbc0 0x7fe95c133220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe9619c2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe95c06cbc0 0x7fe95c133220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52864/0 (socket says 172.21.15.80:52864) 2024-02-18T16:22:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe9619c2640 1 -- 172.21.15.80:0/2394594067 learned_addr learned my addr 172.21.15.80:0/2394594067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe9619c2640 1 -- 172.21.15.80:0/2394594067 >> v1:172.21.15.80:6789/0 conn(0x7fe95c06c0d0 legacy=0x7fe95c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:46.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.960+0000 7fe9619c2640 1 -- 172.21.15.80:0/2394594067 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c071c30 con 0x7fe95c06cbc0 2024-02-18T16:22:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9619c2640 1 --2- 172.21.15.80:0/2394594067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06cbc0 0x7fe95c133220 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe958009e80 tx=0x7fe95801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b8556f05043de2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9611c1640 1 -- 172.21.15.80:0/2394594067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe958009200 con 0x7fe95c06cbc0 2024-02-18T16:22:46.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9611c1640 1 -- 172.21.15.80:0/2394594067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9580a57c0 con 0x7fe95c06cbc0 2024-02-18T16:22:46.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9611c1640 1 -- 172.21.15.80:0/2394594067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9580a5a80 con 0x7fe95c06cbc0 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2394594067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06cbc0 msgr2=0x7fe95c133220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 --2- 172.21.15.80:0/2394594067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06cbc0 0x7fe95c133220 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe958009e80 tx=0x7fe95801c960 comp rx=0 tx=0).stop 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2394594067 shutdown_connections 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 --2- 172.21.15.80:0/2394594067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06cbc0 0x7fe95c133220 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2394594067 >> 172.21.15.80:0/2394594067 conn(0x7fe95c09d470 msgr2=0x7fe95c09d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2394594067 shutdown_connections 2024-02-18T16:22:46.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2394594067 wait complete. 2024-02-18T16:22:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 Processor -- start 2024-02-18T16:22:46.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- start start 2024-02-18T16:22:46.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 0x7fe95c1308c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c124290 con 0x7fe95c06c0d0 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9621c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 0x7fe95c1308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9621c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 0x7fe95c1308c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52876/0 (socket says 172.21.15.80:52876) 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9621c3640 1 -- 172.21.15.80:0/2578825362 learned_addr learned my addr 172.21.15.80:0/2578825362 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9621c3640 1 -- 172.21.15.80:0/2578825362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009b30 con 0x7fe95c06c0d0 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe9621c3640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 0x7fe95c1308c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c480 tx=0x7fe95000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:46.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe950005150 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9500052b0 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c122a50 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe950007030 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.964+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c123220 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe95c062860 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe950007190 con 0x7fe95c06c0d0 2024-02-18T16:22:46.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe940035a40 0x7fe940037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7fe950047cc0 con 0x7fe95c06c0d0 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe940041eb0 0x7fe940044350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe940044a20 con 0x7fe940041eb0 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe95004a330 con 0x7fe95c06c0d0 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe9629c4640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe940041eb0 0x7fe940044350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe9619c2640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe940035a40 0x7fe940037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe9629c4640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe940041eb0 0x7fe940044350 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:46.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== osd.0 v2:172.21.15.80:6800/4245413050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe940044a20 con 0x7fe940041eb0 2024-02-18T16:22:46.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.968+0000 7fe9619c2640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe940035a40 0x7fe940037f00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ae000 tx=0x7fe9580a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:46.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 --> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe95c06ce10 con 0x7fe940041eb0 2024-02-18T16:22:46.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe94effd640 1 -- 172.21.15.80:0/2578825362 <== osd.0 v2:172.21.15.80:6800/4245413050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe95c06ce10 con 0x7fe940041eb0 2024-02-18T16:22:46.991 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-18T16:22:46.991 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T16:22:46.991 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-18T16:22:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe940041eb0 msgr2=0x7fe940044350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:46.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe940041eb0 0x7fe940044350 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe940035a40 msgr2=0x7fe940037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe940035a40 0x7fe940037f00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ae000 tx=0x7fe9580a7070 comp rx=0 tx=0).stop 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 msgr2=0x7fe95c1308c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 0x7fe95c1308c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c480 tx=0x7fe95000c940 comp rx=0 tx=0).stop 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 shutdown_connections 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:6800/4245413050,v1:172.21.15.80:6801/4245413050] conn(0x7fe940041eb0 0x7fe940044350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7fe940035a40 0x7fe940037f00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:46.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 --2- 172.21.15.80:0/2578825362 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe95c06c0d0 0x7fe95c1308c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 >> 172.21.15.80:0/2578825362 conn(0x7fe95c09d470 msgr2=0x7fe95c132440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 shutdown_connections 2024-02-18T16:22:46.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:46.980+0000 7fe964427640 1 -- 172.21.15.80:0/2578825362 wait complete. 2024-02-18T16:22:47.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-18T16:22:47.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f940aed9640 1 Processor -- start 2024-02-18T16:22:47.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f940aed9640 1 -- start start 2024-02-18T16:22:47.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f940aed9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f940412bcc0 0x7f940412c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f940aed9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94040710b0 con 0x7f940412c5e0 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f940aed9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9404067060 con 0x7f940412bcc0 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f9408c75640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f940412bcc0 0x7f940412c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f9403fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f940412c5e0 0x7f94040960c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36634/0 (socket says 172.21.15.80:36634) 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f9403fff640 1 -- 172.21.15.80:0/1872623491 learned_addr learned my addr 172.21.15.80:0/1872623491 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f9408c75640 1 -- 172.21.15.80:0/1872623491 >> v1:172.21.15.80:6789/0 conn(0x7f940412c5e0 legacy=0x7f94040960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f9408c75640 1 -- 172.21.15.80:0/1872623491 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404070960 con 0x7f940412bcc0 2024-02-18T16:22:47.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.104+0000 7f94037fe640 1 -- 172.21.15.80:0/1872623491 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833239346 0 0) 0x7f94040710b0 con 0x7f940412c5e0 2024-02-18T16:22:47.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f9408c75640 1 --2- 172.21.15.80:0/1872623491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f940412c0a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009740 tx=0x7f93fc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d493484bd0953482 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f94037fe640 1 -- 172.21.15.80:0/1872623491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93fc0ab530 con 0x7f940412bcc0 2024-02-18T16:22:47.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f94037fe640 1 -- 172.21.15.80:0/1872623491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc0a7050 con 0x7f940412bcc0 2024-02-18T16:22:47.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f94037fe640 1 -- 172.21.15.80:0/1872623491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93fc0ab7e0 con 0x7f940412bcc0 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 -- 172.21.15.80:0/1872623491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 msgr2=0x7f940412c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 --2- 172.21.15.80:0/1872623491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f940412c0a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009740 tx=0x7f93fc01c370 comp rx=0 tx=0).stop 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 -- 172.21.15.80:0/1872623491 shutdown_connections 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 --2- 172.21.15.80:0/1872623491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f940412c0a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 -- 172.21.15.80:0/1872623491 >> 172.21.15.80:0/1872623491 conn(0x7f940409c8e0 msgr2=0x7f940409ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 -- 172.21.15.80:0/1872623491 shutdown_connections 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.108+0000 7f940aed9640 1 -- 172.21.15.80:0/1872623491 wait complete. 2024-02-18T16:22:47.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 Processor -- start 2024-02-18T16:22:47.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 -- start start 2024-02-18T16:22:47.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f9404124a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9404126410 con 0x7f940412bcc0 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9408c75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f9404124a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9408c75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f9404124a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52898/0 (socket says 172.21.15.80:52898) 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9408c75640 1 -- 172.21.15.80:0/4199155942 learned_addr learned my addr 172.21.15.80:0/4199155942 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9408c75640 1 -- 172.21.15.80:0/4199155942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009420 con 0x7f940412bcc0 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9408c75640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f9404124a10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f93fc019fa0 tx=0x7f93fc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93fc0b7450 con 0x7f940412bcc0 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc0b75b0 con 0x7f940412bcc0 2024-02-18T16:22:47.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404126af0 con 0x7f940412bcc0 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93fc0b7850 con 0x7f940412bcc0 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9404124f50 con 0x7f940412bcc0 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f93fc0b79b0 con 0x7f940412bcc0 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404062860 con 0x7f940412bcc0 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f94017fa640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93e4035a10 0x7f93e4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f93fc0e3020 con 0x7f940412bcc0 2024-02-18T16:22:47.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9403fff640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93e4035a10 0x7f93e4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.112+0000 7f9403fff640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93e4035a10 0x7f93e4037ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f93ec007fd0 tx=0x7f93ec007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.116+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93fc0c74e0 con 0x7f940412bcc0 2024-02-18T16:22:47.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.260+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f94041270a0 con 0x7f93e4035a10 2024-02-18T16:22:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f94017fa640 1 -- 172.21.15.80:0/4199155942 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94041270a0 con 0x7f93e4035a10 2024-02-18T16:22:47.271 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 0 to deep-scrub 2024-02-18T16:22:47.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93e4035a10 msgr2=0x7f93e4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93e4035a10 0x7f93e4037ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f93ec007fd0 tx=0x7f93ec007980 comp rx=0 tx=0).stop 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 msgr2=0x7f9404124a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f9404124a10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f93fc019fa0 tx=0x7f93fc01abb0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 shutdown_connections 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f93e4035a10 0x7f93e4037ed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 --2- 172.21.15.80:0/4199155942 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f940412bcc0 0x7f9404124a10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 >> 172.21.15.80:0/4199155942 conn(0x7f940409c8e0 msgr2=0x7f9404098ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 shutdown_connections 2024-02-18T16:22:47.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.264+0000 7f940aed9640 1 -- 172.21.15.80:0/4199155942 wait complete. 2024-02-18T16:22:47.289 INFO:tasks.ceph:Scrubbing osd.1 2024-02-18T16:22:47.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-18T16:22:47.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066c432640 1 Processor -- start 2024-02-18T16:22:47.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066c432640 1 -- start start 2024-02-18T16:22:47.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066c432640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f066412d470 0x7f066412f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066c432640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0664095830 con 0x7f06640941a0 2024-02-18T16:22:47.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066c432640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066406c370 con 0x7f066412d470 2024-02-18T16:22:47.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066a1ce640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f06640941a0 0x7f0664094580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36638/0 (socket says 172.21.15.80:36638) 2024-02-18T16:22:47.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f066a1ce640 1 -- 172.21.15.80:0/1214307010 learned_addr learned my addr 172.21.15.80:0/1214307010 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f06699cd640 1 --2- 172.21.15.80:0/1214307010 >> v2:172.21.15.80:3300/0 conn(0x7f066412d470 0x7f066412f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f06691cc640 1 -- 172.21.15.80:0/1214307010 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098510159 0 0) 0x7f0664095830 con 0x7f06640941a0 2024-02-18T16:22:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f06691cc640 1 -- 172.21.15.80:0/1214307010 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0650003450 con 0x7f06640941a0 2024-02-18T16:22:47.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f06699cd640 1 -- 172.21.15.80:0/1214307010 >> v1:172.21.15.80:6789/0 conn(0x7f06640941a0 legacy=0x7f0664094580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f06699cd640 1 -- 172.21.15.80:0/1214307010 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664071e40 con 0x7f066412d470 2024-02-18T16:22:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.404+0000 7f06699cd640 1 --2- 172.21.15.80:0/1214307010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f066412d470 0x7f066412f860 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0654009740 tx=0x7f065401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4161307421e4a731 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f06691cc640 1 -- 172.21.15.80:0/1214307010 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06540ab530 con 0x7f066412d470 2024-02-18T16:22:47.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f06691cc640 1 -- 172.21.15.80:0/1214307010 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06540a7050 con 0x7f066412d470 2024-02-18T16:22:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f06691cc640 1 -- 172.21.15.80:0/1214307010 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06540ab7e0 con 0x7f066412d470 2024-02-18T16:22:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/1214307010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f066412d470 msgr2=0x7f066412f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 --2- 172.21.15.80:0/1214307010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f066412d470 0x7f066412f860 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0654009740 tx=0x7f065401c310 comp rx=0 tx=0).stop 2024-02-18T16:22:47.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/1214307010 shutdown_connections 2024-02-18T16:22:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 --2- 172.21.15.80:0/1214307010 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f066412d470 0x7f066412f860 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/1214307010 >> 172.21.15.80:0/1214307010 conn(0x7f066409a050 msgr2=0x7f066409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/1214307010 shutdown_connections 2024-02-18T16:22:47.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/1214307010 wait complete. 2024-02-18T16:22:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 Processor -- start 2024-02-18T16:22:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- start start 2024-02-18T16:22:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 0x7f06641c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066408e7b0 con 0x7f06640941a0 2024-02-18T16:22:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066a1ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 0x7f06641c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066a1ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 0x7f06641c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52910/0 (socket says 172.21.15.80:52910) 2024-02-18T16:22:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066a1ce640 1 -- 172.21.15.80:0/2101708357 learned_addr learned my addr 172.21.15.80:0/2101708357 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:47.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066a1ce640 1 -- 172.21.15.80:0/2101708357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654009420 con 0x7f06640941a0 2024-02-18T16:22:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066a1ce640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 0x7f06641c1240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f066000c3a0 tx=0x7f066000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0660005c20 con 0x7f06640941a0 2024-02-18T16:22:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0660005d80 con 0x7f06640941a0 2024-02-18T16:22:47.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066408d4f0 con 0x7f06640941a0 2024-02-18T16:22:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0660007220 con 0x7f06640941a0 2024-02-18T16:22:47.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.408+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066408e0f0 con 0x7f06640941a0 2024-02-18T16:22:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0664062860 con 0x7f06640941a0 2024-02-18T16:22:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0660007380 con 0x7f06640941a0 2024-02-18T16:22:47.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0648035a10 0x7f0648037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f0660047db0 con 0x7f06640941a0 2024-02-18T16:22:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f0648041ee0 0x7f0648044380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0648044a50 con 0x7f0648041ee0 2024-02-18T16:22:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f066004a420 con 0x7f06640941a0 2024-02-18T16:22:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f06699cd640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0648035a10 0x7f0648037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f066a9cf640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f0648041ee0 0x7f0648044380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f066a9cf640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f0648041ee0 0x7f0648044380 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f06699cd640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0648035a10 0x7f0648037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f06540ad000 tx=0x7f06540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.412+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== osd.1 v2:172.21.15.129:6816/834716550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0648044a50 con 0x7f0648041ee0 2024-02-18T16:22:47.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 --> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f066412d6c0 con 0x7f0648041ee0 2024-02-18T16:22:47.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f065affd640 1 -- 172.21.15.80:0/2101708357 <== osd.1 v2:172.21.15.129:6816/834716550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f066412d6c0 con 0x7f0648041ee0 2024-02-18T16:22:47.436 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-18T16:22:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T16:22:47.437 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-18T16:22:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f0648041ee0 msgr2=0x7f0648044380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f0648041ee0 0x7f0648044380 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0648035a10 msgr2=0x7f0648037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0648035a10 0x7f0648037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f06540ad000 tx=0x7f06540a6000 comp rx=0 tx=0).stop 2024-02-18T16:22:47.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 msgr2=0x7f06641c1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 0x7f06641c1240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f066000c3a0 tx=0x7f066000c860 comp rx=0 tx=0).stop 2024-02-18T16:22:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 shutdown_connections 2024-02-18T16:22:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6816/834716550,v1:172.21.15.129:6817/834716550] conn(0x7f0648041ee0 0x7f0648044380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f0648035a10 0x7f0648037ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 --2- 172.21.15.80:0/2101708357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06640941a0 0x7f06641c1240 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 >> 172.21.15.80:0/2101708357 conn(0x7f066409a050 msgr2=0x7f0664097870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 shutdown_connections 2024-02-18T16:22:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.428+0000 7f066c432640 1 -- 172.21.15.80:0/2101708357 wait complete. 2024-02-18T16:22:47.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-18T16:22:47.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.556+0000 7f38ae5fa640 1 Processor -- start 2024-02-18T16:22:47.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.556+0000 7f38ae5fa640 1 -- start start 2024-02-18T16:22:47.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38a8095700 0x7f38a8130e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a80936c0 con 0x7f38a8093d20 2024-02-18T16:22:47.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a80938f0 con 0x7f38a8095700 2024-02-18T16:22:47.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a77fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f38a8095700 0x7f38a8130e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f38a8093d20 0x7f38a8094100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36648/0 (socket says 172.21.15.80:36648) 2024-02-18T16:22:47.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a7fff640 1 -- 172.21.15.80:0/2310890499 learned_addr learned my addr 172.21.15.80:0/2310890499 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:47.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a77fe640 1 -- 172.21.15.80:0/2310890499 >> v1:172.21.15.80:6789/0 conn(0x7f38a8093d20 legacy=0x7f38a8094100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a77fe640 1 -- 172.21.15.80:0/2310890499 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a809c030 con 0x7f38a8095700 2024-02-18T16:22:47.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a6ffd640 1 -- 172.21.15.80:0/2310890499 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597528642 0 0) 0x7f38a80936c0 con 0x7f38a8093d20 2024-02-18T16:22:47.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a77fe640 1 --2- 172.21.15.80:0/2310890499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8095700 0x7f38a8130e00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3898009740 tx=0x7f389801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a8fe8ea51d80c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a6ffd640 1 -- 172.21.15.80:0/2310890499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38980ab530 con 0x7f38a8095700 2024-02-18T16:22:47.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a6ffd640 1 -- 172.21.15.80:0/2310890499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38980a7050 con 0x7f38a8095700 2024-02-18T16:22:47.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38a6ffd640 1 -- 172.21.15.80:0/2310890499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38980ab7e0 con 0x7f38a8095700 2024-02-18T16:22:47.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- 172.21.15.80:0/2310890499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8095700 msgr2=0x7f38a8130e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 --2- 172.21.15.80:0/2310890499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8095700 0x7f38a8130e00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3898009740 tx=0x7f389801c370 comp rx=0 tx=0).stop 2024-02-18T16:22:47.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- 172.21.15.80:0/2310890499 shutdown_connections 2024-02-18T16:22:47.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 --2- 172.21.15.80:0/2310890499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8095700 0x7f38a8130e00 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- 172.21.15.80:0/2310890499 >> 172.21.15.80:0/2310890499 conn(0x7f38a809a0c0 msgr2=0x7f38a809a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- 172.21.15.80:0/2310890499 shutdown_connections 2024-02-18T16:22:47.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.560+0000 7f38ae5fa640 1 -- 172.21.15.80:0/2310890499 wait complete. 2024-02-18T16:22:47.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 Processor -- start 2024-02-18T16:22:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 -- start start 2024-02-18T16:22:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 0x7f38a81c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80714b0 con 0x7f38a8093d20 2024-02-18T16:22:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 0x7f38a81c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 0x7f38a81c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52936/0 (socket says 172.21.15.80:52936) 2024-02-18T16:22:47.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a7fff640 1 -- 172.21.15.80:0/1166353058 learned_addr learned my addr 172.21.15.80:0/1166353058 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a7fff640 1 -- 172.21.15.80:0/1166353058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009420 con 0x7f38a8093d20 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a7fff640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 0x7f38a81c3100 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f389c00c420 tx=0x7f389c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f389c0074d0 con 0x7f38a8093d20 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c007630 con 0x7f38a8093d20 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f389c004960 con 0x7f38a8093d20 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a812c930 con 0x7f38a8093d20 2024-02-18T16:22:47.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8070930 con 0x7f38a8093d20 2024-02-18T16:22:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a8062860 con 0x7f38a8093d20 2024-02-18T16:22:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f389c004ac0 con 0x7f38a8093d20 2024-02-18T16:22:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a4ff9640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3894035a10 0x7f3894037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f389c047dc0 con 0x7f38a8093d20 2024-02-18T16:22:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a77fe640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3894035a10 0x7f3894037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.564+0000 7f38a77fe640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3894035a10 0x7f3894037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f38980ad000 tx=0x7f38980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.568+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f389c01abc0 con 0x7f38a8093d20 2024-02-18T16:22:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.720+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f38a80718f0 con 0x7f3894035a10 2024-02-18T16:22:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38a4ff9640 1 -- 172.21.15.80:0/1166353058 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38a80718f0 con 0x7f3894035a10 2024-02-18T16:22:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 1 to deep-scrub 2024-02-18T16:22:47.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3894035a10 msgr2=0x7f3894037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3894035a10 0x7f3894037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f38980ad000 tx=0x7f38980a6000 comp rx=0 tx=0).stop 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 msgr2=0x7f38a81c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 0x7f38a81c3100 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f389c00c420 tx=0x7f389c00c8e0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 shutdown_connections 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3894035a10 0x7f3894037ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 --2- 172.21.15.80:0/1166353058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38a8093d20 0x7f38a81c3100 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 >> 172.21.15.80:0/1166353058 conn(0x7f38a809a0c0 msgr2=0x7f38a8097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 shutdown_connections 2024-02-18T16:22:47.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.724+0000 7f38ae5fa640 1 -- 172.21.15.80:0/1166353058 wait complete. 2024-02-18T16:22:47.748 INFO:tasks.ceph:Scrubbing osd.2 2024-02-18T16:22:47.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-18T16:22:47.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f729026f640 1 Processor -- start 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f729026f640 1 -- start start 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f729026f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f728812dd50 0x7f728812e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f729026f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728809a700 con 0x7f728809d620 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f729026f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72880a1240 con 0x7f728812dd50 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f728e00b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f728812dd50 0x7f728812e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f728d80a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f728809d620 0x7f7288096490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36660/0 (socket says 172.21.15.80:36660) 2024-02-18T16:22:47.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f728d80a640 1 -- 172.21.15.80:0/1207695252 learned_addr learned my addr 172.21.15.80:0/1207695252 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f728e00b640 1 -- 172.21.15.80:0/1207695252 >> v1:172.21.15.80:6789/0 conn(0x7f728809d620 legacy=0x7f7288096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.864+0000 7f728e00b640 1 -- 172.21.15.80:0/1207695252 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728809a0b0 con 0x7f728812dd50 2024-02-18T16:22:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728e00b640 1 --2- 172.21.15.80:0/1207695252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728812dd50 0x7f728812e130 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7280009d90 tx=0x7f728001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913ba35effd936fa server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728d009640 1 -- 172.21.15.80:0/1207695252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72800a5850 con 0x7f728812dd50 2024-02-18T16:22:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728d009640 1 -- 172.21.15.80:0/1207695252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800a59b0 con 0x7f728812dd50 2024-02-18T16:22:47.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728d009640 1 -- 172.21.15.80:0/1207695252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72800a5c70 con 0x7f728812dd50 2024-02-18T16:22:47.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/1207695252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728812dd50 msgr2=0x7f728812e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 --2- 172.21.15.80:0/1207695252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728812dd50 0x7f728812e130 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7280009d90 tx=0x7f728001c8c0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/1207695252 shutdown_connections 2024-02-18T16:22:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 --2- 172.21.15.80:0/1207695252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728812dd50 0x7f728812e130 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/1207695252 >> 172.21.15.80:0/1207695252 conn(0x7f72880a0920 msgr2=0x7f728809ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/1207695252 shutdown_connections 2024-02-18T16:22:47.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/1207695252 wait complete. 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 Processor -- start 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- start start 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 0x7f728806e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728806fe90 con 0x7f728809d620 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728e00b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 0x7f728806e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728e00b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 0x7f728806e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52952/0 (socket says 172.21.15.80:52952) 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728e00b640 1 -- 172.21.15.80:0/3075464605 learned_addr learned my addr 172.21.15.80:0/3075464605 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:47.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728e00b640 1 -- 172.21.15.80:0/3075464605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7280009a70 con 0x7f728809d620 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f728e00b640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 0x7f728806e310 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f72800194d0 tx=0x7f7280019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72800ad780 con 0x7f728809d620 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800ad900 con 0x7f728809d620 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7288133f60 con 0x7f728809d620 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72800adc20 con 0x7f728809d620 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.868+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728806e850 con 0x7f728809d620 2024-02-18T16:22:47.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f728809b840 con 0x7f728809d620 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f72800b4050 con 0x7f728809d620 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f726c035a10 0x7f726c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f72800e39d0 con 0x7f728809d620 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f726c041ee0 0x7f726c044380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f726c044a50 con 0x7f726c041ee0 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72800e82a0 con 0x7f728809d620 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f728d80a640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f726c035a10 0x7f726c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f728e80c640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f726c041ee0 0x7f726c044380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:47.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f728e80c640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f726c041ee0 0x7f726c044380 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f728d80a640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f726c035a10 0x7f726c037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7278001610 tx=0x7f7278007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:47.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.872+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== osd.2 v2:172.21.15.129:6808/222672308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f726c044a50 con 0x7f726c041ee0 2024-02-18T16:22:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.884+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 --> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7288062860 con 0x7f726c041ee0 2024-02-18T16:22:47.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f727effd640 1 -- 172.21.15.80:0/3075464605 <== osd.2 v2:172.21.15.129:6808/222672308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7288062860 con 0x7f726c041ee0 2024-02-18T16:22:47.896 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-18T16:22:47.896 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T16:22:47.896 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-18T16:22:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f726c041ee0 msgr2=0x7f726c044380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f726c041ee0 0x7f726c044380 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f726c035a10 msgr2=0x7f726c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f726c035a10 0x7f726c037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7278001610 tx=0x7f7278007ad0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 msgr2=0x7f728806e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 0x7f728806e310 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f72800194d0 tx=0x7f7280019660 comp rx=0 tx=0).stop 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 shutdown_connections 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f726c035a10 0x7f726c037ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.129:6808/222672308,v1:172.21.15.129:6809/222672308] conn(0x7f726c041ee0 0x7f726c044380 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 --2- 172.21.15.80:0/3075464605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f728809d620 0x7f728806e310 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 >> 172.21.15.80:0/3075464605 conn(0x7f72880a0920 msgr2=0x7f728812cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 shutdown_connections 2024-02-18T16:22:47.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:47.888+0000 7f729026f640 1 -- 172.21.15.80:0/3075464605 wait complete. 2024-02-18T16:22:47.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-18T16:22:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dec01640 1 Processor -- start 2024-02-18T16:22:48.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dec01640 1 -- start start 2024-02-18T16:22:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dec01640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94d80936c0 0x7f94d8093aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dec01640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d8095f80 con 0x7f94d8093fe0 2024-02-18T16:22:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dec01640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80724e0 con 0x7f94d80936c0 2024-02-18T16:22:48.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dc99d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f94d80936c0 0x7f94d8093aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94d7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f94d8093fe0 0x7f94d812e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36664/0 (socket says 172.21.15.80:36664) 2024-02-18T16:22:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94d7fff640 1 -- 172.21.15.80:0/1472991902 learned_addr learned my addr 172.21.15.80:0/1472991902 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dc99d640 1 -- 172.21.15.80:0/1472991902 >> v1:172.21.15.80:6789/0 conn(0x7f94d8093fe0 legacy=0x7f94d812e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94d77fe640 1 -- 172.21.15.80:0/1472991902 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283326028 0 0) 0x7f94d8095f80 con 0x7f94d8093fe0 2024-02-18T16:22:48.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.016+0000 7f94dc99d640 1 -- 172.21.15.80:0/1472991902 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8094b70 con 0x7f94d80936c0 2024-02-18T16:22:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dc99d640 1 --2- 172.21.15.80:0/1472991902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d8093aa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009740 tx=0x7f94c801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5eb27b74b4fdddf server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94d77fe640 1 -- 172.21.15.80:0/1472991902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94c80ab530 con 0x7f94d80936c0 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94d77fe640 1 -- 172.21.15.80:0/1472991902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80a7050 con 0x7f94d80936c0 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94d77fe640 1 -- 172.21.15.80:0/1472991902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94c80ab7e0 con 0x7f94d80936c0 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- 172.21.15.80:0/1472991902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 msgr2=0x7f94d8093aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 --2- 172.21.15.80:0/1472991902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d8093aa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009740 tx=0x7f94c801c370 comp rx=0 tx=0).stop 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- 172.21.15.80:0/1472991902 shutdown_connections 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 --2- 172.21.15.80:0/1472991902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d8093aa0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- 172.21.15.80:0/1472991902 >> 172.21.15.80:0/1472991902 conn(0x7f94d809a0c0 msgr2=0x7f94d809a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- 172.21.15.80:0/1472991902 shutdown_connections 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- 172.21.15.80:0/1472991902 wait complete. 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 Processor -- start 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- start start 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d812d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dec01640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80704b0 con 0x7f94d80936c0 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.020+0000 7f94dc99d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d812d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dc99d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d812d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52978/0 (socket says 172.21.15.80:52978) 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dc99d640 1 -- 172.21.15.80:0/408395912 learned_addr learned my addr 172.21.15.80:0/408395912 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:48.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dc99d640 1 -- 172.21.15.80:0/408395912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8009420 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dc99d640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d812d3d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f94c8019fa0 tx=0x7f94c801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94c80abea0 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8004020 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94c80042c0 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80920c0 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d8071d80 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f94c80b2050 con 0x7f94d80936c0 2024-02-18T16:22:48.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d8070d80 con 0x7f94d80936c0 2024-02-18T16:22:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d57fa640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f94c4035a10 0x7f94c4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f94c80e2d50 con 0x7f94d80936c0 2024-02-18T16:22:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d7fff640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f94c4035a10 0x7f94c4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.024+0000 7f94d7fff640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f94c4035a10 0x7f94c4037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f94cc007fd0 tx=0x7f94cc007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.028+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94c80b2300 con 0x7f94d80936c0 2024-02-18T16:22:48.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.188+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d8074270 con 0x7f94c4035a10 2024-02-18T16:22:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.188+0000 7f94d57fa640 1 -- 172.21.15.80:0/408395912 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94d8074270 con 0x7f94c4035a10 2024-02-18T16:22:48.198 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 2 to deep-scrub 2024-02-18T16:22:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f94c4035a10 msgr2=0x7f94c4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f94c4035a10 0x7f94c4037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f94cc007fd0 tx=0x7f94cc007920 comp rx=0 tx=0).stop 2024-02-18T16:22:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 msgr2=0x7f94d812d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d812d3d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f94c8019fa0 tx=0x7f94c801abb0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 shutdown_connections 2024-02-18T16:22:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f94c4035a10 0x7f94c4037ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 --2- 172.21.15.80:0/408395912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94d80936c0 0x7f94d812d3d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 >> 172.21.15.80:0/408395912 conn(0x7f94d809a0c0 msgr2=0x7f94d812f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 shutdown_connections 2024-02-18T16:22:48.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.192+0000 7f94dec01640 1 -- 172.21.15.80:0/408395912 wait complete. 2024-02-18T16:22:48.216 INFO:tasks.ceph:Scrubbing osd.3 2024-02-18T16:22:48.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-18T16:22:48.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c0befe640 1 Processor -- start 2024-02-18T16:22:48.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c0befe640 1 -- start start 2024-02-18T16:22:48.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c0befe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c0412dd50 0x7f2c0412e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c0befe640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0409a700 con 0x7f2c0409d620 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c0befe640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c040a1240 con 0x7f2c0412dd50 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c09c9a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c0412dd50 0x7f2c0412e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c09499640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2c0409d620 0x7f2c04096490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36672/0 (socket says 172.21.15.80:36672) 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c09499640 1 -- 172.21.15.80:0/2130768021 learned_addr learned my addr 172.21.15.80:0/2130768021 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c09c9a640 1 -- 172.21.15.80:0/2130768021 >> v1:172.21.15.80:6789/0 conn(0x7f2c0409d620 legacy=0x7f2c04096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c09c9a640 1 -- 172.21.15.80:0/2130768021 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0409a0b0 con 0x7f2c0412dd50 2024-02-18T16:22:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c09c9a640 1 --2- 172.21.15.80:0/2130768021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0412dd50 0x7f2c0412e130 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009740 tx=0x7f2c0001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ead42e8e753e9a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c08c98640 1 -- 172.21.15.80:0/2130768021 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c000a8050 con 0x7f2c0412dd50 2024-02-18T16:22:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c08c98640 1 -- 172.21.15.80:0/2130768021 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000ac520 con 0x7f2c0412dd50 2024-02-18T16:22:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.332+0000 7f2c08c98640 1 -- 172.21.15.80:0/2130768021 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c000ac7e0 con 0x7f2c0412dd50 2024-02-18T16:22:48.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/2130768021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0412dd50 msgr2=0x7f2c0412e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 --2- 172.21.15.80:0/2130768021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0412dd50 0x7f2c0412e130 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009740 tx=0x7f2c0001c370 comp rx=0 tx=0).stop 2024-02-18T16:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/2130768021 shutdown_connections 2024-02-18T16:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 --2- 172.21.15.80:0/2130768021 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0412dd50 0x7f2c0412e130 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/2130768021 >> 172.21.15.80:0/2130768021 conn(0x7f2c040a0920 msgr2=0x7f2c0409ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/2130768021 shutdown_connections 2024-02-18T16:22:48.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/2130768021 wait complete. 2024-02-18T16:22:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 Processor -- start 2024-02-18T16:22:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- start start 2024-02-18T16:22:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 0x7f2c041c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c04133f80 con 0x7f2c0409d620 2024-02-18T16:22:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c09c9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 0x7f2c041c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c09c9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 0x7f2c041c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52996/0 (socket says 172.21.15.80:52996) 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c09c9a640 1 -- 172.21.15.80:0/3262817252 learned_addr learned my addr 172.21.15.80:0/3262817252 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c09c9a640 1 -- 172.21.15.80:0/3262817252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00009420 con 0x7f2c0409d620 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c09c9a640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 0x7f2c041c5a60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2c0001aa20 tx=0x7f2c0001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c000b8580 con 0x7f2c0409d620 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000b86e0 con 0x7f2c0409d620 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c04071600 con 0x7f2c0409d620 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c000b89c0 con 0x7f2c0409d620 2024-02-18T16:22:48.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c04071140 con 0x7f2c0409d620 2024-02-18T16:22:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2c000b8b20 con 0x7f2c0409d620 2024-02-18T16:22:48.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c04062860 con 0x7f2c0409d620 2024-02-18T16:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2bf67fc640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2be8035a10 0x7f2be8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.336+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f2c000e31d0 con 0x7f2c0409d620 2024-02-18T16:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2bf67fc640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f2be8041e80 0x7f2be8044320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2be80449f0 con 0x7f2be8041e80 2024-02-18T16:22:48.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c000e5780 con 0x7f2c0409d620 2024-02-18T16:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2c09499640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2be8035a10 0x7f2be8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2c0a49b640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f2be8041e80 0x7f2be8044320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2c09499640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2be8035a10 0x7f2be8037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8001610 tx=0x7f2bf8007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2c0a49b640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f2be8041e80 0x7f2be8044320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.340+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== osd.3 v2:172.21.15.129:6800/2085458436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2be80449f0 con 0x7f2be8041e80 2024-02-18T16:22:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.352+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 --> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c0406fd60 con 0x7f2be8041e80 2024-02-18T16:22:48.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.352+0000 7f2bf67fc640 1 -- 172.21.15.80:0/3262817252 <== osd.3 v2:172.21.15.129:6800/2085458436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2c0406fd60 con 0x7f2be8041e80 2024-02-18T16:22:48.362 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-02-18T16:22:48.363 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T16:22:48.363 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-02-18T16:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.352+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f2be8041e80 msgr2=0x7f2be8044320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.352+0000 7f2c0befe640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f2be8041e80 0x7f2be8044320 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2be8035a10 msgr2=0x7f2be8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2be8035a10 0x7f2be8037ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8001610 tx=0x7f2bf8007ad0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 msgr2=0x7f2c041c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 0x7f2c041c5a60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2c0001aa20 tx=0x7f2c0001abb0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 shutdown_connections 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6800/2085458436,v1:172.21.15.129:6801/2085458436] conn(0x7f2be8041e80 0x7f2be8044320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f2be8035a10 0x7f2be8037ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 --2- 172.21.15.80:0/3262817252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c0409d620 0x7f2c041c5a60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 >> 172.21.15.80:0/3262817252 conn(0x7f2c040a0920 msgr2=0x7f2c0409ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 shutdown_connections 2024-02-18T16:22:48.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.356+0000 7f2c0befe640 1 -- 172.21.15.80:0/3262817252 wait complete. 2024-02-18T16:22:48.378 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-18T16:22:48.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b6a4a9640 1 Processor -- start 2024-02-18T16:22:48.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b6a4a9640 1 -- start start 2024-02-18T16:22:48.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b6a4a9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b6412a1b0 0x7f4b6412a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b6a4a9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6406c700 con 0x7f4b6412aad0 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b6a4a9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640954e0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b63fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b6412a1b0 0x7f4b6412a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b5bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4b6412aad0 0x7f4b64092080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36682/0 (socket says 172.21.15.80:36682) 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b5bfff640 1 -- 172.21.15.80:0/2707621606 learned_addr learned my addr 172.21.15.80:0/2707621606 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b63fff640 1 -- 172.21.15.80:0/2707621606 >> v1:172.21.15.80:6789/0 conn(0x7f4b6412aad0 legacy=0x7f4b64092080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b63fff640 1 -- 172.21.15.80:0/2707621606 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b64095f90 con 0x7f4b6412a1b0 2024-02-18T16:22:48.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b637fe640 1 -- 172.21.15.80:0/2707621606 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549234600 0 0) 0x7f4b6406c700 con 0x7f4b6412aad0 2024-02-18T16:22:48.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.484+0000 7f4b63fff640 1 --2- 172.21.15.80:0/2707621606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b6412a590 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009740 tx=0x7f4b5401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57008b8c6d929bf4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b637fe640 1 -- 172.21.15.80:0/2707621606 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b540ab530 con 0x7f4b6412a1b0 2024-02-18T16:22:48.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b637fe640 1 -- 172.21.15.80:0/2707621606 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b540a7050 con 0x7f4b6412a1b0 2024-02-18T16:22:48.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b637fe640 1 -- 172.21.15.80:0/2707621606 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b540ab7e0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/2707621606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 msgr2=0x7f4b6412a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 --2- 172.21.15.80:0/2707621606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b6412a590 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009740 tx=0x7f4b5401c370 comp rx=0 tx=0).stop 2024-02-18T16:22:48.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/2707621606 shutdown_connections 2024-02-18T16:22:48.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 --2- 172.21.15.80:0/2707621606 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b6412a590 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/2707621606 >> 172.21.15.80:0/2707621606 conn(0x7f4b6409a0c0 msgr2=0x7f4b6409a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/2707621606 shutdown_connections 2024-02-18T16:22:48.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/2707621606 wait complete. 2024-02-18T16:22:48.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 Processor -- start 2024-02-18T16:22:48.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- start start 2024-02-18T16:22:48.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b641c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6408f7d0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b63fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b641c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b63fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b641c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53010/0 (socket says 172.21.15.80:53010) 2024-02-18T16:22:48.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b63fff640 1 -- 172.21.15.80:0/1554741688 learned_addr learned my addr 172.21.15.80:0/1554741688 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b63fff640 1 -- 172.21.15.80:0/1554741688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b54009420 con 0x7f4b6412a1b0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b63fff640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b641c34d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4b54019fa0 tx=0x7f4b5401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b540abea0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b54004020 con 0x7f4b6412a1b0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6406c3f0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b540042e0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b64097e80 con 0x7f4b6412a1b0 2024-02-18T16:22:48.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6408e760 con 0x7f4b6412a1b0 2024-02-18T16:22:48.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b54003620 con 0x7f4b6412a1b0 2024-02-18T16:22:48.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.488+0000 7f4b617fa640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b44035a10 0x7f4b44037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.492+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f4b540e2f70 con 0x7f4b6412a1b0 2024-02-18T16:22:48.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.492+0000 7f4b5bfff640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b44035a10 0x7f4b44037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.492+0000 7f4b5bfff640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b44035a10 0x7f4b44037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c007fd0 tx=0x7f4b4c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.496+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b540b45d0 con 0x7f4b6412a1b0 2024-02-18T16:22:48.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.652+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b64094d60 con 0x7f4b44035a10 2024-02-18T16:22:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.652+0000 7f4b617fa640 1 -- 172.21.15.80:0/1554741688 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b64094d60 con 0x7f4b44035a10 2024-02-18T16:22:48.663 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 3 to deep-scrub 2024-02-18T16:22:48.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b44035a10 msgr2=0x7f4b44037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b44035a10 0x7f4b44037ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c007fd0 tx=0x7f4b4c007920 comp rx=0 tx=0).stop 2024-02-18T16:22:48.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 msgr2=0x7f4b641c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b641c34d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4b54019fa0 tx=0x7f4b5401abb0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 shutdown_connections 2024-02-18T16:22:48.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f4b44035a10 0x7f4b44037ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 --2- 172.21.15.80:0/1554741688 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b6412a1b0 0x7f4b641c34d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 >> 172.21.15.80:0/1554741688 conn(0x7f4b6409a0c0 msgr2=0x7f4b6412b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 shutdown_connections 2024-02-18T16:22:48.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.656+0000 7f4b6a4a9640 1 -- 172.21.15.80:0/1554741688 wait complete. 2024-02-18T16:22:48.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:22:48.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f855e2b9640 1 Processor -- start 2024-02-18T16:22:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f855e2b9640 1 -- start start 2024-02-18T16:22:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f855e2b9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8558098830 0x7f8558098c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f855e2b9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855809a490 con 0x7f8558099150 2024-02-18T16:22:48.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f855e2b9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8558072800 con 0x7f8558098830 2024-02-18T16:22:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8557fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8558098830 0x7f8558098c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f85577fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8558099150 0x7f8558096490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36688/0 (socket says 172.21.15.80:36688) 2024-02-18T16:22:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f85577fe640 1 -- 172.21.15.80:0/2545658682 learned_addr learned my addr 172.21.15.80:0/2545658682 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:22:48.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8557fff640 1 -- 172.21.15.80:0/2545658682 >> v1:172.21.15.80:6789/0 conn(0x7f8558099150 legacy=0x7f8558096490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8557fff640 1 -- 172.21.15.80:0/2545658682 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855809d790 con 0x7f8558098830 2024-02-18T16:22:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8556ffd640 1 -- 172.21.15.80:0/2545658682 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437861516 0 0) 0x7f855809a490 con 0x7f8558099150 2024-02-18T16:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8557fff640 1 --2- 172.21.15.80:0/2545658682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558098c10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f854c009740 tx=0x7f854c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0b4bfd41271146 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8556ffd640 1 -- 172.21.15.80:0/2545658682 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854c0ab530 con 0x7f8558098830 2024-02-18T16:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8556ffd640 1 -- 172.21.15.80:0/2545658682 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0a7050 con 0x7f8558098830 2024-02-18T16:22:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.792+0000 7f8556ffd640 1 -- 172.21.15.80:0/2545658682 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854c0ab7e0 con 0x7f8558098830 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2545658682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 msgr2=0x7f8558098c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 --2- 172.21.15.80:0/2545658682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558098c10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f854c009740 tx=0x7f854c01c370 comp rx=0 tx=0).stop 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2545658682 shutdown_connections 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 --2- 172.21.15.80:0/2545658682 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558098c10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2545658682 >> 172.21.15.80:0/2545658682 conn(0x7f85580a0920 msgr2=0x7f855809ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2545658682 shutdown_connections 2024-02-18T16:22:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2545658682 wait complete. 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 Processor -- start 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- start start 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558091420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855806c7e0 con 0x7f8558098830 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8557fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558091420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8557fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558091420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:53024/0 (socket says 172.21.15.80:53024) 2024-02-18T16:22:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8557fff640 1 -- 172.21.15.80:0/2742581009 learned_addr learned my addr 172.21.15.80:0/2742581009 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8557fff640 1 -- 172.21.15.80:0/2742581009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009420 con 0x7f8558098830 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8557fff640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558091420 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f854c019fa0 tx=0x7f854c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854c0b7450 con 0x7f8558098830 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0b75b0 con 0x7f8558098830 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85580720e0 con 0x7f8558098830 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854c0b7850 con 0x7f8558098830 2024-02-18T16:22:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855806caf0 con 0x7f8558098830 2024-02-18T16:22:48.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f854c0b79b0 con 0x7f8558098830 2024-02-18T16:22:48.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8558093fb0 con 0x7f8558098830 2024-02-18T16:22:48.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8554ff9640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8544035a10 0x7f8544037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:22:48.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f854c0e34e0 con 0x7f8558098830 2024-02-18T16:22:48.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.796+0000 7f85577fe640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8544035a10 0x7f8544037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:22:48.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.800+0000 7f85577fe640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8544035a10 0x7f8544037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8548007fd0 tx=0x7f8548007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:22:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.800+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f854c0c74e0 con 0x7f8558098830 2024-02-18T16:22:48.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.952+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8558126dd0 con 0x7f8544035a10 2024-02-18T16:22:49.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:48.996+0000 7f8554ff9640 1 -- 172.21.15.80:0/2742581009 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673669 (secure 0 0 0) 0x7f8558126dd0 con 0x7f8544035a10 2024-02-18T16:22:49.006 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:22:49.019 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:22:49.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8544035a10 msgr2=0x7f8544037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:49.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8544035a10 0x7f8544037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8548007fd0 tx=0x7f8548007980 comp rx=0 tx=0).stop 2024-02-18T16:22:49.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 msgr2=0x7f8558091420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558091420 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f854c019fa0 tx=0x7f854c01abb0 comp rx=0 tx=0).stop 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 shutdown_connections 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f8544035a10 0x7f8544037ed0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 --2- 172.21.15.80:0/2742581009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8558098830 0x7f8558091420 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 >> 172.21.15.80:0/2742581009 conn(0x7f85580a0920 msgr2=0x7f8558127c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 shutdown_connections 2024-02-18T16:22:49.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:22:49.004+0000 7f855e2b9640 1 -- 172.21.15.80:0/2742581009 wait complete. 2024-02-18T16:22:49.031 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-02-18T16:22:47.807040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3827,"num_read_kb":3470,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3687,"ondisk_log_size":3687,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-824,"num_objects":-16,"num_object_clones":0,"num_object_copies":-34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":196,"num_read_kb":191,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005980"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950367+0000","last_change":"2024-02-18T16:20:59.848322+0000","last_active":"2024-02-18T16:21:40.950367+0000","last_peered":"2024-02-18T16:21:40.950367+0000","last_clean":"2024-02-18T16:21:40.950367+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:21:40.950367+0000","last_undegraded":"2024-02-18T16:21:40.950367+0000","last_fullsized":"2024-02-18T16:21:40.950367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436673+0000","last_change":"2024-02-18T16:21:01.837422+0000","last_active":"2024-02-18T16:21:46.436673+0000","last_peered":"2024-02-18T16:21:46.436673+0000","last_clean":"2024-02-18T16:21:46.436673+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:21:46.436673+0000","last_undegraded":"2024-02-18T16:21:46.436673+0000","last_fullsized":"2024-02-18T16:21:46.436673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180695+0000","last_change":"2024-02-18T16:20:59.862127+0000","last_active":"2024-02-18T16:21:41.180695+0000","last_peered":"2024-02-18T16:21:41.180695+0000","last_clean":"2024-02-18T16:21:41.180695+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:21:41.180695+0000","last_undegraded":"2024-02-18T16:21:41.180695+0000","last_fullsized":"2024-02-18T16:21:41.180695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165685+0000","last_change":"2024-02-18T16:21:01.856123+0000","last_active":"2024-02-18T16:21:47.165685+0000","last_peered":"2024-02-18T16:21:47.165685+0000","last_clean":"2024-02-18T16:21:47.165685+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:21:47.165685+0000","last_undegraded":"2024-02-18T16:21:47.165685+0000","last_fullsized":"2024-02-18T16:21:47.165685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:42.640579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952271+0000","last_change":"2024-02-18T16:20:59.872708+0000","last_active":"2024-02-18T16:21:40.952271+0000","last_peered":"2024-02-18T16:21:40.952271+0000","last_clean":"2024-02-18T16:21:40.952271+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:21:40.952271+0000","last_undegraded":"2024-02-18T16:21:40.952271+0000","last_fullsized":"2024-02-18T16:21:40.952271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:12.199846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456931+0000","last_change":"2024-02-18T16:21:01.856474+0000","last_active":"2024-02-18T16:22:30.456931+0000","last_peered":"2024-02-18T16:22:30.456931+0000","last_clean":"2024-02-18T16:22:30.456931+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:22:30.456931+0000","last_undegraded":"2024-02-18T16:22:30.456931+0000","last_fullsized":"2024-02-18T16:22:30.456931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:13.748546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938237+0000","last_change":"2024-02-18T16:20:59.833010+0000","last_active":"2024-02-18T16:21:40.938237+0000","last_peered":"2024-02-18T16:21:40.938237+0000","last_clean":"2024-02-18T16:21:40.938237+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:21:40.938237+0000","last_undegraded":"2024-02-18T16:21:40.938237+0000","last_fullsized":"2024-02-18T16:21:40.938237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457019+0000","last_change":"2024-02-18T16:21:01.857441+0000","last_active":"2024-02-18T16:22:30.457019+0000","last_peered":"2024-02-18T16:22:30.457019+0000","last_clean":"2024-02-18T16:22:30.457019+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:22:30.457019+0000","last_undegraded":"2024-02-18T16:22:30.457019+0000","last_fullsized":"2024-02-18T16:22:30.457019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:02.458464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949134+0000","last_change":"2024-02-18T16:20:59.868597+0000","last_active":"2024-02-18T16:21:40.949134+0000","last_peered":"2024-02-18T16:21:40.949134+0000","last_clean":"2024-02-18T16:21:40.949134+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:21:40.949134+0000","last_undegraded":"2024-02-18T16:21:40.949134+0000","last_fullsized":"2024-02-18T16:21:40.949134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:31.249657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085312+0000","last_change":"2024-02-18T16:21:01.836895+0000","last_active":"2024-02-18T16:22:36.085312+0000","last_peered":"2024-02-18T16:22:36.085312+0000","last_clean":"2024-02-18T16:22:36.085312+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:22:36.085312+0000","last_undegraded":"2024-02-18T16:22:36.085312+0000","last_fullsized":"2024-02-18T16:22:36.085312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:15.712412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937535+0000","last_change":"2024-02-18T16:20:59.827833+0000","last_active":"2024-02-18T16:21:40.937535+0000","last_peered":"2024-02-18T16:21:40.937535+0000","last_clean":"2024-02-18T16:21:40.937535+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:21:40.937535+0000","last_undegraded":"2024-02-18T16:21:40.937535+0000","last_fullsized":"2024-02-18T16:21:40.937535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.868753+0000","last_change":"2024-02-18T16:21:01.856191+0000","last_active":"2024-02-18T16:21:47.868753+0000","last_peered":"2024-02-18T16:21:47.868753+0000","last_clean":"2024-02-18T16:21:47.868753+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:21:47.868753+0000","last_undegraded":"2024-02-18T16:21:47.868753+0000","last_fullsized":"2024-02-18T16:21:47.868753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:03.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.077672+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:36.077672+0000","last_peered":"2024-02-18T16:22:36.077672+0000","last_clean":"2024-02-18T16:22:36.077672+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:36.077672+0000","last_undegraded":"2024-02-18T16:22:36.077672+0000","last_fullsized":"2024-02-18T16:22:36.077672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:39:01.643786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'17","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085590+0000","last_change":"2024-02-18T16:21:01.831792+0000","last_active":"2024-02-18T16:22:36.085590+0000","last_peered":"2024-02-18T16:22:36.085590+0000","last_clean":"2024-02-18T16:22:36.085590+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:22:36.085590+0000","last_undegraded":"2024-02-18T16:22:36.085590+0000","last_fullsized":"2024-02-18T16:22:36.085590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174557+0000","last_change":"2024-02-18T16:20:59.851482+0000","last_active":"2024-02-18T16:21:41.174557+0000","last_peered":"2024-02-18T16:21:41.174557+0000","last_clean":"2024-02-18T16:21:41.174557+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:21:41.174557+0000","last_undegraded":"2024-02-18T16:21:41.174557+0000","last_fullsized":"2024-02-18T16:21:41.174557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871870+0000","last_change":"2024-02-18T16:21:01.845622+0000","last_active":"2024-02-18T16:21:46.871870+0000","last_peered":"2024-02-18T16:21:46.871870+0000","last_clean":"2024-02-18T16:21:46.871870+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:21:46.871870+0000","last_undegraded":"2024-02-18T16:21:46.871870+0000","last_fullsized":"2024-02-18T16:21:46.871870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471613+0000","last_change":"2024-02-18T16:21:01.852206+0000","last_active":"2024-02-18T16:22:30.471613+0000","last_peered":"2024-02-18T16:22:30.471613+0000","last_clean":"2024-02-18T16:22:30.471613+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:22:30.471613+0000","last_undegraded":"2024-02-18T16:22:30.471613+0000","last_fullsized":"2024-02-18T16:22:30.471613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:45.548759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946674+0000","last_change":"2024-02-18T16:20:59.861096+0000","last_active":"2024-02-18T16:21:40.946674+0000","last_peered":"2024-02-18T16:21:40.946674+0000","last_clean":"2024-02-18T16:21:40.946674+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:21:40.946674+0000","last_undegraded":"2024-02-18T16:21:40.946674+0000","last_fullsized":"2024-02-18T16:21:40.946674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457228+0000","last_change":"2024-02-18T16:21:01.833772+0000","last_active":"2024-02-18T16:22:30.457228+0000","last_peered":"2024-02-18T16:22:30.457228+0000","last_clean":"2024-02-18T16:22:30.457228+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:22:30.457228+0000","last_undegraded":"2024-02-18T16:22:30.457228+0000","last_fullsized":"2024-02-18T16:22:30.457228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954107+0000","last_change":"2024-02-18T16:20:59.858318+0000","last_active":"2024-02-18T16:21:40.954107+0000","last_peered":"2024-02-18T16:21:40.954107+0000","last_clean":"2024-02-18T16:21:40.954107+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:21:40.954107+0000","last_undegraded":"2024-02-18T16:21:40.954107+0000","last_fullsized":"2024-02-18T16:21:40.954107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085421+0000","last_change":"2024-02-18T16:21:01.848259+0000","last_active":"2024-02-18T16:22:36.085421+0000","last_peered":"2024-02-18T16:22:36.085421+0000","last_clean":"2024-02-18T16:22:36.085421+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:22:36.085421+0000","last_undegraded":"2024-02-18T16:22:36.085421+0000","last_fullsized":"2024-02-18T16:22:36.085421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.151295+0000","last_change":"2024-02-18T16:20:59.862404+0000","last_active":"2024-02-18T16:21:47.151295+0000","last_peered":"2024-02-18T16:21:47.151295+0000","last_clean":"2024-02-18T16:21:47.151295+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:21:47.151295+0000","last_undegraded":"2024-02-18T16:21:47.151295+0000","last_fullsized":"2024-02-18T16:21:47.151295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085319+0000","last_change":"2024-02-18T16:21:01.844448+0000","last_active":"2024-02-18T16:22:36.085319+0000","last_peered":"2024-02-18T16:22:36.085319+0000","last_clean":"2024-02-18T16:22:36.085319+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:22:36.085319+0000","last_undegraded":"2024-02-18T16:22:36.085319+0000","last_fullsized":"2024-02-18T16:22:36.085319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929557+0000","last_change":"2024-02-18T16:20:59.861087+0000","last_active":"2024-02-18T16:21:40.929557+0000","last_peered":"2024-02-18T16:21:40.929557+0000","last_clean":"2024-02-18T16:21:40.929557+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:21:40.929557+0000","last_undegraded":"2024-02-18T16:21:40.929557+0000","last_fullsized":"2024-02-18T16:21:40.929557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605978+0000","last_change":"2024-02-18T16:21:01.849052+0000","last_active":"2024-02-18T16:22:29.605978+0000","last_peered":"2024-02-18T16:22:29.605978+0000","last_clean":"2024-02-18T16:22:29.605978+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:22:29.605978+0000","last_undegraded":"2024-02-18T16:22:29.605978+0000","last_fullsized":"2024-02-18T16:22:29.605978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.157404+0000","last_change":"2024-02-18T16:20:59.860613+0000","last_active":"2024-02-18T16:21:47.157404+0000","last_peered":"2024-02-18T16:21:47.157404+0000","last_clean":"2024-02-18T16:21:47.157404+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:21:47.157404+0000","last_undegraded":"2024-02-18T16:21:47.157404+0000","last_fullsized":"2024-02-18T16:21:47.157404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085347+0000","last_change":"2024-02-18T16:21:01.838527+0000","last_active":"2024-02-18T16:22:36.085347+0000","last_peered":"2024-02-18T16:22:36.085347+0000","last_clean":"2024-02-18T16:22:36.085347+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:22:36.085347+0000","last_undegraded":"2024-02-18T16:22:36.085347+0000","last_fullsized":"2024-02-18T16:22:36.085347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:26.235100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940659+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:21:40.940659+0000","last_peered":"2024-02-18T16:21:40.940659+0000","last_clean":"2024-02-18T16:21:40.940659+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:21:40.940659+0000","last_undegraded":"2024-02-18T16:21:40.940659+0000","last_fullsized":"2024-02-18T16:21:40.940659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.743095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.071636+0000","last_change":"2024-02-18T16:21:09.915975+0000","last_active":"2024-02-18T16:22:36.071636+0000","last_peered":"2024-02-18T16:22:36.071636+0000","last_clean":"2024-02-18T16:22:36.071636+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:22:36.071636+0000","last_undegraded":"2024-02-18T16:22:36.071636+0000","last_fullsized":"2024-02-18T16:22:36.071636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:47.379422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605701+0000","last_change":"2024-02-18T16:21:01.853570+0000","last_active":"2024-02-18T16:22:29.605701+0000","last_peered":"2024-02-18T16:22:29.605701+0000","last_clean":"2024-02-18T16:22:29.605701+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:22:29.605701+0000","last_undegraded":"2024-02-18T16:22:29.605701+0000","last_fullsized":"2024-02-18T16:22:29.605701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:25.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.140958+0000","last_change":"2024-02-18T16:20:59.871560+0000","last_active":"2024-02-18T16:21:47.140958+0000","last_peered":"2024-02-18T16:21:47.140958+0000","last_clean":"2024-02-18T16:21:47.140958+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:21:47.140958+0000","last_undegraded":"2024-02-18T16:21:47.140958+0000","last_fullsized":"2024-02-18T16:21:47.140958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:22.719740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950984+0000","last_change":"2024-02-18T16:21:03.855757+0000","last_active":"2024-02-18T16:21:40.950984+0000","last_peered":"2024-02-18T16:21:40.950984+0000","last_clean":"2024-02-18T16:21:40.950984+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:21:40.950984+0000","last_undegraded":"2024-02-18T16:21:40.950984+0000","last_fullsized":"2024-02-18T16:21:40.950984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:32.293153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.407799+0000","last_change":"2024-02-18T16:21:05.901603+0000","last_active":"2024-02-18T16:22:30.407799+0000","last_peered":"2024-02-18T16:22:30.407799+0000","last_clean":"2024-02-18T16:22:30.407799+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:22:30.407799+0000","last_undegraded":"2024-02-18T16:22:30.407799+0000","last_fullsized":"2024-02-18T16:22:30.407799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:06:03.628864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946001+0000","last_change":"2024-02-18T16:21:07.918527+0000","last_active":"2024-02-18T16:21:40.946001+0000","last_peered":"2024-02-18T16:21:40.946001+0000","last_clean":"2024-02-18T16:21:40.946001+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:21:40.946001+0000","last_undegraded":"2024-02-18T16:21:40.946001+0000","last_fullsized":"2024-02-18T16:21:40.946001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.550475+0000","last_change":"2024-02-18T16:21:09.916272+0000","last_active":"2024-02-18T16:22:24.550475+0000","last_peered":"2024-02-18T16:22:24.550475+0000","last_clean":"2024-02-18T16:22:24.550475+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:22:24.550475+0000","last_undegraded":"2024-02-18T16:22:24.550475+0000","last_fullsized":"2024-02-18T16:22:24.550475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951709+0000","last_change":"2024-02-18T16:21:01.856905+0000","last_active":"2024-02-18T16:21:40.951709+0000","last_peered":"2024-02-18T16:21:40.951709+0000","last_clean":"2024-02-18T16:21:40.951709+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:21:40.951709+0000","last_undegraded":"2024-02-18T16:21:40.951709+0000","last_fullsized":"2024-02-18T16:21:40.951709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:29.356729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936829+0000","last_change":"2024-02-18T16:20:59.829726+0000","last_active":"2024-02-18T16:21:40.936829+0000","last_peered":"2024-02-18T16:21:40.936829+0000","last_clean":"2024-02-18T16:21:40.936829+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:21:40.936829+0000","last_undegraded":"2024-02-18T16:21:40.936829+0000","last_fullsized":"2024-02-18T16:21:40.936829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175923+0000","last_change":"2024-02-18T16:21:03.852211+0000","last_active":"2024-02-18T16:21:41.175923+0000","last_peered":"2024-02-18T16:21:41.175923+0000","last_clean":"2024-02-18T16:21:41.175923+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:21:41.175923+0000","last_undegraded":"2024-02-18T16:21:41.175923+0000","last_fullsized":"2024-02-18T16:21:41.175923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:26.567810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944532+0000","last_change":"2024-02-18T16:21:05.875530+0000","last_active":"2024-02-18T16:21:40.944532+0000","last_peered":"2024-02-18T16:21:40.944532+0000","last_clean":"2024-02-18T16:21:40.944532+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:21:40.944532+0000","last_undegraded":"2024-02-18T16:21:40.944532+0000","last_fullsized":"2024-02-18T16:21:40.944532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:31.379508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937157+0000","last_change":"2024-02-18T16:21:07.909691+0000","last_active":"2024-02-18T16:21:40.937157+0000","last_peered":"2024-02-18T16:21:40.937157+0000","last_clean":"2024-02-18T16:21:40.937157+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:21:40.937157+0000","last_undegraded":"2024-02-18T16:21:40.937157+0000","last_fullsized":"2024-02-18T16:21:40.937157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173888+0000","last_change":"2024-02-18T16:21:09.926133+0000","last_active":"2024-02-18T16:21:41.173888+0000","last_peered":"2024-02-18T16:21:41.173888+0000","last_clean":"2024-02-18T16:21:41.173888+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:21:41.173888+0000","last_undegraded":"2024-02-18T16:21:41.173888+0000","last_fullsized":"2024-02-18T16:21:41.173888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098429+0000","last_change":"2024-02-18T16:21:41.176291+0000","last_active":"2024-02-18T16:22:36.098429+0000","last_peered":"2024-02-18T16:22:36.098429+0000","last_clean":"2024-02-18T16:22:36.098429+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:22:36.098429+0000","last_undegraded":"2024-02-18T16:22:36.098429+0000","last_fullsized":"2024-02-18T16:22:36.098429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:36.303877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933821+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:21:40.933821+0000","last_peered":"2024-02-18T16:21:40.933821+0000","last_clean":"2024-02-18T16:21:40.933821+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:21:40.933821+0000","last_undegraded":"2024-02-18T16:21:40.933821+0000","last_fullsized":"2024-02-18T16:21:40.933821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:46:08.501321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956515+0000","last_change":"2024-02-18T16:21:40.955018+0000","last_active":"2024-02-18T16:21:40.956515+0000","last_peered":"2024-02-18T16:21:40.956515+0000","last_clean":"2024-02-18T16:21:40.956515+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:21:40.956515+0000","last_undegraded":"2024-02-18T16:21:40.956515+0000","last_fullsized":"2024-02-18T16:21:40.956515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:41.335446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937307+0000","last_change":"2024-02-18T16:21:05.895213+0000","last_active":"2024-02-18T16:21:40.937307+0000","last_peered":"2024-02-18T16:21:40.937307+0000","last_clean":"2024-02-18T16:21:40.937307+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:21:40.937307+0000","last_undegraded":"2024-02-18T16:21:40.937307+0000","last_fullsized":"2024-02-18T16:21:40.937307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:22.737750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'242","reported_seq":307,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.854700+0000","last_change":"2024-02-18T16:21:07.917843+0000","last_active":"2024-02-18T16:22:43.854700+0000","last_peered":"2024-02-18T16:22:43.854700+0000","last_clean":"2024-02-18T16:22:43.854700+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:22:43.854700+0000","last_undegraded":"2024-02-18T16:22:43.854700+0000","last_fullsized":"2024-02-18T16:22:43.854700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:42:39.457576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936747+0000","last_change":"2024-02-18T16:21:09.929317+0000","last_active":"2024-02-18T16:21:40.936747+0000","last_peered":"2024-02-18T16:21:40.936747+0000","last_clean":"2024-02-18T16:21:40.936747+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:21:40.936747+0000","last_undegraded":"2024-02-18T16:21:40.936747+0000","last_fullsized":"2024-02-18T16:21:40.936747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:22:09.795840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183777+0000","last_change":"2024-02-18T16:21:01.841643+0000","last_active":"2024-02-18T16:21:41.183777+0000","last_peered":"2024-02-18T16:21:41.183777+0000","last_clean":"2024-02-18T16:21:41.183777+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:21:41.183777+0000","last_undegraded":"2024-02-18T16:21:41.183777+0000","last_fullsized":"2024-02-18T16:21:41.183777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927879+0000","last_change":"2024-02-18T16:20:59.860132+0000","last_active":"2024-02-18T16:21:40.927879+0000","last_peered":"2024-02-18T16:21:40.927879+0000","last_clean":"2024-02-18T16:21:40.927879+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:21:40.927879+0000","last_undegraded":"2024-02-18T16:21:40.927879+0000","last_fullsized":"2024-02-18T16:21:40.927879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:46:23.673530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.960144+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:21:40.960144+0000","last_peered":"2024-02-18T16:21:40.960144+0000","last_clean":"2024-02-18T16:21:40.960144+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:21:40.960144+0000","last_undegraded":"2024-02-18T16:21:40.960144+0000","last_fullsized":"2024-02-18T16:21:40.960144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:24.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.399232+0000","last_change":"2024-02-18T16:21:05.888007+0000","last_active":"2024-02-18T16:22:30.399232+0000","last_peered":"2024-02-18T16:22:30.399232+0000","last_clean":"2024-02-18T16:22:30.399232+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:30.399232+0000","last_undegraded":"2024-02-18T16:22:30.399232+0000","last_fullsized":"2024-02-18T16:22:30.399232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:15.657774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.307880+0000","last_change":"2024-02-18T16:21:07.907499+0000","last_active":"2024-02-18T16:22:36.307880+0000","last_peered":"2024-02-18T16:22:36.307880+0000","last_clean":"2024-02-18T16:22:36.307880+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:22:36.307880+0000","last_undegraded":"2024-02-18T16:22:36.307880+0000","last_fullsized":"2024-02-18T16:22:36.307880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936628+0000","last_change":"2024-02-18T16:21:01.852914+0000","last_active":"2024-02-18T16:21:40.936628+0000","last_peered":"2024-02-18T16:21:40.936628+0000","last_clean":"2024-02-18T16:21:40.936628+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:21:40.936628+0000","last_undegraded":"2024-02-18T16:21:40.936628+0000","last_fullsized":"2024-02-18T16:21:40.936628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:11:11.629778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948658+0000","last_change":"2024-02-18T16:20:59.835343+0000","last_active":"2024-02-18T16:21:40.948658+0000","last_peered":"2024-02-18T16:21:40.948658+0000","last_clean":"2024-02-18T16:21:40.948658+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:21:40.948658+0000","last_undegraded":"2024-02-18T16:21:40.948658+0000","last_fullsized":"2024-02-18T16:21:40.948658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928167+0000","last_change":"2024-02-18T16:21:03.865004+0000","last_active":"2024-02-18T16:21:40.928167+0000","last_peered":"2024-02-18T16:21:40.928167+0000","last_clean":"2024-02-18T16:21:40.928167+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:21:40.928167+0000","last_undegraded":"2024-02-18T16:21:40.928167+0000","last_fullsized":"2024-02-18T16:21:40.928167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:19:00.973310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.415467+0000","last_change":"2024-02-18T16:21:05.885363+0000","last_active":"2024-02-18T16:22:30.415467+0000","last_peered":"2024-02-18T16:22:30.415467+0000","last_clean":"2024-02-18T16:22:30.415467+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:22:30.415467+0000","last_undegraded":"2024-02-18T16:22:30.415467+0000","last_fullsized":"2024-02-18T16:22:30.415467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:15.677159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177269+0000","last_change":"2024-02-18T16:21:07.907548+0000","last_active":"2024-02-18T16:21:41.177269+0000","last_peered":"2024-02-18T16:21:41.177269+0000","last_clean":"2024-02-18T16:21:41.177269+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:21:41.177269+0000","last_undegraded":"2024-02-18T16:21:41.177269+0000","last_fullsized":"2024-02-18T16:21:41.177269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:36.323096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.170197+0000","last_change":"2024-02-18T16:21:09.918869+0000","last_active":"2024-02-18T16:22:30.170197+0000","last_peered":"2024-02-18T16:22:30.170197+0000","last_clean":"2024-02-18T16:22:30.170197+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:22:30.170197+0000","last_undegraded":"2024-02-18T16:22:30.170197+0000","last_fullsized":"2024-02-18T16:22:30.170197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:04.707222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929560+0000","last_change":"2024-02-18T16:21:01.843254+0000","last_active":"2024-02-18T16:21:40.929560+0000","last_peered":"2024-02-18T16:21:40.929560+0000","last_clean":"2024-02-18T16:21:40.929560+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:21:40.929560+0000","last_undegraded":"2024-02-18T16:21:40.929560+0000","last_fullsized":"2024-02-18T16:21:40.929560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:15.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946541+0000","last_change":"2024-02-18T16:20:59.832949+0000","last_active":"2024-02-18T16:21:40.946541+0000","last_peered":"2024-02-18T16:21:40.946541+0000","last_clean":"2024-02-18T16:21:40.946541+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:21:40.946541+0000","last_undegraded":"2024-02-18T16:21:40.946541+0000","last_fullsized":"2024-02-18T16:21:40.946541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174581+0000","last_change":"2024-02-18T16:21:03.866038+0000","last_active":"2024-02-18T16:21:41.174581+0000","last_peered":"2024-02-18T16:21:41.174581+0000","last_clean":"2024-02-18T16:21:41.174581+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:21:41.174581+0000","last_undegraded":"2024-02-18T16:21:41.174581+0000","last_fullsized":"2024-02-18T16:21:41.174581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:03:20.723354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.475520+0000","last_change":"2024-02-18T16:21:05.902821+0000","last_active":"2024-02-18T16:22:30.475520+0000","last_peered":"2024-02-18T16:22:30.475520+0000","last_clean":"2024-02-18T16:22:30.475520+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:22:30.475520+0000","last_undegraded":"2024-02-18T16:22:30.475520+0000","last_fullsized":"2024-02-18T16:22:30.475520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:10:54.114055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176144+0000","last_change":"2024-02-18T16:21:07.896519+0000","last_active":"2024-02-18T16:21:41.176144+0000","last_peered":"2024-02-18T16:21:41.176144+0000","last_clean":"2024-02-18T16:21:41.176144+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:21:41.176144+0000","last_undegraded":"2024-02-18T16:21:41.176144+0000","last_fullsized":"2024-02-18T16:21:41.176144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:10:02.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.400852+0000","last_change":"2024-02-18T16:21:09.931902+0000","last_active":"2024-02-18T16:22:24.400852+0000","last_peered":"2024-02-18T16:22:24.400852+0000","last_clean":"2024-02-18T16:22:24.400852+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:22:24.400852+0000","last_undegraded":"2024-02-18T16:22:24.400852+0000","last_fullsized":"2024-02-18T16:22:24.400852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.164976+0000","last_change":"2024-02-18T16:21:01.851100+0000","last_active":"2024-02-18T16:21:47.164976+0000","last_peered":"2024-02-18T16:21:47.164976+0000","last_clean":"2024-02-18T16:21:47.164976+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:21:47.164976+0000","last_undegraded":"2024-02-18T16:21:47.164976+0000","last_fullsized":"2024-02-18T16:21:47.164976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:34.686883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.393724+0000","last_change":"2024-02-18T16:20:59.873014+0000","last_active":"2024-02-18T16:21:46.393724+0000","last_peered":"2024-02-18T16:21:46.393724+0000","last_clean":"2024-02-18T16:21:46.393724+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:21:46.393724+0000","last_undegraded":"2024-02-18T16:21:46.393724+0000","last_fullsized":"2024-02-18T16:21:46.393724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:07:13.577731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176424+0000","last_change":"2024-02-18T16:21:03.860965+0000","last_active":"2024-02-18T16:21:41.176424+0000","last_peered":"2024-02-18T16:21:41.176424+0000","last_clean":"2024-02-18T16:21:41.176424+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:21:41.176424+0000","last_undegraded":"2024-02-18T16:21:41.176424+0000","last_fullsized":"2024-02-18T16:21:41.176424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:49:52.683114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.418535+0000","last_change":"2024-02-18T16:21:05.886545+0000","last_active":"2024-02-18T16:22:30.418535+0000","last_peered":"2024-02-18T16:22:30.418535+0000","last_clean":"2024-02-18T16:22:30.418535+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:30.418535+0000","last_undegraded":"2024-02-18T16:22:30.418535+0000","last_fullsized":"2024-02-18T16:22:30.418535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:42.523543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.309717+0000","last_change":"2024-02-18T16:21:07.901321+0000","last_active":"2024-02-18T16:22:36.309717+0000","last_peered":"2024-02-18T16:22:36.309717+0000","last_clean":"2024-02-18T16:22:36.309717+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:36.309717+0000","last_undegraded":"2024-02-18T16:22:36.309717+0000","last_fullsized":"2024-02-18T16:22:36.309717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179560+0000","last_change":"2024-02-18T16:21:09.926915+0000","last_active":"2024-02-18T16:21:41.179560+0000","last_peered":"2024-02-18T16:21:41.179560+0000","last_clean":"2024-02-18T16:21:41.179560+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:21:41.179560+0000","last_undegraded":"2024-02-18T16:21:41.179560+0000","last_fullsized":"2024-02-18T16:21:41.179560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:45.424448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165040+0000","last_change":"2024-02-18T16:21:01.837388+0000","last_active":"2024-02-18T16:21:47.165040+0000","last_peered":"2024-02-18T16:21:47.165040+0000","last_clean":"2024-02-18T16:21:47.165040+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:21:47.165040+0000","last_undegraded":"2024-02-18T16:21:47.165040+0000","last_fullsized":"2024-02-18T16:21:47.165040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:54.957691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951017+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:21:40.951017+0000","last_peered":"2024-02-18T16:21:40.951017+0000","last_clean":"2024-02-18T16:21:40.951017+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:21:40.951017+0000","last_undegraded":"2024-02-18T16:21:40.951017+0000","last_fullsized":"2024-02-18T16:21:40.951017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:50.834394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174589+0000","last_change":"2024-02-18T16:21:03.871286+0000","last_active":"2024-02-18T16:21:41.174589+0000","last_peered":"2024-02-18T16:21:41.174589+0000","last_clean":"2024-02-18T16:21:41.174589+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:21:41.174589+0000","last_undegraded":"2024-02-18T16:21:41.174589+0000","last_fullsized":"2024-02-18T16:21:41.174589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:42.607662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.031258+0000","last_change":"2024-02-18T16:21:05.901392+0000","last_active":"2024-02-18T16:22:36.031258+0000","last_peered":"2024-02-18T16:22:36.031258+0000","last_clean":"2024-02-18T16:22:36.031258+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:22:36.031258+0000","last_undegraded":"2024-02-18T16:22:36.031258+0000","last_fullsized":"2024-02-18T16:22:36.031258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:17:42.330964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174155+0000","last_change":"2024-02-18T16:21:07.899232+0000","last_active":"2024-02-18T16:21:41.174155+0000","last_peered":"2024-02-18T16:21:41.174155+0000","last_clean":"2024-02-18T16:21:41.174155+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:21:41.174155+0000","last_undegraded":"2024-02-18T16:21:41.174155+0000","last_fullsized":"2024-02-18T16:21:41.174155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182379+0000","last_change":"2024-02-18T16:21:09.901860+0000","last_active":"2024-02-18T16:21:41.182379+0000","last_peered":"2024-02-18T16:21:41.182379+0000","last_clean":"2024-02-18T16:21:41.182379+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:21:41.182379+0000","last_undegraded":"2024-02-18T16:21:41.182379+0000","last_fullsized":"2024-02-18T16:21:41.182379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:12:00.287324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955531+0000","last_change":"2024-02-18T16:21:40.945387+0000","last_active":"2024-02-18T16:21:40.955531+0000","last_peered":"2024-02-18T16:21:40.955531+0000","last_clean":"2024-02-18T16:21:40.955531+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:21:40.955531+0000","last_undegraded":"2024-02-18T16:21:40.955531+0000","last_fullsized":"2024-02-18T16:21:40.955531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:56.813772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176709+0000","last_change":"2024-02-18T16:20:59.857151+0000","last_active":"2024-02-18T16:21:41.176709+0000","last_peered":"2024-02-18T16:21:41.176709+0000","last_clean":"2024-02-18T16:21:41.176709+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:21:41.176709+0000","last_undegraded":"2024-02-18T16:21:41.176709+0000","last_fullsized":"2024-02-18T16:21:41.176709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:16:45.887795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941688+0000","last_change":"2024-02-18T16:21:03.858681+0000","last_active":"2024-02-18T16:21:40.941688+0000","last_peered":"2024-02-18T16:21:40.941688+0000","last_clean":"2024-02-18T16:21:40.941688+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:21:40.941688+0000","last_undegraded":"2024-02-18T16:21:40.941688+0000","last_fullsized":"2024-02-18T16:21:40.941688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:12.798570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.388713+0000","last_change":"2024-02-18T16:21:05.883774+0000","last_active":"2024-02-18T16:22:30.388713+0000","last_peered":"2024-02-18T16:22:30.388713+0000","last_clean":"2024-02-18T16:22:30.388713+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:30.388713+0000","last_undegraded":"2024-02-18T16:22:30.388713+0000","last_fullsized":"2024-02-18T16:22:30.388713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:03.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954455+0000","last_change":"2024-02-18T16:21:07.917345+0000","last_active":"2024-02-18T16:21:40.954455+0000","last_peered":"2024-02-18T16:21:40.954455+0000","last_clean":"2024-02-18T16:21:40.954455+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:21:40.954455+0000","last_undegraded":"2024-02-18T16:21:40.954455+0000","last_fullsized":"2024-02-18T16:21:40.954455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:07:30.025216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931965+0000","last_change":"2024-02-18T16:21:09.920227+0000","last_active":"2024-02-18T16:21:40.931965+0000","last_peered":"2024-02-18T16:21:40.931965+0000","last_clean":"2024-02-18T16:21:40.931965+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:21:40.931965+0000","last_undegraded":"2024-02-18T16:21:40.931965+0000","last_fullsized":"2024-02-18T16:21:40.931965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:48:17.637183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457048+0000","last_change":"2024-02-18T16:21:01.858118+0000","last_active":"2024-02-18T16:22:30.457048+0000","last_peered":"2024-02-18T16:22:30.457048+0000","last_clean":"2024-02-18T16:22:30.457048+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:30.457048+0000","last_undegraded":"2024-02-18T16:22:30.457048+0000","last_fullsized":"2024-02-18T16:22:30.457048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:17.368689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947140+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:21:40.947140+0000","last_peered":"2024-02-18T16:21:40.947140+0000","last_clean":"2024-02-18T16:21:40.947140+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:21:40.947140+0000","last_undegraded":"2024-02-18T16:21:40.947140+0000","last_fullsized":"2024-02-18T16:21:40.947140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:24.038884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176422+0000","last_change":"2024-02-18T16:21:03.865714+0000","last_active":"2024-02-18T16:21:41.176422+0000","last_peered":"2024-02-18T16:21:41.176422+0000","last_clean":"2024-02-18T16:21:41.176422+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:21:41.176422+0000","last_undegraded":"2024-02-18T16:21:41.176422+0000","last_fullsized":"2024-02-18T16:21:41.176422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:14.663950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.434437+0000","last_change":"2024-02-18T16:21:05.875396+0000","last_active":"2024-02-18T16:22:30.434437+0000","last_peered":"2024-02-18T16:22:30.434437+0000","last_clean":"2024-02-18T16:22:30.434437+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:22:30.434437+0000","last_undegraded":"2024-02-18T16:22:30.434437+0000","last_fullsized":"2024-02-18T16:22:30.434437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:46.668575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'242","reported_seq":323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.856744+0000","last_change":"2024-02-18T16:21:07.904059+0000","last_active":"2024-02-18T16:22:43.856744+0000","last_peered":"2024-02-18T16:22:43.856744+0000","last_clean":"2024-02-18T16:22:43.856744+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:43.856744+0000","last_undegraded":"2024-02-18T16:22:43.856744+0000","last_fullsized":"2024-02-18T16:22:43.856744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:40.559228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.477263+0000","last_change":"2024-02-18T16:21:09.901476+0000","last_active":"2024-02-18T16:22:30.477263+0000","last_peered":"2024-02-18T16:22:30.477263+0000","last_clean":"2024-02-18T16:22:30.477263+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:22:30.477263+0000","last_undegraded":"2024-02-18T16:22:30.477263+0000","last_fullsized":"2024-02-18T16:22:30.477263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:21.092939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.606451+0000","last_change":"2024-02-18T16:21:01.854526+0000","last_active":"2024-02-18T16:22:29.606451+0000","last_peered":"2024-02-18T16:22:29.606451+0000","last_clean":"2024-02-18T16:22:29.606451+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:22:29.606451+0000","last_undegraded":"2024-02-18T16:22:29.606451+0000","last_fullsized":"2024-02-18T16:22:29.606451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940406+0000","last_change":"2024-02-18T16:20:59.863525+0000","last_active":"2024-02-18T16:21:40.940406+0000","last_peered":"2024-02-18T16:21:40.940406+0000","last_clean":"2024-02-18T16:21:40.940406+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:21:40.940406+0000","last_undegraded":"2024-02-18T16:21:40.940406+0000","last_fullsized":"2024-02-18T16:21:40.940406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:40.125913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":529,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.846721+0000","last_change":"2024-02-18T16:21:03.865047+0000","last_active":"2024-02-18T16:22:43.846721+0000","last_peered":"2024-02-18T16:22:43.846721+0000","last_clean":"2024-02-18T16:22:43.846721+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:22:43.846721+0000","last_undegraded":"2024-02-18T16:22:43.846721+0000","last_fullsized":"2024-02-18T16:22:43.846721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:27.693710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":581,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953466+0000","last_change":"2024-02-18T16:21:05.901561+0000","last_active":"2024-02-18T16:21:40.953466+0000","last_peered":"2024-02-18T16:21:40.953466+0000","last_clean":"2024-02-18T16:21:40.953466+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:21:40.953466+0000","last_undegraded":"2024-02-18T16:21:40.953466+0000","last_fullsized":"2024-02-18T16:21:40.953466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:37.955679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'242","reported_seq":354,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.859159+0000","last_change":"2024-02-18T16:21:07.894723+0000","last_active":"2024-02-18T16:22:43.859159+0000","last_peered":"2024-02-18T16:22:43.859159+0000","last_clean":"2024-02-18T16:22:43.859159+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:43.859159+0000","last_undegraded":"2024-02-18T16:22:43.859159+0000","last_fullsized":"2024-02-18T16:22:43.859159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:29.456393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939087+0000","last_change":"2024-02-18T16:21:09.907248+0000","last_active":"2024-02-18T16:21:40.939087+0000","last_peered":"2024-02-18T16:21:40.939087+0000","last_clean":"2024-02-18T16:21:40.939087+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:21:40.939087+0000","last_undegraded":"2024-02-18T16:21:40.939087+0000","last_fullsized":"2024-02-18T16:21:40.939087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:20.642816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947627+0000","last_change":"2024-02-18T16:21:01.845972+0000","last_active":"2024-02-18T16:21:40.947627+0000","last_peered":"2024-02-18T16:21:40.947627+0000","last_clean":"2024-02-18T16:21:40.947627+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:21:40.947627+0000","last_undegraded":"2024-02-18T16:21:40.947627+0000","last_fullsized":"2024-02-18T16:21:40.947627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:21:09.332475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934644+0000","last_change":"2024-02-18T16:20:59.866261+0000","last_active":"2024-02-18T16:21:40.934644+0000","last_peered":"2024-02-18T16:21:40.934644+0000","last_clean":"2024-02-18T16:21:40.934644+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:21:40.934644+0000","last_undegraded":"2024-02-18T16:21:40.934644+0000","last_fullsized":"2024-02-18T16:21:40.934644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:49.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953511+0000","last_change":"2024-02-18T16:21:03.857468+0000","last_active":"2024-02-18T16:21:40.953511+0000","last_peered":"2024-02-18T16:21:40.953511+0000","last_clean":"2024-02-18T16:21:40.953511+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:21:40.953511+0000","last_undegraded":"2024-02-18T16:21:40.953511+0000","last_fullsized":"2024-02-18T16:21:40.953511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:57.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.409997+0000","last_change":"2024-02-18T16:21:05.883765+0000","last_active":"2024-02-18T16:22:30.409997+0000","last_peered":"2024-02-18T16:22:30.409997+0000","last_clean":"2024-02-18T16:22:30.409997+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:30.409997+0000","last_undegraded":"2024-02-18T16:22:30.409997+0000","last_fullsized":"2024-02-18T16:22:30.409997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:38.527945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936924+0000","last_change":"2024-02-18T16:21:07.900271+0000","last_active":"2024-02-18T16:21:40.936924+0000","last_peered":"2024-02-18T16:21:40.936924+0000","last_clean":"2024-02-18T16:21:40.936924+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:21:40.936924+0000","last_undegraded":"2024-02-18T16:21:40.936924+0000","last_fullsized":"2024-02-18T16:21:40.936924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:55:23.412232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929089+0000","last_change":"2024-02-18T16:21:09.921128+0000","last_active":"2024-02-18T16:21:40.929089+0000","last_peered":"2024-02-18T16:21:40.929089+0000","last_clean":"2024-02-18T16:21:40.929089+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:21:40.929089+0000","last_undegraded":"2024-02-18T16:21:40.929089+0000","last_fullsized":"2024-02-18T16:21:40.929089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:50:44.361454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085664+0000","last_change":"2024-02-18T16:21:01.857176+0000","last_active":"2024-02-18T16:22:36.085664+0000","last_peered":"2024-02-18T16:22:36.085664+0000","last_clean":"2024-02-18T16:22:36.085664+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:22:36.085664+0000","last_undegraded":"2024-02-18T16:22:36.085664+0000","last_fullsized":"2024-02-18T16:22:36.085664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:50:56.586473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927237+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:21:40.927237+0000","last_peered":"2024-02-18T16:21:40.927237+0000","last_clean":"2024-02-18T16:21:40.927237+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:21:40.927237+0000","last_undegraded":"2024-02-18T16:21:40.927237+0000","last_fullsized":"2024-02-18T16:21:40.927237+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:37.088141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949389+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:21:40.949389+0000","last_peered":"2024-02-18T16:21:40.949389+0000","last_clean":"2024-02-18T16:21:40.949389+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:21:40.949389+0000","last_undegraded":"2024-02-18T16:21:40.949389+0000","last_fullsized":"2024-02-18T16:21:40.949389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:58:17.643534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939942+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:21:40.939942+0000","last_peered":"2024-02-18T16:21:40.939942+0000","last_clean":"2024-02-18T16:21:40.939942+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:21:40.939942+0000","last_undegraded":"2024-02-18T16:21:40.939942+0000","last_fullsized":"2024-02-18T16:21:40.939942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:33.884874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930956+0000","last_change":"2024-02-18T16:21:03.862227+0000","last_active":"2024-02-18T16:21:40.930956+0000","last_peered":"2024-02-18T16:21:40.930956+0000","last_clean":"2024-02-18T16:21:40.930956+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:21:40.930956+0000","last_undegraded":"2024-02-18T16:21:40.930956+0000","last_fullsized":"2024-02-18T16:21:40.930956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:32:05.466118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'70","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.054236+0000","last_change":"2024-02-18T16:21:05.897156+0000","last_active":"2024-02-18T16:22:36.054236+0000","last_peered":"2024-02-18T16:22:36.054236+0000","last_clean":"2024-02-18T16:22:36.054236+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:22:36.054236+0000","last_undegraded":"2024-02-18T16:22:36.054236+0000","last_fullsized":"2024-02-18T16:22:36.054236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:44:22.601995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179893+0000","last_change":"2024-02-18T16:21:07.900898+0000","last_active":"2024-02-18T16:21:41.179893+0000","last_peered":"2024-02-18T16:21:41.179893+0000","last_clean":"2024-02-18T16:21:41.179893+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:21:41.179893+0000","last_undegraded":"2024-02-18T16:21:41.179893+0000","last_fullsized":"2024-02-18T16:21:41.179893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:59:15.395075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.103257+0000","last_change":"2024-02-18T16:21:09.898538+0000","last_active":"2024-02-18T16:22:36.103257+0000","last_peered":"2024-02-18T16:22:36.103257+0000","last_clean":"2024-02-18T16:22:36.103257+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:36.103257+0000","last_undegraded":"2024-02-18T16:22:36.103257+0000","last_fullsized":"2024-02-18T16:22:36.103257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:33.080540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955558+0000","last_change":"2024-02-18T16:21:01.853487+0000","last_active":"2024-02-18T16:21:40.955558+0000","last_peered":"2024-02-18T16:21:40.955558+0000","last_clean":"2024-02-18T16:21:40.955558+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:21:40.955558+0000","last_undegraded":"2024-02-18T16:21:40.955558+0000","last_fullsized":"2024-02-18T16:21:40.955558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:51.840069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933083+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:21:40.933083+0000","last_peered":"2024-02-18T16:21:40.933083+0000","last_clean":"2024-02-18T16:21:40.933083+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:21:40.933083+0000","last_undegraded":"2024-02-18T16:21:40.933083+0000","last_fullsized":"2024-02-18T16:21:40.933083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:05:58.537300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174299+0000","last_change":"2024-02-18T16:20:59.848482+0000","last_active":"2024-02-18T16:21:41.174299+0000","last_peered":"2024-02-18T16:21:41.174299+0000","last_clean":"2024-02-18T16:21:41.174299+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:21:41.174299+0000","last_undegraded":"2024-02-18T16:21:41.174299+0000","last_fullsized":"2024-02-18T16:21:41.174299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954843+0000","last_change":"2024-02-18T16:21:03.853258+0000","last_active":"2024-02-18T16:21:40.954843+0000","last_peered":"2024-02-18T16:21:40.954843+0000","last_clean":"2024-02-18T16:21:40.954843+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:21:40.954843+0000","last_undegraded":"2024-02-18T16:21:40.954843+0000","last_fullsized":"2024-02-18T16:21:40.954843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:43:34.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'240","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.869988+0000","last_change":"2024-02-18T16:21:05.900069+0000","last_active":"2024-02-18T16:22:43.869988+0000","last_peered":"2024-02-18T16:22:43.869988+0000","last_clean":"2024-02-18T16:22:43.869988+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:43.869988+0000","last_undegraded":"2024-02-18T16:22:43.869988+0000","last_fullsized":"2024-02-18T16:22:43.869988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:29:44.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":318,"num_read_kb":303,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950461+0000","last_change":"2024-02-18T16:21:07.915843+0000","last_active":"2024-02-18T16:21:40.950461+0000","last_peered":"2024-02-18T16:21:40.950461+0000","last_clean":"2024-02-18T16:21:40.950461+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:21:40.950461+0000","last_undegraded":"2024-02-18T16:21:40.950461+0000","last_fullsized":"2024-02-18T16:21:40.950461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:32:30.258086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.566050+0000","last_change":"2024-02-18T16:21:09.927419+0000","last_active":"2024-02-18T16:22:24.566050+0000","last_peered":"2024-02-18T16:22:24.566050+0000","last_clean":"2024-02-18T16:22:24.566050+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:22:24.566050+0000","last_undegraded":"2024-02-18T16:22:24.566050+0000","last_fullsized":"2024-02-18T16:22:24.566050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:21.437890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.855571+0000","last_change":"2024-02-18T16:21:01.846415+0000","last_active":"2024-02-18T16:21:47.855571+0000","last_peered":"2024-02-18T16:21:47.855571+0000","last_clean":"2024-02-18T16:21:47.855571+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:21:47.855571+0000","last_undegraded":"2024-02-18T16:21:47.855571+0000","last_fullsized":"2024-02-18T16:21:47.855571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936337+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:21:40.936337+0000","last_peered":"2024-02-18T16:21:40.936337+0000","last_clean":"2024-02-18T16:21:40.936337+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:21:40.936337+0000","last_undegraded":"2024-02-18T16:21:40.936337+0000","last_fullsized":"2024-02-18T16:21:40.936337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:43.102493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173554+0000","last_change":"2024-02-18T16:20:59.850718+0000","last_active":"2024-02-18T16:21:41.173554+0000","last_peered":"2024-02-18T16:21:41.173554+0000","last_clean":"2024-02-18T16:21:41.173554+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:21:41.173554+0000","last_undegraded":"2024-02-18T16:21:41.173554+0000","last_fullsized":"2024-02-18T16:21:41.173554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945273+0000","last_change":"2024-02-18T16:21:03.854140+0000","last_active":"2024-02-18T16:21:40.945273+0000","last_peered":"2024-02-18T16:21:40.945273+0000","last_clean":"2024-02-18T16:21:40.945273+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:21:40.945273+0000","last_undegraded":"2024-02-18T16:21:40.945273+0000","last_fullsized":"2024-02-18T16:21:40.945273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:45.475648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:34.003316+0000","last_change":"2024-02-18T16:21:05.883106+0000","last_active":"2024-02-18T16:22:34.003316+0000","last_peered":"2024-02-18T16:22:34.003316+0000","last_clean":"2024-02-18T16:22:34.003316+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:22:34.003316+0000","last_undegraded":"2024-02-18T16:22:34.003316+0000","last_fullsized":"2024-02-18T16:22:34.003316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:49.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176697+0000","last_change":"2024-02-18T16:21:07.901039+0000","last_active":"2024-02-18T16:21:41.176697+0000","last_peered":"2024-02-18T16:21:41.176697+0000","last_clean":"2024-02-18T16:21:41.176697+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:21:41.176697+0000","last_undegraded":"2024-02-18T16:21:41.176697+0000","last_fullsized":"2024-02-18T16:21:41.176697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:12.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946747+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:21:40.946747+0000","last_peered":"2024-02-18T16:21:40.946747+0000","last_clean":"2024-02-18T16:21:40.946747+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:21:40.946747+0000","last_undegraded":"2024-02-18T16:21:40.946747+0000","last_fullsized":"2024-02-18T16:21:40.946747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:15.833558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179127+0000","last_change":"2024-02-18T16:21:01.841136+0000","last_active":"2024-02-18T16:21:41.179127+0000","last_peered":"2024-02-18T16:21:41.179127+0000","last_clean":"2024-02-18T16:21:41.179127+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:21:41.179127+0000","last_undegraded":"2024-02-18T16:21:41.179127+0000","last_fullsized":"2024-02-18T16:21:41.179127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939268+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:21:40.939268+0000","last_peered":"2024-02-18T16:21:40.939268+0000","last_clean":"2024-02-18T16:21:40.939268+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:21:40.939268+0000","last_undegraded":"2024-02-18T16:21:40.939268+0000","last_fullsized":"2024-02-18T16:21:40.939268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:28:03.856941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939793+0000","last_change":"2024-02-18T16:20:59.855189+0000","last_active":"2024-02-18T16:21:40.939793+0000","last_peered":"2024-02-18T16:21:40.939793+0000","last_clean":"2024-02-18T16:21:40.939793+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:21:40.939793+0000","last_undegraded":"2024-02-18T16:21:40.939793+0000","last_fullsized":"2024-02-18T16:21:40.939793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179358+0000","last_change":"2024-02-18T16:21:03.858464+0000","last_active":"2024-02-18T16:21:41.179358+0000","last_peered":"2024-02-18T16:21:41.179358+0000","last_clean":"2024-02-18T16:21:41.179358+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:21:41.179358+0000","last_undegraded":"2024-02-18T16:21:41.179358+0000","last_fullsized":"2024-02-18T16:21:41.179358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:23:07.857672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952037+0000","last_change":"2024-02-18T16:21:05.897074+0000","last_active":"2024-02-18T16:21:40.952037+0000","last_peered":"2024-02-18T16:21:40.952037+0000","last_clean":"2024-02-18T16:21:40.952037+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:21:40.952037+0000","last_undegraded":"2024-02-18T16:21:40.952037+0000","last_fullsized":"2024-02-18T16:21:40.952037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:04:33.549154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955422+0000","last_change":"2024-02-18T16:21:07.918398+0000","last_active":"2024-02-18T16:21:40.955422+0000","last_peered":"2024-02-18T16:21:40.955422+0000","last_clean":"2024-02-18T16:21:40.955422+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:21:40.955422+0000","last_undegraded":"2024-02-18T16:21:40.955422+0000","last_fullsized":"2024-02-18T16:21:40.955422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:47.114614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.926920+0000","last_change":"2024-02-18T16:21:09.915876+0000","last_active":"2024-02-18T16:21:40.926920+0000","last_peered":"2024-02-18T16:21:40.926920+0000","last_clean":"2024-02-18T16:21:40.926920+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:21:40.926920+0000","last_undegraded":"2024-02-18T16:21:40.926920+0000","last_fullsized":"2024-02-18T16:21:40.926920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:53.323552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858131+0000","last_change":"2024-02-18T16:21:01.844784+0000","last_active":"2024-02-18T16:21:47.858131+0000","last_peered":"2024-02-18T16:21:47.858131+0000","last_clean":"2024-02-18T16:21:47.858131+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:21:47.858131+0000","last_undegraded":"2024-02-18T16:21:47.858131+0000","last_fullsized":"2024-02-18T16:21:47.858131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938015+0000","last_change":"2024-02-18T16:20:59.833465+0000","last_active":"2024-02-18T16:21:40.938015+0000","last_peered":"2024-02-18T16:21:40.938015+0000","last_clean":"2024-02-18T16:21:40.938015+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:21:40.938015+0000","last_undegraded":"2024-02-18T16:21:40.938015+0000","last_fullsized":"2024-02-18T16:21:40.938015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176645+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:21:41.176645+0000","last_peered":"2024-02-18T16:21:41.176645+0000","last_clean":"2024-02-18T16:21:41.176645+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:21:41.176645+0000","last_undegraded":"2024-02-18T16:21:41.176645+0000","last_fullsized":"2024-02-18T16:21:41.176645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:59:56.616913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947011+0000","last_change":"2024-02-18T16:21:40.945591+0000","last_active":"2024-02-18T16:21:40.947011+0000","last_peered":"2024-02-18T16:21:40.947011+0000","last_clean":"2024-02-18T16:21:40.947011+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:21:40.947011+0000","last_undegraded":"2024-02-18T16:21:40.947011+0000","last_fullsized":"2024-02-18T16:21:40.947011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:15:47.279576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.043805+0000","last_change":"2024-02-18T16:21:05.889484+0000","last_active":"2024-02-18T16:22:36.043805+0000","last_peered":"2024-02-18T16:22:36.043805+0000","last_clean":"2024-02-18T16:22:36.043805+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:36.043805+0000","last_undegraded":"2024-02-18T16:22:36.043805+0000","last_fullsized":"2024-02-18T16:22:36.043805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:15.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932933+0000","last_change":"2024-02-18T16:21:07.902044+0000","last_active":"2024-02-18T16:21:40.932933+0000","last_peered":"2024-02-18T16:21:40.932933+0000","last_clean":"2024-02-18T16:21:40.932933+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:21:40.932933+0000","last_undegraded":"2024-02-18T16:21:40.932933+0000","last_fullsized":"2024-02-18T16:21:40.932933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:08.502008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.436370+0000","last_change":"2024-02-18T16:21:09.905763+0000","last_active":"2024-02-18T16:22:30.436370+0000","last_peered":"2024-02-18T16:22:30.436370+0000","last_clean":"2024-02-18T16:22:30.436370+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:22:30.436370+0000","last_undegraded":"2024-02-18T16:22:30.436370+0000","last_fullsized":"2024-02-18T16:22:30.436370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:52:46.553123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.872182+0000","last_change":"2024-02-18T16:21:01.847741+0000","last_active":"2024-02-18T16:21:46.872182+0000","last_peered":"2024-02-18T16:21:46.872182+0000","last_clean":"2024-02-18T16:21:46.872182+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:21:46.872182+0000","last_undegraded":"2024-02-18T16:21:46.872182+0000","last_fullsized":"2024-02-18T16:21:46.872182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:41:45.770571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176949+0000","last_change":"2024-02-18T16:20:59.861790+0000","last_active":"2024-02-18T16:21:41.176949+0000","last_peered":"2024-02-18T16:21:41.176949+0000","last_clean":"2024-02-18T16:21:41.176949+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:21:41.176949+0000","last_undegraded":"2024-02-18T16:21:41.176949+0000","last_fullsized":"2024-02-18T16:21:41.176949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:51:44.573258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951463+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:21:40.951463+0000","last_peered":"2024-02-18T16:21:40.951463+0000","last_clean":"2024-02-18T16:21:40.951463+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:21:40.951463+0000","last_undegraded":"2024-02-18T16:21:40.951463+0000","last_fullsized":"2024-02-18T16:21:40.951463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:55:06.221596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938609+0000","last_change":"2024-02-18T16:21:03.849021+0000","last_active":"2024-02-18T16:21:40.938609+0000","last_peered":"2024-02-18T16:21:40.938609+0000","last_clean":"2024-02-18T16:21:40.938609+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:21:40.938609+0000","last_undegraded":"2024-02-18T16:21:40.938609+0000","last_fullsized":"2024-02-18T16:21:40.938609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:48:08.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929054+0000","last_change":"2024-02-18T16:21:05.898616+0000","last_active":"2024-02-18T16:21:40.929054+0000","last_peered":"2024-02-18T16:21:40.929054+0000","last_clean":"2024-02-18T16:21:40.929054+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:21:40.929054+0000","last_undegraded":"2024-02-18T16:21:40.929054+0000","last_fullsized":"2024-02-18T16:21:40.929054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:38.543681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'242","reported_seq":320,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.851552+0000","last_change":"2024-02-18T16:21:07.893283+0000","last_active":"2024-02-18T16:22:43.851552+0000","last_peered":"2024-02-18T16:22:43.851552+0000","last_clean":"2024-02-18T16:22:43.851552+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:43.851552+0000","last_undegraded":"2024-02-18T16:22:43.851552+0000","last_fullsized":"2024-02-18T16:22:43.851552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:18.628782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953932+0000","last_change":"2024-02-18T16:21:09.914553+0000","last_active":"2024-02-18T16:21:40.953932+0000","last_peered":"2024-02-18T16:21:40.953932+0000","last_clean":"2024-02-18T16:21:40.953932+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:21:40.953932+0000","last_undegraded":"2024-02-18T16:21:40.953932+0000","last_fullsized":"2024-02-18T16:21:40.953932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:02:46.246218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.456732+0000","last_change":"2024-02-18T16:21:01.853061+0000","last_active":"2024-02-18T16:22:30.456732+0000","last_peered":"2024-02-18T16:22:30.456732+0000","last_clean":"2024-02-18T16:22:30.456732+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:22:30.456732+0000","last_undegraded":"2024-02-18T16:22:30.456732+0000","last_fullsized":"2024-02-18T16:22:30.456732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:44.090520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956980+0000","last_change":"2024-02-18T16:20:59.868556+0000","last_active":"2024-02-18T16:21:40.956980+0000","last_peered":"2024-02-18T16:21:40.956980+0000","last_clean":"2024-02-18T16:21:40.956980+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:21:40.956980+0000","last_undegraded":"2024-02-18T16:21:40.956980+0000","last_fullsized":"2024-02-18T16:21:40.956980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:56.658418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180424+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:21:41.180424+0000","last_peered":"2024-02-18T16:21:41.180424+0000","last_clean":"2024-02-18T16:21:41.180424+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:21:41.180424+0000","last_undegraded":"2024-02-18T16:21:41.180424+0000","last_fullsized":"2024-02-18T16:21:41.180424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:07.695714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933580+0000","last_change":"2024-02-18T16:21:03.852652+0000","last_active":"2024-02-18T16:21:40.933580+0000","last_peered":"2024-02-18T16:21:40.933580+0000","last_clean":"2024-02-18T16:21:40.933580+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:21:40.933580+0000","last_undegraded":"2024-02-18T16:21:40.933580+0000","last_fullsized":"2024-02-18T16:21:40.933580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:23.631357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946439+0000","last_change":"2024-02-18T16:21:05.894104+0000","last_active":"2024-02-18T16:21:40.946439+0000","last_peered":"2024-02-18T16:21:40.946439+0000","last_clean":"2024-02-18T16:21:40.946439+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:21:40.946439+0000","last_undegraded":"2024-02-18T16:21:40.946439+0000","last_fullsized":"2024-02-18T16:21:40.946439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:42.813295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.306039+0000","last_change":"2024-02-18T16:21:07.893288+0000","last_active":"2024-02-18T16:22:36.306039+0000","last_peered":"2024-02-18T16:22:36.306039+0000","last_clean":"2024-02-18T16:22:36.306039+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:36.306039+0000","last_undegraded":"2024-02-18T16:22:36.306039+0000","last_fullsized":"2024-02-18T16:22:36.306039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:01:27.661300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.859966+0000","last_change":"2024-02-18T16:21:09.917363+0000","last_active":"2024-02-18T16:21:47.859966+0000","last_peered":"2024-02-18T16:21:47.859966+0000","last_clean":"2024-02-18T16:21:47.859966+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:21:47.859966+0000","last_undegraded":"2024-02-18T16:21:47.859966+0000","last_fullsized":"2024-02-18T16:21:47.859966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:47.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935139+0000","last_change":"2024-02-18T16:21:01.849433+0000","last_active":"2024-02-18T16:21:40.935139+0000","last_peered":"2024-02-18T16:21:40.935139+0000","last_clean":"2024-02-18T16:21:40.935139+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:21:40.935139+0000","last_undegraded":"2024-02-18T16:21:40.935139+0000","last_fullsized":"2024-02-18T16:21:40.935139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:01:26.052157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937475+0000","last_change":"2024-02-18T16:20:59.873711+0000","last_active":"2024-02-18T16:21:40.937475+0000","last_peered":"2024-02-18T16:21:40.937475+0000","last_clean":"2024-02-18T16:21:40.937475+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:21:40.937475+0000","last_undegraded":"2024-02-18T16:21:40.937475+0000","last_fullsized":"2024-02-18T16:21:40.937475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:17:11.690004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956548+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:21:40.956548+0000","last_peered":"2024-02-18T16:21:40.956548+0000","last_clean":"2024-02-18T16:21:40.956548+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:21:40.956548+0000","last_undegraded":"2024-02-18T16:21:40.956548+0000","last_fullsized":"2024-02-18T16:21:40.956548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:28:14.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932706+0000","last_change":"2024-02-18T16:21:03.851642+0000","last_active":"2024-02-18T16:21:40.932706+0000","last_peered":"2024-02-18T16:21:40.932706+0000","last_clean":"2024-02-18T16:21:40.932706+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:21:40.932706+0000","last_undegraded":"2024-02-18T16:21:40.932706+0000","last_fullsized":"2024-02-18T16:21:40.932706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:09:58.409243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'76","reported_seq":147,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.038660+0000","last_change":"2024-02-18T16:21:05.894249+0000","last_active":"2024-02-18T16:22:36.038660+0000","last_peered":"2024-02-18T16:22:36.038660+0000","last_clean":"2024-02-18T16:22:36.038660+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:36.038660+0000","last_undegraded":"2024-02-18T16:22:36.038660+0000","last_fullsized":"2024-02-18T16:22:36.038660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:49:16.678346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174054+0000","last_change":"2024-02-18T16:21:07.899674+0000","last_active":"2024-02-18T16:21:41.174054+0000","last_peered":"2024-02-18T16:21:41.174054+0000","last_clean":"2024-02-18T16:21:41.174054+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:21:41.174054+0000","last_undegraded":"2024-02-18T16:21:41.174054+0000","last_fullsized":"2024-02-18T16:21:41.174054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:02.693188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.943250+0000","last_change":"2024-02-18T16:21:09.913278+0000","last_active":"2024-02-18T16:21:40.943250+0000","last_peered":"2024-02-18T16:21:40.943250+0000","last_clean":"2024-02-18T16:21:40.943250+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:21:40.943250+0000","last_undegraded":"2024-02-18T16:21:40.943250+0000","last_fullsized":"2024-02-18T16:21:40.943250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:44.928722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.072534+0000","last_change":"2024-02-18T16:21:09.912010+0000","last_active":"2024-02-18T16:22:36.072534+0000","last_peered":"2024-02-18T16:22:36.072534+0000","last_clean":"2024-02-18T16:22:36.072534+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:22:36.072534+0000","last_undegraded":"2024-02-18T16:22:36.072534+0000","last_fullsized":"2024-02-18T16:22:36.072534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:22.614788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183619+0000","last_change":"2024-02-18T16:21:41.183619+0000","last_active":"2024-02-18T16:21:41.183619+0000","last_peered":"2024-02-18T16:21:41.183619+0000","last_clean":"2024-02-18T16:21:41.183619+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:21:41.183619+0000","last_undegraded":"2024-02-18T16:21:41.183619+0000","last_fullsized":"2024-02-18T16:21:41.183619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:13.035362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951280+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:21:40.951280+0000","last_peered":"2024-02-18T16:21:40.951280+0000","last_clean":"2024-02-18T16:21:40.951280+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:21:40.951280+0000","last_undegraded":"2024-02-18T16:21:40.951280+0000","last_fullsized":"2024-02-18T16:21:40.951280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:18:58.769509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929562+0000","last_change":"2024-02-18T16:21:03.865820+0000","last_active":"2024-02-18T16:21:40.929562+0000","last_peered":"2024-02-18T16:21:40.929562+0000","last_clean":"2024-02-18T16:21:40.929562+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:21:40.929562+0000","last_undegraded":"2024-02-18T16:21:40.929562+0000","last_fullsized":"2024-02-18T16:21:40.929562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:04:46.104120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.417194+0000","last_change":"2024-02-18T16:21:05.885905+0000","last_active":"2024-02-18T16:22:30.417194+0000","last_peered":"2024-02-18T16:22:30.417194+0000","last_clean":"2024-02-18T16:22:30.417194+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:30.417194+0000","last_undegraded":"2024-02-18T16:22:30.417194+0000","last_fullsized":"2024-02-18T16:22:30.417194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:28.353159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936858+0000","last_change":"2024-02-18T16:21:07.897703+0000","last_active":"2024-02-18T16:21:40.936858+0000","last_peered":"2024-02-18T16:21:40.936858+0000","last_clean":"2024-02-18T16:21:40.936858+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:21:40.936858+0000","last_undegraded":"2024-02-18T16:21:40.936858+0000","last_fullsized":"2024-02-18T16:21:40.936858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:21:41.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179155+0000","last_change":"2024-02-18T16:21:09.909919+0000","last_active":"2024-02-18T16:21:41.179155+0000","last_peered":"2024-02-18T16:21:41.179155+0000","last_clean":"2024-02-18T16:21:41.179155+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:21:41.179155+0000","last_undegraded":"2024-02-18T16:21:41.179155+0000","last_fullsized":"2024-02-18T16:21:41.179155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:22:27.374232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605789+0000","last_change":"2024-02-18T16:21:01.852159+0000","last_active":"2024-02-18T16:22:29.605789+0000","last_peered":"2024-02-18T16:22:29.605789+0000","last_clean":"2024-02-18T16:22:29.605789+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:22:29.605789+0000","last_undegraded":"2024-02-18T16:22:29.605789+0000","last_fullsized":"2024-02-18T16:22:29.605789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:20.164166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941358+0000","last_change":"2024-02-18T16:20:59.833123+0000","last_active":"2024-02-18T16:21:40.941358+0000","last_peered":"2024-02-18T16:21:40.941358+0000","last_clean":"2024-02-18T16:21:40.941358+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:21:40.941358+0000","last_undegraded":"2024-02-18T16:21:40.941358+0000","last_fullsized":"2024-02-18T16:21:40.941358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947671+0000","last_change":"2024-02-18T16:21:03.850309+0000","last_active":"2024-02-18T16:21:40.947671+0000","last_peered":"2024-02-18T16:21:40.947671+0000","last_clean":"2024-02-18T16:21:40.947671+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:21:40.947671+0000","last_undegraded":"2024-02-18T16:21:40.947671+0000","last_fullsized":"2024-02-18T16:21:40.947671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:21.788879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:23.050364+0000","last_change":"2024-02-18T16:21:05.880698+0000","last_active":"2024-02-18T16:22:23.050364+0000","last_peered":"2024-02-18T16:22:23.050364+0000","last_clean":"2024-02-18T16:22:23.050364+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:22:23.050364+0000","last_undegraded":"2024-02-18T16:22:23.050364+0000","last_fullsized":"2024-02-18T16:22:23.050364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:51:33.384726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935541+0000","last_change":"2024-02-18T16:21:07.900044+0000","last_active":"2024-02-18T16:21:40.935541+0000","last_peered":"2024-02-18T16:21:40.935541+0000","last_clean":"2024-02-18T16:21:40.935541+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:21:40.935541+0000","last_undegraded":"2024-02-18T16:21:40.935541+0000","last_fullsized":"2024-02-18T16:21:40.935541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:14.205593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177117+0000","last_change":"2024-02-18T16:21:09.926381+0000","last_active":"2024-02-18T16:21:41.177117+0000","last_peered":"2024-02-18T16:21:41.177117+0000","last_clean":"2024-02-18T16:21:41.177117+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:21:41.177117+0000","last_undegraded":"2024-02-18T16:21:41.177117+0000","last_fullsized":"2024-02-18T16:21:41.177117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165508+0000","last_change":"2024-02-18T16:21:01.847228+0000","last_active":"2024-02-18T16:21:47.165508+0000","last_peered":"2024-02-18T16:21:47.165508+0000","last_clean":"2024-02-18T16:21:47.165508+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:21:47.165508+0000","last_undegraded":"2024-02-18T16:21:47.165508+0000","last_fullsized":"2024-02-18T16:21:47.165508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:14:33.262929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952876+0000","last_change":"2024-02-18T16:20:59.839316+0000","last_active":"2024-02-18T16:21:40.952876+0000","last_peered":"2024-02-18T16:21:40.952876+0000","last_clean":"2024-02-18T16:21:40.952876+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:21:40.952876+0000","last_undegraded":"2024-02-18T16:21:40.952876+0000","last_fullsized":"2024-02-18T16:21:40.952876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934519+0000","last_change":"2024-02-18T16:21:03.864201+0000","last_active":"2024-02-18T16:21:40.934519+0000","last_peered":"2024-02-18T16:21:40.934519+0000","last_clean":"2024-02-18T16:21:40.934519+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:21:40.934519+0000","last_undegraded":"2024-02-18T16:21:40.934519+0000","last_fullsized":"2024-02-18T16:21:40.934519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:26:17.726013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'34","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:35.841028+0000","last_change":"2024-02-18T16:21:05.876928+0000","last_active":"2024-02-18T16:22:35.841028+0000","last_peered":"2024-02-18T16:22:35.841028+0000","last_clean":"2024-02-18T16:22:35.841028+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:22:35.841028+0000","last_undegraded":"2024-02-18T16:22:35.841028+0000","last_fullsized":"2024-02-18T16:22:35.841028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:50:06.486461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.928756+0000","last_change":"2024-02-18T16:21:07.894242+0000","last_active":"2024-02-18T16:21:40.928756+0000","last_peered":"2024-02-18T16:21:40.928756+0000","last_clean":"2024-02-18T16:21:40.928756+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:21:40.928756+0000","last_undegraded":"2024-02-18T16:21:40.928756+0000","last_fullsized":"2024-02-18T16:21:40.928756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:42.914688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.128244+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:21:47.128244+0000","last_peered":"2024-02-18T16:21:47.128244+0000","last_clean":"2024-02-18T16:21:47.128244+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:21:47.128244+0000","last_undegraded":"2024-02-18T16:21:47.128244+0000","last_fullsized":"2024-02-18T16:21:47.128244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:15:42.799340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.871877+0000","last_change":"2024-02-18T16:21:01.853323+0000","last_active":"2024-02-18T16:21:46.871877+0000","last_peered":"2024-02-18T16:21:46.871877+0000","last_clean":"2024-02-18T16:21:46.871877+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:21:46.871877+0000","last_undegraded":"2024-02-18T16:21:46.871877+0000","last_fullsized":"2024-02-18T16:21:46.871877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:11.618049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945582+0000","last_change":"2024-02-18T16:20:59.853141+0000","last_active":"2024-02-18T16:21:40.945582+0000","last_peered":"2024-02-18T16:21:40.945582+0000","last_clean":"2024-02-18T16:21:40.945582+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:21:40.945582+0000","last_undegraded":"2024-02-18T16:21:40.945582+0000","last_fullsized":"2024-02-18T16:21:40.945582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933353+0000","last_change":"2024-02-18T16:21:03.852896+0000","last_active":"2024-02-18T16:21:40.933353+0000","last_peered":"2024-02-18T16:21:40.933353+0000","last_clean":"2024-02-18T16:21:40.933353+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:21:40.933353+0000","last_undegraded":"2024-02-18T16:21:40.933353+0000","last_fullsized":"2024-02-18T16:21:40.933353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:25.426450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.393010+0000","last_change":"2024-02-18T16:21:05.877090+0000","last_active":"2024-02-18T16:22:30.393010+0000","last_peered":"2024-02-18T16:22:30.393010+0000","last_clean":"2024-02-18T16:22:30.393010+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:22:30.393010+0000","last_undegraded":"2024-02-18T16:22:30.393010+0000","last_fullsized":"2024-02-18T16:22:30.393010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:47:28.582206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937205+0000","last_change":"2024-02-18T16:21:07.895684+0000","last_active":"2024-02-18T16:21:40.937205+0000","last_peered":"2024-02-18T16:21:40.937205+0000","last_clean":"2024-02-18T16:21:40.937205+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:21:40.937205+0000","last_undegraded":"2024-02-18T16:21:40.937205+0000","last_fullsized":"2024-02-18T16:21:40.937205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:02.630017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956804+0000","last_change":"2024-02-18T16:21:01.852475+0000","last_active":"2024-02-18T16:21:40.956804+0000","last_peered":"2024-02-18T16:21:40.956804+0000","last_clean":"2024-02-18T16:21:40.956804+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:21:40.956804+0000","last_undegraded":"2024-02-18T16:21:40.956804+0000","last_fullsized":"2024-02-18T16:21:40.956804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:27.351511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933470+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:21:40.933470+0000","last_peered":"2024-02-18T16:21:40.933470+0000","last_clean":"2024-02-18T16:21:40.933470+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:21:40.933470+0000","last_undegraded":"2024-02-18T16:21:40.933470+0000","last_fullsized":"2024-02-18T16:21:40.933470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:15:24.659323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180433+0000","last_change":"2024-02-18T16:21:03.857015+0000","last_active":"2024-02-18T16:21:41.180433+0000","last_peered":"2024-02-18T16:21:41.180433+0000","last_clean":"2024-02-18T16:21:41.180433+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:21:41.180433+0000","last_undegraded":"2024-02-18T16:21:41.180433+0000","last_fullsized":"2024-02-18T16:21:41.180433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:13:13.662764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.034479+0000","last_change":"2024-02-18T16:21:05.880717+0000","last_active":"2024-02-18T16:22:36.034479+0000","last_peered":"2024-02-18T16:22:36.034479+0000","last_clean":"2024-02-18T16:22:36.034479+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:36.034479+0000","last_undegraded":"2024-02-18T16:22:36.034479+0000","last_fullsized":"2024-02-18T16:22:36.034479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:12.190046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936708+0000","last_change":"2024-02-18T16:21:07.890941+0000","last_active":"2024-02-18T16:21:40.936708+0000","last_peered":"2024-02-18T16:21:40.936708+0000","last_clean":"2024-02-18T16:21:40.936708+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:21:40.936708+0000","last_undegraded":"2024-02-18T16:21:40.936708+0000","last_fullsized":"2024-02-18T16:21:40.936708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:57.883612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.748309+0000","last_change":"2024-02-18T16:21:09.926618+0000","last_active":"2024-02-18T16:22:29.748309+0000","last_peered":"2024-02-18T16:22:29.748309+0000","last_clean":"2024-02-18T16:22:29.748309+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:22:29.748309+0000","last_undegraded":"2024-02-18T16:22:29.748309+0000","last_fullsized":"2024-02-18T16:22:29.748309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:31:18.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183335+0000","last_change":"2024-02-18T16:21:01.841268+0000","last_active":"2024-02-18T16:21:41.183335+0000","last_peered":"2024-02-18T16:21:41.183335+0000","last_clean":"2024-02-18T16:21:41.183335+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:21:41.183335+0000","last_undegraded":"2024-02-18T16:21:41.183335+0000","last_fullsized":"2024-02-18T16:21:41.183335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:54:37.580542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927563+0000","last_change":"2024-02-18T16:20:59.853982+0000","last_active":"2024-02-18T16:21:40.927563+0000","last_peered":"2024-02-18T16:21:40.927563+0000","last_clean":"2024-02-18T16:21:40.927563+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:21:40.927563+0000","last_undegraded":"2024-02-18T16:21:40.927563+0000","last_fullsized":"2024-02-18T16:21:40.927563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950616+0000","last_change":"2024-02-18T16:21:03.854204+0000","last_active":"2024-02-18T16:21:40.950616+0000","last_peered":"2024-02-18T16:21:40.950616+0000","last_clean":"2024-02-18T16:21:40.950616+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:21:40.950616+0000","last_undegraded":"2024-02-18T16:21:40.950616+0000","last_fullsized":"2024-02-18T16:21:40.950616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:42:28.248701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.394256+0000","last_change":"2024-02-18T16:21:05.897013+0000","last_active":"2024-02-18T16:22:30.394256+0000","last_peered":"2024-02-18T16:22:30.394256+0000","last_clean":"2024-02-18T16:22:30.394256+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:22:30.394256+0000","last_undegraded":"2024-02-18T16:22:30.394256+0000","last_fullsized":"2024-02-18T16:22:30.394256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:16.724717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931649+0000","last_change":"2024-02-18T16:21:07.917711+0000","last_active":"2024-02-18T16:21:40.931649+0000","last_peered":"2024-02-18T16:21:40.931649+0000","last_clean":"2024-02-18T16:21:40.931649+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:21:40.931649+0000","last_undegraded":"2024-02-18T16:21:40.931649+0000","last_fullsized":"2024-02-18T16:21:40.931649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933181+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:21:40.933181+0000","last_peered":"2024-02-18T16:21:40.933181+0000","last_clean":"2024-02-18T16:21:40.933181+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:21:40.933181+0000","last_undegraded":"2024-02-18T16:21:40.933181+0000","last_fullsized":"2024-02-18T16:21:40.933181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:37:16.456409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952947+0000","last_change":"2024-02-18T16:21:01.858003+0000","last_active":"2024-02-18T16:21:40.952947+0000","last_peered":"2024-02-18T16:21:40.952947+0000","last_clean":"2024-02-18T16:21:40.952947+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:21:40.952947+0000","last_undegraded":"2024-02-18T16:21:40.952947+0000","last_fullsized":"2024-02-18T16:21:40.952947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929693+0000","last_change":"2024-02-18T16:20:59.854045+0000","last_active":"2024-02-18T16:21:40.929693+0000","last_peered":"2024-02-18T16:21:40.929693+0000","last_clean":"2024-02-18T16:21:40.929693+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:21:40.929693+0000","last_undegraded":"2024-02-18T16:21:40.929693+0000","last_fullsized":"2024-02-18T16:21:40.929693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939479+0000","last_change":"2024-02-18T16:21:03.855690+0000","last_active":"2024-02-18T16:21:40.939479+0000","last_peered":"2024-02-18T16:21:40.939479+0000","last_clean":"2024-02-18T16:21:40.939479+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:21:40.939479+0000","last_undegraded":"2024-02-18T16:21:40.939479+0000","last_fullsized":"2024-02-18T16:21:40.939479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:40.744979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.423091+0000","last_change":"2024-02-18T16:21:05.889337+0000","last_active":"2024-02-18T16:22:30.423091+0000","last_peered":"2024-02-18T16:22:30.423091+0000","last_clean":"2024-02-18T16:22:30.423091+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:30.423091+0000","last_undegraded":"2024-02-18T16:22:30.423091+0000","last_fullsized":"2024-02-18T16:22:30.423091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:00.614470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179753+0000","last_change":"2024-02-18T16:21:07.907388+0000","last_active":"2024-02-18T16:21:41.179753+0000","last_peered":"2024-02-18T16:21:41.179753+0000","last_clean":"2024-02-18T16:21:41.179753+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:21:41.179753+0000","last_undegraded":"2024-02-18T16:21:41.179753+0000","last_fullsized":"2024-02-18T16:21:41.179753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:59:25.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939050+0000","last_change":"2024-02-18T16:21:09.911546+0000","last_active":"2024-02-18T16:21:40.939050+0000","last_peered":"2024-02-18T16:21:40.939050+0000","last_clean":"2024-02-18T16:21:40.939050+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:21:40.939050+0000","last_undegraded":"2024-02-18T16:21:40.939050+0000","last_fullsized":"2024-02-18T16:21:40.939050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:51:41.804331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.856054+0000","last_change":"2024-02-18T16:21:01.840394+0000","last_active":"2024-02-18T16:21:47.856054+0000","last_peered":"2024-02-18T16:21:47.856054+0000","last_clean":"2024-02-18T16:21:47.856054+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:21:47.856054+0000","last_undegraded":"2024-02-18T16:21:47.856054+0000","last_fullsized":"2024-02-18T16:21:47.856054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948852+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:21:40.948852+0000","last_peered":"2024-02-18T16:21:40.948852+0000","last_clean":"2024-02-18T16:21:40.948852+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:21:40.948852+0000","last_undegraded":"2024-02-18T16:21:40.948852+0000","last_fullsized":"2024-02-18T16:21:40.948852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:18:32.673610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933457+0000","last_change":"2024-02-18T16:21:03.867900+0000","last_active":"2024-02-18T16:21:40.933457+0000","last_peered":"2024-02-18T16:21:40.933457+0000","last_clean":"2024-02-18T16:21:40.933457+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:21:40.933457+0000","last_undegraded":"2024-02-18T16:21:40.933457+0000","last_fullsized":"2024-02-18T16:21:40.933457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:15.762147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.952376+0000","last_change":"2024-02-18T16:21:05.897563+0000","last_active":"2024-02-18T16:21:40.952376+0000","last_peered":"2024-02-18T16:21:40.952376+0000","last_clean":"2024-02-18T16:21:40.952376+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:21:40.952376+0000","last_undegraded":"2024-02-18T16:21:40.952376+0000","last_fullsized":"2024-02-18T16:21:40.952376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:21:22.623751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'242","reported_seq":306,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.849280+0000","last_change":"2024-02-18T16:21:07.903096+0000","last_active":"2024-02-18T16:22:43.849280+0000","last_peered":"2024-02-18T16:22:43.849280+0000","last_clean":"2024-02-18T16:22:43.849280+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:43.849280+0000","last_undegraded":"2024-02-18T16:22:43.849280+0000","last_fullsized":"2024-02-18T16:22:43.849280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:33:33.395055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931705+0000","last_change":"2024-02-18T16:21:09.924100+0000","last_active":"2024-02-18T16:21:40.931705+0000","last_peered":"2024-02-18T16:21:40.931705+0000","last_clean":"2024-02-18T16:21:40.931705+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:21:40.931705+0000","last_undegraded":"2024-02-18T16:21:40.931705+0000","last_fullsized":"2024-02-18T16:21:40.931705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:28:24.032500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940205+0000","last_change":"2024-02-18T16:21:01.837599+0000","last_active":"2024-02-18T16:21:40.940205+0000","last_peered":"2024-02-18T16:21:40.940205+0000","last_clean":"2024-02-18T16:21:40.940205+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:21:40.940205+0000","last_undegraded":"2024-02-18T16:21:40.940205+0000","last_fullsized":"2024-02-18T16:21:40.940205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:07.608465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929848+0000","last_change":"2024-02-18T16:20:59.859857+0000","last_active":"2024-02-18T16:21:40.929848+0000","last_peered":"2024-02-18T16:21:40.929848+0000","last_clean":"2024-02-18T16:21:40.929848+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:21:40.929848+0000","last_undegraded":"2024-02-18T16:21:40.929848+0000","last_fullsized":"2024-02-18T16:21:40.929848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929290+0000","last_change":"2024-02-18T16:21:03.868183+0000","last_active":"2024-02-18T16:21:40.929290+0000","last_peered":"2024-02-18T16:21:40.929290+0000","last_clean":"2024-02-18T16:21:40.929290+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:21:40.929290+0000","last_undegraded":"2024-02-18T16:21:40.929290+0000","last_fullsized":"2024-02-18T16:21:40.929290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:51:44.654179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'35","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.025423+0000","last_change":"2024-02-18T16:21:05.890224+0000","last_active":"2024-02-18T16:22:36.025423+0000","last_peered":"2024-02-18T16:22:36.025423+0000","last_clean":"2024-02-18T16:22:36.025423+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:36.025423+0000","last_undegraded":"2024-02-18T16:22:36.025423+0000","last_fullsized":"2024-02-18T16:22:36.025423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:55:55.868065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.173856+0000","last_change":"2024-02-18T16:21:07.895448+0000","last_active":"2024-02-18T16:21:41.173856+0000","last_peered":"2024-02-18T16:21:41.173856+0000","last_clean":"2024-02-18T16:21:41.173856+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:21:41.173856+0000","last_undegraded":"2024-02-18T16:21:41.173856+0000","last_fullsized":"2024-02-18T16:21:41.173856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:31.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946969+0000","last_change":"2024-02-18T16:21:09.927008+0000","last_active":"2024-02-18T16:21:40.946969+0000","last_peered":"2024-02-18T16:21:40.946969+0000","last_clean":"2024-02-18T16:21:40.946969+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:21:40.946969+0000","last_undegraded":"2024-02-18T16:21:40.946969+0000","last_fullsized":"2024-02-18T16:21:40.946969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:20.239389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937270+0000","last_change":"2024-02-18T16:21:01.831920+0000","last_active":"2024-02-18T16:21:40.937270+0000","last_peered":"2024-02-18T16:21:40.937270+0000","last_clean":"2024-02-18T16:21:40.937270+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:21:40.937270+0000","last_undegraded":"2024-02-18T16:21:40.937270+0000","last_fullsized":"2024-02-18T16:21:40.937270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:09:24.733013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951556+0000","last_change":"2024-02-18T16:20:59.872971+0000","last_active":"2024-02-18T16:21:40.951556+0000","last_peered":"2024-02-18T16:21:40.951556+0000","last_clean":"2024-02-18T16:21:40.951556+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:21:40.951556+0000","last_undegraded":"2024-02-18T16:21:40.951556+0000","last_fullsized":"2024-02-18T16:21:40.951556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:31.687324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940611+0000","last_change":"2024-02-18T16:21:03.854122+0000","last_active":"2024-02-18T16:21:40.940611+0000","last_peered":"2024-02-18T16:21:40.940611+0000","last_clean":"2024-02-18T16:21:40.940611+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:21:40.940611+0000","last_undegraded":"2024-02-18T16:21:40.940611+0000","last_fullsized":"2024-02-18T16:21:40.940611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:46.493787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.380857+0000","last_change":"2024-02-18T16:21:05.895074+0000","last_active":"2024-02-18T16:22:30.380857+0000","last_peered":"2024-02-18T16:22:30.380857+0000","last_clean":"2024-02-18T16:22:30.380857+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:30.380857+0000","last_undegraded":"2024-02-18T16:22:30.380857+0000","last_fullsized":"2024-02-18T16:22:30.380857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:29.708106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932403+0000","last_change":"2024-02-18T16:21:07.908003+0000","last_active":"2024-02-18T16:21:40.932403+0000","last_peered":"2024-02-18T16:21:40.932403+0000","last_clean":"2024-02-18T16:21:40.932403+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:21:40.932403+0000","last_undegraded":"2024-02-18T16:21:40.932403+0000","last_fullsized":"2024-02-18T16:21:40.932403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:07.987144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954186+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:21:40.954186+0000","last_peered":"2024-02-18T16:21:40.954186+0000","last_clean":"2024-02-18T16:21:40.954186+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:21:40.954186+0000","last_undegraded":"2024-02-18T16:21:40.954186+0000","last_fullsized":"2024-02-18T16:21:40.954186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:55:03.922245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.423870+0000","last_change":"2024-02-18T16:21:01.855576+0000","last_active":"2024-02-18T16:21:46.423870+0000","last_peered":"2024-02-18T16:21:46.423870+0000","last_clean":"2024-02-18T16:21:46.423870+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:21:46.423870+0000","last_undegraded":"2024-02-18T16:21:46.423870+0000","last_fullsized":"2024-02-18T16:21:46.423870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:07:08.162049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.180630+0000","last_change":"2024-02-18T16:20:59.862651+0000","last_active":"2024-02-18T16:21:41.180630+0000","last_peered":"2024-02-18T16:21:41.180630+0000","last_clean":"2024-02-18T16:21:41.180630+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:21:41.180630+0000","last_undegraded":"2024-02-18T16:21:41.180630+0000","last_fullsized":"2024-02-18T16:21:41.180630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:36.920744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.818091+0000","last_change":"2024-02-18T16:21:03.858753+0000","last_active":"2024-02-18T16:22:43.818091+0000","last_peered":"2024-02-18T16:22:43.818091+0000","last_clean":"2024-02-18T16:22:43.818091+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:22:43.818091+0000","last_undegraded":"2024-02-18T16:22:43.818091+0000","last_fullsized":"2024-02-18T16:22:43.818091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:47.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.419821+0000","last_change":"2024-02-18T16:21:05.886757+0000","last_active":"2024-02-18T16:22:30.419821+0000","last_peered":"2024-02-18T16:22:30.419821+0000","last_clean":"2024-02-18T16:22:30.419821+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:30.419821+0000","last_undegraded":"2024-02-18T16:22:30.419821+0000","last_fullsized":"2024-02-18T16:22:30.419821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:25:06.744338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.938999+0000","last_change":"2024-02-18T16:21:07.912579+0000","last_active":"2024-02-18T16:21:40.938999+0000","last_peered":"2024-02-18T16:21:40.938999+0000","last_clean":"2024-02-18T16:21:40.938999+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:21:40.938999+0000","last_undegraded":"2024-02-18T16:21:40.938999+0000","last_fullsized":"2024-02-18T16:21:40.938999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:03:05.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950786+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:21:40.950786+0000","last_peered":"2024-02-18T16:21:40.950786+0000","last_clean":"2024-02-18T16:21:40.950786+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:21:40.950786+0000","last_undegraded":"2024-02-18T16:21:40.950786+0000","last_fullsized":"2024-02-18T16:21:40.950786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:08.385221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085308+0000","last_change":"2024-02-18T16:21:01.833320+0000","last_active":"2024-02-18T16:22:36.085308+0000","last_peered":"2024-02-18T16:22:36.085308+0000","last_clean":"2024-02-18T16:22:36.085308+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:22:36.085308+0000","last_undegraded":"2024-02-18T16:22:36.085308+0000","last_fullsized":"2024-02-18T16:22:36.085308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:35.898147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946271+0000","last_change":"2024-02-18T16:20:59.855832+0000","last_active":"2024-02-18T16:21:40.946271+0000","last_peered":"2024-02-18T16:21:40.946271+0000","last_clean":"2024-02-18T16:21:40.946271+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:21:40.946271+0000","last_undegraded":"2024-02-18T16:21:40.946271+0000","last_fullsized":"2024-02-18T16:21:40.946271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:05.331148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930567+0000","last_change":"2024-02-18T16:21:03.862714+0000","last_active":"2024-02-18T16:21:40.930567+0000","last_peered":"2024-02-18T16:21:40.930567+0000","last_clean":"2024-02-18T16:21:40.930567+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:21:40.930567+0000","last_undegraded":"2024-02-18T16:21:40.930567+0000","last_fullsized":"2024-02-18T16:21:40.930567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:36.699699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.062152+0000","last_change":"2024-02-18T16:21:05.890834+0000","last_active":"2024-02-18T16:22:36.062152+0000","last_peered":"2024-02-18T16:22:36.062152+0000","last_clean":"2024-02-18T16:22:36.062152+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:22:36.062152+0000","last_undegraded":"2024-02-18T16:22:36.062152+0000","last_fullsized":"2024-02-18T16:22:36.062152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:57:24.200656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":46,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.175495+0000","last_change":"2024-02-18T16:21:07.894884+0000","last_active":"2024-02-18T16:21:41.175495+0000","last_peered":"2024-02-18T16:21:41.175495+0000","last_clean":"2024-02-18T16:21:41.175495+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:21:41.175495+0000","last_undegraded":"2024-02-18T16:21:41.175495+0000","last_fullsized":"2024-02-18T16:21:41.175495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:20.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.438798+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:30.438798+0000","last_peered":"2024-02-18T16:22:30.438798+0000","last_clean":"2024-02-18T16:22:30.438798+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:30.438798+0000","last_undegraded":"2024-02-18T16:22:30.438798+0000","last_fullsized":"2024-02-18T16:22:30.438798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:31.495612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.845885+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:17:13.639861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932873+0000","last_change":"2024-02-18T16:20:59.838011+0000","last_active":"2024-02-18T16:21:40.932873+0000","last_peered":"2024-02-18T16:21:40.932873+0000","last_clean":"2024-02-18T16:21:40.932873+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:21:40.932873+0000","last_undegraded":"2024-02-18T16:21:40.932873+0000","last_fullsized":"2024-02-18T16:21:40.932873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:24.881026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.182948+0000","last_change":"2024-02-18T16:21:01.839946+0000","last_active":"2024-02-18T16:21:41.182948+0000","last_peered":"2024-02-18T16:21:41.182948+0000","last_clean":"2024-02-18T16:21:41.182948+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:21:41.182948+0000","last_undegraded":"2024-02-18T16:21:41.182948+0000","last_fullsized":"2024-02-18T16:21:41.182948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:45:58.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.146551+0000","last_change":"2024-02-18T16:20:59.850717+0000","last_active":"2024-02-18T16:21:47.146551+0000","last_peered":"2024-02-18T16:21:47.146551+0000","last_clean":"2024-02-18T16:21:47.146551+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:21:47.146551+0000","last_undegraded":"2024-02-18T16:21:47.146551+0000","last_fullsized":"2024-02-18T16:21:47.146551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:49:00.166780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605557+0000","last_change":"2024-02-18T16:21:01.857016+0000","last_active":"2024-02-18T16:22:29.605557+0000","last_peered":"2024-02-18T16:22:29.605557+0000","last_clean":"2024-02-18T16:22:29.605557+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:22:29.605557+0000","last_undegraded":"2024-02-18T16:22:29.605557+0000","last_fullsized":"2024-02-18T16:22:29.605557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:34.686098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.613089+0000","last_change":"2024-02-18T16:20:59.865570+0000","last_active":"2024-02-18T16:22:29.613089+0000","last_peered":"2024-02-18T16:22:29.613089+0000","last_clean":"2024-02-18T16:22:29.613089+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:22:29.613089+0000","last_undegraded":"2024-02-18T16:22:29.613089+0000","last_fullsized":"2024-02-18T16:22:29.613089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:24.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.881324+0000","last_change":"2024-02-18T16:21:01.844340+0000","last_active":"2024-02-18T16:21:46.881324+0000","last_peered":"2024-02-18T16:21:46.881324+0000","last_clean":"2024-02-18T16:21:46.881324+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:21:46.881324+0000","last_undegraded":"2024-02-18T16:21:46.881324+0000","last_fullsized":"2024-02-18T16:21:46.881324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:32:33.700597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177537+0000","last_change":"2024-02-18T16:20:59.857706+0000","last_active":"2024-02-18T16:21:41.177537+0000","last_peered":"2024-02-18T16:21:41.177537+0000","last_clean":"2024-02-18T16:21:41.177537+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:21:41.177537+0000","last_undegraded":"2024-02-18T16:21:41.177537+0000","last_fullsized":"2024-02-18T16:21:41.177537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:54:03.661573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177027+0000","last_change":"2024-02-18T16:21:01.852407+0000","last_active":"2024-02-18T16:21:41.177027+0000","last_peered":"2024-02-18T16:21:41.177027+0000","last_clean":"2024-02-18T16:21:41.177027+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:21:41.177027+0000","last_undegraded":"2024-02-18T16:21:41.177027+0000","last_fullsized":"2024-02-18T16:21:41.177027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:00.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177143+0000","last_change":"2024-02-18T16:20:59.859871+0000","last_active":"2024-02-18T16:21:41.177143+0000","last_peered":"2024-02-18T16:21:41.177143+0000","last_clean":"2024-02-18T16:21:41.177143+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:21:41.177143+0000","last_undegraded":"2024-02-18T16:21:41.177143+0000","last_fullsized":"2024-02-18T16:21:41.177143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085205+0000","last_change":"2024-02-18T16:21:40.963827+0000","last_active":"2024-02-18T16:22:36.085205+0000","last_peered":"2024-02-18T16:22:36.085205+0000","last_clean":"2024-02-18T16:22:36.085205+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:22:36.085205+0000","last_undegraded":"2024-02-18T16:22:36.085205+0000","last_fullsized":"2024-02-18T16:22:36.085205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:01:13.380313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933696+0000","last_change":"2024-02-18T16:20:59.861914+0000","last_active":"2024-02-18T16:21:40.933696+0000","last_peered":"2024-02-18T16:21:40.933696+0000","last_clean":"2024-02-18T16:21:40.933696+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:21:40.933696+0000","last_undegraded":"2024-02-18T16:21:40.933696+0000","last_fullsized":"2024-02-18T16:21:40.933696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:01:57.737407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176179+0000","last_change":"2024-02-18T16:21:01.843302+0000","last_active":"2024-02-18T16:21:41.176179+0000","last_peered":"2024-02-18T16:21:41.176179+0000","last_clean":"2024-02-18T16:21:41.176179+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:21:41.176179+0000","last_undegraded":"2024-02-18T16:21:41.176179+0000","last_fullsized":"2024-02-18T16:21:41.176179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953161+0000","last_change":"2024-02-18T16:20:59.835435+0000","last_active":"2024-02-18T16:21:40.953161+0000","last_peered":"2024-02-18T16:21:40.953161+0000","last_clean":"2024-02-18T16:21:40.953161+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:21:40.953161+0000","last_undegraded":"2024-02-18T16:21:40.953161+0000","last_fullsized":"2024-02-18T16:21:40.953161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:59:41.869601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.424363+0000","last_change":"2024-02-18T16:21:01.838281+0000","last_active":"2024-02-18T16:21:46.424363+0000","last_peered":"2024-02-18T16:21:46.424363+0000","last_clean":"2024-02-18T16:21:46.424363+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:21:46.424363+0000","last_undegraded":"2024-02-18T16:21:46.424363+0000","last_fullsized":"2024-02-18T16:21:46.424363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:39:14.213118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183281+0000","last_change":"2024-02-18T16:20:59.859552+0000","last_active":"2024-02-18T16:21:41.183281+0000","last_peered":"2024-02-18T16:21:41.183281+0000","last_clean":"2024-02-18T16:21:41.183281+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:21:41.183281+0000","last_undegraded":"2024-02-18T16:21:41.183281+0000","last_fullsized":"2024-02-18T16:21:41.183281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:55:51.749702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947919+0000","last_change":"2024-02-18T16:21:01.840265+0000","last_active":"2024-02-18T16:21:40.947919+0000","last_peered":"2024-02-18T16:21:40.947919+0000","last_clean":"2024-02-18T16:21:40.947919+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:21:40.947919+0000","last_undegraded":"2024-02-18T16:21:40.947919+0000","last_fullsized":"2024-02-18T16:21:40.947919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:15:26.840777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934046+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:21:40.934046+0000","last_peered":"2024-02-18T16:21:40.934046+0000","last_clean":"2024-02-18T16:21:40.934046+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:21:40.934046+0000","last_undegraded":"2024-02-18T16:21:40.934046+0000","last_fullsized":"2024-02-18T16:21:40.934046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:53:59.394571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457053+0000","last_change":"2024-02-18T16:21:01.853933+0000","last_active":"2024-02-18T16:22:30.457053+0000","last_peered":"2024-02-18T16:22:30.457053+0000","last_clean":"2024-02-18T16:22:30.457053+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:22:30.457053+0000","last_undegraded":"2024-02-18T16:22:30.457053+0000","last_fullsized":"2024-02-18T16:22:30.457053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.515684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.446026+0000","last_change":"2024-02-18T16:20:59.853659+0000","last_active":"2024-02-18T16:22:30.446026+0000","last_peered":"2024-02-18T16:22:30.446026+0000","last_clean":"2024-02-18T16:22:30.446026+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:22:30.446026+0000","last_undegraded":"2024-02-18T16:22:30.446026+0000","last_fullsized":"2024-02-18T16:22:30.446026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:45.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.858279+0000","last_change":"2024-02-18T16:21:01.853974+0000","last_active":"2024-02-18T16:21:47.858279+0000","last_peered":"2024-02-18T16:21:47.858279+0000","last_clean":"2024-02-18T16:21:47.858279+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:21:47.858279+0000","last_undegraded":"2024-02-18T16:21:47.858279+0000","last_fullsized":"2024-02-18T16:21:47.858279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:23:51.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930423+0000","last_change":"2024-02-18T16:20:59.859832+0000","last_active":"2024-02-18T16:21:40.930423+0000","last_peered":"2024-02-18T16:21:40.930423+0000","last_clean":"2024-02-18T16:21:40.930423+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:21:40.930423+0000","last_undegraded":"2024-02-18T16:21:40.930423+0000","last_fullsized":"2024-02-18T16:21:40.930423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:16:31.269042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.085223+0000","last_change":"2024-02-18T16:21:01.839367+0000","last_active":"2024-02-18T16:22:36.085223+0000","last_peered":"2024-02-18T16:22:36.085223+0000","last_clean":"2024-02-18T16:22:36.085223+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:22:36.085223+0000","last_undegraded":"2024-02-18T16:22:36.085223+0000","last_fullsized":"2024-02-18T16:22:36.085223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:59:10.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929055+0000","last_change":"2024-02-18T16:20:59.859222+0000","last_active":"2024-02-18T16:21:40.929055+0000","last_peered":"2024-02-18T16:21:40.929055+0000","last_clean":"2024-02-18T16:21:40.929055+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:21:40.929055+0000","last_undegraded":"2024-02-18T16:21:40.929055+0000","last_fullsized":"2024-02-18T16:21:40.929055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:53:28.564236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.605946+0000","last_change":"2024-02-18T16:21:01.848741+0000","last_active":"2024-02-18T16:22:29.605946+0000","last_peered":"2024-02-18T16:22:29.605946+0000","last_clean":"2024-02-18T16:22:29.605946+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:22:29.605946+0000","last_undegraded":"2024-02-18T16:22:29.605946+0000","last_fullsized":"2024-02-18T16:22:29.605946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:40:26.706399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951778+0000","last_change":"2024-02-18T16:20:59.863633+0000","last_active":"2024-02-18T16:21:40.951778+0000","last_peered":"2024-02-18T16:21:40.951778+0000","last_clean":"2024-02-18T16:21:40.951778+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:21:40.951778+0000","last_undegraded":"2024-02-18T16:21:40.951778+0000","last_fullsized":"2024-02-18T16:21:40.951778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:36:52.944418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.457179+0000","last_change":"2024-02-18T16:21:01.843918+0000","last_active":"2024-02-18T16:22:30.457179+0000","last_peered":"2024-02-18T16:22:30.457179+0000","last_clean":"2024-02-18T16:22:30.457179+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:22:30.457179+0000","last_undegraded":"2024-02-18T16:22:30.457179+0000","last_fullsized":"2024-02-18T16:22:30.457179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:09:44.480187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951870+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:21:40.951870+0000","last_peered":"2024-02-18T16:21:40.951870+0000","last_clean":"2024-02-18T16:21:40.951870+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:21:40.951870+0000","last_undegraded":"2024-02-18T16:21:40.951870+0000","last_fullsized":"2024-02-18T16:21:40.951870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:47:05.595193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939474+0000","last_change":"2024-02-18T16:21:01.855777+0000","last_active":"2024-02-18T16:21:40.939474+0000","last_peered":"2024-02-18T16:21:40.939474+0000","last_clean":"2024-02-18T16:21:40.939474+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:21:40.939474+0000","last_undegraded":"2024-02-18T16:21:40.939474+0000","last_fullsized":"2024-02-18T16:21:40.939474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:58.959710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953859+0000","last_change":"2024-02-18T16:20:59.854737+0000","last_active":"2024-02-18T16:21:40.953859+0000","last_peered":"2024-02-18T16:21:40.953859+0000","last_clean":"2024-02-18T16:21:40.953859+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:21:40.953859+0000","last_undegraded":"2024-02-18T16:21:40.953859+0000","last_fullsized":"2024-02-18T16:21:40.953859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:54:26.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.165380+0000","last_change":"2024-02-18T16:21:01.838289+0000","last_active":"2024-02-18T16:21:47.165380+0000","last_peered":"2024-02-18T16:21:47.165380+0000","last_clean":"2024-02-18T16:21:47.165380+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:21:47.165380+0000","last_undegraded":"2024-02-18T16:21:47.165380+0000","last_fullsized":"2024-02-18T16:21:47.165380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:42:52.847667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955671+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:21:40.955671+0000","last_peered":"2024-02-18T16:21:40.955671+0000","last_clean":"2024-02-18T16:21:40.955671+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:21:40.955671+0000","last_undegraded":"2024-02-18T16:21:40.955671+0000","last_fullsized":"2024-02-18T16:21:40.955671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:48:18.150893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935916+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:21:40.935916+0000","last_peered":"2024-02-18T16:21:40.935916+0000","last_clean":"2024-02-18T16:21:40.935916+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:21:40.935916+0000","last_undegraded":"2024-02-18T16:21:40.935916+0000","last_fullsized":"2024-02-18T16:21:40.935916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:46:46.292617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.184388+0000","last_change":"2024-02-18T16:21:01.848174+0000","last_active":"2024-02-18T16:21:41.184388+0000","last_peered":"2024-02-18T16:21:41.184388+0000","last_clean":"2024-02-18T16:21:41.184388+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:21:41.184388+0000","last_undegraded":"2024-02-18T16:21:41.184388+0000","last_fullsized":"2024-02-18T16:21:41.184388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:36:39.607508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174728+0000","last_change":"2024-02-18T16:20:59.856141+0000","last_active":"2024-02-18T16:21:41.174728+0000","last_peered":"2024-02-18T16:21:41.174728+0000","last_clean":"2024-02-18T16:21:41.174728+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:21:41.174728+0000","last_undegraded":"2024-02-18T16:21:41.174728+0000","last_fullsized":"2024-02-18T16:21:41.174728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:27:39.301396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944734+0000","last_change":"2024-02-18T16:21:01.839351+0000","last_active":"2024-02-18T16:21:40.944734+0000","last_peered":"2024-02-18T16:21:40.944734+0000","last_clean":"2024-02-18T16:21:40.944734+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:21:40.944734+0000","last_undegraded":"2024-02-18T16:21:40.944734+0000","last_fullsized":"2024-02-18T16:21:40.944734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:43.462047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1930,"ondisk_log_size":1930,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1340,"num_read_kb":1123,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1173,"ondisk_log_size":1173,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.748}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68799999999999994}]},{"osd":2,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.59399999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":18.120999999999999,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":11.683999999999999,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Feb 18 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":26.050999999999998,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.76600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72499999999999998}]},{"osd":2,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61299999999999999}]},{"osd":3,"last update":"Sun Feb 18 16:21:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57399999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Feb 18 16:21:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.751},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:22:49.044 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.044 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.044 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.045 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.045 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.045 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.045 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.045 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.045 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.046 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.046 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.046 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.046 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.046 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.046 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.047 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.047 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.047 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.047 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.047 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.047 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.048 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.048 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.048 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.048 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.048 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.049 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.050 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.051 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.052 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.052 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.052 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.052 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.052 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.052 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.053 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.054 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.054 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.054 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.054 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.054 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.054 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.055 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.056 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.057 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.058 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.059 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.060 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-18T16:20:44.740634+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=44, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.060 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.060 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.060 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.060 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.060 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.061 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.062 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.062 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.062 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.062 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.062 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.063 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.063 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.063 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.063 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.063 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.063 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.064 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.064 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.064 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.064 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.064 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.065 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.065 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.065 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.065 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.065 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.065 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.066 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.066 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.066 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.066 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.066 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.066 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.067 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.067 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.067 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.067 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.067 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.067 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.068 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.068 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.068 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.068 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.069 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.069 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.069 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.069 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.069 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.069 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.070 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.070 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.070 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.070 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.071 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.071 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.071 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.071 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.071 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.071 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.072 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.072 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.072 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.072 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.072 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.072 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.073 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.073 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.073 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.073 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.073 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.074 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.074 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.074 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.074 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.074 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.075 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.075 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.075 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.075 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.075 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.075 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.076 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.076 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.076 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.076 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.077 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.077 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.077 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.077 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.077 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.078 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.078 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.078 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.078 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.078 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.078 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.079 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.079 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.079 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.079 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.079 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.080 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.080 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.080 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.080 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.080 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.080 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.081 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.082 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.082 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.082 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.082 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.082 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.082 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.083 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.084 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.084 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.084 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.084 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.085 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.085 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.085 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.085 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.085 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.085 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.086 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.086 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.086 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.086 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.086 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.086 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.087 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.087 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.087 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.087 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.087 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.088 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.089 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:22:49.089 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-18T16:23:09.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:23:09.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f35512d3640 1 Processor -- start 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f35512d3640 1 -- start start 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f35512d3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f354c128d10 0x7f354c1290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f35512d3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c095ee0 con 0x7f354c12bb20 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f35512d3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c095b30 con 0x7f354c128d10 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f354affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f354c128d10 0x7f354c1290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f354a7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f354c12bb20 0x7f354c12bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43536/0 (socket says 172.21.15.80:43536) 2024-02-18T16:23:09.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f354a7fc640 1 -- 172.21.15.80:0/3678222506 learned_addr learned my addr 172.21.15.80:0/3678222506 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:23:09.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f354affd640 1 -- 172.21.15.80:0/3678222506 >> v1:172.21.15.80:6789/0 conn(0x7f354c12bb20 legacy=0x7f354c12bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:09.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f354affd640 1 -- 172.21.15.80:0/3678222506 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c096320 con 0x7f354c128d10 2024-02-18T16:23:09.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f354affd640 1 --2- 172.21.15.80:0/3678222506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c1290f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f353c009740 tx=0x7f353c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c7ecad4de9aa4c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:09.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f3549ffb640 1 -- 172.21.15.80:0/3678222506 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f353c0ab530 con 0x7f354c128d10 2024-02-18T16:23:09.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f3549ffb640 1 -- 172.21.15.80:0/3678222506 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0a7050 con 0x7f354c128d10 2024-02-18T16:23:09.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.211+0000 7f3549ffb640 1 -- 172.21.15.80:0/3678222506 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f353c0ab7e0 con 0x7f354c128d10 2024-02-18T16:23:09.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/3678222506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 msgr2=0x7f354c1290f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:09.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 --2- 172.21.15.80:0/3678222506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c1290f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f353c009740 tx=0x7f353c01c400 comp rx=0 tx=0).stop 2024-02-18T16:23:09.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/3678222506 shutdown_connections 2024-02-18T16:23:09.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 --2- 172.21.15.80:0/3678222506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c1290f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:09.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/3678222506 >> 172.21.15.80:0/3678222506 conn(0x7f354c09a2f0 msgr2=0x7f354c09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/3678222506 shutdown_connections 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/3678222506 wait complete. 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 Processor -- start 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- start start 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c12eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c131020 con 0x7f354c128d10 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f354affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c12eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:09.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f354affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c12eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44932/0 (socket says 172.21.15.80:44932) 2024-02-18T16:23:09.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f354affd640 1 -- 172.21.15.80:0/991955529 learned_addr learned my addr 172.21.15.80:0/991955529 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:23:09.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f354affd640 1 -- 172.21.15.80:0/991955529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c009420 con 0x7f354c128d10 2024-02-18T16:23:09.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f354affd640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c12eb10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f353c0ae040 tx=0x7f353c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:09.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f353c0b4750 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0a4e90 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c130700 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f353c0b49e0 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c1317c0 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c067e00 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f353c0b2040 con 0x7f354c128d10 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35337fe640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3538035a10 0x7f3538037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:09.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.215+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f353c0e2da0 con 0x7f354c128d10 2024-02-18T16:23:09.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.219+0000 7f354a7fc640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3538035a10 0x7f3538037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:09.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.219+0000 7f354a7fc640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3538035a10 0x7f3538037ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3540001610 tx=0x7f3540007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:09.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.223+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f353c0bc9a0 con 0x7f354c128d10 2024-02-18T16:23:09.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.371+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f354c09b760 con 0x7f3538035a10 2024-02-18T16:23:09.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.419+0000 7f35337fe640 1 -- 172.21.15.80:0/991955529 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666502 (secure 0 0 0) 0x7f354c09b760 con 0x7f3538035a10 2024-02-18T16:23:09.434 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:23:09.440 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:23:09.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3538035a10 msgr2=0x7f3538037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3538035a10 0x7f3538037ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3540001610 tx=0x7f3540007ad0 comp rx=0 tx=0).stop 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 msgr2=0x7f354c12eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c12eb10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f353c0ae040 tx=0x7f353c0191a0 comp rx=0 tx=0).stop 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 shutdown_connections 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3538035a10 0x7f3538037ed0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 --2- 172.21.15.80:0/991955529 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f354c128d10 0x7f354c12eb10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 >> 172.21.15.80:0/991955529 conn(0x7f354c09a2f0 msgr2=0x7f354c0970b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:23:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 shutdown_connections 2024-02-18T16:23:09.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:09.423+0000 7f35512d3640 1 -- 172.21.15.80:0/991955529 wait complete. 2024-02-18T16:23:09.449 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-02-18T16:23:07.817376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1150,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3904,"ondisk_log_size":3904,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1150,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006818"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194665+0000","last_change":"2024-02-18T16:20:59.848322+0000","last_active":"2024-02-18T16:22:48.194665+0000","last_peered":"2024-02-18T16:22:48.194665+0000","last_clean":"2024-02-18T16:22:48.194665+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:22:48.194665+0000","last_undegraded":"2024-02-18T16:22:48.194665+0000","last_fullsized":"2024-02-18T16:22:48.194665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436973+0000","last_change":"2024-02-18T16:21:01.837422+0000","last_active":"2024-02-18T16:21:46.436973+0000","last_peered":"2024-02-18T16:21:46.436973+0000","last_clean":"2024-02-18T16:21:46.436973+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:21:46.436973+0000","last_undegraded":"2024-02-18T16:21:46.436973+0000","last_fullsized":"2024-02-18T16:21:46.436973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267975+0000","last_change":"2024-02-18T16:20:59.862127+0000","last_active":"2024-02-18T16:22:47.267975+0000","last_peered":"2024-02-18T16:22:47.267975+0000","last_clean":"2024-02-18T16:22:47.267975+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:22:47.267975+0000","last_undegraded":"2024-02-18T16:22:47.267975+0000","last_fullsized":"2024-02-18T16:22:47.267975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.177058+0000","last_change":"2024-02-18T16:21:01.856123+0000","last_active":"2024-02-18T16:21:47.177058+0000","last_peered":"2024-02-18T16:21:47.177058+0000","last_clean":"2024-02-18T16:21:47.177058+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:21:47.177058+0000","last_undegraded":"2024-02-18T16:21:47.177058+0000","last_fullsized":"2024-02-18T16:21:47.177058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660662+0000","last_change":"2024-02-18T16:20:59.872708+0000","last_active":"2024-02-18T16:22:48.660662+0000","last_peered":"2024-02-18T16:22:48.660662+0000","last_clean":"2024-02-18T16:22:48.660662+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:22:48.660662+0000","last_undegraded":"2024-02-18T16:22:48.660662+0000","last_fullsized":"2024-02-18T16:22:48.660662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471563+0000","last_change":"2024-02-18T16:21:01.856474+0000","last_active":"2024-02-18T16:22:30.471563+0000","last_peered":"2024-02-18T16:22:30.471563+0000","last_clean":"2024-02-18T16:22:30.471563+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:22:30.471563+0000","last_undegraded":"2024-02-18T16:22:30.471563+0000","last_fullsized":"2024-02-18T16:22:30.471563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194622+0000","last_change":"2024-02-18T16:20:59.833010+0000","last_active":"2024-02-18T16:22:48.194622+0000","last_peered":"2024-02-18T16:22:48.194622+0000","last_clean":"2024-02-18T16:22:48.194622+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:22:48.194622+0000","last_undegraded":"2024-02-18T16:22:48.194622+0000","last_fullsized":"2024-02-18T16:22:48.194622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.751028+0000","last_change":"2024-02-18T16:23:03.751173+0000","last_active":"2024-02-18T16:23:03.751028+0000","last_peered":"2024-02-18T16:23:03.751028+0000","last_clean":"2024-02-18T16:23:03.751028+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:23:03.751028+0000","last_undegraded":"2024-02-18T16:23:03.751028+0000","last_fullsized":"2024-02-18T16:23:03.751028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.750777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:02.603622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949247+0000","last_change":"2024-02-18T16:20:59.868597+0000","last_active":"2024-02-18T16:21:40.949247+0000","last_peered":"2024-02-18T16:21:40.949247+0000","last_clean":"2024-02-18T16:21:40.949247+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:21:40.949247+0000","last_undegraded":"2024-02-18T16:21:40.949247+0000","last_fullsized":"2024-02-18T16:21:40.949247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.729169+0000","last_change":"2024-02-18T16:21:01.836895+0000","last_active":"2024-02-18T16:22:47.729169+0000","last_peered":"2024-02-18T16:22:47.729169+0000","last_clean":"2024-02-18T16:22:47.729169+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:22:47.729169+0000","last_undegraded":"2024-02-18T16:22:47.729169+0000","last_fullsized":"2024-02-18T16:22:47.729169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937651+0000","last_change":"2024-02-18T16:20:59.827833+0000","last_active":"2024-02-18T16:21:40.937651+0000","last_peered":"2024-02-18T16:21:40.937651+0000","last_clean":"2024-02-18T16:21:40.937651+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:21:40.937651+0000","last_undegraded":"2024-02-18T16:21:40.937651+0000","last_fullsized":"2024-02-18T16:21:40.937651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.868892+0000","last_change":"2024-02-18T16:21:01.856191+0000","last_active":"2024-02-18T16:21:47.868892+0000","last_peered":"2024-02-18T16:21:47.868892+0000","last_clean":"2024-02-18T16:21:47.868892+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:21:47.868892+0000","last_undegraded":"2024-02-18T16:21:47.868892+0000","last_fullsized":"2024-02-18T16:21:47.868892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.082322+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:36.082322+0000","last_peered":"2024-02-18T16:22:36.082322+0000","last_clean":"2024-02-18T16:22:36.082322+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:36.082322+0000","last_undegraded":"2024-02-18T16:22:36.082322+0000","last_fullsized":"2024-02-18T16:22:36.082322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'17","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098344+0000","last_change":"2024-02-18T16:21:01.831792+0000","last_active":"2024-02-18T16:22:36.098344+0000","last_peered":"2024-02-18T16:22:36.098344+0000","last_clean":"2024-02-18T16:22:36.098344+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:22:36.098344+0000","last_undegraded":"2024-02-18T16:22:36.098344+0000","last_fullsized":"2024-02-18T16:22:36.098344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:45.690414+0000","last_change":"2024-02-18T16:20:59.851482+0000","last_active":"2024-02-18T16:21:45.690414+0000","last_peered":"2024-02-18T16:21:45.690414+0000","last_clean":"2024-02-18T16:21:45.690414+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:21:45.690414+0000","last_undegraded":"2024-02-18T16:21:45.690414+0000","last_fullsized":"2024-02-18T16:21:45.690414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.879925+0000","last_change":"2024-02-18T16:21:01.845622+0000","last_active":"2024-02-18T16:21:46.879925+0000","last_peered":"2024-02-18T16:21:46.879925+0000","last_clean":"2024-02-18T16:21:46.879925+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:21:46.879925+0000","last_undegraded":"2024-02-18T16:21:46.879925+0000","last_fullsized":"2024-02-18T16:21:46.879925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471831+0000","last_change":"2024-02-18T16:21:01.852206+0000","last_active":"2024-02-18T16:22:30.471831+0000","last_peered":"2024-02-18T16:22:30.471831+0000","last_clean":"2024-02-18T16:22:30.471831+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:22:30.471831+0000","last_undegraded":"2024-02-18T16:22:30.471831+0000","last_fullsized":"2024-02-18T16:22:30.471831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:45.689890+0000","last_change":"2024-02-18T16:20:59.861096+0000","last_active":"2024-02-18T16:21:45.689890+0000","last_peered":"2024-02-18T16:21:45.689890+0000","last_clean":"2024-02-18T16:21:45.689890+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:21:45.689890+0000","last_undegraded":"2024-02-18T16:21:45.689890+0000","last_fullsized":"2024-02-18T16:21:45.689890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.470571+0000","last_change":"2024-02-18T16:21:01.833772+0000","last_active":"2024-02-18T16:22:30.470571+0000","last_peered":"2024-02-18T16:22:30.470571+0000","last_clean":"2024-02-18T16:22:30.470571+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:22:30.470571+0000","last_undegraded":"2024-02-18T16:22:30.470571+0000","last_fullsized":"2024-02-18T16:22:30.470571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954243+0000","last_change":"2024-02-18T16:20:59.858318+0000","last_active":"2024-02-18T16:21:40.954243+0000","last_peered":"2024-02-18T16:21:40.954243+0000","last_clean":"2024-02-18T16:21:40.954243+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:21:40.954243+0000","last_undegraded":"2024-02-18T16:21:40.954243+0000","last_fullsized":"2024-02-18T16:21:40.954243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.096385+0000","last_change":"2024-02-18T16:21:01.848259+0000","last_active":"2024-02-18T16:22:36.096385+0000","last_peered":"2024-02-18T16:22:36.096385+0000","last_clean":"2024-02-18T16:22:36.096385+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:22:36.096385+0000","last_undegraded":"2024-02-18T16:22:36.096385+0000","last_fullsized":"2024-02-18T16:22:36.096385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.156142+0000","last_change":"2024-02-18T16:20:59.862404+0000","last_active":"2024-02-18T16:21:47.156142+0000","last_peered":"2024-02-18T16:21:47.156142+0000","last_clean":"2024-02-18T16:21:47.156142+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:21:47.156142+0000","last_undegraded":"2024-02-18T16:21:47.156142+0000","last_fullsized":"2024-02-18T16:21:47.156142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.097969+0000","last_change":"2024-02-18T16:21:01.844448+0000","last_active":"2024-02-18T16:22:36.097969+0000","last_peered":"2024-02-18T16:22:36.097969+0000","last_clean":"2024-02-18T16:22:36.097969+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:22:36.097969+0000","last_undegraded":"2024-02-18T16:22:36.097969+0000","last_fullsized":"2024-02-18T16:22:36.097969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929691+0000","last_change":"2024-02-18T16:20:59.861087+0000","last_active":"2024-02-18T16:21:40.929691+0000","last_peered":"2024-02-18T16:21:40.929691+0000","last_clean":"2024-02-18T16:21:40.929691+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:21:40.929691+0000","last_undegraded":"2024-02-18T16:21:40.929691+0000","last_fullsized":"2024-02-18T16:21:40.929691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'1","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.960072+0000","last_change":"2024-02-18T16:21:01.849052+0000","last_active":"2024-02-18T16:22:29.960072+0000","last_peered":"2024-02-18T16:22:29.960072+0000","last_clean":"2024-02-18T16:22:29.960072+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:22:29.960072+0000","last_undegraded":"2024-02-18T16:22:29.960072+0000","last_fullsized":"2024-02-18T16:22:29.960072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.162169+0000","last_change":"2024-02-18T16:20:59.860613+0000","last_active":"2024-02-18T16:21:47.162169+0000","last_peered":"2024-02-18T16:21:47.162169+0000","last_clean":"2024-02-18T16:21:47.162169+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:21:47.162169+0000","last_undegraded":"2024-02-18T16:21:47.162169+0000","last_fullsized":"2024-02-18T16:21:47.162169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.097405+0000","last_change":"2024-02-18T16:21:01.838527+0000","last_active":"2024-02-18T16:22:36.097405+0000","last_peered":"2024-02-18T16:22:36.097405+0000","last_clean":"2024-02-18T16:22:36.097405+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:22:36.097405+0000","last_undegraded":"2024-02-18T16:22:36.097405+0000","last_fullsized":"2024-02-18T16:22:36.097405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:45.690042+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:21:45.690042+0000","last_peered":"2024-02-18T16:21:45.690042+0000","last_clean":"2024-02-18T16:21:45.690042+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:21:45.690042+0000","last_undegraded":"2024-02-18T16:21:45.690042+0000","last_fullsized":"2024-02-18T16:21:45.690042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.114887+0000","last_change":"2024-02-18T16:21:09.915975+0000","last_active":"2024-02-18T16:22:36.114887+0000","last_peered":"2024-02-18T16:22:36.114887+0000","last_clean":"2024-02-18T16:22:36.114887+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:22:36.114887+0000","last_undegraded":"2024-02-18T16:22:36.114887+0000","last_fullsized":"2024-02-18T16:22:36.114887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.959738+0000","last_change":"2024-02-18T16:21:01.853570+0000","last_active":"2024-02-18T16:22:29.959738+0000","last_peered":"2024-02-18T16:22:29.959738+0000","last_clean":"2024-02-18T16:22:29.959738+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:22:29.959738+0000","last_undegraded":"2024-02-18T16:22:29.959738+0000","last_fullsized":"2024-02-18T16:22:29.959738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.145303+0000","last_change":"2024-02-18T16:20:59.871560+0000","last_active":"2024-02-18T16:21:47.145303+0000","last_peered":"2024-02-18T16:21:47.145303+0000","last_clean":"2024-02-18T16:21:47.145303+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:21:47.145303+0000","last_undegraded":"2024-02-18T16:21:47.145303+0000","last_fullsized":"2024-02-18T16:21:47.145303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.907078+0000","last_change":"2024-02-18T16:22:49.907189+0000","last_active":"2024-02-18T16:22:49.907078+0000","last_peered":"2024-02-18T16:22:49.907078+0000","last_clean":"2024-02-18T16:22:49.907078+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:22:49.907078+0000","last_undegraded":"2024-02-18T16:22:49.907078+0000","last_fullsized":"2024-02-18T16:22:49.907078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.906822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:01.255503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'32","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.931029+0000","last_change":"2024-02-18T16:21:05.901603+0000","last_active":"2024-02-18T16:22:43.931029+0000","last_peered":"2024-02-18T16:22:43.931029+0000","last_clean":"2024-02-18T16:22:43.931029+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:22:43.931029+0000","last_undegraded":"2024-02-18T16:22:43.931029+0000","last_fullsized":"2024-02-18T16:22:43.931029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946109+0000","last_change":"2024-02-18T16:21:07.918527+0000","last_active":"2024-02-18T16:21:40.946109+0000","last_peered":"2024-02-18T16:21:40.946109+0000","last_clean":"2024-02-18T16:21:40.946109+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:21:40.946109+0000","last_undegraded":"2024-02-18T16:21:40.946109+0000","last_fullsized":"2024-02-18T16:21:40.946109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.177233+0000","last_change":"2024-02-18T16:21:09.916272+0000","last_active":"2024-02-18T16:22:30.177233+0000","last_peered":"2024-02-18T16:22:30.177233+0000","last_clean":"2024-02-18T16:22:30.177233+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:22:30.177233+0000","last_undegraded":"2024-02-18T16:22:30.177233+0000","last_fullsized":"2024-02-18T16:22:30.177233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951829+0000","last_change":"2024-02-18T16:21:01.856905+0000","last_active":"2024-02-18T16:21:40.951829+0000","last_peered":"2024-02-18T16:21:40.951829+0000","last_clean":"2024-02-18T16:21:40.951829+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:21:40.951829+0000","last_undegraded":"2024-02-18T16:21:40.951829+0000","last_fullsized":"2024-02-18T16:21:40.951829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936964+0000","last_change":"2024-02-18T16:20:59.829726+0000","last_active":"2024-02-18T16:21:40.936964+0000","last_peered":"2024-02-18T16:21:40.936964+0000","last_clean":"2024-02-18T16:21:40.936964+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:21:40.936964+0000","last_undegraded":"2024-02-18T16:21:40.936964+0000","last_fullsized":"2024-02-18T16:21:40.936964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176065+0000","last_change":"2024-02-18T16:21:03.852211+0000","last_active":"2024-02-18T16:21:41.176065+0000","last_peered":"2024-02-18T16:21:41.176065+0000","last_clean":"2024-02-18T16:21:41.176065+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:21:41.176065+0000","last_undegraded":"2024-02-18T16:21:41.176065+0000","last_fullsized":"2024-02-18T16:21:41.176065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.663405+0000","last_change":"2024-02-18T16:22:55.663488+0000","last_active":"2024-02-18T16:22:55.663405+0000","last_peered":"2024-02-18T16:22:55.663405+0000","last_clean":"2024-02-18T16:22:55.663405+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:22:55.663405+0000","last_undegraded":"2024-02-18T16:22:55.663405+0000","last_fullsized":"2024-02-18T16:22:55.663405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.663204+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:33.049677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.622259+0000","last_change":"2024-02-18T16:23:02.622314+0000","last_active":"2024-02-18T16:23:02.622259+0000","last_peered":"2024-02-18T16:23:02.622259+0000","last_clean":"2024-02-18T16:23:02.622259+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:23:02.622259+0000","last_undegraded":"2024-02-18T16:23:02.622259+0000","last_fullsized":"2024-02-18T16:23:02.622259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.622050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.772173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174052+0000","last_change":"2024-02-18T16:21:09.926133+0000","last_active":"2024-02-18T16:21:41.174052+0000","last_peered":"2024-02-18T16:21:41.174052+0000","last_clean":"2024-02-18T16:21:41.174052+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:21:41.174052+0000","last_undegraded":"2024-02-18T16:21:41.174052+0000","last_fullsized":"2024-02-18T16:21:41.174052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098695+0000","last_change":"2024-02-18T16:21:41.176291+0000","last_active":"2024-02-18T16:22:36.098695+0000","last_peered":"2024-02-18T16:22:36.098695+0000","last_clean":"2024-02-18T16:22:36.098695+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:22:36.098695+0000","last_undegraded":"2024-02-18T16:22:36.098695+0000","last_fullsized":"2024-02-18T16:22:36.098695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933943+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:21:40.933943+0000","last_peered":"2024-02-18T16:21:40.933943+0000","last_clean":"2024-02-18T16:21:40.933943+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:21:40.933943+0000","last_undegraded":"2024-02-18T16:21:40.933943+0000","last_fullsized":"2024-02-18T16:21:40.933943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:43.859242+0000","last_change":"2024-02-18T16:21:40.955018+0000","last_active":"2024-02-18T16:21:43.859242+0000","last_peered":"2024-02-18T16:21:43.859242+0000","last_clean":"2024-02-18T16:21:43.859242+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:21:43.859242+0000","last_undegraded":"2024-02-18T16:21:43.859242+0000","last_fullsized":"2024-02-18T16:21:43.859242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.873382+0000","last_change":"2024-02-18T16:22:56.873532+0000","last_active":"2024-02-18T16:22:56.873382+0000","last_peered":"2024-02-18T16:22:56.873382+0000","last_clean":"2024-02-18T16:22:56.873382+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:22:56.873382+0000","last_undegraded":"2024-02-18T16:22:56.873382+0000","last_fullsized":"2024-02-18T16:22:56.873382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.873112+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:36.931560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'243","reported_seq":309,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.134597+0000","last_change":"2024-02-18T16:21:07.917843+0000","last_active":"2024-02-18T16:22:44.134597+0000","last_peered":"2024-02-18T16:22:44.134597+0000","last_clean":"2024-02-18T16:22:44.134597+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:22:44.134597+0000","last_undegraded":"2024-02-18T16:22:44.134597+0000","last_fullsized":"2024-02-18T16:22:44.134597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936881+0000","last_change":"2024-02-18T16:21:09.929317+0000","last_active":"2024-02-18T16:21:40.936881+0000","last_peered":"2024-02-18T16:21:40.936881+0000","last_clean":"2024-02-18T16:21:40.936881+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:21:40.936881+0000","last_undegraded":"2024-02-18T16:21:40.936881+0000","last_fullsized":"2024-02-18T16:21:40.936881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183905+0000","last_change":"2024-02-18T16:21:01.841643+0000","last_active":"2024-02-18T16:21:41.183905+0000","last_peered":"2024-02-18T16:21:41.183905+0000","last_clean":"2024-02-18T16:21:41.183905+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:21:41.183905+0000","last_undegraded":"2024-02-18T16:21:41.183905+0000","last_fullsized":"2024-02-18T16:21:41.183905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927996+0000","last_change":"2024-02-18T16:20:59.860132+0000","last_active":"2024-02-18T16:21:40.927996+0000","last_peered":"2024-02-18T16:21:40.927996+0000","last_clean":"2024-02-18T16:21:40.927996+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:21:40.927996+0000","last_undegraded":"2024-02-18T16:21:40.927996+0000","last_fullsized":"2024-02-18T16:21:40.927996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.961283+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:21:40.961283+0000","last_peered":"2024-02-18T16:21:40.961283+0000","last_clean":"2024-02-18T16:21:40.961283+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:21:40.961283+0000","last_undegraded":"2024-02-18T16:21:40.961283+0000","last_fullsized":"2024-02-18T16:21:40.961283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.859328+0000","last_change":"2024-02-18T16:22:58.859501+0000","last_active":"2024-02-18T16:22:58.859328+0000","last_peered":"2024-02-18T16:22:58.859328+0000","last_clean":"2024-02-18T16:22:58.859328+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:58.859328+0000","last_undegraded":"2024-02-18T16:22:58.859328+0000","last_fullsized":"2024-02-18T16:22:58.859328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.859048+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:31.803635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.144732+0000","last_change":"2024-02-18T16:21:07.907499+0000","last_active":"2024-02-18T16:22:44.144732+0000","last_peered":"2024-02-18T16:22:44.144732+0000","last_clean":"2024-02-18T16:22:44.144732+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:22:44.144732+0000","last_undegraded":"2024-02-18T16:22:44.144732+0000","last_fullsized":"2024-02-18T16:22:44.144732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936737+0000","last_change":"2024-02-18T16:21:01.852914+0000","last_active":"2024-02-18T16:21:40.936737+0000","last_peered":"2024-02-18T16:21:40.936737+0000","last_clean":"2024-02-18T16:21:40.936737+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:21:40.936737+0000","last_undegraded":"2024-02-18T16:21:40.936737+0000","last_fullsized":"2024-02-18T16:21:40.936737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948779+0000","last_change":"2024-02-18T16:20:59.835343+0000","last_active":"2024-02-18T16:21:40.948779+0000","last_peered":"2024-02-18T16:21:40.948779+0000","last_clean":"2024-02-18T16:21:40.948779+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:21:40.948779+0000","last_undegraded":"2024-02-18T16:21:40.948779+0000","last_fullsized":"2024-02-18T16:21:40.948779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.628304+0000","last_change":"2024-02-18T16:23:01.628366+0000","last_active":"2024-02-18T16:23:01.628304+0000","last_peered":"2024-02-18T16:23:01.628304+0000","last_clean":"2024-02-18T16:23:01.628304+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:23:01.628304+0000","last_undegraded":"2024-02-18T16:23:01.628304+0000","last_fullsized":"2024-02-18T16:23:01.628304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.628086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:49:06.387306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.868317+0000","last_change":"2024-02-18T16:23:00.868488+0000","last_active":"2024-02-18T16:23:00.868317+0000","last_peered":"2024-02-18T16:23:00.868317+0000","last_clean":"2024-02-18T16:23:00.868317+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:23:00.868317+0000","last_undegraded":"2024-02-18T16:23:00.868317+0000","last_fullsized":"2024-02-18T16:23:00.868317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.868066+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:38.254540+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177379+0000","last_change":"2024-02-18T16:21:07.907548+0000","last_active":"2024-02-18T16:21:41.177379+0000","last_peered":"2024-02-18T16:21:41.177379+0000","last_clean":"2024-02-18T16:21:41.177379+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:21:41.177379+0000","last_undegraded":"2024-02-18T16:21:41.177379+0000","last_fullsized":"2024-02-18T16:21:41.177379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.180516+0000","last_change":"2024-02-18T16:21:09.918869+0000","last_active":"2024-02-18T16:22:30.180516+0000","last_peered":"2024-02-18T16:22:30.180516+0000","last_clean":"2024-02-18T16:22:30.180516+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:22:30.180516+0000","last_undegraded":"2024-02-18T16:22:30.180516+0000","last_fullsized":"2024-02-18T16:22:30.180516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929750+0000","last_change":"2024-02-18T16:21:01.843254+0000","last_active":"2024-02-18T16:21:40.929750+0000","last_peered":"2024-02-18T16:21:40.929750+0000","last_clean":"2024-02-18T16:21:40.929750+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:21:40.929750+0000","last_undegraded":"2024-02-18T16:21:40.929750+0000","last_fullsized":"2024-02-18T16:21:40.929750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946658+0000","last_change":"2024-02-18T16:20:59.832949+0000","last_active":"2024-02-18T16:21:40.946658+0000","last_peered":"2024-02-18T16:21:40.946658+0000","last_clean":"2024-02-18T16:21:40.946658+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:21:40.946658+0000","last_undegraded":"2024-02-18T16:21:40.946658+0000","last_fullsized":"2024-02-18T16:21:40.946658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174720+0000","last_change":"2024-02-18T16:21:03.866038+0000","last_active":"2024-02-18T16:21:41.174720+0000","last_peered":"2024-02-18T16:21:41.174720+0000","last_clean":"2024-02-18T16:21:41.174720+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:21:41.174720+0000","last_undegraded":"2024-02-18T16:21:41.174720+0000","last_fullsized":"2024-02-18T16:21:41.174720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'32","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.027741+0000","last_change":"2024-02-18T16:21:05.902821+0000","last_active":"2024-02-18T16:22:44.027741+0000","last_peered":"2024-02-18T16:22:44.027741+0000","last_clean":"2024-02-18T16:22:44.027741+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:22:44.027741+0000","last_undegraded":"2024-02-18T16:22:44.027741+0000","last_fullsized":"2024-02-18T16:22:44.027741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.441990+0000","last_change":"2024-02-18T16:22:49.442044+0000","last_active":"2024-02-18T16:22:49.441990+0000","last_peered":"2024-02-18T16:22:49.441990+0000","last_clean":"2024-02-18T16:22:49.441990+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:22:49.441990+0000","last_undegraded":"2024-02-18T16:22:49.441990+0000","last_fullsized":"2024-02-18T16:22:49.441990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.441791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:45:05.815867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:24.546379+0000","last_change":"2024-02-18T16:21:09.931902+0000","last_active":"2024-02-18T16:22:24.546379+0000","last_peered":"2024-02-18T16:22:24.546379+0000","last_clean":"2024-02-18T16:22:24.546379+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:22:24.546379+0000","last_undegraded":"2024-02-18T16:22:24.546379+0000","last_fullsized":"2024-02-18T16:22:24.546379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.176308+0000","last_change":"2024-02-18T16:21:01.851100+0000","last_active":"2024-02-18T16:21:47.176308+0000","last_peered":"2024-02-18T16:21:47.176308+0000","last_clean":"2024-02-18T16:21:47.176308+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:21:47.176308+0000","last_undegraded":"2024-02-18T16:21:47.176308+0000","last_fullsized":"2024-02-18T16:21:47.176308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.398177+0000","last_change":"2024-02-18T16:20:59.873014+0000","last_active":"2024-02-18T16:21:46.398177+0000","last_peered":"2024-02-18T16:21:46.398177+0000","last_clean":"2024-02-18T16:21:46.398177+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:21:46.398177+0000","last_undegraded":"2024-02-18T16:21:46.398177+0000","last_fullsized":"2024-02-18T16:21:46.398177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176537+0000","last_change":"2024-02-18T16:21:03.860965+0000","last_active":"2024-02-18T16:21:41.176537+0000","last_peered":"2024-02-18T16:21:41.176537+0000","last_clean":"2024-02-18T16:21:41.176537+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:21:41.176537+0000","last_undegraded":"2024-02-18T16:21:41.176537+0000","last_fullsized":"2024-02-18T16:21:41.176537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.865927+0000","last_change":"2024-02-18T16:22:54.866009+0000","last_active":"2024-02-18T16:22:54.865927+0000","last_peered":"2024-02-18T16:22:54.865927+0000","last_clean":"2024-02-18T16:22:54.865927+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:54.865927+0000","last_undegraded":"2024-02-18T16:22:54.865927+0000","last_fullsized":"2024-02-18T16:22:54.865927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.865742+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:38.608078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":296,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.424354+0000","last_change":"2024-02-18T16:22:59.424493+0000","last_active":"2024-02-18T16:22:59.424354+0000","last_peered":"2024-02-18T16:22:59.424354+0000","last_clean":"2024-02-18T16:22:59.424354+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:59.424354+0000","last_undegraded":"2024-02-18T16:22:59.424354+0000","last_fullsized":"2024-02-18T16:22:59.424354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.424108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:27.706578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179669+0000","last_change":"2024-02-18T16:21:09.926915+0000","last_active":"2024-02-18T16:21:41.179669+0000","last_peered":"2024-02-18T16:21:41.179669+0000","last_clean":"2024-02-18T16:21:41.179669+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:21:41.179669+0000","last_undegraded":"2024-02-18T16:21:41.179669+0000","last_fullsized":"2024-02-18T16:21:41.179669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.177768+0000","last_change":"2024-02-18T16:21:01.837388+0000","last_active":"2024-02-18T16:21:47.177768+0000","last_peered":"2024-02-18T16:21:47.177768+0000","last_clean":"2024-02-18T16:21:47.177768+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:21:47.177768+0000","last_undegraded":"2024-02-18T16:21:47.177768+0000","last_fullsized":"2024-02-18T16:21:47.177768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951141+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:21:40.951141+0000","last_peered":"2024-02-18T16:21:40.951141+0000","last_clean":"2024-02-18T16:21:40.951141+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:21:40.951141+0000","last_undegraded":"2024-02-18T16:21:40.951141+0000","last_fullsized":"2024-02-18T16:21:40.951141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.385186+0000","last_change":"2024-02-18T16:23:02.385292+0000","last_active":"2024-02-18T16:23:02.385186+0000","last_peered":"2024-02-18T16:23:02.385186+0000","last_clean":"2024-02-18T16:23:02.385186+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:23:02.385186+0000","last_undegraded":"2024-02-18T16:23:02.385186+0000","last_fullsized":"2024-02-18T16:23:02.385186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.384857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'56","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.043413+0000","last_change":"2024-02-18T16:21:05.901392+0000","last_active":"2024-02-18T16:22:44.043413+0000","last_peered":"2024-02-18T16:22:44.043413+0000","last_clean":"2024-02-18T16:22:44.043413+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:22:44.043413+0000","last_undegraded":"2024-02-18T16:22:44.043413+0000","last_fullsized":"2024-02-18T16:22:44.043413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.418983+0000","last_change":"2024-02-18T16:22:48.419003+0000","last_active":"2024-02-18T16:22:48.418983+0000","last_peered":"2024-02-18T16:22:48.418983+0000","last_clean":"2024-02-18T16:22:48.418983+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:22:48.418983+0000","last_undegraded":"2024-02-18T16:22:48.418983+0000","last_fullsized":"2024-02-18T16:22:48.418983+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.418904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:26.809828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.105670+0000","last_change":"2024-02-18T16:21:09.901860+0000","last_active":"2024-02-18T16:22:36.105670+0000","last_peered":"2024-02-18T16:22:36.105670+0000","last_clean":"2024-02-18T16:22:36.105670+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:22:36.105670+0000","last_undegraded":"2024-02-18T16:22:36.105670+0000","last_fullsized":"2024-02-18T16:22:36.105670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:43.859021+0000","last_change":"2024-02-18T16:21:40.945387+0000","last_active":"2024-02-18T16:21:43.859021+0000","last_peered":"2024-02-18T16:21:43.859021+0000","last_clean":"2024-02-18T16:21:43.859021+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:21:43.859021+0000","last_undegraded":"2024-02-18T16:21:43.859021+0000","last_fullsized":"2024-02-18T16:21:43.859021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176874+0000","last_change":"2024-02-18T16:20:59.857151+0000","last_active":"2024-02-18T16:21:41.176874+0000","last_peered":"2024-02-18T16:21:41.176874+0000","last_clean":"2024-02-18T16:21:41.176874+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:21:41.176874+0000","last_undegraded":"2024-02-18T16:21:41.176874+0000","last_fullsized":"2024-02-18T16:21:41.176874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941806+0000","last_change":"2024-02-18T16:21:03.858681+0000","last_active":"2024-02-18T16:21:40.941806+0000","last_peered":"2024-02-18T16:21:40.941806+0000","last_clean":"2024-02-18T16:21:40.941806+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:21:40.941806+0000","last_undegraded":"2024-02-18T16:21:40.941806+0000","last_fullsized":"2024-02-18T16:21:40.941806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.716359+0000","last_change":"2024-02-18T16:22:53.716444+0000","last_active":"2024-02-18T16:22:53.716359+0000","last_peered":"2024-02-18T16:22:53.716359+0000","last_clean":"2024-02-18T16:22:53.716359+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:53.716359+0000","last_undegraded":"2024-02-18T16:22:53.716359+0000","last_fullsized":"2024-02-18T16:22:53.716359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.716166+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:15:00.689979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954560+0000","last_change":"2024-02-18T16:21:07.917345+0000","last_active":"2024-02-18T16:21:40.954560+0000","last_peered":"2024-02-18T16:21:40.954560+0000","last_clean":"2024-02-18T16:21:40.954560+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:21:40.954560+0000","last_undegraded":"2024-02-18T16:21:40.954560+0000","last_fullsized":"2024-02-18T16:21:40.954560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932078+0000","last_change":"2024-02-18T16:21:09.920227+0000","last_active":"2024-02-18T16:21:40.932078+0000","last_peered":"2024-02-18T16:21:40.932078+0000","last_clean":"2024-02-18T16:21:40.932078+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:21:40.932078+0000","last_undegraded":"2024-02-18T16:21:40.932078+0000","last_fullsized":"2024-02-18T16:21:40.932078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.775632+0000","last_change":"2024-02-18T16:22:59.775757+0000","last_active":"2024-02-18T16:22:59.775632+0000","last_peered":"2024-02-18T16:22:59.775632+0000","last_clean":"2024-02-18T16:22:59.775632+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:59.775632+0000","last_undegraded":"2024-02-18T16:22:59.775632+0000","last_fullsized":"2024-02-18T16:22:59.775632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.775299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:17:59.839199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947260+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:21:40.947260+0000","last_peered":"2024-02-18T16:21:40.947260+0000","last_clean":"2024-02-18T16:21:40.947260+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:21:40.947260+0000","last_undegraded":"2024-02-18T16:21:40.947260+0000","last_fullsized":"2024-02-18T16:21:40.947260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176532+0000","last_change":"2024-02-18T16:21:03.865714+0000","last_active":"2024-02-18T16:21:41.176532+0000","last_peered":"2024-02-18T16:21:41.176532+0000","last_clean":"2024-02-18T16:21:41.176532+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:21:41.176532+0000","last_undegraded":"2024-02-18T16:21:41.176532+0000","last_fullsized":"2024-02-18T16:21:41.176532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.007699+0000","last_change":"2024-02-18T16:21:05.875396+0000","last_active":"2024-02-18T16:22:44.007699+0000","last_peered":"2024-02-18T16:22:44.007699+0000","last_clean":"2024-02-18T16:22:44.007699+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:22:44.007699+0000","last_undegraded":"2024-02-18T16:22:44.007699+0000","last_fullsized":"2024-02-18T16:22:44.007699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":333,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.769891+0000","last_change":"2024-02-18T16:22:51.770013+0000","last_active":"2024-02-18T16:22:51.769891+0000","last_peered":"2024-02-18T16:22:51.769891+0000","last_clean":"2024-02-18T16:22:51.769891+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:51.769891+0000","last_undegraded":"2024-02-18T16:22:51.769891+0000","last_fullsized":"2024-02-18T16:22:51.769891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.769642+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:23:26.328772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.484503+0000","last_change":"2024-02-18T16:21:09.901476+0000","last_active":"2024-02-18T16:22:30.484503+0000","last_peered":"2024-02-18T16:22:30.484503+0000","last_clean":"2024-02-18T16:22:30.484503+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:22:30.484503+0000","last_undegraded":"2024-02-18T16:22:30.484503+0000","last_fullsized":"2024-02-18T16:22:30.484503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.959710+0000","last_change":"2024-02-18T16:21:01.854526+0000","last_active":"2024-02-18T16:22:29.959710+0000","last_peered":"2024-02-18T16:22:29.959710+0000","last_clean":"2024-02-18T16:22:29.959710+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:22:29.959710+0000","last_undegraded":"2024-02-18T16:22:29.959710+0000","last_fullsized":"2024-02-18T16:22:29.959710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940512+0000","last_change":"2024-02-18T16:20:59.863525+0000","last_active":"2024-02-18T16:21:40.940512+0000","last_peered":"2024-02-18T16:21:40.940512+0000","last_clean":"2024-02-18T16:21:40.940512+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:21:40.940512+0000","last_undegraded":"2024-02-18T16:21:40.940512+0000","last_fullsized":"2024-02-18T16:21:40.940512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'6","reported_seq":539,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.656191+0000","last_change":"2024-02-18T16:23:00.656384+0000","last_active":"2024-02-18T16:23:00.656191+0000","last_peered":"2024-02-18T16:23:00.656191+0000","last_clean":"2024-02-18T16:23:00.656191+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:23:00.656191+0000","last_undegraded":"2024-02-18T16:23:00.656191+0000","last_fullsized":"2024-02-18T16:23:00.656191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.655960+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:31:46.016785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":581,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953581+0000","last_change":"2024-02-18T16:21:05.901561+0000","last_active":"2024-02-18T16:21:40.953581+0000","last_peered":"2024-02-18T16:21:40.953581+0000","last_clean":"2024-02-18T16:21:40.953581+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:21:40.953581+0000","last_undegraded":"2024-02-18T16:21:40.953581+0000","last_fullsized":"2024-02-18T16:21:40.953581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":364,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.693726+0000","last_change":"2024-02-18T16:22:58.693788+0000","last_active":"2024-02-18T16:22:58.693726+0000","last_peered":"2024-02-18T16:22:58.693726+0000","last_clean":"2024-02-18T16:22:58.693726+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:58.693726+0000","last_undegraded":"2024-02-18T16:22:58.693726+0000","last_fullsized":"2024-02-18T16:22:58.693726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.693538+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:28.192638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.897694+0000","last_change":"2024-02-18T16:22:59.897770+0000","last_active":"2024-02-18T16:22:59.897694+0000","last_peered":"2024-02-18T16:22:59.897694+0000","last_clean":"2024-02-18T16:22:59.897694+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:22:59.897694+0000","last_undegraded":"2024-02-18T16:22:59.897694+0000","last_fullsized":"2024-02-18T16:22:59.897694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.897511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:17:33.837107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.947740+0000","last_change":"2024-02-18T16:21:01.845972+0000","last_active":"2024-02-18T16:21:40.947740+0000","last_peered":"2024-02-18T16:21:40.947740+0000","last_clean":"2024-02-18T16:21:40.947740+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:21:40.947740+0000","last_undegraded":"2024-02-18T16:21:40.947740+0000","last_fullsized":"2024-02-18T16:21:40.947740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934756+0000","last_change":"2024-02-18T16:20:59.866261+0000","last_active":"2024-02-18T16:21:40.934756+0000","last_peered":"2024-02-18T16:21:40.934756+0000","last_clean":"2024-02-18T16:21:40.934756+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:21:40.934756+0000","last_undegraded":"2024-02-18T16:21:40.934756+0000","last_fullsized":"2024-02-18T16:21:40.934756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.918064+0000","last_change":"2024-02-18T16:22:48.918122+0000","last_active":"2024-02-18T16:22:48.918064+0000","last_peered":"2024-02-18T16:22:48.918064+0000","last_clean":"2024-02-18T16:22:48.918064+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:22:48.918064+0000","last_undegraded":"2024-02-18T16:22:48.918064+0000","last_fullsized":"2024-02-18T16:22:48.918064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.917868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:12.197986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.726369+0000","last_change":"2024-02-18T16:22:52.726450+0000","last_active":"2024-02-18T16:22:52.726369+0000","last_peered":"2024-02-18T16:22:52.726369+0000","last_clean":"2024-02-18T16:22:52.726369+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:52.726369+0000","last_undegraded":"2024-02-18T16:22:52.726369+0000","last_fullsized":"2024-02-18T16:22:52.726369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.726227+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:01.503665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.749541+0000","last_change":"2024-02-18T16:22:50.749676+0000","last_active":"2024-02-18T16:22:50.749541+0000","last_peered":"2024-02-18T16:22:50.749541+0000","last_clean":"2024-02-18T16:22:50.749541+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:22:50.749541+0000","last_undegraded":"2024-02-18T16:22:50.749541+0000","last_fullsized":"2024-02-18T16:22:50.749541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.749316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:31.018219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.108910+0000","last_change":"2024-02-18T16:21:09.921128+0000","last_active":"2024-02-18T16:22:36.108910+0000","last_peered":"2024-02-18T16:22:36.108910+0000","last_clean":"2024-02-18T16:22:36.108910+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:22:36.108910+0000","last_undegraded":"2024-02-18T16:22:36.108910+0000","last_fullsized":"2024-02-18T16:22:36.108910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098331+0000","last_change":"2024-02-18T16:21:01.857176+0000","last_active":"2024-02-18T16:22:36.098331+0000","last_peered":"2024-02-18T16:22:36.098331+0000","last_clean":"2024-02-18T16:22:36.098331+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:22:36.098331+0000","last_undegraded":"2024-02-18T16:22:36.098331+0000","last_fullsized":"2024-02-18T16:22:36.098331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.727969+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:22:47.727969+0000","last_peered":"2024-02-18T16:22:47.727969+0000","last_clean":"2024-02-18T16:22:47.727969+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:22:47.727969+0000","last_undegraded":"2024-02-18T16:22:47.727969+0000","last_fullsized":"2024-02-18T16:22:47.727969+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659462+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:22:48.659462+0000","last_peered":"2024-02-18T16:22:48.659462+0000","last_clean":"2024-02-18T16:22:48.659462+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:22:48.659462+0000","last_undegraded":"2024-02-18T16:22:48.659462+0000","last_fullsized":"2024-02-18T16:22:48.659462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659514+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:22:48.659514+0000","last_peered":"2024-02-18T16:22:48.659514+0000","last_clean":"2024-02-18T16:22:48.659514+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:22:48.659514+0000","last_undegraded":"2024-02-18T16:22:48.659514+0000","last_fullsized":"2024-02-18T16:22:48.659514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.664822+0000","last_change":"2024-02-18T16:23:03.664877+0000","last_active":"2024-02-18T16:23:03.664822+0000","last_peered":"2024-02-18T16:23:03.664822+0000","last_clean":"2024-02-18T16:23:03.664822+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:23:03.664822+0000","last_undegraded":"2024-02-18T16:23:03.664822+0000","last_fullsized":"2024-02-18T16:23:03.664822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.664624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:45.069024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.122869+0000","last_change":"2024-02-18T16:21:05.897156+0000","last_active":"2024-02-18T16:22:44.122869+0000","last_peered":"2024-02-18T16:22:44.122869+0000","last_clean":"2024-02-18T16:22:44.122869+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:22:44.122869+0000","last_undegraded":"2024-02-18T16:22:44.122869+0000","last_fullsized":"2024-02-18T16:22:44.122869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.479721+0000","last_change":"2024-02-18T16:22:51.479778+0000","last_active":"2024-02-18T16:22:51.479721+0000","last_peered":"2024-02-18T16:22:51.479721+0000","last_clean":"2024-02-18T16:22:51.479721+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:22:51.479721+0000","last_undegraded":"2024-02-18T16:22:51.479721+0000","last_fullsized":"2024-02-18T16:22:51.479721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.479526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:00.256964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.875881+0000","last_change":"2024-02-18T16:22:55.875952+0000","last_active":"2024-02-18T16:22:55.875881+0000","last_peered":"2024-02-18T16:22:55.875881+0000","last_clean":"2024-02-18T16:22:55.875881+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:55.875881+0000","last_undegraded":"2024-02-18T16:22:55.875881+0000","last_fullsized":"2024-02-18T16:22:55.875881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.875669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:33.784174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955626+0000","last_change":"2024-02-18T16:21:01.853487+0000","last_active":"2024-02-18T16:21:40.955626+0000","last_peered":"2024-02-18T16:21:40.955626+0000","last_clean":"2024-02-18T16:21:40.955626+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:21:40.955626+0000","last_undegraded":"2024-02-18T16:21:40.955626+0000","last_fullsized":"2024-02-18T16:21:40.955626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659370+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:22:48.659370+0000","last_peered":"2024-02-18T16:22:48.659370+0000","last_clean":"2024-02-18T16:22:48.659370+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:22:48.659370+0000","last_undegraded":"2024-02-18T16:22:48.659370+0000","last_fullsized":"2024-02-18T16:22:48.659370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267702+0000","last_change":"2024-02-18T16:20:59.848482+0000","last_active":"2024-02-18T16:22:47.267702+0000","last_peered":"2024-02-18T16:22:47.267702+0000","last_clean":"2024-02-18T16:22:47.267702+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:22:47.267702+0000","last_undegraded":"2024-02-18T16:22:47.267702+0000","last_fullsized":"2024-02-18T16:22:47.267702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.880196+0000","last_change":"2024-02-18T16:22:50.880298+0000","last_active":"2024-02-18T16:22:50.880196+0000","last_peered":"2024-02-18T16:22:50.880196+0000","last_clean":"2024-02-18T16:22:50.880196+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:22:50.880196+0000","last_undegraded":"2024-02-18T16:22:50.880196+0000","last_fullsized":"2024-02-18T16:22:50.880196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.879993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:40:55.016859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.676194+0000","last_change":"2024-02-18T16:22:48.676283+0000","last_active":"2024-02-18T16:22:48.676194+0000","last_peered":"2024-02-18T16:22:48.676194+0000","last_clean":"2024-02-18T16:22:48.676194+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:48.676194+0000","last_undegraded":"2024-02-18T16:22:48.676194+0000","last_fullsized":"2024-02-18T16:22:48.676194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.676008+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:36.238448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950570+0000","last_change":"2024-02-18T16:21:07.915843+0000","last_active":"2024-02-18T16:21:40.950570+0000","last_peered":"2024-02-18T16:21:40.950570+0000","last_clean":"2024-02-18T16:21:40.950570+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:21:40.950570+0000","last_undegraded":"2024-02-18T16:21:40.950570+0000","last_fullsized":"2024-02-18T16:21:40.950570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.173793+0000","last_change":"2024-02-18T16:21:09.927419+0000","last_active":"2024-02-18T16:22:30.173793+0000","last_peered":"2024-02-18T16:22:30.173793+0000","last_clean":"2024-02-18T16:22:30.173793+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:22:30.173793+0000","last_undegraded":"2024-02-18T16:22:30.173793+0000","last_fullsized":"2024-02-18T16:22:30.173793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.866633+0000","last_change":"2024-02-18T16:21:01.846415+0000","last_active":"2024-02-18T16:21:47.866633+0000","last_peered":"2024-02-18T16:21:47.866633+0000","last_clean":"2024-02-18T16:21:47.866633+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:21:47.866633+0000","last_undegraded":"2024-02-18T16:21:47.866633+0000","last_fullsized":"2024-02-18T16:21:47.866633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194384+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:22:48.194384+0000","last_peered":"2024-02-18T16:22:48.194384+0000","last_clean":"2024-02-18T16:22:48.194384+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:22:48.194384+0000","last_undegraded":"2024-02-18T16:22:48.194384+0000","last_fullsized":"2024-02-18T16:22:48.194384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267551+0000","last_change":"2024-02-18T16:20:59.850718+0000","last_active":"2024-02-18T16:22:47.267551+0000","last_peered":"2024-02-18T16:22:47.267551+0000","last_clean":"2024-02-18T16:22:47.267551+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:22:47.267551+0000","last_undegraded":"2024-02-18T16:22:47.267551+0000","last_fullsized":"2024-02-18T16:22:47.267551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945421+0000","last_change":"2024-02-18T16:21:03.854140+0000","last_active":"2024-02-18T16:21:40.945421+0000","last_peered":"2024-02-18T16:21:40.945421+0000","last_clean":"2024-02-18T16:21:40.945421+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:21:40.945421+0000","last_undegraded":"2024-02-18T16:21:40.945421+0000","last_fullsized":"2024-02-18T16:21:40.945421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.880106+0000","last_change":"2024-02-18T16:23:01.880194+0000","last_active":"2024-02-18T16:23:01.880106+0000","last_peered":"2024-02-18T16:23:01.880106+0000","last_clean":"2024-02-18T16:23:01.880106+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:23:01.880106+0000","last_undegraded":"2024-02-18T16:23:01.880106+0000","last_fullsized":"2024-02-18T16:23:01.880106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.879908+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:49.968692+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.417857+0000","last_change":"2024-02-18T16:22:55.417911+0000","last_active":"2024-02-18T16:22:55.417857+0000","last_peered":"2024-02-18T16:22:55.417857+0000","last_clean":"2024-02-18T16:22:55.417857+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:22:55.417857+0000","last_undegraded":"2024-02-18T16:22:55.417857+0000","last_fullsized":"2024-02-18T16:22:55.417857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.417642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:43.506426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946879+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:21:40.946879+0000","last_peered":"2024-02-18T16:21:40.946879+0000","last_clean":"2024-02-18T16:21:40.946879+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:21:40.946879+0000","last_undegraded":"2024-02-18T16:21:40.946879+0000","last_fullsized":"2024-02-18T16:21:40.946879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179241+0000","last_change":"2024-02-18T16:21:01.841136+0000","last_active":"2024-02-18T16:21:41.179241+0000","last_peered":"2024-02-18T16:21:41.179241+0000","last_clean":"2024-02-18T16:21:41.179241+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:21:41.179241+0000","last_undegraded":"2024-02-18T16:21:41.179241+0000","last_fullsized":"2024-02-18T16:21:41.179241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659406+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:22:48.659406+0000","last_peered":"2024-02-18T16:22:48.659406+0000","last_clean":"2024-02-18T16:22:48.659406+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:22:48.659406+0000","last_undegraded":"2024-02-18T16:22:48.659406+0000","last_fullsized":"2024-02-18T16:22:48.659406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194395+0000","last_change":"2024-02-18T16:20:59.855189+0000","last_active":"2024-02-18T16:22:48.194395+0000","last_peered":"2024-02-18T16:22:48.194395+0000","last_clean":"2024-02-18T16:22:48.194395+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:22:48.194395+0000","last_undegraded":"2024-02-18T16:22:48.194395+0000","last_fullsized":"2024-02-18T16:22:48.194395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179481+0000","last_change":"2024-02-18T16:21:03.858464+0000","last_active":"2024-02-18T16:21:41.179481+0000","last_peered":"2024-02-18T16:21:41.179481+0000","last_clean":"2024-02-18T16:21:41.179481+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:21:41.179481+0000","last_undegraded":"2024-02-18T16:21:41.179481+0000","last_fullsized":"2024-02-18T16:21:41.179481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:37.498262+0000","last_change":"2024-02-18T16:21:05.897074+0000","last_active":"2024-02-18T16:22:37.498262+0000","last_peered":"2024-02-18T16:22:37.498262+0000","last_clean":"2024-02-18T16:22:37.498262+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:22:37.498262+0000","last_undegraded":"2024-02-18T16:22:37.498262+0000","last_fullsized":"2024-02-18T16:22:37.498262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955527+0000","last_change":"2024-02-18T16:21:07.918398+0000","last_active":"2024-02-18T16:21:40.955527+0000","last_peered":"2024-02-18T16:21:40.955527+0000","last_clean":"2024-02-18T16:21:40.955527+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:21:40.955527+0000","last_undegraded":"2024-02-18T16:21:40.955527+0000","last_fullsized":"2024-02-18T16:21:40.955527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927077+0000","last_change":"2024-02-18T16:21:09.915876+0000","last_active":"2024-02-18T16:21:40.927077+0000","last_peered":"2024-02-18T16:21:40.927077+0000","last_clean":"2024-02-18T16:21:40.927077+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:21:40.927077+0000","last_undegraded":"2024-02-18T16:21:40.927077+0000","last_fullsized":"2024-02-18T16:21:40.927077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.868995+0000","last_change":"2024-02-18T16:21:01.844784+0000","last_active":"2024-02-18T16:21:47.868995+0000","last_peered":"2024-02-18T16:21:47.868995+0000","last_clean":"2024-02-18T16:21:47.868995+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:21:47.868995+0000","last_undegraded":"2024-02-18T16:21:47.868995+0000","last_fullsized":"2024-02-18T16:21:47.868995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194439+0000","last_change":"2024-02-18T16:20:59.833465+0000","last_active":"2024-02-18T16:22:48.194439+0000","last_peered":"2024-02-18T16:22:48.194439+0000","last_clean":"2024-02-18T16:22:48.194439+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:22:48.194439+0000","last_undegraded":"2024-02-18T16:22:48.194439+0000","last_fullsized":"2024-02-18T16:22:48.194439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267532+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:22:47.267532+0000","last_peered":"2024-02-18T16:22:47.267532+0000","last_clean":"2024-02-18T16:22:47.267532+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:22:47.267532+0000","last_undegraded":"2024-02-18T16:22:47.267532+0000","last_fullsized":"2024-02-18T16:22:47.267532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:43.858936+0000","last_change":"2024-02-18T16:21:40.945591+0000","last_active":"2024-02-18T16:21:43.858936+0000","last_peered":"2024-02-18T16:21:43.858936+0000","last_clean":"2024-02-18T16:21:43.858936+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:21:43.858936+0000","last_undegraded":"2024-02-18T16:21:43.858936+0000","last_fullsized":"2024-02-18T16:21:43.858936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.420170+0000","last_change":"2024-02-18T16:22:56.420257+0000","last_active":"2024-02-18T16:22:56.420170+0000","last_peered":"2024-02-18T16:22:56.420170+0000","last_clean":"2024-02-18T16:22:56.420170+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:56.420170+0000","last_undegraded":"2024-02-18T16:22:56.420170+0000","last_fullsized":"2024-02-18T16:22:56.420170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.419970+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:02.428762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.748108+0000","last_change":"2024-02-18T16:22:49.748170+0000","last_active":"2024-02-18T16:22:49.748108+0000","last_peered":"2024-02-18T16:22:49.748108+0000","last_clean":"2024-02-18T16:22:49.748108+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:22:49.748108+0000","last_undegraded":"2024-02-18T16:22:49.748108+0000","last_fullsized":"2024-02-18T16:22:49.748108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.747885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:10:50.889318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.488905+0000","last_change":"2024-02-18T16:21:09.905763+0000","last_active":"2024-02-18T16:22:30.488905+0000","last_peered":"2024-02-18T16:22:30.488905+0000","last_clean":"2024-02-18T16:22:30.488905+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:22:30.488905+0000","last_undegraded":"2024-02-18T16:22:30.488905+0000","last_fullsized":"2024-02-18T16:22:30.488905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.880143+0000","last_change":"2024-02-18T16:21:01.847741+0000","last_active":"2024-02-18T16:21:46.880143+0000","last_peered":"2024-02-18T16:21:46.880143+0000","last_clean":"2024-02-18T16:21:46.880143+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:21:46.880143+0000","last_undegraded":"2024-02-18T16:21:46.880143+0000","last_fullsized":"2024-02-18T16:21:46.880143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267659+0000","last_change":"2024-02-18T16:20:59.861790+0000","last_active":"2024-02-18T16:22:47.267659+0000","last_peered":"2024-02-18T16:22:47.267659+0000","last_clean":"2024-02-18T16:22:47.267659+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:22:47.267659+0000","last_undegraded":"2024-02-18T16:22:47.267659+0000","last_fullsized":"2024-02-18T16:22:47.267659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659615+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:22:48.659615+0000","last_peered":"2024-02-18T16:22:48.659615+0000","last_clean":"2024-02-18T16:22:48.659615+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:22:48.659615+0000","last_undegraded":"2024-02-18T16:22:48.659615+0000","last_fullsized":"2024-02-18T16:22:48.659615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.818319+0000","last_change":"2024-02-18T16:22:58.818376+0000","last_active":"2024-02-18T16:22:58.818319+0000","last_peered":"2024-02-18T16:22:58.818319+0000","last_clean":"2024-02-18T16:22:58.818319+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:22:58.818319+0000","last_undegraded":"2024-02-18T16:22:58.818319+0000","last_fullsized":"2024-02-18T16:22:58.818319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.818107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:11.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.707831+0000","last_change":"2024-02-18T16:22:49.707930+0000","last_active":"2024-02-18T16:22:49.707831+0000","last_peered":"2024-02-18T16:22:49.707831+0000","last_clean":"2024-02-18T16:22:49.707831+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:22:49.707831+0000","last_undegraded":"2024-02-18T16:22:49.707831+0000","last_fullsized":"2024-02-18T16:22:49.707831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.707617+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:28.098540+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.735631+0000","last_change":"2024-02-18T16:22:50.735695+0000","last_active":"2024-02-18T16:22:50.735631+0000","last_peered":"2024-02-18T16:22:50.735631+0000","last_clean":"2024-02-18T16:22:50.735631+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:50.735631+0000","last_undegraded":"2024-02-18T16:22:50.735631+0000","last_fullsized":"2024-02-18T16:22:50.735631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.735438+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:28.643943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954125+0000","last_change":"2024-02-18T16:21:09.914553+0000","last_active":"2024-02-18T16:21:40.954125+0000","last_peered":"2024-02-18T16:21:40.954125+0000","last_clean":"2024-02-18T16:21:40.954125+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:21:40.954125+0000","last_undegraded":"2024-02-18T16:21:40.954125+0000","last_fullsized":"2024-02-18T16:21:40.954125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660810+0000","last_change":"2024-02-18T16:21:01.853061+0000","last_active":"2024-02-18T16:22:48.660810+0000","last_peered":"2024-02-18T16:22:48.660810+0000","last_clean":"2024-02-18T16:22:48.660810+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:22:48.660810+0000","last_undegraded":"2024-02-18T16:22:48.660810+0000","last_fullsized":"2024-02-18T16:22:48.660810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.957085+0000","last_change":"2024-02-18T16:20:59.868556+0000","last_active":"2024-02-18T16:21:40.957085+0000","last_peered":"2024-02-18T16:21:40.957085+0000","last_clean":"2024-02-18T16:21:40.957085+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:21:40.957085+0000","last_undegraded":"2024-02-18T16:21:40.957085+0000","last_fullsized":"2024-02-18T16:21:40.957085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267532+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:22:47.267532+0000","last_peered":"2024-02-18T16:22:47.267532+0000","last_clean":"2024-02-18T16:22:47.267532+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:22:47.267532+0000","last_undegraded":"2024-02-18T16:22:47.267532+0000","last_fullsized":"2024-02-18T16:22:47.267532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.835102+0000","last_change":"2024-02-18T16:22:53.835162+0000","last_active":"2024-02-18T16:22:53.835102+0000","last_peered":"2024-02-18T16:22:53.835102+0000","last_clean":"2024-02-18T16:22:53.835102+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:22:53.835102+0000","last_undegraded":"2024-02-18T16:22:53.835102+0000","last_fullsized":"2024-02-18T16:22:53.835102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.834880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:45:52.990486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.796606+0000","last_change":"2024-02-18T16:23:02.796672+0000","last_active":"2024-02-18T16:23:02.796606+0000","last_peered":"2024-02-18T16:23:02.796606+0000","last_clean":"2024-02-18T16:23:02.796606+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:23:02.796606+0000","last_undegraded":"2024-02-18T16:23:02.796606+0000","last_fullsized":"2024-02-18T16:23:02.796606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.796510+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:15.165336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":328,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.432132+0000","last_change":"2024-02-18T16:22:53.432203+0000","last_active":"2024-02-18T16:22:53.432132+0000","last_peered":"2024-02-18T16:22:53.432132+0000","last_clean":"2024-02-18T16:22:53.432132+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:53.432132+0000","last_undegraded":"2024-02-18T16:22:53.432132+0000","last_fullsized":"2024-02-18T16:22:53.432132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.431945+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:16.067812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.871480+0000","last_change":"2024-02-18T16:21:09.917363+0000","last_active":"2024-02-18T16:21:47.871480+0000","last_peered":"2024-02-18T16:21:47.871480+0000","last_clean":"2024-02-18T16:21:47.871480+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:21:47.871480+0000","last_undegraded":"2024-02-18T16:21:47.871480+0000","last_fullsized":"2024-02-18T16:21:47.871480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.935256+0000","last_change":"2024-02-18T16:21:01.849433+0000","last_active":"2024-02-18T16:21:40.935256+0000","last_peered":"2024-02-18T16:21:40.935256+0000","last_clean":"2024-02-18T16:21:40.935256+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:21:40.935256+0000","last_undegraded":"2024-02-18T16:21:40.935256+0000","last_fullsized":"2024-02-18T16:21:40.935256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937594+0000","last_change":"2024-02-18T16:20:59.873711+0000","last_active":"2024-02-18T16:21:40.937594+0000","last_peered":"2024-02-18T16:21:40.937594+0000","last_clean":"2024-02-18T16:21:40.937594+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:21:40.937594+0000","last_undegraded":"2024-02-18T16:21:40.937594+0000","last_fullsized":"2024-02-18T16:21:40.937594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659496+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:22:48.659496+0000","last_peered":"2024-02-18T16:22:48.659496+0000","last_clean":"2024-02-18T16:22:48.659496+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:22:48.659496+0000","last_undegraded":"2024-02-18T16:22:48.659496+0000","last_fullsized":"2024-02-18T16:22:48.659496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.848661+0000","last_change":"2024-02-18T16:22:55.848661+0000","last_active":"2024-02-18T16:22:55.848661+0000","last_peered":"2024-02-18T16:22:55.848661+0000","last_clean":"2024-02-18T16:22:55.848661+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:22:55.848661+0000","last_undegraded":"2024-02-18T16:22:55.848661+0000","last_fullsized":"2024-02-18T16:22:55.848661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.848402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:19.446935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":182,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.897921+0000","last_change":"2024-02-18T16:22:57.898018+0000","last_active":"2024-02-18T16:22:57.897921+0000","last_peered":"2024-02-18T16:22:57.897921+0000","last_clean":"2024-02-18T16:22:57.897921+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:57.897921+0000","last_undegraded":"2024-02-18T16:22:57.897921+0000","last_fullsized":"2024-02-18T16:22:57.897921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.897660+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:13.070415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.433619+0000","last_change":"2024-02-18T16:22:47.433639+0000","last_active":"2024-02-18T16:22:47.433619+0000","last_peered":"2024-02-18T16:22:47.433619+0000","last_clean":"2024-02-18T16:22:47.433619+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:22:47.433619+0000","last_undegraded":"2024-02-18T16:22:47.433619+0000","last_fullsized":"2024-02-18T16:22:47.433619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_clean_scrub_stamp":"2024-02-18T16:22:47.433513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:34.995953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.943373+0000","last_change":"2024-02-18T16:21:09.913278+0000","last_active":"2024-02-18T16:21:40.943373+0000","last_peered":"2024-02-18T16:21:40.943373+0000","last_clean":"2024-02-18T16:21:40.943373+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:21:40.943373+0000","last_undegraded":"2024-02-18T16:21:40.943373+0000","last_fullsized":"2024-02-18T16:21:40.943373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.094391+0000","last_change":"2024-02-18T16:21:09.912010+0000","last_active":"2024-02-18T16:22:36.094391+0000","last_peered":"2024-02-18T16:22:36.094391+0000","last_clean":"2024-02-18T16:22:36.094391+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:22:36.094391+0000","last_undegraded":"2024-02-18T16:22:36.094391+0000","last_fullsized":"2024-02-18T16:22:36.094391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.184457+0000","last_change":"2024-02-18T16:21:41.183619+0000","last_active":"2024-02-18T16:21:41.184457+0000","last_peered":"2024-02-18T16:21:41.184457+0000","last_clean":"2024-02-18T16:21:41.184457+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:21:41.184457+0000","last_undegraded":"2024-02-18T16:21:41.184457+0000","last_fullsized":"2024-02-18T16:21:41.184457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951391+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:21:40.951391+0000","last_peered":"2024-02-18T16:21:40.951391+0000","last_clean":"2024-02-18T16:21:40.951391+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:21:40.951391+0000","last_undegraded":"2024-02-18T16:21:40.951391+0000","last_fullsized":"2024-02-18T16:21:40.951391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.662555+0000","last_change":"2024-02-18T16:22:59.662609+0000","last_active":"2024-02-18T16:22:59.662555+0000","last_peered":"2024-02-18T16:22:59.662555+0000","last_clean":"2024-02-18T16:22:59.662555+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:22:59.662555+0000","last_undegraded":"2024-02-18T16:22:59.662555+0000","last_fullsized":"2024-02-18T16:22:59.662555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.662355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:03.409762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.873591+0000","last_change":"2024-02-18T16:22:52.873759+0000","last_active":"2024-02-18T16:22:52.873591+0000","last_peered":"2024-02-18T16:22:52.873591+0000","last_clean":"2024-02-18T16:22:52.873591+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:52.873591+0000","last_undegraded":"2024-02-18T16:22:52.873591+0000","last_fullsized":"2024-02-18T16:22:52.873591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.873343+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:03.165248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936964+0000","last_change":"2024-02-18T16:21:07.897703+0000","last_active":"2024-02-18T16:21:40.936964+0000","last_peered":"2024-02-18T16:21:40.936964+0000","last_clean":"2024-02-18T16:21:40.936964+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:21:40.936964+0000","last_undegraded":"2024-02-18T16:21:40.936964+0000","last_fullsized":"2024-02-18T16:21:40.936964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.179409+0000","last_change":"2024-02-18T16:21:09.909919+0000","last_active":"2024-02-18T16:21:41.179409+0000","last_peered":"2024-02-18T16:21:41.179409+0000","last_clean":"2024-02-18T16:21:41.179409+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:21:41.179409+0000","last_undegraded":"2024-02-18T16:21:41.179409+0000","last_fullsized":"2024-02-18T16:21:41.179409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.959744+0000","last_change":"2024-02-18T16:21:01.852159+0000","last_active":"2024-02-18T16:22:29.959744+0000","last_peered":"2024-02-18T16:22:29.959744+0000","last_clean":"2024-02-18T16:22:29.959744+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:22:29.959744+0000","last_undegraded":"2024-02-18T16:22:29.959744+0000","last_fullsized":"2024-02-18T16:22:29.959744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.941503+0000","last_change":"2024-02-18T16:20:59.833123+0000","last_active":"2024-02-18T16:21:40.941503+0000","last_peered":"2024-02-18T16:21:40.941503+0000","last_clean":"2024-02-18T16:21:40.941503+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:21:40.941503+0000","last_undegraded":"2024-02-18T16:21:40.941503+0000","last_fullsized":"2024-02-18T16:21:40.941503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.819030+0000","last_change":"2024-02-18T16:22:57.819086+0000","last_active":"2024-02-18T16:22:57.819030+0000","last_peered":"2024-02-18T16:22:57.819030+0000","last_clean":"2024-02-18T16:22:57.819030+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:22:57.819030+0000","last_undegraded":"2024-02-18T16:22:57.819030+0000","last_fullsized":"2024-02-18T16:22:57.819030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.818829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:13.082229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.400283+0000","last_change":"2024-02-18T16:23:00.400353+0000","last_active":"2024-02-18T16:23:00.400283+0000","last_peered":"2024-02-18T16:23:00.400283+0000","last_clean":"2024-02-18T16:23:00.400283+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:23:00.400283+0000","last_undegraded":"2024-02-18T16:23:00.400283+0000","last_fullsized":"2024-02-18T16:23:00.400283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.400088+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:15.271349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.800962+0000","last_change":"2024-02-18T16:22:52.801018+0000","last_active":"2024-02-18T16:22:52.800962+0000","last_peered":"2024-02-18T16:22:52.800962+0000","last_clean":"2024-02-18T16:22:52.800962+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:22:52.800962+0000","last_undegraded":"2024-02-18T16:22:52.800962+0000","last_fullsized":"2024-02-18T16:22:52.800962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.800725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:35:16.840171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177260+0000","last_change":"2024-02-18T16:21:09.926381+0000","last_active":"2024-02-18T16:21:41.177260+0000","last_peered":"2024-02-18T16:21:41.177260+0000","last_clean":"2024-02-18T16:21:41.177260+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:21:41.177260+0000","last_undegraded":"2024-02-18T16:21:41.177260+0000","last_fullsized":"2024-02-18T16:21:41.177260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.177404+0000","last_change":"2024-02-18T16:21:01.847228+0000","last_active":"2024-02-18T16:21:47.177404+0000","last_peered":"2024-02-18T16:21:47.177404+0000","last_clean":"2024-02-18T16:21:47.177404+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:21:47.177404+0000","last_undegraded":"2024-02-18T16:21:47.177404+0000","last_fullsized":"2024-02-18T16:21:47.177404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953007+0000","last_change":"2024-02-18T16:20:59.839316+0000","last_active":"2024-02-18T16:21:40.953007+0000","last_peered":"2024-02-18T16:21:40.953007+0000","last_clean":"2024-02-18T16:21:40.953007+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:21:40.953007+0000","last_undegraded":"2024-02-18T16:21:40.953007+0000","last_fullsized":"2024-02-18T16:21:40.953007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934626+0000","last_change":"2024-02-18T16:21:03.864201+0000","last_active":"2024-02-18T16:21:40.934626+0000","last_peered":"2024-02-18T16:21:40.934626+0000","last_clean":"2024-02-18T16:21:40.934626+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:21:40.934626+0000","last_undegraded":"2024-02-18T16:21:40.934626+0000","last_fullsized":"2024-02-18T16:21:40.934626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.361817+0000","last_change":"2024-02-18T16:23:01.361892+0000","last_active":"2024-02-18T16:23:01.361817+0000","last_peered":"2024-02-18T16:23:01.361817+0000","last_clean":"2024-02-18T16:23:01.361817+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:23:01.361817+0000","last_undegraded":"2024-02-18T16:23:01.361817+0000","last_fullsized":"2024-02-18T16:23:01.361817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.361622+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:34.284887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.674877+0000","last_change":"2024-02-18T16:22:54.674935+0000","last_active":"2024-02-18T16:22:54.674877+0000","last_peered":"2024-02-18T16:22:54.674877+0000","last_clean":"2024-02-18T16:22:54.674877+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:22:54.674877+0000","last_undegraded":"2024-02-18T16:22:54.674877+0000","last_fullsized":"2024-02-18T16:22:54.674877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.674677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:17.310545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.173978+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:21:47.173978+0000","last_peered":"2024-02-18T16:21:47.173978+0000","last_clean":"2024-02-18T16:21:47.173978+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:21:47.173978+0000","last_undegraded":"2024-02-18T16:21:47.173978+0000","last_fullsized":"2024-02-18T16:21:47.173978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.880640+0000","last_change":"2024-02-18T16:21:01.853323+0000","last_active":"2024-02-18T16:21:46.880640+0000","last_peered":"2024-02-18T16:21:46.880640+0000","last_clean":"2024-02-18T16:21:46.880640+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:21:46.880640+0000","last_undegraded":"2024-02-18T16:21:46.880640+0000","last_fullsized":"2024-02-18T16:21:46.880640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.945702+0000","last_change":"2024-02-18T16:20:59.853141+0000","last_active":"2024-02-18T16:21:40.945702+0000","last_peered":"2024-02-18T16:21:40.945702+0000","last_clean":"2024-02-18T16:21:40.945702+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:21:40.945702+0000","last_undegraded":"2024-02-18T16:21:40.945702+0000","last_fullsized":"2024-02-18T16:21:40.945702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.913419+0000","last_change":"2024-02-18T16:22:51.913473+0000","last_active":"2024-02-18T16:22:51.913419+0000","last_peered":"2024-02-18T16:22:51.913419+0000","last_clean":"2024-02-18T16:22:51.913419+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:22:51.913419+0000","last_undegraded":"2024-02-18T16:22:51.913419+0000","last_fullsized":"2024-02-18T16:22:51.913419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.913196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:37:17.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.903611+0000","last_change":"2024-02-18T16:23:02.903715+0000","last_active":"2024-02-18T16:23:02.903611+0000","last_peered":"2024-02-18T16:23:02.903611+0000","last_clean":"2024-02-18T16:23:02.903611+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:23:02.903611+0000","last_undegraded":"2024-02-18T16:23:02.903611+0000","last_fullsized":"2024-02-18T16:23:02.903611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.903414+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:08.912206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.831496+0000","last_change":"2024-02-18T16:22:53.831594+0000","last_active":"2024-02-18T16:22:53.831496+0000","last_peered":"2024-02-18T16:22:53.831496+0000","last_clean":"2024-02-18T16:22:53.831496+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:22:53.831496+0000","last_undegraded":"2024-02-18T16:22:53.831496+0000","last_fullsized":"2024-02-18T16:22:53.831496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.831178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:41.393618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.956899+0000","last_change":"2024-02-18T16:21:01.852475+0000","last_active":"2024-02-18T16:21:40.956899+0000","last_peered":"2024-02-18T16:21:40.956899+0000","last_clean":"2024-02-18T16:21:40.956899+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:21:40.956899+0000","last_undegraded":"2024-02-18T16:21:40.956899+0000","last_fullsized":"2024-02-18T16:21:40.956899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:45.690094+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:21:45.690094+0000","last_peered":"2024-02-18T16:21:45.690094+0000","last_clean":"2024-02-18T16:21:45.690094+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:21:45.690094+0000","last_undegraded":"2024-02-18T16:21:45.690094+0000","last_fullsized":"2024-02-18T16:21:45.690094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268534+0000","last_change":"2024-02-18T16:21:03.857015+0000","last_active":"2024-02-18T16:22:47.268534+0000","last_peered":"2024-02-18T16:22:47.268534+0000","last_clean":"2024-02-18T16:22:47.268534+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:22:47.268534+0000","last_undegraded":"2024-02-18T16:22:47.268534+0000","last_fullsized":"2024-02-18T16:22:47.268534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.423949+0000","last_change":"2024-02-18T16:22:58.424028+0000","last_active":"2024-02-18T16:22:58.423949+0000","last_peered":"2024-02-18T16:22:58.423949+0000","last_clean":"2024-02-18T16:22:58.423949+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:58.423949+0000","last_undegraded":"2024-02-18T16:22:58.423949+0000","last_fullsized":"2024-02-18T16:22:58.423949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.423765+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:19.745145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.869538+0000","last_change":"2024-02-18T16:22:54.869606+0000","last_active":"2024-02-18T16:22:54.869538+0000","last_peered":"2024-02-18T16:22:54.869538+0000","last_clean":"2024-02-18T16:22:54.869538+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:22:54.869538+0000","last_undegraded":"2024-02-18T16:22:54.869538+0000","last_fullsized":"2024-02-18T16:22:54.869538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.869352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:33.260275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.480602+0000","last_change":"2024-02-18T16:21:09.926618+0000","last_active":"2024-02-18T16:22:30.480602+0000","last_peered":"2024-02-18T16:22:30.480602+0000","last_clean":"2024-02-18T16:22:30.480602+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:22:30.480602+0000","last_undegraded":"2024-02-18T16:22:30.480602+0000","last_fullsized":"2024-02-18T16:22:30.480602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268111+0000","last_change":"2024-02-18T16:21:01.841268+0000","last_active":"2024-02-18T16:22:47.268111+0000","last_peered":"2024-02-18T16:22:47.268111+0000","last_clean":"2024-02-18T16:22:47.268111+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:22:47.268111+0000","last_undegraded":"2024-02-18T16:22:47.268111+0000","last_fullsized":"2024-02-18T16:22:47.268111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.927698+0000","last_change":"2024-02-18T16:20:59.853982+0000","last_active":"2024-02-18T16:21:40.927698+0000","last_peered":"2024-02-18T16:21:40.927698+0000","last_clean":"2024-02-18T16:21:40.927698+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:21:40.927698+0000","last_undegraded":"2024-02-18T16:21:40.927698+0000","last_fullsized":"2024-02-18T16:21:40.927698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950714+0000","last_change":"2024-02-18T16:21:03.854204+0000","last_active":"2024-02-18T16:21:40.950714+0000","last_peered":"2024-02-18T16:21:40.950714+0000","last_clean":"2024-02-18T16:21:40.950714+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:21:40.950714+0000","last_undegraded":"2024-02-18T16:21:40.950714+0000","last_fullsized":"2024-02-18T16:21:40.950714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:44.075040+0000","last_change":"2024-02-18T16:21:05.897013+0000","last_active":"2024-02-18T16:22:44.075040+0000","last_peered":"2024-02-18T16:22:44.075040+0000","last_clean":"2024-02-18T16:22:44.075040+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:22:44.075040+0000","last_undegraded":"2024-02-18T16:22:44.075040+0000","last_fullsized":"2024-02-18T16:22:44.075040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931752+0000","last_change":"2024-02-18T16:21:07.917711+0000","last_active":"2024-02-18T16:21:40.931752+0000","last_peered":"2024-02-18T16:21:40.931752+0000","last_clean":"2024-02-18T16:21:40.931752+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:21:40.931752+0000","last_undegraded":"2024-02-18T16:21:40.931752+0000","last_fullsized":"2024-02-18T16:21:40.931752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933306+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:21:40.933306+0000","last_peered":"2024-02-18T16:21:40.933306+0000","last_clean":"2024-02-18T16:21:40.933306+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:21:40.933306+0000","last_undegraded":"2024-02-18T16:21:40.933306+0000","last_fullsized":"2024-02-18T16:21:40.933306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.756135+0000","last_change":"2024-02-18T16:23:01.756244+0000","last_active":"2024-02-18T16:23:01.756135+0000","last_peered":"2024-02-18T16:23:01.756135+0000","last_clean":"2024-02-18T16:23:01.756135+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:23:01.756135+0000","last_undegraded":"2024-02-18T16:23:01.756135+0000","last_fullsized":"2024-02-18T16:23:01.756135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.755900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:58.697375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929816+0000","last_change":"2024-02-18T16:20:59.854045+0000","last_active":"2024-02-18T16:21:40.929816+0000","last_peered":"2024-02-18T16:21:40.929816+0000","last_clean":"2024-02-18T16:21:40.929816+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:21:40.929816+0000","last_undegraded":"2024-02-18T16:21:40.929816+0000","last_fullsized":"2024-02-18T16:21:40.929816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939592+0000","last_change":"2024-02-18T16:21:03.855690+0000","last_active":"2024-02-18T16:21:40.939592+0000","last_peered":"2024-02-18T16:21:40.939592+0000","last_clean":"2024-02-18T16:21:40.939592+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:21:40.939592+0000","last_undegraded":"2024-02-18T16:21:40.939592+0000","last_fullsized":"2024-02-18T16:21:40.939592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.388891+0000","last_change":"2024-02-18T16:22:57.388978+0000","last_active":"2024-02-18T16:22:57.388891+0000","last_peered":"2024-02-18T16:22:57.388891+0000","last_clean":"2024-02-18T16:22:57.388891+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:57.388891+0000","last_undegraded":"2024-02-18T16:22:57.388891+0000","last_fullsized":"2024-02-18T16:22:57.388891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.388689+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:26.576966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.357909+0000","last_change":"2024-02-18T16:23:03.357962+0000","last_active":"2024-02-18T16:23:03.357909+0000","last_peered":"2024-02-18T16:23:03.357909+0000","last_clean":"2024-02-18T16:23:03.357909+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:23:03.357909+0000","last_undegraded":"2024-02-18T16:23:03.357909+0000","last_fullsized":"2024-02-18T16:23:03.357909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.357709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:29:02.881887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939178+0000","last_change":"2024-02-18T16:21:09.911546+0000","last_active":"2024-02-18T16:21:40.939178+0000","last_peered":"2024-02-18T16:21:40.939178+0000","last_clean":"2024-02-18T16:21:40.939178+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:21:40.939178+0000","last_undegraded":"2024-02-18T16:21:40.939178+0000","last_fullsized":"2024-02-18T16:21:40.939178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.869339+0000","last_change":"2024-02-18T16:21:01.840394+0000","last_active":"2024-02-18T16:21:47.869339+0000","last_peered":"2024-02-18T16:21:47.869339+0000","last_clean":"2024-02-18T16:21:47.869339+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:21:47.869339+0000","last_undegraded":"2024-02-18T16:21:47.869339+0000","last_fullsized":"2024-02-18T16:21:47.869339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948982+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:21:40.948982+0000","last_peered":"2024-02-18T16:21:40.948982+0000","last_clean":"2024-02-18T16:21:40.948982+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:21:40.948982+0000","last_undegraded":"2024-02-18T16:21:40.948982+0000","last_fullsized":"2024-02-18T16:21:40.948982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.683276+0000","last_change":"2024-02-18T16:22:56.683330+0000","last_active":"2024-02-18T16:22:56.683276+0000","last_peered":"2024-02-18T16:22:56.683276+0000","last_clean":"2024-02-18T16:22:56.683276+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:22:56.683276+0000","last_undegraded":"2024-02-18T16:22:56.683276+0000","last_fullsized":"2024-02-18T16:22:56.683276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.683085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:46:21.980224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.101184+0000","last_change":"2024-02-18T16:21:05.897563+0000","last_active":"2024-02-18T16:22:36.101184+0000","last_peered":"2024-02-18T16:22:36.101184+0000","last_clean":"2024-02-18T16:22:36.101184+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:22:36.101184+0000","last_undegraded":"2024-02-18T16:22:36.101184+0000","last_fullsized":"2024-02-18T16:22:36.101184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:04.830164+0000","last_clean_scrub_stamp":"2024-02-18T16:21:04.830164+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.790661+0000","last_change":"2024-02-18T16:22:48.790722+0000","last_active":"2024-02-18T16:22:48.790661+0000","last_peered":"2024-02-18T16:22:48.790661+0000","last_clean":"2024-02-18T16:22:48.790661+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:48.790661+0000","last_undegraded":"2024-02-18T16:22:48.790661+0000","last_fullsized":"2024-02-18T16:22:48.790661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.790462+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:30:37.353769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931834+0000","last_change":"2024-02-18T16:21:09.924100+0000","last_active":"2024-02-18T16:21:40.931834+0000","last_peered":"2024-02-18T16:21:40.931834+0000","last_clean":"2024-02-18T16:21:40.931834+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:21:40.931834+0000","last_undegraded":"2024-02-18T16:21:40.931834+0000","last_fullsized":"2024-02-18T16:21:40.931834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940322+0000","last_change":"2024-02-18T16:21:01.837599+0000","last_active":"2024-02-18T16:21:40.940322+0000","last_peered":"2024-02-18T16:21:40.940322+0000","last_clean":"2024-02-18T16:21:40.940322+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:21:40.940322+0000","last_undegraded":"2024-02-18T16:21:40.940322+0000","last_fullsized":"2024-02-18T16:21:40.940322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929965+0000","last_change":"2024-02-18T16:20:59.859857+0000","last_active":"2024-02-18T16:21:40.929965+0000","last_peered":"2024-02-18T16:21:40.929965+0000","last_clean":"2024-02-18T16:21:40.929965+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:21:40.929965+0000","last_undegraded":"2024-02-18T16:21:40.929965+0000","last_fullsized":"2024-02-18T16:21:40.929965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.684007+0000","last_change":"2024-02-18T16:22:57.684114+0000","last_active":"2024-02-18T16:22:57.684007+0000","last_peered":"2024-02-18T16:22:57.684007+0000","last_clean":"2024-02-18T16:22:57.684007+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:22:57.684007+0000","last_undegraded":"2024-02-18T16:22:57.684007+0000","last_fullsized":"2024-02-18T16:22:57.684007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.683775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:46.393290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.747350+0000","last_change":"2024-02-18T16:22:51.747441+0000","last_active":"2024-02-18T16:22:51.747350+0000","last_peered":"2024-02-18T16:22:51.747350+0000","last_clean":"2024-02-18T16:22:51.747350+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:51.747350+0000","last_undegraded":"2024-02-18T16:22:51.747350+0000","last_fullsized":"2024-02-18T16:22:51.747350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.747142+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:31.805590+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.481423+0000","last_change":"2024-02-18T16:22:50.481478+0000","last_active":"2024-02-18T16:22:50.481423+0000","last_peered":"2024-02-18T16:22:50.481423+0000","last_clean":"2024-02-18T16:22:50.481423+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:22:50.481423+0000","last_undegraded":"2024-02-18T16:22:50.481423+0000","last_fullsized":"2024-02-18T16:22:50.481423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.481235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:40.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.432992+0000","last_change":"2024-02-18T16:21:09.927008+0000","last_active":"2024-02-18T16:21:46.432992+0000","last_peered":"2024-02-18T16:21:46.432992+0000","last_clean":"2024-02-18T16:21:46.432992+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:21:46.432992+0000","last_undegraded":"2024-02-18T16:21:46.432992+0000","last_fullsized":"2024-02-18T16:21:46.432992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937387+0000","last_change":"2024-02-18T16:21:01.831920+0000","last_active":"2024-02-18T16:21:40.937387+0000","last_peered":"2024-02-18T16:21:40.937387+0000","last_clean":"2024-02-18T16:21:40.937387+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:21:40.937387+0000","last_undegraded":"2024-02-18T16:21:40.937387+0000","last_fullsized":"2024-02-18T16:21:40.937387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951717+0000","last_change":"2024-02-18T16:20:59.872971+0000","last_active":"2024-02-18T16:21:40.951717+0000","last_peered":"2024-02-18T16:21:40.951717+0000","last_clean":"2024-02-18T16:21:40.951717+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:21:40.951717+0000","last_undegraded":"2024-02-18T16:21:40.951717+0000","last_fullsized":"2024-02-18T16:21:40.951717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.940715+0000","last_change":"2024-02-18T16:21:03.854122+0000","last_active":"2024-02-18T16:21:40.940715+0000","last_peered":"2024-02-18T16:21:40.940715+0000","last_clean":"2024-02-18T16:21:40.940715+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:21:40.940715+0000","last_undegraded":"2024-02-18T16:21:40.940715+0000","last_fullsized":"2024-02-18T16:21:40.940715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.395608+0000","last_change":"2024-02-18T16:22:54.395705+0000","last_active":"2024-02-18T16:22:54.395608+0000","last_peered":"2024-02-18T16:22:54.395608+0000","last_clean":"2024-02-18T16:22:54.395608+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:54.395608+0000","last_undegraded":"2024-02-18T16:22:54.395608+0000","last_fullsized":"2024-02-18T16:22:54.395608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.395421+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:31.781895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.932518+0000","last_change":"2024-02-18T16:21:07.908003+0000","last_active":"2024-02-18T16:21:40.932518+0000","last_peered":"2024-02-18T16:21:40.932518+0000","last_clean":"2024-02-18T16:21:40.932518+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:21:40.932518+0000","last_undegraded":"2024-02-18T16:21:40.932518+0000","last_fullsized":"2024-02-18T16:21:40.932518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954314+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:21:40.954314+0000","last_peered":"2024-02-18T16:21:40.954314+0000","last_clean":"2024-02-18T16:21:40.954314+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:21:40.954314+0000","last_undegraded":"2024-02-18T16:21:40.954314+0000","last_fullsized":"2024-02-18T16:21:40.954314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436088+0000","last_change":"2024-02-18T16:21:01.855576+0000","last_active":"2024-02-18T16:21:46.436088+0000","last_peered":"2024-02-18T16:21:46.436088+0000","last_clean":"2024-02-18T16:21:46.436088+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:21:46.436088+0000","last_undegraded":"2024-02-18T16:21:46.436088+0000","last_fullsized":"2024-02-18T16:21:46.436088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267747+0000","last_change":"2024-02-18T16:20:59.862651+0000","last_active":"2024-02-18T16:22:47.267747+0000","last_peered":"2024-02-18T16:22:47.267747+0000","last_clean":"2024-02-18T16:22:47.267747+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:22:47.267747+0000","last_undegraded":"2024-02-18T16:22:47.267747+0000","last_fullsized":"2024-02-18T16:22:47.267747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:43.831128+0000","last_change":"2024-02-18T16:21:03.858753+0000","last_active":"2024-02-18T16:22:43.831128+0000","last_peered":"2024-02-18T16:22:43.831128+0000","last_clean":"2024-02-18T16:22:43.831128+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:22:43.831128+0000","last_undegraded":"2024-02-18T16:22:43.831128+0000","last_fullsized":"2024-02-18T16:22:43.831128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.822931+0000","last_change":"2024-02-18T16:22:56.822998+0000","last_active":"2024-02-18T16:22:56.822931+0000","last_peered":"2024-02-18T16:22:56.822931+0000","last_clean":"2024-02-18T16:22:56.822931+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:56.822931+0000","last_undegraded":"2024-02-18T16:22:56.822931+0000","last_fullsized":"2024-02-18T16:22:56.822931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.822745+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:54.548170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939105+0000","last_change":"2024-02-18T16:21:07.912579+0000","last_active":"2024-02-18T16:21:40.939105+0000","last_peered":"2024-02-18T16:21:40.939105+0000","last_clean":"2024-02-18T16:21:40.939105+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:21:40.939105+0000","last_undegraded":"2024-02-18T16:21:40.939105+0000","last_fullsized":"2024-02-18T16:21:40.939105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950949+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:21:40.950949+0000","last_peered":"2024-02-18T16:21:40.950949+0000","last_clean":"2024-02-18T16:21:40.950949+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:21:40.950949+0000","last_undegraded":"2024-02-18T16:21:40.950949+0000","last_fullsized":"2024-02-18T16:21:40.950949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098414+0000","last_change":"2024-02-18T16:21:01.833320+0000","last_active":"2024-02-18T16:22:36.098414+0000","last_peered":"2024-02-18T16:22:36.098414+0000","last_clean":"2024-02-18T16:22:36.098414+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:22:36.098414+0000","last_undegraded":"2024-02-18T16:22:36.098414+0000","last_fullsized":"2024-02-18T16:22:36.098414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728312+0000","last_change":"2024-02-18T16:20:59.855832+0000","last_active":"2024-02-18T16:22:47.728312+0000","last_peered":"2024-02-18T16:22:47.728312+0000","last_clean":"2024-02-18T16:22:47.728312+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:22:47.728312+0000","last_undegraded":"2024-02-18T16:22:47.728312+0000","last_fullsized":"2024-02-18T16:22:47.728312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.562129+0000","last_change":"2024-02-18T16:21:03.862714+0000","last_active":"2024-02-18T16:22:36.562129+0000","last_peered":"2024-02-18T16:22:36.562129+0000","last_clean":"2024-02-18T16:22:36.562129+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:22:36.562129+0000","last_undegraded":"2024-02-18T16:22:36.562129+0000","last_fullsized":"2024-02-18T16:22:36.562129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'38","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.770182+0000","last_change":"2024-02-18T16:23:00.770286+0000","last_active":"2024-02-18T16:23:00.770182+0000","last_peered":"2024-02-18T16:23:00.770182+0000","last_clean":"2024-02-18T16:23:00.770182+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:23:00.770182+0000","last_undegraded":"2024-02-18T16:23:00.770182+0000","last_fullsized":"2024-02-18T16:23:00.770182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.769987+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:07.581229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.449610+0000","last_change":"2024-02-18T16:22:52.449715+0000","last_active":"2024-02-18T16:22:52.449610+0000","last_peered":"2024-02-18T16:22:52.449610+0000","last_clean":"2024-02-18T16:22:52.449610+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:22:52.449610+0000","last_undegraded":"2024-02-18T16:22:52.449610+0000","last_fullsized":"2024-02-18T16:22:52.449610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.449362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:25.393949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.467458+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:30.467458+0000","last_peered":"2024-02-18T16:22:30.467458+0000","last_clean":"2024-02-18T16:22:30.467458+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:30.467458+0000","last_undegraded":"2024-02-18T16:22:30.467458+0000","last_fullsized":"2024-02-18T16:22:30.467458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'9","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.959757+0000","last_change":"2024-02-18T16:21:01.845885+0000","last_active":"2024-02-18T16:22:29.959757+0000","last_peered":"2024-02-18T16:22:29.959757+0000","last_clean":"2024-02-18T16:22:29.959757+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:22:29.959757+0000","last_undegraded":"2024-02-18T16:22:29.959757+0000","last_fullsized":"2024-02-18T16:22:29.959757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194662+0000","last_change":"2024-02-18T16:20:59.838011+0000","last_active":"2024-02-18T16:22:48.194662+0000","last_peered":"2024-02-18T16:22:48.194662+0000","last_clean":"2024-02-18T16:22:48.194662+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:22:48.194662+0000","last_undegraded":"2024-02-18T16:22:48.194662+0000","last_fullsized":"2024-02-18T16:22:48.194662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183055+0000","last_change":"2024-02-18T16:21:01.839946+0000","last_active":"2024-02-18T16:21:41.183055+0000","last_peered":"2024-02-18T16:21:41.183055+0000","last_clean":"2024-02-18T16:21:41.183055+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:21:41.183055+0000","last_undegraded":"2024-02-18T16:21:41.183055+0000","last_fullsized":"2024-02-18T16:21:41.183055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267824+0000","last_change":"2024-02-18T16:20:59.850717+0000","last_active":"2024-02-18T16:22:47.267824+0000","last_peered":"2024-02-18T16:22:47.267824+0000","last_clean":"2024-02-18T16:22:47.267824+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:22:47.267824+0000","last_undegraded":"2024-02-18T16:22:47.267824+0000","last_fullsized":"2024-02-18T16:22:47.267824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.959709+0000","last_change":"2024-02-18T16:21:01.857016+0000","last_active":"2024-02-18T16:22:29.959709+0000","last_peered":"2024-02-18T16:22:29.959709+0000","last_clean":"2024-02-18T16:22:29.959709+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:22:29.959709+0000","last_undegraded":"2024-02-18T16:22:29.959709+0000","last_fullsized":"2024-02-18T16:22:29.959709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660371+0000","last_change":"2024-02-18T16:20:59.865570+0000","last_active":"2024-02-18T16:22:48.660371+0000","last_peered":"2024-02-18T16:22:48.660371+0000","last_clean":"2024-02-18T16:22:48.660371+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:22:48.660371+0000","last_undegraded":"2024-02-18T16:22:48.660371+0000","last_fullsized":"2024-02-18T16:22:48.660371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.882283+0000","last_change":"2024-02-18T16:21:01.844340+0000","last_active":"2024-02-18T16:21:46.882283+0000","last_peered":"2024-02-18T16:21:46.882283+0000","last_clean":"2024-02-18T16:21:46.882283+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:21:46.882283+0000","last_undegraded":"2024-02-18T16:21:46.882283+0000","last_fullsized":"2024-02-18T16:21:46.882283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267768+0000","last_change":"2024-02-18T16:20:59.857706+0000","last_active":"2024-02-18T16:22:47.267768+0000","last_peered":"2024-02-18T16:22:47.267768+0000","last_clean":"2024-02-18T16:22:47.267768+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:22:47.267768+0000","last_undegraded":"2024-02-18T16:22:47.267768+0000","last_fullsized":"2024-02-18T16:22:47.267768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177134+0000","last_change":"2024-02-18T16:21:01.852407+0000","last_active":"2024-02-18T16:21:41.177134+0000","last_peered":"2024-02-18T16:21:41.177134+0000","last_clean":"2024-02-18T16:21:41.177134+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:21:41.177134+0000","last_undegraded":"2024-02-18T16:21:41.177134+0000","last_fullsized":"2024-02-18T16:21:41.177134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177267+0000","last_change":"2024-02-18T16:20:59.859871+0000","last_active":"2024-02-18T16:21:41.177267+0000","last_peered":"2024-02-18T16:21:41.177267+0000","last_clean":"2024-02-18T16:21:41.177267+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:21:41.177267+0000","last_undegraded":"2024-02-18T16:21:41.177267+0000","last_fullsized":"2024-02-18T16:21:41.177267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.096435+0000","last_change":"2024-02-18T16:21:40.963827+0000","last_active":"2024-02-18T16:22:36.096435+0000","last_peered":"2024-02-18T16:22:36.096435+0000","last_clean":"2024-02-18T16:22:36.096435+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:22:36.096435+0000","last_undegraded":"2024-02-18T16:22:36.096435+0000","last_fullsized":"2024-02-18T16:22:36.096435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933807+0000","last_change":"2024-02-18T16:20:59.861914+0000","last_active":"2024-02-18T16:21:40.933807+0000","last_peered":"2024-02-18T16:21:40.933807+0000","last_clean":"2024-02-18T16:21:40.933807+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:21:40.933807+0000","last_undegraded":"2024-02-18T16:21:40.933807+0000","last_fullsized":"2024-02-18T16:21:40.933807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.176281+0000","last_change":"2024-02-18T16:21:01.843302+0000","last_active":"2024-02-18T16:21:41.176281+0000","last_peered":"2024-02-18T16:21:41.176281+0000","last_clean":"2024-02-18T16:21:41.176281+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:21:41.176281+0000","last_undegraded":"2024-02-18T16:21:41.176281+0000","last_fullsized":"2024-02-18T16:21:41.176281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953284+0000","last_change":"2024-02-18T16:20:59.835435+0000","last_active":"2024-02-18T16:21:40.953284+0000","last_peered":"2024-02-18T16:21:40.953284+0000","last_clean":"2024-02-18T16:21:40.953284+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:21:40.953284+0000","last_undegraded":"2024-02-18T16:21:40.953284+0000","last_fullsized":"2024-02-18T16:21:40.953284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.437937+0000","last_change":"2024-02-18T16:21:01.838281+0000","last_active":"2024-02-18T16:21:46.437937+0000","last_peered":"2024-02-18T16:21:46.437937+0000","last_clean":"2024-02-18T16:21:46.437937+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:21:46.437937+0000","last_undegraded":"2024-02-18T16:21:46.437937+0000","last_fullsized":"2024-02-18T16:21:46.437937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183398+0000","last_change":"2024-02-18T16:20:59.859552+0000","last_active":"2024-02-18T16:21:41.183398+0000","last_peered":"2024-02-18T16:21:41.183398+0000","last_clean":"2024-02-18T16:21:41.183398+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:21:41.183398+0000","last_undegraded":"2024-02-18T16:21:41.183398+0000","last_fullsized":"2024-02-18T16:21:41.183398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948028+0000","last_change":"2024-02-18T16:21:01.840265+0000","last_active":"2024-02-18T16:21:40.948028+0000","last_peered":"2024-02-18T16:21:40.948028+0000","last_clean":"2024-02-18T16:21:40.948028+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:21:40.948028+0000","last_undegraded":"2024-02-18T16:21:40.948028+0000","last_fullsized":"2024-02-18T16:21:40.948028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.934165+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:21:40.934165+0000","last_peered":"2024-02-18T16:21:40.934165+0000","last_clean":"2024-02-18T16:21:40.934165+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:21:40.934165+0000","last_undegraded":"2024-02-18T16:21:40.934165+0000","last_fullsized":"2024-02-18T16:21:40.934165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471972+0000","last_change":"2024-02-18T16:21:01.853933+0000","last_active":"2024-02-18T16:22:30.471972+0000","last_peered":"2024-02-18T16:22:30.471972+0000","last_clean":"2024-02-18T16:22:30.471972+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:22:30.471972+0000","last_undegraded":"2024-02-18T16:22:30.471972+0000","last_fullsized":"2024-02-18T16:22:30.471972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.451898+0000","last_change":"2024-02-18T16:20:59.853659+0000","last_active":"2024-02-18T16:22:30.451898+0000","last_peered":"2024-02-18T16:22:30.451898+0000","last_clean":"2024-02-18T16:22:30.451898+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:22:30.451898+0000","last_undegraded":"2024-02-18T16:22:30.451898+0000","last_fullsized":"2024-02-18T16:22:30.451898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.869612+0000","last_change":"2024-02-18T16:21:01.853974+0000","last_active":"2024-02-18T16:21:47.869612+0000","last_peered":"2024-02-18T16:21:47.869612+0000","last_clean":"2024-02-18T16:21:47.869612+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:21:47.869612+0000","last_undegraded":"2024-02-18T16:21:47.869612+0000","last_fullsized":"2024-02-18T16:21:47.869612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.930530+0000","last_change":"2024-02-18T16:20:59.859832+0000","last_active":"2024-02-18T16:21:40.930530+0000","last_peered":"2024-02-18T16:21:40.930530+0000","last_clean":"2024-02-18T16:21:40.930530+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:21:40.930530+0000","last_undegraded":"2024-02-18T16:21:40.930530+0000","last_fullsized":"2024-02-18T16:21:40.930530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.096642+0000","last_change":"2024-02-18T16:21:01.839367+0000","last_active":"2024-02-18T16:22:36.096642+0000","last_peered":"2024-02-18T16:22:36.096642+0000","last_clean":"2024-02-18T16:22:36.096642+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:22:36.096642+0000","last_undegraded":"2024-02-18T16:22:36.096642+0000","last_fullsized":"2024-02-18T16:22:36.096642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929223+0000","last_change":"2024-02-18T16:20:59.859222+0000","last_active":"2024-02-18T16:21:40.929223+0000","last_peered":"2024-02-18T16:21:40.929223+0000","last_clean":"2024-02-18T16:21:40.929223+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:21:40.929223+0000","last_undegraded":"2024-02-18T16:21:40.929223+0000","last_fullsized":"2024-02-18T16:21:40.929223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:29.959714+0000","last_change":"2024-02-18T16:21:01.848741+0000","last_active":"2024-02-18T16:22:29.959714+0000","last_peered":"2024-02-18T16:22:29.959714+0000","last_clean":"2024-02-18T16:22:29.959714+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:22:29.959714+0000","last_undegraded":"2024-02-18T16:22:29.959714+0000","last_fullsized":"2024-02-18T16:22:29.959714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951893+0000","last_change":"2024-02-18T16:20:59.863633+0000","last_active":"2024-02-18T16:21:40.951893+0000","last_peered":"2024-02-18T16:21:40.951893+0000","last_clean":"2024-02-18T16:21:40.951893+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:21:40.951893+0000","last_undegraded":"2024-02-18T16:21:40.951893+0000","last_fullsized":"2024-02-18T16:21:40.951893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.471418+0000","last_change":"2024-02-18T16:21:01.843918+0000","last_active":"2024-02-18T16:22:30.471418+0000","last_peered":"2024-02-18T16:22:30.471418+0000","last_clean":"2024-02-18T16:22:30.471418+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:22:30.471418+0000","last_undegraded":"2024-02-18T16:22:30.471418+0000","last_fullsized":"2024-02-18T16:22:30.471418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951986+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:21:40.951986+0000","last_peered":"2024-02-18T16:21:40.951986+0000","last_clean":"2024-02-18T16:21:40.951986+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:21:40.951986+0000","last_undegraded":"2024-02-18T16:21:40.951986+0000","last_fullsized":"2024-02-18T16:21:40.951986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939580+0000","last_change":"2024-02-18T16:21:01.855777+0000","last_active":"2024-02-18T16:21:40.939580+0000","last_peered":"2024-02-18T16:21:40.939580+0000","last_clean":"2024-02-18T16:21:40.939580+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:21:40.939580+0000","last_undegraded":"2024-02-18T16:21:40.939580+0000","last_fullsized":"2024-02-18T16:21:40.939580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.953970+0000","last_change":"2024-02-18T16:20:59.854737+0000","last_active":"2024-02-18T16:21:40.953970+0000","last_peered":"2024-02-18T16:21:40.953970+0000","last_clean":"2024-02-18T16:21:40.953970+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:21:40.953970+0000","last_undegraded":"2024-02-18T16:21:40.953970+0000","last_fullsized":"2024-02-18T16:21:40.953970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.176631+0000","last_change":"2024-02-18T16:21:01.838289+0000","last_active":"2024-02-18T16:21:47.176631+0000","last_peered":"2024-02-18T16:21:47.176631+0000","last_clean":"2024-02-18T16:21:47.176631+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:21:47.176631+0000","last_undegraded":"2024-02-18T16:21:47.176631+0000","last_fullsized":"2024-02-18T16:21:47.176631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.955783+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:21:40.955783+0000","last_peered":"2024-02-18T16:21:40.955783+0000","last_clean":"2024-02-18T16:21:40.955783+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:21:40.955783+0000","last_undegraded":"2024-02-18T16:21:40.955783+0000","last_fullsized":"2024-02-18T16:21:40.955783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936028+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:21:40.936028+0000","last_peered":"2024-02-18T16:21:40.936028+0000","last_clean":"2024-02-18T16:21:40.936028+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:21:40.936028+0000","last_undegraded":"2024-02-18T16:21:40.936028+0000","last_fullsized":"2024-02-18T16:21:40.936028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.184448+0000","last_change":"2024-02-18T16:21:01.848174+0000","last_active":"2024-02-18T16:21:41.184448+0000","last_peered":"2024-02-18T16:21:41.184448+0000","last_clean":"2024-02-18T16:21:41.184448+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:21:41.184448+0000","last_undegraded":"2024-02-18T16:21:41.184448+0000","last_fullsized":"2024-02-18T16:21:41.184448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174875+0000","last_change":"2024-02-18T16:20:59.856141+0000","last_active":"2024-02-18T16:21:41.174875+0000","last_peered":"2024-02-18T16:21:41.174875+0000","last_clean":"2024-02-18T16:21:41.174875+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:21:41.174875+0000","last_undegraded":"2024-02-18T16:21:41.174875+0000","last_fullsized":"2024-02-18T16:21:41.174875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944861+0000","last_change":"2024-02-18T16:21:01.839351+0000","last_active":"2024-02-18T16:21:40.944861+0000","last_peered":"2024-02-18T16:21:40.944861+0000","last_clean":"2024-02-18T16:21:40.944861+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:21:40.944861+0000","last_undegraded":"2024-02-18T16:21:40.944861+0000","last_fullsized":"2024-02-18T16:21:40.944861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1150,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1375,"ondisk_log_size":1375,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.88,"15min":0.88},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.55900000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76400000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.77100000000000002,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.48499999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.77900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.52200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80600000000000005,"5min":1.2,"15min":1.2},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.50800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69099999999999995,"5min":1.319,"15min":1.319},"last":0.60199999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76700000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.1599999999999999,"15min":1.26},"min":{"1min":0.38800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.68400000000000005,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.96299999999999997,"15min":1.0289999999999999},"min":{"1min":0.29999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.71999999999999997,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.5}]},{"osd":3,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.374,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":1.5589999999999999,"15min":1.7010000000000001},"min":{"1min":0.46700000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81599999999999995,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.68000000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.52500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.625,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.46999999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78300000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.47699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.745},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.55500000000000005,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.82199999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93200000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:23:09.459 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.459 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.459 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.459 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.459 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.460 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.460 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.460 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.460 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.460 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.461 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.461 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.461 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.461 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.461 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.461 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.462 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.463 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.463 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.463 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.463 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.463 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.463 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.464 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.464 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.464 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.464 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.464 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.464 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.465 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.465 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.465 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.465 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.465 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.465 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.466 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.466 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.466 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.466 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.466 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.466 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.467 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.467 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.467 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.467 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.467 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.467 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.468 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.468 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.468 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.468 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.468 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.468 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.469 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.469 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.469 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.469 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.469 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.469 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.470 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.470 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.470 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.470 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.470 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.470 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.471 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.471 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.471 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.471 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.471 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.472 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.472 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.472 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.472 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-18T16:20:44.740634+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=44, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.472 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.472 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.473 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.473 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.473 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.473 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.473 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.473 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.474 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.474 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.474 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.474 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.474 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.474 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.475 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.475 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.475 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.475 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.475 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.475 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.476 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.476 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.476 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.476 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.476 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.476 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.477 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.477 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.477 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.477 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.477 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.477 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.478 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.478 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.478 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.478 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.478 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.478 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.479 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.479 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.479 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.479 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.479 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.479 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.480 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.480 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.480 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.480 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.480 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.481 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.482 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.482 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.482 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.482 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.482 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.482 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.483 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.483 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.483 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.483 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.483 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-18T16:21:04.830164+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=4, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.483 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.484 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.484 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.484 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.484 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.484 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.485 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.486 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.486 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.486 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.486 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.486 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.486 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.487 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.487 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.487 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.487 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.487 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.487 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.488 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.488 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.488 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.488 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.488 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.488 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.489 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.489 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.489 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.489 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.489 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.489 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.490 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.491 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.491 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.491 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.491 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.491 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.491 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.492 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.492 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.492 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.492 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:09.492 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-18T16:23:29.493 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:23:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.611+0000 7f3693fb0640 1 Processor -- start 2024-02-18T16:23:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.611+0000 7f3693fb0640 1 -- start start 2024-02-18T16:23:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3693fb0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f368c092560 0x7f368c092940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3693fb0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c094180 con 0x7f368c12a220 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3693fb0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c0958f0 con 0x7f368c092560 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3691d4c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f368c092560 0x7f368c092940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f369154b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f368c12a220 0x7f368c12a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39002/0 (socket says 172.21.15.80:39002) 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f369154b640 1 -- 172.21.15.80:0/1500362778 learned_addr learned my addr 172.21.15.80:0/1500362778 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3691d4c640 1 -- 172.21.15.80:0/1500362778 >> v1:172.21.15.80:6789/0 conn(0x7f368c12a220 legacy=0x7f368c12a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3691d4c640 1 -- 172.21.15.80:0/1500362778 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c09c160 con 0x7f368c092560 2024-02-18T16:23:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3690d4a640 1 -- 172.21.15.80:0/1500362778 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582090618 0 0) 0x7f368c094180 con 0x7f368c12a220 2024-02-18T16:23:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3691d4c640 1 --2- 172.21.15.80:0/1500362778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c092940 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f367c009740 tx=0x7f367c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56e954de86087c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3690d4a640 1 -- 172.21.15.80:0/1500362778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0ac570 con 0x7f368c092560 2024-02-18T16:23:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3690d4a640 1 -- 172.21.15.80:0/1500362778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0ac6d0 con 0x7f368c092560 2024-02-18T16:23:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.615+0000 7f3690d4a640 1 -- 172.21.15.80:0/1500362778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0ac990 con 0x7f368c092560 2024-02-18T16:23:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/1500362778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 msgr2=0x7f368c092940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:29.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 --2- 172.21.15.80:0/1500362778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c092940 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f367c009740 tx=0x7f367c01c370 comp rx=0 tx=0).stop 2024-02-18T16:23:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/1500362778 shutdown_connections 2024-02-18T16:23:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 --2- 172.21.15.80:0/1500362778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c092940 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/1500362778 >> 172.21.15.80:0/1500362778 conn(0x7f368c09a2f0 msgr2=0x7f368c09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:23:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/1500362778 shutdown_connections 2024-02-18T16:23:29.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/1500362778 wait complete. 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 Processor -- start 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- start start 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c08a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c08bc90 con 0x7f368c092560 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3691d4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c08a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3691d4c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c08a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38220/0 (socket says 172.21.15.80:38220) 2024-02-18T16:23:29.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3691d4c640 1 -- 172.21.15.80:0/28581179 learned_addr learned my addr 172.21.15.80:0/28581179 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3691d4c640 1 -- 172.21.15.80:0/28581179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c009420 con 0x7f368c092560 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3691d4c640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c08a000 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f367c019fa0 tx=0x7f367c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0b4970 con 0x7f368c092560 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0b4ad0 con 0x7f368c092560 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367c0b4d70 con 0x7f368c092560 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c093000 con 0x7f368c092560 2024-02-18T16:23:29.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c12fa20 con 0x7f368c092560 2024-02-18T16:23:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f367c0c7450 con 0x7f368c092560 2024-02-18T16:23:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c067e00 con 0x7f368c092560 2024-02-18T16:23:29.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f36827fc640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3670035a60 0x7f3670037f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.619+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f367c0e4dd0 con 0x7f368c092560 2024-02-18T16:23:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.623+0000 7f369154b640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3670035a60 0x7f3670037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:29.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.623+0000 7f369154b640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3670035a60 0x7f3670037f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3688007fd0 tx=0x7f3688007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:29.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.627+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f367c0e9070 con 0x7f368c092560 2024-02-18T16:23:29.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.775+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f368c092e80 con 0x7f3670035a60 2024-02-18T16:23:29.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.823+0000 7f36827fc640 1 -- 172.21.15.80:0/28581179 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669613 (secure 0 0 0) 0x7f3688001c60 con 0x7f3670035a60 2024-02-18T16:23:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:23:29.848 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:23:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3670035a60 msgr2=0x7f3670037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3670035a60 0x7f3670037f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3688007fd0 tx=0x7f3688007980 comp rx=0 tx=0).stop 2024-02-18T16:23:29.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 msgr2=0x7f368c08a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c08a000 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f367c019fa0 tx=0x7f367c01abb0 comp rx=0 tx=0).stop 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 shutdown_connections 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f3670035a60 0x7f3670037f20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 --2- 172.21.15.80:0/28581179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f368c092560 0x7f368c08a000 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 >> 172.21.15.80:0/28581179 conn(0x7f368c09a2f0 msgr2=0x7f368c06e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 shutdown_connections 2024-02-18T16:23:29.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:29.831+0000 7f3693fb0640 1 -- 172.21.15.80:0/28581179 wait complete. 2024-02-18T16:23:29.859 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-02-18T16:23:27.827722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3960,"ondisk_log_size":3960,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006902"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.916811+0000","last_change":"2024-02-18T16:23:22.916928+0000","last_active":"2024-02-18T16:23:22.916811+0000","last_peered":"2024-02-18T16:23:22.916811+0000","last_clean":"2024-02-18T16:23:22.916811+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:23:22.916811+0000","last_undegraded":"2024-02-18T16:23:22.916811+0000","last_fullsized":"2024-02-18T16:23:22.916811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.916517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:21.117744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.750540+0000","last_change":"2024-02-18T16:23:16.750600+0000","last_active":"2024-02-18T16:23:16.750540+0000","last_peered":"2024-02-18T16:23:16.750540+0000","last_clean":"2024-02-18T16:23:16.750540+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:23:16.750540+0000","last_undegraded":"2024-02-18T16:23:16.750540+0000","last_fullsized":"2024-02-18T16:23:16.750540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.750307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.951534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.161692+0000","last_change":"2024-02-18T16:23:20.161755+0000","last_active":"2024-02-18T16:23:20.161692+0000","last_peered":"2024-02-18T16:23:20.161692+0000","last_clean":"2024-02-18T16:23:20.161692+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:23:20.161692+0000","last_undegraded":"2024-02-18T16:23:20.161692+0000","last_fullsized":"2024-02-18T16:23:20.161692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.161465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:08.032544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.737723+0000","last_change":"2024-02-18T16:23:23.737788+0000","last_active":"2024-02-18T16:23:23.737723+0000","last_peered":"2024-02-18T16:23:23.737723+0000","last_clean":"2024-02-18T16:23:23.737723+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:23:23.737723+0000","last_undegraded":"2024-02-18T16:23:23.737723+0000","last_fullsized":"2024-02-18T16:23:23.737723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.737502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:54.805702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660662+0000","last_change":"2024-02-18T16:20:59.872708+0000","last_active":"2024-02-18T16:22:48.660662+0000","last_peered":"2024-02-18T16:22:48.660662+0000","last_clean":"2024-02-18T16:22:48.660662+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:22:48.660662+0000","last_undegraded":"2024-02-18T16:22:48.660662+0000","last_fullsized":"2024-02-18T16:22:48.660662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.635008+0000","last_change":"2024-02-18T16:23:09.635085+0000","last_active":"2024-02-18T16:23:09.635008+0000","last_peered":"2024-02-18T16:23:09.635008+0000","last_clean":"2024-02-18T16:23:09.635008+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:23:09.635008+0000","last_undegraded":"2024-02-18T16:23:09.635008+0000","last_fullsized":"2024-02-18T16:23:09.635008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.634784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:09.758604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194622+0000","last_change":"2024-02-18T16:20:59.833010+0000","last_active":"2024-02-18T16:22:48.194622+0000","last_peered":"2024-02-18T16:22:48.194622+0000","last_clean":"2024-02-18T16:22:48.194622+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:22:48.194622+0000","last_undegraded":"2024-02-18T16:22:48.194622+0000","last_fullsized":"2024-02-18T16:22:48.194622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.751028+0000","last_change":"2024-02-18T16:23:03.751173+0000","last_active":"2024-02-18T16:23:03.751028+0000","last_peered":"2024-02-18T16:23:03.751028+0000","last_clean":"2024-02-18T16:23:03.751028+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:23:03.751028+0000","last_undegraded":"2024-02-18T16:23:03.751028+0000","last_fullsized":"2024-02-18T16:23:03.751028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.750777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:02.603622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.949247+0000","last_change":"2024-02-18T16:20:59.868597+0000","last_active":"2024-02-18T16:21:40.949247+0000","last_peered":"2024-02-18T16:21:40.949247+0000","last_clean":"2024-02-18T16:21:40.949247+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:21:40.949247+0000","last_undegraded":"2024-02-18T16:21:40.949247+0000","last_fullsized":"2024-02-18T16:21:40.949247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.783795+0000","last_change":"2024-02-18T16:23:17.783856+0000","last_active":"2024-02-18T16:23:17.783795+0000","last_peered":"2024-02-18T16:23:17.783795+0000","last_clean":"2024-02-18T16:23:17.783795+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:23:17.783795+0000","last_undegraded":"2024-02-18T16:23:17.783795+0000","last_fullsized":"2024-02-18T16:23:17.783795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.783609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.839510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.937651+0000","last_change":"2024-02-18T16:20:59.827833+0000","last_active":"2024-02-18T16:21:40.937651+0000","last_peered":"2024-02-18T16:21:40.937651+0000","last_clean":"2024-02-18T16:21:40.937651+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:21:40.937651+0000","last_undegraded":"2024-02-18T16:21:40.937651+0000","last_fullsized":"2024-02-18T16:21:40.937651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.784360+0000","last_change":"2024-02-18T16:23:22.784418+0000","last_active":"2024-02-18T16:23:22.784360+0000","last_peered":"2024-02-18T16:23:22.784360+0000","last_clean":"2024-02-18T16:23:22.784360+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:23:22.784360+0000","last_undegraded":"2024-02-18T16:23:22.784360+0000","last_fullsized":"2024-02-18T16:23:22.784360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.784173+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:14.537344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.082322+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:36.082322+0000","last_peered":"2024-02-18T16:22:36.082322+0000","last_clean":"2024-02-18T16:22:36.082322+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:36.082322+0000","last_undegraded":"2024-02-18T16:22:36.082322+0000","last_fullsized":"2024-02-18T16:22:36.082322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.991352+0000","last_change":"2024-02-18T16:23:13.991423+0000","last_active":"2024-02-18T16:23:13.991352+0000","last_peered":"2024-02-18T16:23:13.991352+0000","last_clean":"2024-02-18T16:23:13.991352+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:23:13.991352+0000","last_undegraded":"2024-02-18T16:23:13.991352+0000","last_fullsized":"2024-02-18T16:23:13.991352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.991156+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:26.734895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:45.690414+0000","last_change":"2024-02-18T16:20:59.851482+0000","last_active":"2024-02-18T16:21:45.690414+0000","last_peered":"2024-02-18T16:21:45.690414+0000","last_clean":"2024-02-18T16:21:45.690414+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:21:45.690414+0000","last_undegraded":"2024-02-18T16:21:45.690414+0000","last_fullsized":"2024-02-18T16:21:45.690414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.883579+0000","last_change":"2024-02-18T16:23:21.883639+0000","last_active":"2024-02-18T16:23:21.883579+0000","last_peered":"2024-02-18T16:23:21.883579+0000","last_clean":"2024-02-18T16:23:21.883579+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:23:21.883579+0000","last_undegraded":"2024-02-18T16:23:21.883579+0000","last_fullsized":"2024-02-18T16:23:21.883579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.883366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:05.625702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661224+0000","last_change":"2024-02-18T16:21:01.852206+0000","last_active":"2024-02-18T16:22:48.661224+0000","last_peered":"2024-02-18T16:22:48.661224+0000","last_clean":"2024-02-18T16:22:48.661224+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:22:48.661224+0000","last_undegraded":"2024-02-18T16:22:48.661224+0000","last_fullsized":"2024-02-18T16:22:48.661224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728499+0000","last_change":"2024-02-18T16:20:59.861096+0000","last_active":"2024-02-18T16:22:47.728499+0000","last_peered":"2024-02-18T16:22:47.728499+0000","last_clean":"2024-02-18T16:22:47.728499+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:22:47.728499+0000","last_undegraded":"2024-02-18T16:22:47.728499+0000","last_fullsized":"2024-02-18T16:22:47.728499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.727308+0000","last_change":"2024-02-18T16:23:19.727308+0000","last_active":"2024-02-18T16:23:19.727308+0000","last_peered":"2024-02-18T16:23:19.727308+0000","last_clean":"2024-02-18T16:23:19.727308+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:23:19.727308+0000","last_undegraded":"2024-02-18T16:23:19.727308+0000","last_fullsized":"2024-02-18T16:23:19.727308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.727029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:34:32.149408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.946153+0000","last_change":"2024-02-18T16:23:16.946153+0000","last_active":"2024-02-18T16:23:16.946153+0000","last_peered":"2024-02-18T16:23:16.946153+0000","last_clean":"2024-02-18T16:23:16.946153+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:23:16.946153+0000","last_undegraded":"2024-02-18T16:23:16.946153+0000","last_fullsized":"2024-02-18T16:23:16.946153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.945824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:28.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.715031+0000","last_change":"2024-02-18T16:23:09.715031+0000","last_active":"2024-02-18T16:23:09.715031+0000","last_peered":"2024-02-18T16:23:09.715031+0000","last_clean":"2024-02-18T16:23:09.715031+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:23:09.715031+0000","last_undegraded":"2024-02-18T16:23:09.715031+0000","last_fullsized":"2024-02-18T16:23:09.715031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.714755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.994872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.725548+0000","last_change":"2024-02-18T16:23:23.725548+0000","last_active":"2024-02-18T16:23:23.725548+0000","last_peered":"2024-02-18T16:23:23.725548+0000","last_clean":"2024-02-18T16:23:23.725548+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:23:23.725548+0000","last_undegraded":"2024-02-18T16:23:23.725548+0000","last_fullsized":"2024-02-18T16:23:23.725548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.725287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:05:10.067817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.097969+0000","last_change":"2024-02-18T16:21:01.844448+0000","last_active":"2024-02-18T16:22:36.097969+0000","last_peered":"2024-02-18T16:22:36.097969+0000","last_clean":"2024-02-18T16:22:36.097969+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:22:36.097969+0000","last_undegraded":"2024-02-18T16:22:36.097969+0000","last_fullsized":"2024-02-18T16:22:36.097969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728320+0000","last_change":"2024-02-18T16:20:59.861087+0000","last_active":"2024-02-18T16:22:47.728320+0000","last_peered":"2024-02-18T16:22:47.728320+0000","last_clean":"2024-02-18T16:22:47.728320+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:22:47.728320+0000","last_undegraded":"2024-02-18T16:22:47.728320+0000","last_fullsized":"2024-02-18T16:22:47.728320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean+scrubbing+deep","last_fresh":"2024-02-18T16:23:23.881361+0000","last_change":"2024-02-18T16:23:23.877877+0000","last_active":"2024-02-18T16:23:23.881361+0000","last_peered":"2024-02-18T16:23:23.881361+0000","last_clean":"2024-02-18T16:23:23.881361+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:23:23.881361+0000","last_undegraded":"2024-02-18T16:23:23.881361+0000","last_fullsized":"2024-02-18T16:23:23.881361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267877+0000","last_change":"2024-02-18T16:20:59.860613+0000","last_active":"2024-02-18T16:22:47.267877+0000","last_peered":"2024-02-18T16:22:47.267877+0000","last_clean":"2024-02-18T16:22:47.267877+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:22:47.267877+0000","last_undegraded":"2024-02-18T16:22:47.267877+0000","last_fullsized":"2024-02-18T16:22:47.267877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.728598+0000","last_change":"2024-02-18T16:23:20.728657+0000","last_active":"2024-02-18T16:23:20.728598+0000","last_peered":"2024-02-18T16:23:20.728598+0000","last_clean":"2024-02-18T16:23:20.728598+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:23:20.728598+0000","last_undegraded":"2024-02-18T16:23:20.728598+0000","last_fullsized":"2024-02-18T16:23:20.728598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.728399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:20.792298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660650+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:22:48.660650+0000","last_peered":"2024-02-18T16:22:48.660650+0000","last_clean":"2024-02-18T16:22:48.660650+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:22:48.660650+0000","last_undegraded":"2024-02-18T16:22:48.660650+0000","last_fullsized":"2024-02-18T16:22:48.660650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.114887+0000","last_change":"2024-02-18T16:21:09.915975+0000","last_active":"2024-02-18T16:22:36.114887+0000","last_peered":"2024-02-18T16:22:36.114887+0000","last_clean":"2024-02-18T16:22:36.114887+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:22:36.114887+0000","last_undegraded":"2024-02-18T16:22:36.114887+0000","last_fullsized":"2024-02-18T16:22:36.114887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661042+0000","last_change":"2024-02-18T16:21:01.853570+0000","last_active":"2024-02-18T16:22:48.661042+0000","last_peered":"2024-02-18T16:22:48.661042+0000","last_clean":"2024-02-18T16:22:48.661042+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:22:48.661042+0000","last_undegraded":"2024-02-18T16:22:48.661042+0000","last_fullsized":"2024-02-18T16:22:48.661042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659940+0000","last_change":"2024-02-18T16:20:59.871560+0000","last_active":"2024-02-18T16:22:48.659940+0000","last_peered":"2024-02-18T16:22:48.659940+0000","last_clean":"2024-02-18T16:22:48.659940+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:22:48.659940+0000","last_undegraded":"2024-02-18T16:22:48.659940+0000","last_fullsized":"2024-02-18T16:22:48.659940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.907078+0000","last_change":"2024-02-18T16:22:49.907189+0000","last_active":"2024-02-18T16:22:49.907078+0000","last_peered":"2024-02-18T16:22:49.907078+0000","last_clean":"2024-02-18T16:22:49.907078+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:22:49.907078+0000","last_undegraded":"2024-02-18T16:22:49.907078+0000","last_fullsized":"2024-02-18T16:22:49.907078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.906822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:01.255503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.688950+0000","last_change":"2024-02-18T16:23:15.689035+0000","last_active":"2024-02-18T16:23:15.688950+0000","last_peered":"2024-02-18T16:23:15.688950+0000","last_clean":"2024-02-18T16:23:15.688950+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:23:15.688950+0000","last_undegraded":"2024-02-18T16:23:15.688950+0000","last_fullsized":"2024-02-18T16:23:15.688950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.688708+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:06.486435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.716724+0000","last_change":"2024-02-18T16:23:10.716776+0000","last_active":"2024-02-18T16:23:10.716724+0000","last_peered":"2024-02-18T16:23:10.716724+0000","last_clean":"2024-02-18T16:23:10.716724+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:23:10.716724+0000","last_undegraded":"2024-02-18T16:23:10.716724+0000","last_fullsized":"2024-02-18T16:23:10.716724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.716530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:22.065211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.177233+0000","last_change":"2024-02-18T16:21:09.916272+0000","last_active":"2024-02-18T16:22:30.177233+0000","last_peered":"2024-02-18T16:22:30.177233+0000","last_clean":"2024-02-18T16:22:30.177233+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:22:30.177233+0000","last_undegraded":"2024-02-18T16:22:30.177233+0000","last_fullsized":"2024-02-18T16:22:30.177233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.649668+0000","last_change":"2024-02-18T16:23:07.649753+0000","last_active":"2024-02-18T16:23:07.649668+0000","last_peered":"2024-02-18T16:23:07.649668+0000","last_clean":"2024-02-18T16:23:07.649668+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:23:07.649668+0000","last_undegraded":"2024-02-18T16:23:07.649668+0000","last_fullsized":"2024-02-18T16:23:07.649668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.649419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:13.854686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194492+0000","last_change":"2024-02-18T16:20:59.829726+0000","last_active":"2024-02-18T16:22:48.194492+0000","last_peered":"2024-02-18T16:22:48.194492+0000","last_clean":"2024-02-18T16:22:48.194492+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:22:48.194492+0000","last_undegraded":"2024-02-18T16:22:48.194492+0000","last_fullsized":"2024-02-18T16:22:48.194492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.257769+0000","last_change":"2024-02-18T16:23:10.257769+0000","last_active":"2024-02-18T16:23:10.257769+0000","last_peered":"2024-02-18T16:23:10.257769+0000","last_clean":"2024-02-18T16:23:10.257769+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:23:10.257769+0000","last_undegraded":"2024-02-18T16:23:10.257769+0000","last_fullsized":"2024-02-18T16:23:10.257769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.257505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:21.606186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.663405+0000","last_change":"2024-02-18T16:22:55.663488+0000","last_active":"2024-02-18T16:22:55.663405+0000","last_peered":"2024-02-18T16:22:55.663405+0000","last_clean":"2024-02-18T16:22:55.663405+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:22:55.663405+0000","last_undegraded":"2024-02-18T16:22:55.663405+0000","last_fullsized":"2024-02-18T16:22:55.663405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.663204+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:33.049677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.622259+0000","last_change":"2024-02-18T16:23:02.622314+0000","last_active":"2024-02-18T16:23:02.622259+0000","last_peered":"2024-02-18T16:23:02.622259+0000","last_clean":"2024-02-18T16:23:02.622259+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:23:02.622259+0000","last_undegraded":"2024-02-18T16:23:02.622259+0000","last_fullsized":"2024-02-18T16:23:02.622259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.622050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.772173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.174052+0000","last_change":"2024-02-18T16:21:09.926133+0000","last_active":"2024-02-18T16:21:41.174052+0000","last_peered":"2024-02-18T16:21:41.174052+0000","last_clean":"2024-02-18T16:21:41.174052+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:21:41.174052+0000","last_undegraded":"2024-02-18T16:21:41.174052+0000","last_fullsized":"2024-02-18T16:21:41.174052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.098695+0000","last_change":"2024-02-18T16:21:41.176291+0000","last_active":"2024-02-18T16:22:36.098695+0000","last_peered":"2024-02-18T16:22:36.098695+0000","last_clean":"2024-02-18T16:22:36.098695+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:22:36.098695+0000","last_undegraded":"2024-02-18T16:22:36.098695+0000","last_fullsized":"2024-02-18T16:22:36.098695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659946+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:22:48.659946+0000","last_peered":"2024-02-18T16:22:48.659946+0000","last_clean":"2024-02-18T16:22:48.659946+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:22:48.659946+0000","last_undegraded":"2024-02-18T16:22:48.659946+0000","last_fullsized":"2024-02-18T16:22:48.659946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:43.859242+0000","last_change":"2024-02-18T16:21:40.955018+0000","last_active":"2024-02-18T16:21:43.859242+0000","last_peered":"2024-02-18T16:21:43.859242+0000","last_clean":"2024-02-18T16:21:43.859242+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:21:43.859242+0000","last_undegraded":"2024-02-18T16:21:43.859242+0000","last_fullsized":"2024-02-18T16:21:43.859242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.873382+0000","last_change":"2024-02-18T16:22:56.873532+0000","last_active":"2024-02-18T16:22:56.873382+0000","last_peered":"2024-02-18T16:22:56.873382+0000","last_clean":"2024-02-18T16:22:56.873382+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:22:56.873382+0000","last_undegraded":"2024-02-18T16:22:56.873382+0000","last_fullsized":"2024-02-18T16:22:56.873382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.873112+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:36.931560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.812514+0000","last_change":"2024-02-18T16:23:20.812587+0000","last_active":"2024-02-18T16:23:20.812514+0000","last_peered":"2024-02-18T16:23:20.812514+0000","last_clean":"2024-02-18T16:23:20.812514+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:23:20.812514+0000","last_undegraded":"2024-02-18T16:23:20.812514+0000","last_fullsized":"2024-02-18T16:23:20.812514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.812325+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:19:44.799795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.936881+0000","last_change":"2024-02-18T16:21:09.929317+0000","last_active":"2024-02-18T16:21:40.936881+0000","last_peered":"2024-02-18T16:21:40.936881+0000","last_clean":"2024-02-18T16:21:40.936881+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:21:40.936881+0000","last_undegraded":"2024-02-18T16:21:40.936881+0000","last_fullsized":"2024-02-18T16:21:40.936881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.183905+0000","last_change":"2024-02-18T16:21:01.841643+0000","last_active":"2024-02-18T16:21:41.183905+0000","last_peered":"2024-02-18T16:21:41.183905+0000","last_clean":"2024-02-18T16:21:41.183905+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:21:41.183905+0000","last_undegraded":"2024-02-18T16:21:41.183905+0000","last_fullsized":"2024-02-18T16:21:41.183905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728038+0000","last_change":"2024-02-18T16:20:59.860132+0000","last_active":"2024-02-18T16:22:47.728038+0000","last_peered":"2024-02-18T16:22:47.728038+0000","last_clean":"2024-02-18T16:22:47.728038+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:22:47.728038+0000","last_undegraded":"2024-02-18T16:22:47.728038+0000","last_fullsized":"2024-02-18T16:22:47.728038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.961283+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:21:40.961283+0000","last_peered":"2024-02-18T16:21:40.961283+0000","last_clean":"2024-02-18T16:21:40.961283+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:21:40.961283+0000","last_undegraded":"2024-02-18T16:21:40.961283+0000","last_fullsized":"2024-02-18T16:21:40.961283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.859328+0000","last_change":"2024-02-18T16:22:58.859501+0000","last_active":"2024-02-18T16:22:58.859328+0000","last_peered":"2024-02-18T16:22:58.859328+0000","last_clean":"2024-02-18T16:22:58.859328+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:58.859328+0000","last_undegraded":"2024-02-18T16:22:58.859328+0000","last_fullsized":"2024-02-18T16:22:58.859328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.859048+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:31.803635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.257728+0000","last_change":"2024-02-18T16:23:07.257854+0000","last_active":"2024-02-18T16:23:07.257728+0000","last_peered":"2024-02-18T16:23:07.257728+0000","last_clean":"2024-02-18T16:23:07.257728+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:23:07.257728+0000","last_undegraded":"2024-02-18T16:23:07.257728+0000","last_fullsized":"2024-02-18T16:23:07.257728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.257430+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.001169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661013+0000","last_change":"2024-02-18T16:21:01.852914+0000","last_active":"2024-02-18T16:22:48.661013+0000","last_peered":"2024-02-18T16:22:48.661013+0000","last_clean":"2024-02-18T16:22:48.661013+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:22:48.661013+0000","last_undegraded":"2024-02-18T16:22:48.661013+0000","last_fullsized":"2024-02-18T16:22:48.661013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194488+0000","last_change":"2024-02-18T16:20:59.835343+0000","last_active":"2024-02-18T16:22:48.194488+0000","last_peered":"2024-02-18T16:22:48.194488+0000","last_clean":"2024-02-18T16:22:48.194488+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:22:48.194488+0000","last_undegraded":"2024-02-18T16:22:48.194488+0000","last_fullsized":"2024-02-18T16:22:48.194488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.628366+0000","last_change":"2024-02-18T16:23:01.628366+0000","last_active":"2024-02-18T16:23:01.628366+0000","last_peered":"2024-02-18T16:23:01.628366+0000","last_clean":"2024-02-18T16:23:01.628366+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:23:01.628366+0000","last_undegraded":"2024-02-18T16:23:01.628366+0000","last_fullsized":"2024-02-18T16:23:01.628366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.628086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:49:06.387306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.868488+0000","last_change":"2024-02-18T16:23:00.868488+0000","last_active":"2024-02-18T16:23:00.868488+0000","last_peered":"2024-02-18T16:23:00.868488+0000","last_clean":"2024-02-18T16:23:00.868488+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:23:00.868488+0000","last_undegraded":"2024-02-18T16:23:00.868488+0000","last_fullsized":"2024-02-18T16:23:00.868488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.868066+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:38.254540+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.249222+0000","last_change":"2024-02-18T16:23:11.249222+0000","last_active":"2024-02-18T16:23:11.249222+0000","last_peered":"2024-02-18T16:23:11.249222+0000","last_clean":"2024-02-18T16:23:11.249222+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:23:11.249222+0000","last_undegraded":"2024-02-18T16:23:11.249222+0000","last_fullsized":"2024-02-18T16:23:11.249222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.248957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.900091+0000","last_change":"2024-02-18T16:23:11.900091+0000","last_active":"2024-02-18T16:23:11.900091+0000","last_peered":"2024-02-18T16:23:11.900091+0000","last_clean":"2024-02-18T16:23:11.900091+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:23:11.900091+0000","last_undegraded":"2024-02-18T16:23:11.900091+0000","last_fullsized":"2024-02-18T16:23:11.900091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.899800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:40.591864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728572+0000","last_change":"2024-02-18T16:21:01.843254+0000","last_active":"2024-02-18T16:22:47.728572+0000","last_peered":"2024-02-18T16:22:47.728572+0000","last_clean":"2024-02-18T16:22:47.728572+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:22:47.728572+0000","last_undegraded":"2024-02-18T16:22:47.728572+0000","last_fullsized":"2024-02-18T16:22:47.728572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194419+0000","last_change":"2024-02-18T16:20:59.832949+0000","last_active":"2024-02-18T16:22:48.194419+0000","last_peered":"2024-02-18T16:22:48.194419+0000","last_clean":"2024-02-18T16:22:48.194419+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:22:48.194419+0000","last_undegraded":"2024-02-18T16:22:48.194419+0000","last_fullsized":"2024-02-18T16:22:48.194419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.348633+0000","last_change":"2024-02-18T16:23:04.348633+0000","last_active":"2024-02-18T16:23:04.348633+0000","last_peered":"2024-02-18T16:23:04.348633+0000","last_clean":"2024-02-18T16:23:04.348633+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:23:04.348633+0000","last_undegraded":"2024-02-18T16:23:04.348633+0000","last_fullsized":"2024-02-18T16:23:04.348633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.348289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:35.555767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.694029+0000","last_change":"2024-02-18T16:23:14.694029+0000","last_active":"2024-02-18T16:23:14.694029+0000","last_peered":"2024-02-18T16:23:14.694029+0000","last_clean":"2024-02-18T16:23:14.694029+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:23:14.694029+0000","last_undegraded":"2024-02-18T16:23:14.694029+0000","last_fullsized":"2024-02-18T16:23:14.694029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.693728+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:39.653173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.442044+0000","last_change":"2024-02-18T16:22:49.442044+0000","last_active":"2024-02-18T16:22:49.442044+0000","last_peered":"2024-02-18T16:22:49.442044+0000","last_clean":"2024-02-18T16:22:49.442044+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:22:49.442044+0000","last_undegraded":"2024-02-18T16:22:49.442044+0000","last_fullsized":"2024-02-18T16:22:49.442044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.441791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:45:05.815867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.729998+0000","last_change":"2024-02-18T16:21:09.931902+0000","last_active":"2024-02-18T16:22:47.729998+0000","last_peered":"2024-02-18T16:22:47.729998+0000","last_clean":"2024-02-18T16:22:47.729998+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:22:47.729998+0000","last_undegraded":"2024-02-18T16:22:47.729998+0000","last_fullsized":"2024-02-18T16:22:47.729998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194887+0000","last_change":"2024-02-18T16:21:01.851100+0000","last_active":"2024-02-18T16:22:48.194887+0000","last_peered":"2024-02-18T16:22:48.194887+0000","last_clean":"2024-02-18T16:22:48.194887+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:22:48.194887+0000","last_undegraded":"2024-02-18T16:22:48.194887+0000","last_fullsized":"2024-02-18T16:22:48.194887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659926+0000","last_change":"2024-02-18T16:20:59.873014+0000","last_active":"2024-02-18T16:22:48.659926+0000","last_peered":"2024-02-18T16:22:48.659926+0000","last_clean":"2024-02-18T16:22:48.659926+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:22:48.659926+0000","last_undegraded":"2024-02-18T16:22:48.659926+0000","last_fullsized":"2024-02-18T16:22:48.659926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.288342+0000","last_change":"2024-02-18T16:23:06.288342+0000","last_active":"2024-02-18T16:23:06.288342+0000","last_peered":"2024-02-18T16:23:06.288342+0000","last_clean":"2024-02-18T16:23:06.288342+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:23:06.288342+0000","last_undegraded":"2024-02-18T16:23:06.288342+0000","last_fullsized":"2024-02-18T16:23:06.288342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.288089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:53.929609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.866009+0000","last_change":"2024-02-18T16:22:54.866009+0000","last_active":"2024-02-18T16:22:54.866009+0000","last_peered":"2024-02-18T16:22:54.866009+0000","last_clean":"2024-02-18T16:22:54.866009+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:54.866009+0000","last_undegraded":"2024-02-18T16:22:54.866009+0000","last_fullsized":"2024-02-18T16:22:54.866009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.865742+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:38.608078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.424493+0000","last_change":"2024-02-18T16:22:59.424493+0000","last_active":"2024-02-18T16:22:59.424493+0000","last_peered":"2024-02-18T16:22:59.424493+0000","last_clean":"2024-02-18T16:22:59.424493+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:59.424493+0000","last_undegraded":"2024-02-18T16:22:59.424493+0000","last_fullsized":"2024-02-18T16:22:59.424493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.424108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:27.706578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268704+0000","last_change":"2024-02-18T16:21:09.926915+0000","last_active":"2024-02-18T16:22:47.268704+0000","last_peered":"2024-02-18T16:22:47.268704+0000","last_clean":"2024-02-18T16:22:47.268704+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:22:47.268704+0000","last_undegraded":"2024-02-18T16:22:47.268704+0000","last_fullsized":"2024-02-18T16:22:47.268704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.950077+0000","last_change":"2024-02-18T16:23:17.950077+0000","last_active":"2024-02-18T16:23:17.950077+0000","last_peered":"2024-02-18T16:23:17.950077+0000","last_clean":"2024-02-18T16:23:17.950077+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:23:17.950077+0000","last_undegraded":"2024-02-18T16:23:17.950077+0000","last_fullsized":"2024-02-18T16:23:17.950077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.949811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:22.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659841+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:22:48.659841+0000","last_peered":"2024-02-18T16:22:48.659841+0000","last_clean":"2024-02-18T16:22:48.659841+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:22:48.659841+0000","last_undegraded":"2024-02-18T16:22:48.659841+0000","last_fullsized":"2024-02-18T16:22:48.659841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.385292+0000","last_change":"2024-02-18T16:23:02.385292+0000","last_active":"2024-02-18T16:23:02.385292+0000","last_peered":"2024-02-18T16:23:02.385292+0000","last_clean":"2024-02-18T16:23:02.385292+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:23:02.385292+0000","last_undegraded":"2024-02-18T16:23:02.385292+0000","last_fullsized":"2024-02-18T16:23:02.385292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.384857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.736442+0000","last_change":"2024-02-18T16:23:18.736442+0000","last_active":"2024-02-18T16:23:18.736442+0000","last_peered":"2024-02-18T16:23:18.736442+0000","last_clean":"2024-02-18T16:23:18.736442+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:23:18.736442+0000","last_undegraded":"2024-02-18T16:23:18.736442+0000","last_fullsized":"2024-02-18T16:23:18.736442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.736028+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:33.973183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.419003+0000","last_change":"2024-02-18T16:22:48.419003+0000","last_active":"2024-02-18T16:22:48.419003+0000","last_peered":"2024-02-18T16:22:48.419003+0000","last_clean":"2024-02-18T16:22:48.419003+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:22:48.419003+0000","last_undegraded":"2024-02-18T16:22:48.419003+0000","last_fullsized":"2024-02-18T16:22:48.419003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.418904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:26.809828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268729+0000","last_change":"2024-02-18T16:21:09.901860+0000","last_active":"2024-02-18T16:22:47.268729+0000","last_peered":"2024-02-18T16:22:47.268729+0000","last_clean":"2024-02-18T16:22:47.268729+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:22:47.268729+0000","last_undegraded":"2024-02-18T16:22:47.268729+0000","last_fullsized":"2024-02-18T16:22:47.268729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:43.859021+0000","last_change":"2024-02-18T16:21:40.945387+0000","last_active":"2024-02-18T16:21:43.859021+0000","last_peered":"2024-02-18T16:21:43.859021+0000","last_clean":"2024-02-18T16:21:43.859021+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:21:43.859021+0000","last_undegraded":"2024-02-18T16:21:43.859021+0000","last_fullsized":"2024-02-18T16:21:43.859021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267676+0000","last_change":"2024-02-18T16:20:59.857151+0000","last_active":"2024-02-18T16:22:47.267676+0000","last_peered":"2024-02-18T16:22:47.267676+0000","last_clean":"2024-02-18T16:22:47.267676+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:22:47.267676+0000","last_undegraded":"2024-02-18T16:22:47.267676+0000","last_fullsized":"2024-02-18T16:22:47.267676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.895970+0000","last_change":"2024-02-18T16:23:06.895970+0000","last_active":"2024-02-18T16:23:06.895970+0000","last_peered":"2024-02-18T16:23:06.895970+0000","last_clean":"2024-02-18T16:23:06.895970+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:23:06.895970+0000","last_undegraded":"2024-02-18T16:23:06.895970+0000","last_fullsized":"2024-02-18T16:23:06.895970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.895683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:21.766945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.716444+0000","last_change":"2024-02-18T16:22:53.716444+0000","last_active":"2024-02-18T16:22:53.716444+0000","last_peered":"2024-02-18T16:22:53.716444+0000","last_clean":"2024-02-18T16:22:53.716444+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:53.716444+0000","last_undegraded":"2024-02-18T16:22:53.716444+0000","last_fullsized":"2024-02-18T16:22:53.716444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.716166+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:15:00.689979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.730325+0000","last_change":"2024-02-18T16:23:16.730325+0000","last_active":"2024-02-18T16:23:16.730325+0000","last_peered":"2024-02-18T16:23:16.730325+0000","last_clean":"2024-02-18T16:23:16.730325+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:23:16.730325+0000","last_undegraded":"2024-02-18T16:23:16.730325+0000","last_fullsized":"2024-02-18T16:23:16.730325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.729880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:09.848063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663291+0000","last_change":"2024-02-18T16:21:09.920227+0000","last_active":"2024-02-18T16:22:48.663291+0000","last_peered":"2024-02-18T16:22:48.663291+0000","last_clean":"2024-02-18T16:22:48.663291+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:22:48.663291+0000","last_undegraded":"2024-02-18T16:22:48.663291+0000","last_fullsized":"2024-02-18T16:22:48.663291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.775757+0000","last_change":"2024-02-18T16:22:59.775757+0000","last_active":"2024-02-18T16:22:59.775757+0000","last_peered":"2024-02-18T16:22:59.775757+0000","last_clean":"2024-02-18T16:22:59.775757+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:59.775757+0000","last_undegraded":"2024-02-18T16:22:59.775757+0000","last_fullsized":"2024-02-18T16:22:59.775757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.775299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:17:59.839199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659874+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:22:48.659874+0000","last_peered":"2024-02-18T16:22:48.659874+0000","last_clean":"2024-02-18T16:22:48.659874+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:22:48.659874+0000","last_undegraded":"2024-02-18T16:22:48.659874+0000","last_fullsized":"2024-02-18T16:22:48.659874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.315310+0000","last_change":"2024-02-18T16:23:05.315310+0000","last_active":"2024-02-18T16:23:05.315310+0000","last_peered":"2024-02-18T16:23:05.315310+0000","last_clean":"2024-02-18T16:23:05.315310+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:23:05.315310+0000","last_undegraded":"2024-02-18T16:23:05.315310+0000","last_fullsized":"2024-02-18T16:23:05.315310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.315056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:34.007120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.877151+0000","last_change":"2024-02-18T16:23:04.877151+0000","last_active":"2024-02-18T16:23:04.877151+0000","last_peered":"2024-02-18T16:23:04.877151+0000","last_clean":"2024-02-18T16:23:04.877151+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:23:04.877151+0000","last_undegraded":"2024-02-18T16:23:04.877151+0000","last_fullsized":"2024-02-18T16:23:04.877151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.876858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:34.375957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":334,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.770013+0000","last_change":"2024-02-18T16:22:51.770013+0000","last_active":"2024-02-18T16:22:51.770013+0000","last_peered":"2024-02-18T16:22:51.770013+0000","last_clean":"2024-02-18T16:22:51.770013+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:51.770013+0000","last_undegraded":"2024-02-18T16:22:51.770013+0000","last_fullsized":"2024-02-18T16:22:51.770013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.769642+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:23:26.328772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.126785+0000","last_change":"2024-02-18T16:23:15.126785+0000","last_active":"2024-02-18T16:23:15.126785+0000","last_peered":"2024-02-18T16:23:15.126785+0000","last_clean":"2024-02-18T16:23:15.126785+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:23:15.126785+0000","last_undegraded":"2024-02-18T16:23:15.126785+0000","last_fullsized":"2024-02-18T16:23:15.126785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.126508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:58.868844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.195051+0000","last_change":"2024-02-18T16:21:01.854526+0000","last_active":"2024-02-18T16:22:48.195051+0000","last_peered":"2024-02-18T16:22:48.195051+0000","last_clean":"2024-02-18T16:22:48.195051+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:22:48.195051+0000","last_undegraded":"2024-02-18T16:22:48.195051+0000","last_fullsized":"2024-02-18T16:22:48.195051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659767+0000","last_change":"2024-02-18T16:20:59.863525+0000","last_active":"2024-02-18T16:22:48.659767+0000","last_peered":"2024-02-18T16:22:48.659767+0000","last_clean":"2024-02-18T16:22:48.659767+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:22:48.659767+0000","last_undegraded":"2024-02-18T16:22:48.659767+0000","last_fullsized":"2024-02-18T16:22:48.659767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'6","reported_seq":540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.656384+0000","last_change":"2024-02-18T16:23:00.656384+0000","last_active":"2024-02-18T16:23:00.656384+0000","last_peered":"2024-02-18T16:23:00.656384+0000","last_clean":"2024-02-18T16:23:00.656384+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:23:00.656384+0000","last_undegraded":"2024-02-18T16:23:00.656384+0000","last_fullsized":"2024-02-18T16:23:00.656384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.655960+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:31:46.016785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":581,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.749256+0000","last_change":"2024-02-18T16:23:17.749256+0000","last_active":"2024-02-18T16:23:17.749256+0000","last_peered":"2024-02-18T16:23:17.749256+0000","last_clean":"2024-02-18T16:23:17.749256+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:23:17.749256+0000","last_undegraded":"2024-02-18T16:23:17.749256+0000","last_fullsized":"2024-02-18T16:23:17.749256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.748943+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:25.419343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":365,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.693788+0000","last_change":"2024-02-18T16:22:58.693788+0000","last_active":"2024-02-18T16:22:58.693788+0000","last_peered":"2024-02-18T16:22:58.693788+0000","last_clean":"2024-02-18T16:22:58.693788+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:58.693788+0000","last_undegraded":"2024-02-18T16:22:58.693788+0000","last_fullsized":"2024-02-18T16:22:58.693788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.693538+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:28.192638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.897770+0000","last_change":"2024-02-18T16:22:59.897770+0000","last_active":"2024-02-18T16:22:59.897770+0000","last_peered":"2024-02-18T16:22:59.897770+0000","last_clean":"2024-02-18T16:22:59.897770+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:22:59.897770+0000","last_undegraded":"2024-02-18T16:22:59.897770+0000","last_fullsized":"2024-02-18T16:22:59.897770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.897511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:17:33.837107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.740243+0000","last_change":"2024-02-18T16:23:12.740243+0000","last_active":"2024-02-18T16:23:12.740243+0000","last_peered":"2024-02-18T16:23:12.740243+0000","last_clean":"2024-02-18T16:23:12.740243+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:23:12.740243+0000","last_undegraded":"2024-02-18T16:23:12.740243+0000","last_fullsized":"2024-02-18T16:23:12.740243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.739975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.749389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659744+0000","last_change":"2024-02-18T16:20:59.866261+0000","last_active":"2024-02-18T16:22:48.659744+0000","last_peered":"2024-02-18T16:22:48.659744+0000","last_clean":"2024-02-18T16:22:48.659744+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:22:48.659744+0000","last_undegraded":"2024-02-18T16:22:48.659744+0000","last_fullsized":"2024-02-18T16:22:48.659744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.918122+0000","last_change":"2024-02-18T16:22:48.918122+0000","last_active":"2024-02-18T16:22:48.918122+0000","last_peered":"2024-02-18T16:22:48.918122+0000","last_clean":"2024-02-18T16:22:48.918122+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:22:48.918122+0000","last_undegraded":"2024-02-18T16:22:48.918122+0000","last_fullsized":"2024-02-18T16:22:48.918122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.917868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:12.197986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.726450+0000","last_change":"2024-02-18T16:22:52.726450+0000","last_active":"2024-02-18T16:22:52.726450+0000","last_peered":"2024-02-18T16:22:52.726450+0000","last_clean":"2024-02-18T16:22:52.726450+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:52.726450+0000","last_undegraded":"2024-02-18T16:22:52.726450+0000","last_fullsized":"2024-02-18T16:22:52.726450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.726227+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:01.503665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.749676+0000","last_change":"2024-02-18T16:22:50.749676+0000","last_active":"2024-02-18T16:22:50.749676+0000","last_peered":"2024-02-18T16:22:50.749676+0000","last_clean":"2024-02-18T16:22:50.749676+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:22:50.749676+0000","last_undegraded":"2024-02-18T16:22:50.749676+0000","last_fullsized":"2024-02-18T16:22:50.749676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.749316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:31.018219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.729815+0000","last_change":"2024-02-18T16:21:09.921128+0000","last_active":"2024-02-18T16:22:47.729815+0000","last_peered":"2024-02-18T16:22:47.729815+0000","last_clean":"2024-02-18T16:22:47.729815+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:22:47.729815+0000","last_undegraded":"2024-02-18T16:22:47.729815+0000","last_fullsized":"2024-02-18T16:22:47.729815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.684394+0000","last_change":"2024-02-18T16:23:05.684394+0000","last_active":"2024-02-18T16:23:05.684394+0000","last_peered":"2024-02-18T16:23:05.684394+0000","last_clean":"2024-02-18T16:23:05.684394+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:23:05.684394+0000","last_undegraded":"2024-02-18T16:23:05.684394+0000","last_fullsized":"2024-02-18T16:23:05.684394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.684138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:51:47.648057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.727969+0000","last_change":"2024-02-18T16:20:46.525242+0000","last_active":"2024-02-18T16:22:47.727969+0000","last_peered":"2024-02-18T16:22:47.727969+0000","last_clean":"2024-02-18T16:22:47.727969+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:22:47.727969+0000","last_undegraded":"2024-02-18T16:22:47.727969+0000","last_fullsized":"2024-02-18T16:22:47.727969+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:44.740634+0000","last_clean_scrub_stamp":"2024-02-18T16:20:44.740634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659462+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:22:48.659462+0000","last_peered":"2024-02-18T16:22:48.659462+0000","last_clean":"2024-02-18T16:22:48.659462+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:22:48.659462+0000","last_undegraded":"2024-02-18T16:22:48.659462+0000","last_fullsized":"2024-02-18T16:22:48.659462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659514+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:22:48.659514+0000","last_peered":"2024-02-18T16:22:48.659514+0000","last_clean":"2024-02-18T16:22:48.659514+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:22:48.659514+0000","last_undegraded":"2024-02-18T16:22:48.659514+0000","last_fullsized":"2024-02-18T16:22:48.659514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.664877+0000","last_change":"2024-02-18T16:23:03.664877+0000","last_active":"2024-02-18T16:23:03.664877+0000","last_peered":"2024-02-18T16:23:03.664877+0000","last_clean":"2024-02-18T16:23:03.664877+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:23:03.664877+0000","last_undegraded":"2024-02-18T16:23:03.664877+0000","last_fullsized":"2024-02-18T16:23:03.664877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.664624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:45.069024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'84","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.776665+0000","last_change":"2024-02-18T16:23:21.776848+0000","last_active":"2024-02-18T16:23:21.776665+0000","last_peered":"2024-02-18T16:23:21.776665+0000","last_clean":"2024-02-18T16:23:21.776665+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:23:21.776665+0000","last_undegraded":"2024-02-18T16:23:21.776665+0000","last_fullsized":"2024-02-18T16:23:21.776665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.776429+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:19.871412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.479778+0000","last_change":"2024-02-18T16:22:51.479778+0000","last_active":"2024-02-18T16:22:51.479778+0000","last_peered":"2024-02-18T16:22:51.479778+0000","last_clean":"2024-02-18T16:22:51.479778+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:22:51.479778+0000","last_undegraded":"2024-02-18T16:22:51.479778+0000","last_fullsized":"2024-02-18T16:22:51.479778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.479526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:00.256964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.875952+0000","last_change":"2024-02-18T16:22:55.875952+0000","last_active":"2024-02-18T16:22:55.875952+0000","last_peered":"2024-02-18T16:22:55.875952+0000","last_clean":"2024-02-18T16:22:55.875952+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:55.875952+0000","last_undegraded":"2024-02-18T16:22:55.875952+0000","last_fullsized":"2024-02-18T16:22:55.875952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.875669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:33.784174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660865+0000","last_change":"2024-02-18T16:21:01.853487+0000","last_active":"2024-02-18T16:22:48.660865+0000","last_peered":"2024-02-18T16:22:48.660865+0000","last_clean":"2024-02-18T16:22:48.660865+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:22:48.660865+0000","last_undegraded":"2024-02-18T16:22:48.660865+0000","last_fullsized":"2024-02-18T16:22:48.660865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659370+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:22:48.659370+0000","last_peered":"2024-02-18T16:22:48.659370+0000","last_clean":"2024-02-18T16:22:48.659370+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:22:48.659370+0000","last_undegraded":"2024-02-18T16:22:48.659370+0000","last_fullsized":"2024-02-18T16:22:48.659370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267702+0000","last_change":"2024-02-18T16:20:59.848482+0000","last_active":"2024-02-18T16:22:47.267702+0000","last_peered":"2024-02-18T16:22:47.267702+0000","last_clean":"2024-02-18T16:22:47.267702+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:22:47.267702+0000","last_undegraded":"2024-02-18T16:22:47.267702+0000","last_fullsized":"2024-02-18T16:22:47.267702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.880298+0000","last_change":"2024-02-18T16:22:50.880298+0000","last_active":"2024-02-18T16:22:50.880298+0000","last_peered":"2024-02-18T16:22:50.880298+0000","last_clean":"2024-02-18T16:22:50.880298+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:22:50.880298+0000","last_undegraded":"2024-02-18T16:22:50.880298+0000","last_fullsized":"2024-02-18T16:22:50.880298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.879993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:40:55.016859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.676283+0000","last_change":"2024-02-18T16:22:48.676283+0000","last_active":"2024-02-18T16:22:48.676283+0000","last_peered":"2024-02-18T16:22:48.676283+0000","last_clean":"2024-02-18T16:22:48.676283+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:48.676283+0000","last_undegraded":"2024-02-18T16:22:48.676283+0000","last_fullsized":"2024-02-18T16:22:48.676283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.676008+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:36.238448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.648672+0000","last_change":"2024-02-18T16:23:12.648672+0000","last_active":"2024-02-18T16:23:12.648672+0000","last_peered":"2024-02-18T16:23:12.648672+0000","last_clean":"2024-02-18T16:23:12.648672+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:23:12.648672+0000","last_undegraded":"2024-02-18T16:23:12.648672+0000","last_fullsized":"2024-02-18T16:23:12.648672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.648341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:17:59.693351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.729907+0000","last_change":"2024-02-18T16:21:09.927419+0000","last_active":"2024-02-18T16:22:47.729907+0000","last_peered":"2024-02-18T16:22:47.729907+0000","last_clean":"2024-02-18T16:22:47.729907+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:22:47.729907+0000","last_undegraded":"2024-02-18T16:22:47.729907+0000","last_fullsized":"2024-02-18T16:22:47.729907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268046+0000","last_change":"2024-02-18T16:21:01.846415+0000","last_active":"2024-02-18T16:22:47.268046+0000","last_peered":"2024-02-18T16:22:47.268046+0000","last_clean":"2024-02-18T16:22:47.268046+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:22:47.268046+0000","last_undegraded":"2024-02-18T16:22:47.268046+0000","last_fullsized":"2024-02-18T16:22:47.268046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194384+0000","last_change":"2024-02-18T16:20:51.775932+0000","last_active":"2024-02-18T16:22:48.194384+0000","last_peered":"2024-02-18T16:22:48.194384+0000","last_clean":"2024-02-18T16:22:48.194384+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:22:48.194384+0000","last_undegraded":"2024-02-18T16:22:48.194384+0000","last_fullsized":"2024-02-18T16:22:48.194384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267551+0000","last_change":"2024-02-18T16:20:59.850718+0000","last_active":"2024-02-18T16:22:47.267551+0000","last_peered":"2024-02-18T16:22:47.267551+0000","last_clean":"2024-02-18T16:22:47.267551+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:22:47.267551+0000","last_undegraded":"2024-02-18T16:22:47.267551+0000","last_fullsized":"2024-02-18T16:22:47.267551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.949902+0000","last_change":"2024-02-18T16:23:12.949902+0000","last_active":"2024-02-18T16:23:12.949902+0000","last_peered":"2024-02-18T16:23:12.949902+0000","last_clean":"2024-02-18T16:23:12.949902+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:23:12.949902+0000","last_undegraded":"2024-02-18T16:23:12.949902+0000","last_fullsized":"2024-02-18T16:23:12.949902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.949503+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:07:00.591023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.880194+0000","last_change":"2024-02-18T16:23:01.880194+0000","last_active":"2024-02-18T16:23:01.880194+0000","last_peered":"2024-02-18T16:23:01.880194+0000","last_clean":"2024-02-18T16:23:01.880194+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:23:01.880194+0000","last_undegraded":"2024-02-18T16:23:01.880194+0000","last_fullsized":"2024-02-18T16:23:01.880194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.879908+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:49.968692+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.417911+0000","last_change":"2024-02-18T16:22:55.417911+0000","last_active":"2024-02-18T16:22:55.417911+0000","last_peered":"2024-02-18T16:22:55.417911+0000","last_clean":"2024-02-18T16:22:55.417911+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:22:55.417911+0000","last_undegraded":"2024-02-18T16:22:55.417911+0000","last_fullsized":"2024-02-18T16:22:55.417911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.417642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:43.506426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.946879+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:21:40.946879+0000","last_peered":"2024-02-18T16:21:40.946879+0000","last_clean":"2024-02-18T16:21:40.946879+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:21:40.946879+0000","last_undegraded":"2024-02-18T16:21:40.946879+0000","last_fullsized":"2024-02-18T16:21:40.946879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.122969+0000","last_change":"2024-02-18T16:23:21.123024+0000","last_active":"2024-02-18T16:23:21.122969+0000","last_peered":"2024-02-18T16:23:21.122969+0000","last_clean":"2024-02-18T16:23:21.122969+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:23:21.122969+0000","last_undegraded":"2024-02-18T16:23:21.122969+0000","last_fullsized":"2024-02-18T16:23:21.122969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.122778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:31.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659406+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:22:48.659406+0000","last_peered":"2024-02-18T16:22:48.659406+0000","last_clean":"2024-02-18T16:22:48.659406+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:22:48.659406+0000","last_undegraded":"2024-02-18T16:22:48.659406+0000","last_fullsized":"2024-02-18T16:22:48.659406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.910035+0000","last_change":"2024-02-18T16:23:18.910098+0000","last_active":"2024-02-18T16:23:18.910035+0000","last_peered":"2024-02-18T16:23:18.910035+0000","last_clean":"2024-02-18T16:23:18.910035+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:23:18.910035+0000","last_undegraded":"2024-02-18T16:23:18.910035+0000","last_fullsized":"2024-02-18T16:23:18.910035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.909845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:53:00.919260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.247235+0000","last_change":"2024-02-18T16:23:08.247235+0000","last_active":"2024-02-18T16:23:08.247235+0000","last_peered":"2024-02-18T16:23:08.247235+0000","last_clean":"2024-02-18T16:23:08.247235+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:23:08.247235+0000","last_undegraded":"2024-02-18T16:23:08.247235+0000","last_fullsized":"2024-02-18T16:23:08.247235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.246981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:42:58.377194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.623260+0000","last_change":"2024-02-18T16:23:08.623260+0000","last_active":"2024-02-18T16:23:08.623260+0000","last_peered":"2024-02-18T16:23:08.623260+0000","last_clean":"2024-02-18T16:23:08.623260+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:23:08.623260+0000","last_undegraded":"2024-02-18T16:23:08.623260+0000","last_fullsized":"2024-02-18T16:23:08.623260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.622991+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:02.281198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.662488+0000","last_change":"2024-02-18T16:21:07.918398+0000","last_active":"2024-02-18T16:22:48.662488+0000","last_peered":"2024-02-18T16:22:48.662488+0000","last_clean":"2024-02-18T16:22:48.662488+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:22:48.662488+0000","last_undegraded":"2024-02-18T16:22:48.662488+0000","last_fullsized":"2024-02-18T16:22:48.662488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:06.845711+0000","last_clean_scrub_stamp":"2024-02-18T16:21:06.845711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.736675+0000","last_change":"2024-02-18T16:23:14.736675+0000","last_active":"2024-02-18T16:23:14.736675+0000","last_peered":"2024-02-18T16:23:14.736675+0000","last_clean":"2024-02-18T16:23:14.736675+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:23:14.736675+0000","last_undegraded":"2024-02-18T16:23:14.736675+0000","last_fullsized":"2024-02-18T16:23:14.736675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.736262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.555313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.756320+0000","last_change":"2024-02-18T16:23:15.756377+0000","last_active":"2024-02-18T16:23:15.756320+0000","last_peered":"2024-02-18T16:23:15.756320+0000","last_clean":"2024-02-18T16:23:15.756320+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:23:15.756320+0000","last_undegraded":"2024-02-18T16:23:15.756320+0000","last_fullsized":"2024-02-18T16:23:15.756320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.756123+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.498459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194439+0000","last_change":"2024-02-18T16:20:59.833465+0000","last_active":"2024-02-18T16:22:48.194439+0000","last_peered":"2024-02-18T16:22:48.194439+0000","last_clean":"2024-02-18T16:22:48.194439+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:22:48.194439+0000","last_undegraded":"2024-02-18T16:22:48.194439+0000","last_fullsized":"2024-02-18T16:22:48.194439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267532+0000","last_change":"2024-02-18T16:20:51.776902+0000","last_active":"2024-02-18T16:22:47.267532+0000","last_peered":"2024-02-18T16:22:47.267532+0000","last_clean":"2024-02-18T16:22:47.267532+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:22:47.267532+0000","last_undegraded":"2024-02-18T16:22:47.267532+0000","last_fullsized":"2024-02-18T16:22:47.267532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:43.858936+0000","last_change":"2024-02-18T16:21:40.945591+0000","last_active":"2024-02-18T16:21:43.858936+0000","last_peered":"2024-02-18T16:21:43.858936+0000","last_clean":"2024-02-18T16:21:43.858936+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:21:43.858936+0000","last_undegraded":"2024-02-18T16:21:43.858936+0000","last_fullsized":"2024-02-18T16:21:43.858936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.420257+0000","last_change":"2024-02-18T16:22:56.420257+0000","last_active":"2024-02-18T16:22:56.420257+0000","last_peered":"2024-02-18T16:22:56.420257+0000","last_clean":"2024-02-18T16:22:56.420257+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:56.420257+0000","last_undegraded":"2024-02-18T16:22:56.420257+0000","last_fullsized":"2024-02-18T16:22:56.420257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.419970+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:02.428762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.748170+0000","last_change":"2024-02-18T16:22:49.748170+0000","last_active":"2024-02-18T16:22:49.748170+0000","last_peered":"2024-02-18T16:22:49.748170+0000","last_clean":"2024-02-18T16:22:49.748170+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:22:49.748170+0000","last_undegraded":"2024-02-18T16:22:49.748170+0000","last_fullsized":"2024-02-18T16:22:49.748170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.747885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:10:50.889318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.488905+0000","last_change":"2024-02-18T16:21:09.905763+0000","last_active":"2024-02-18T16:22:30.488905+0000","last_peered":"2024-02-18T16:22:30.488905+0000","last_clean":"2024-02-18T16:22:30.488905+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:22:30.488905+0000","last_undegraded":"2024-02-18T16:22:30.488905+0000","last_fullsized":"2024-02-18T16:22:30.488905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.714159+0000","last_change":"2024-02-18T16:23:11.714272+0000","last_active":"2024-02-18T16:23:11.714159+0000","last_peered":"2024-02-18T16:23:11.714159+0000","last_clean":"2024-02-18T16:23:11.714159+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:23:11.714159+0000","last_undegraded":"2024-02-18T16:23:11.714159+0000","last_fullsized":"2024-02-18T16:23:11.714159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.713937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.850804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.160180+0000","last_change":"2024-02-18T16:23:22.160243+0000","last_active":"2024-02-18T16:23:22.160180+0000","last_peered":"2024-02-18T16:23:22.160180+0000","last_clean":"2024-02-18T16:23:22.160180+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:23:22.160180+0000","last_undegraded":"2024-02-18T16:23:22.160180+0000","last_fullsized":"2024-02-18T16:23:22.160180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.159961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.101435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659615+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:22:48.659615+0000","last_peered":"2024-02-18T16:22:48.659615+0000","last_clean":"2024-02-18T16:22:48.659615+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:22:48.659615+0000","last_undegraded":"2024-02-18T16:22:48.659615+0000","last_fullsized":"2024-02-18T16:22:48.659615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.818376+0000","last_change":"2024-02-18T16:22:58.818376+0000","last_active":"2024-02-18T16:22:58.818376+0000","last_peered":"2024-02-18T16:22:58.818376+0000","last_clean":"2024-02-18T16:22:58.818376+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:22:58.818376+0000","last_undegraded":"2024-02-18T16:22:58.818376+0000","last_fullsized":"2024-02-18T16:22:58.818376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.818107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:11.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.707930+0000","last_change":"2024-02-18T16:22:49.707930+0000","last_active":"2024-02-18T16:22:49.707930+0000","last_peered":"2024-02-18T16:22:49.707930+0000","last_clean":"2024-02-18T16:22:49.707930+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:22:49.707930+0000","last_undegraded":"2024-02-18T16:22:49.707930+0000","last_fullsized":"2024-02-18T16:22:49.707930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.707617+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:28.098540+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.735695+0000","last_change":"2024-02-18T16:22:50.735695+0000","last_active":"2024-02-18T16:22:50.735695+0000","last_peered":"2024-02-18T16:22:50.735695+0000","last_clean":"2024-02-18T16:22:50.735695+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:50.735695+0000","last_undegraded":"2024-02-18T16:22:50.735695+0000","last_fullsized":"2024-02-18T16:22:50.735695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.735438+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:28.643943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954125+0000","last_change":"2024-02-18T16:21:09.914553+0000","last_active":"2024-02-18T16:21:40.954125+0000","last_peered":"2024-02-18T16:21:40.954125+0000","last_clean":"2024-02-18T16:21:40.954125+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:21:40.954125+0000","last_undegraded":"2024-02-18T16:21:40.954125+0000","last_fullsized":"2024-02-18T16:21:40.954125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660810+0000","last_change":"2024-02-18T16:21:01.853061+0000","last_active":"2024-02-18T16:22:48.660810+0000","last_peered":"2024-02-18T16:22:48.660810+0000","last_clean":"2024-02-18T16:22:48.660810+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:22:48.660810+0000","last_undegraded":"2024-02-18T16:22:48.660810+0000","last_fullsized":"2024-02-18T16:22:48.660810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659702+0000","last_change":"2024-02-18T16:20:59.868556+0000","last_active":"2024-02-18T16:22:48.659702+0000","last_peered":"2024-02-18T16:22:48.659702+0000","last_clean":"2024-02-18T16:22:48.659702+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:22:48.659702+0000","last_undegraded":"2024-02-18T16:22:48.659702+0000","last_fullsized":"2024-02-18T16:22:48.659702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267532+0000","last_change":"2024-02-18T16:20:51.777166+0000","last_active":"2024-02-18T16:22:47.267532+0000","last_peered":"2024-02-18T16:22:47.267532+0000","last_clean":"2024-02-18T16:22:47.267532+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:22:47.267532+0000","last_undegraded":"2024-02-18T16:22:47.267532+0000","last_fullsized":"2024-02-18T16:22:47.267532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.835162+0000","last_change":"2024-02-18T16:22:53.835162+0000","last_active":"2024-02-18T16:22:53.835162+0000","last_peered":"2024-02-18T16:22:53.835162+0000","last_clean":"2024-02-18T16:22:53.835162+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:22:53.835162+0000","last_undegraded":"2024-02-18T16:22:53.835162+0000","last_fullsized":"2024-02-18T16:22:53.835162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.834880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:45:52.990486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.796672+0000","last_change":"2024-02-18T16:23:02.796672+0000","last_active":"2024-02-18T16:23:02.796672+0000","last_peered":"2024-02-18T16:23:02.796672+0000","last_clean":"2024-02-18T16:23:02.796672+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:23:02.796672+0000","last_undegraded":"2024-02-18T16:23:02.796672+0000","last_fullsized":"2024-02-18T16:23:02.796672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.796510+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:15.165336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.432203+0000","last_change":"2024-02-18T16:22:53.432203+0000","last_active":"2024-02-18T16:22:53.432203+0000","last_peered":"2024-02-18T16:22:53.432203+0000","last_clean":"2024-02-18T16:22:53.432203+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:53.432203+0000","last_undegraded":"2024-02-18T16:22:53.432203+0000","last_fullsized":"2024-02-18T16:22:53.432203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.431945+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:16.067812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.871480+0000","last_change":"2024-02-18T16:21:09.917363+0000","last_active":"2024-02-18T16:21:47.871480+0000","last_peered":"2024-02-18T16:21:47.871480+0000","last_clean":"2024-02-18T16:21:47.871480+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:21:47.871480+0000","last_undegraded":"2024-02-18T16:21:47.871480+0000","last_fullsized":"2024-02-18T16:21:47.871480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194810+0000","last_change":"2024-02-18T16:21:01.849433+0000","last_active":"2024-02-18T16:22:48.194810+0000","last_peered":"2024-02-18T16:22:48.194810+0000","last_clean":"2024-02-18T16:22:48.194810+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:22:48.194810+0000","last_undegraded":"2024-02-18T16:22:48.194810+0000","last_fullsized":"2024-02-18T16:22:48.194810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.719789+0000","last_change":"2024-02-18T16:23:21.719847+0000","last_active":"2024-02-18T16:23:21.719789+0000","last_peered":"2024-02-18T16:23:21.719789+0000","last_clean":"2024-02-18T16:23:21.719789+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:23:21.719789+0000","last_undegraded":"2024-02-18T16:23:21.719789+0000","last_fullsized":"2024-02-18T16:23:21.719789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.719594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:28.530836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659496+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:22:48.659496+0000","last_peered":"2024-02-18T16:22:48.659496+0000","last_clean":"2024-02-18T16:22:48.659496+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:22:48.659496+0000","last_undegraded":"2024-02-18T16:22:48.659496+0000","last_fullsized":"2024-02-18T16:22:48.659496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.848661+0000","last_change":"2024-02-18T16:22:55.848661+0000","last_active":"2024-02-18T16:22:55.848661+0000","last_peered":"2024-02-18T16:22:55.848661+0000","last_clean":"2024-02-18T16:22:55.848661+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:22:55.848661+0000","last_undegraded":"2024-02-18T16:22:55.848661+0000","last_fullsized":"2024-02-18T16:22:55.848661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.848402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:19.446935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.898018+0000","last_change":"2024-02-18T16:22:57.898018+0000","last_active":"2024-02-18T16:22:57.898018+0000","last_peered":"2024-02-18T16:22:57.898018+0000","last_clean":"2024-02-18T16:22:57.898018+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:57.898018+0000","last_undegraded":"2024-02-18T16:22:57.898018+0000","last_fullsized":"2024-02-18T16:22:57.898018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.897660+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:13.070415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.433639+0000","last_change":"2024-02-18T16:22:47.433639+0000","last_active":"2024-02-18T16:22:47.433639+0000","last_peered":"2024-02-18T16:22:47.433639+0000","last_clean":"2024-02-18T16:22:47.433639+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:22:47.433639+0000","last_undegraded":"2024-02-18T16:22:47.433639+0000","last_fullsized":"2024-02-18T16:22:47.433639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_clean_scrub_stamp":"2024-02-18T16:22:47.433513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:34.995953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.868762+0000","last_change":"2024-02-18T16:23:07.868860+0000","last_active":"2024-02-18T16:23:07.868762+0000","last_peered":"2024-02-18T16:23:07.868762+0000","last_clean":"2024-02-18T16:23:07.868762+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:23:07.868762+0000","last_undegraded":"2024-02-18T16:23:07.868762+0000","last_fullsized":"2024-02-18T16:23:07.868762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.868484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:40.791749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.906138+0000","last_change":"2024-02-18T16:23:03.906138+0000","last_active":"2024-02-18T16:23:03.906138+0000","last_peered":"2024-02-18T16:23:03.906138+0000","last_clean":"2024-02-18T16:23:03.906138+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:23:03.906138+0000","last_undegraded":"2024-02-18T16:23:03.906138+0000","last_fullsized":"2024-02-18T16:23:03.906138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.905867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:52.615381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.195009+0000","last_change":"2024-02-18T16:21:41.183619+0000","last_active":"2024-02-18T16:22:48.195009+0000","last_peered":"2024-02-18T16:22:48.195009+0000","last_clean":"2024-02-18T16:22:48.195009+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:22:48.195009+0000","last_undegraded":"2024-02-18T16:22:48.195009+0000","last_fullsized":"2024-02-18T16:22:48.195009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659990+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:22:48.659990+0000","last_peered":"2024-02-18T16:22:48.659990+0000","last_clean":"2024-02-18T16:22:48.659990+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:22:48.659990+0000","last_undegraded":"2024-02-18T16:22:48.659990+0000","last_fullsized":"2024-02-18T16:22:48.659990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.662609+0000","last_change":"2024-02-18T16:22:59.662609+0000","last_active":"2024-02-18T16:22:59.662609+0000","last_peered":"2024-02-18T16:22:59.662609+0000","last_clean":"2024-02-18T16:22:59.662609+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:22:59.662609+0000","last_undegraded":"2024-02-18T16:22:59.662609+0000","last_fullsized":"2024-02-18T16:22:59.662609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.662355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:03.409762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.873591+0000","last_change":"2024-02-18T16:22:52.873759+0000","last_active":"2024-02-18T16:22:52.873591+0000","last_peered":"2024-02-18T16:22:52.873591+0000","last_clean":"2024-02-18T16:22:52.873591+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:52.873591+0000","last_undegraded":"2024-02-18T16:22:52.873591+0000","last_fullsized":"2024-02-18T16:22:52.873591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.873343+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:03.165248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.654604+0000","last_change":"2024-02-18T16:23:13.654661+0000","last_active":"2024-02-18T16:23:13.654604+0000","last_peered":"2024-02-18T16:23:13.654604+0000","last_clean":"2024-02-18T16:23:13.654604+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:23:13.654604+0000","last_undegraded":"2024-02-18T16:23:13.654604+0000","last_fullsized":"2024-02-18T16:23:13.654604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.654400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:20:57.367640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.269119+0000","last_change":"2024-02-18T16:21:09.909919+0000","last_active":"2024-02-18T16:22:47.269119+0000","last_peered":"2024-02-18T16:22:47.269119+0000","last_clean":"2024-02-18T16:22:47.269119+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:22:47.269119+0000","last_undegraded":"2024-02-18T16:22:47.269119+0000","last_fullsized":"2024-02-18T16:22:47.269119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.698302+0000","last_change":"2024-02-18T16:23:07.698302+0000","last_active":"2024-02-18T16:23:07.698302+0000","last_peered":"2024-02-18T16:23:07.698302+0000","last_clean":"2024-02-18T16:23:07.698302+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:23:07.698302+0000","last_undegraded":"2024-02-18T16:23:07.698302+0000","last_fullsized":"2024-02-18T16:23:07.698302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.697990+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.441729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194573+0000","last_change":"2024-02-18T16:20:59.833123+0000","last_active":"2024-02-18T16:22:48.194573+0000","last_peered":"2024-02-18T16:22:48.194573+0000","last_clean":"2024-02-18T16:22:48.194573+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:22:48.194573+0000","last_undegraded":"2024-02-18T16:22:48.194573+0000","last_fullsized":"2024-02-18T16:22:48.194573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.819086+0000","last_change":"2024-02-18T16:22:57.819086+0000","last_active":"2024-02-18T16:22:57.819086+0000","last_peered":"2024-02-18T16:22:57.819086+0000","last_clean":"2024-02-18T16:22:57.819086+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:22:57.819086+0000","last_undegraded":"2024-02-18T16:22:57.819086+0000","last_fullsized":"2024-02-18T16:22:57.819086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.818829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:13.082229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.400283+0000","last_change":"2024-02-18T16:23:00.400353+0000","last_active":"2024-02-18T16:23:00.400283+0000","last_peered":"2024-02-18T16:23:00.400283+0000","last_clean":"2024-02-18T16:23:00.400283+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:23:00.400283+0000","last_undegraded":"2024-02-18T16:23:00.400283+0000","last_fullsized":"2024-02-18T16:23:00.400283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.400088+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:15.271349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.800962+0000","last_change":"2024-02-18T16:22:52.801018+0000","last_active":"2024-02-18T16:22:52.800962+0000","last_peered":"2024-02-18T16:22:52.800962+0000","last_clean":"2024-02-18T16:22:52.800962+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:22:52.800962+0000","last_undegraded":"2024-02-18T16:22:52.800962+0000","last_fullsized":"2024-02-18T16:22:52.800962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.800725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:35:16.840171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:41.177260+0000","last_change":"2024-02-18T16:21:09.926381+0000","last_active":"2024-02-18T16:21:41.177260+0000","last_peered":"2024-02-18T16:21:41.177260+0000","last_clean":"2024-02-18T16:21:41.177260+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:21:41.177260+0000","last_undegraded":"2024-02-18T16:21:41.177260+0000","last_fullsized":"2024-02-18T16:21:41.177260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.086901+0000","last_change":"2024-02-18T16:23:16.086901+0000","last_active":"2024-02-18T16:23:16.086901+0000","last_peered":"2024-02-18T16:23:16.086901+0000","last_clean":"2024-02-18T16:23:16.086901+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:23:16.086901+0000","last_undegraded":"2024-02-18T16:23:16.086901+0000","last_fullsized":"2024-02-18T16:23:16.086901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.086590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.287817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194706+0000","last_change":"2024-02-18T16:20:59.839316+0000","last_active":"2024-02-18T16:22:48.194706+0000","last_peered":"2024-02-18T16:22:48.194706+0000","last_clean":"2024-02-18T16:22:48.194706+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:22:48.194706+0000","last_undegraded":"2024-02-18T16:22:48.194706+0000","last_fullsized":"2024-02-18T16:22:48.194706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.876247+0000","last_change":"2024-02-18T16:23:05.876247+0000","last_active":"2024-02-18T16:23:05.876247+0000","last_peered":"2024-02-18T16:23:05.876247+0000","last_clean":"2024-02-18T16:23:05.876247+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:23:05.876247+0000","last_undegraded":"2024-02-18T16:23:05.876247+0000","last_fullsized":"2024-02-18T16:23:05.876247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.875986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:34.158456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.361817+0000","last_change":"2024-02-18T16:23:01.361892+0000","last_active":"2024-02-18T16:23:01.361817+0000","last_peered":"2024-02-18T16:23:01.361817+0000","last_clean":"2024-02-18T16:23:01.361817+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:23:01.361817+0000","last_undegraded":"2024-02-18T16:23:01.361817+0000","last_fullsized":"2024-02-18T16:23:01.361817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.361622+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:34.284887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.674877+0000","last_change":"2024-02-18T16:22:54.674935+0000","last_active":"2024-02-18T16:22:54.674877+0000","last_peered":"2024-02-18T16:22:54.674877+0000","last_clean":"2024-02-18T16:22:54.674877+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:22:54.674877+0000","last_undegraded":"2024-02-18T16:22:54.674877+0000","last_fullsized":"2024-02-18T16:22:54.674877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.674677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:17.310545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:47.173978+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:21:47.173978+0000","last_peered":"2024-02-18T16:21:47.173978+0000","last_clean":"2024-02-18T16:21:47.173978+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:21:47.173978+0000","last_undegraded":"2024-02-18T16:21:47.173978+0000","last_fullsized":"2024-02-18T16:21:47.173978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661189+0000","last_change":"2024-02-18T16:21:01.853323+0000","last_active":"2024-02-18T16:22:48.661189+0000","last_peered":"2024-02-18T16:22:48.661189+0000","last_clean":"2024-02-18T16:22:48.661189+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:22:48.661189+0000","last_undegraded":"2024-02-18T16:22:48.661189+0000","last_fullsized":"2024-02-18T16:22:48.661189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728048+0000","last_change":"2024-02-18T16:20:59.853141+0000","last_active":"2024-02-18T16:22:47.728048+0000","last_peered":"2024-02-18T16:22:47.728048+0000","last_clean":"2024-02-18T16:22:47.728048+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:22:47.728048+0000","last_undegraded":"2024-02-18T16:22:47.728048+0000","last_fullsized":"2024-02-18T16:22:47.728048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.913473+0000","last_change":"2024-02-18T16:22:51.913473+0000","last_active":"2024-02-18T16:22:51.913473+0000","last_peered":"2024-02-18T16:22:51.913473+0000","last_clean":"2024-02-18T16:22:51.913473+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:22:51.913473+0000","last_undegraded":"2024-02-18T16:22:51.913473+0000","last_fullsized":"2024-02-18T16:22:51.913473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.913196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:37:17.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.903611+0000","last_change":"2024-02-18T16:23:02.903715+0000","last_active":"2024-02-18T16:23:02.903611+0000","last_peered":"2024-02-18T16:23:02.903611+0000","last_clean":"2024-02-18T16:23:02.903611+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:23:02.903611+0000","last_undegraded":"2024-02-18T16:23:02.903611+0000","last_fullsized":"2024-02-18T16:23:02.903611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.903414+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:08.912206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.831496+0000","last_change":"2024-02-18T16:22:53.831594+0000","last_active":"2024-02-18T16:22:53.831496+0000","last_peered":"2024-02-18T16:22:53.831496+0000","last_clean":"2024-02-18T16:22:53.831496+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:22:53.831496+0000","last_undegraded":"2024-02-18T16:22:53.831496+0000","last_fullsized":"2024-02-18T16:22:53.831496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.831178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:41.393618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661015+0000","last_change":"2024-02-18T16:21:01.852475+0000","last_active":"2024-02-18T16:22:48.661015+0000","last_peered":"2024-02-18T16:22:48.661015+0000","last_clean":"2024-02-18T16:22:48.661015+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:22:48.661015+0000","last_undegraded":"2024-02-18T16:22:48.661015+0000","last_fullsized":"2024-02-18T16:22:48.661015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660080+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:22:48.660080+0000","last_peered":"2024-02-18T16:22:48.660080+0000","last_clean":"2024-02-18T16:22:48.660080+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:22:48.660080+0000","last_undegraded":"2024-02-18T16:22:48.660080+0000","last_fullsized":"2024-02-18T16:22:48.660080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.208927+0000","last_change":"2024-02-18T16:23:09.208983+0000","last_active":"2024-02-18T16:23:09.208927+0000","last_peered":"2024-02-18T16:23:09.208927+0000","last_clean":"2024-02-18T16:23:09.208927+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:23:09.208927+0000","last_undegraded":"2024-02-18T16:23:09.208927+0000","last_fullsized":"2024-02-18T16:23:09.208927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.208729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.488847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.423949+0000","last_change":"2024-02-18T16:22:58.424028+0000","last_active":"2024-02-18T16:22:58.423949+0000","last_peered":"2024-02-18T16:22:58.423949+0000","last_clean":"2024-02-18T16:22:58.423949+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:58.423949+0000","last_undegraded":"2024-02-18T16:22:58.423949+0000","last_fullsized":"2024-02-18T16:22:58.423949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.423765+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:19.745145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.869538+0000","last_change":"2024-02-18T16:22:54.869606+0000","last_active":"2024-02-18T16:22:54.869538+0000","last_peered":"2024-02-18T16:22:54.869538+0000","last_clean":"2024-02-18T16:22:54.869538+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:22:54.869538+0000","last_undegraded":"2024-02-18T16:22:54.869538+0000","last_fullsized":"2024-02-18T16:22:54.869538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.869352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:33.260275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.480602+0000","last_change":"2024-02-18T16:21:09.926618+0000","last_active":"2024-02-18T16:22:30.480602+0000","last_peered":"2024-02-18T16:22:30.480602+0000","last_clean":"2024-02-18T16:22:30.480602+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:22:30.480602+0000","last_undegraded":"2024-02-18T16:22:30.480602+0000","last_fullsized":"2024-02-18T16:22:30.480602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.153440+0000","last_change":"2024-02-18T16:23:23.153502+0000","last_active":"2024-02-18T16:23:23.153440+0000","last_peered":"2024-02-18T16:23:23.153440+0000","last_clean":"2024-02-18T16:23:23.153440+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:23:23.153440+0000","last_undegraded":"2024-02-18T16:23:23.153440+0000","last_fullsized":"2024-02-18T16:23:23.153440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.153242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:35.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728099+0000","last_change":"2024-02-18T16:20:59.853982+0000","last_active":"2024-02-18T16:22:47.728099+0000","last_peered":"2024-02-18T16:22:47.728099+0000","last_clean":"2024-02-18T16:22:47.728099+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:22:47.728099+0000","last_undegraded":"2024-02-18T16:22:47.728099+0000","last_fullsized":"2024-02-18T16:22:47.728099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.898942+0000","last_change":"2024-02-18T16:23:10.898998+0000","last_active":"2024-02-18T16:23:10.898942+0000","last_peered":"2024-02-18T16:23:10.898942+0000","last_clean":"2024-02-18T16:23:10.898942+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:23:10.898942+0000","last_undegraded":"2024-02-18T16:23:10.898942+0000","last_fullsized":"2024-02-18T16:23:10.898942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.898746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:42.106224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.722639+0000","last_change":"2024-02-18T16:23:04.722806+0000","last_active":"2024-02-18T16:23:04.722639+0000","last_peered":"2024-02-18T16:23:04.722639+0000","last_clean":"2024-02-18T16:23:04.722639+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:23:04.722639+0000","last_undegraded":"2024-02-18T16:23:04.722639+0000","last_fullsized":"2024-02-18T16:23:04.722639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.722326+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:12.289082+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.699684+0000","last_change":"2024-02-18T16:23:06.699736+0000","last_active":"2024-02-18T16:23:06.699684+0000","last_peered":"2024-02-18T16:23:06.699684+0000","last_clean":"2024-02-18T16:23:06.699684+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:23:06.699684+0000","last_undegraded":"2024-02-18T16:23:06.699684+0000","last_fullsized":"2024-02-18T16:23:06.699684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.699466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:54.340986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.933306+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:21:40.933306+0000","last_peered":"2024-02-18T16:21:40.933306+0000","last_clean":"2024-02-18T16:21:40.933306+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:21:40.933306+0000","last_undegraded":"2024-02-18T16:21:40.933306+0000","last_fullsized":"2024-02-18T16:21:40.933306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.756135+0000","last_change":"2024-02-18T16:23:01.756244+0000","last_active":"2024-02-18T16:23:01.756135+0000","last_peered":"2024-02-18T16:23:01.756135+0000","last_clean":"2024-02-18T16:23:01.756135+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:23:01.756135+0000","last_undegraded":"2024-02-18T16:23:01.756135+0000","last_fullsized":"2024-02-18T16:23:01.756135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.755900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:58.697375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929816+0000","last_change":"2024-02-18T16:20:59.854045+0000","last_active":"2024-02-18T16:21:40.929816+0000","last_peered":"2024-02-18T16:21:40.929816+0000","last_clean":"2024-02-18T16:21:40.929816+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:21:40.929816+0000","last_undegraded":"2024-02-18T16:21:40.929816+0000","last_fullsized":"2024-02-18T16:21:40.929816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.887374+0000","last_change":"2024-02-18T16:23:08.887431+0000","last_active":"2024-02-18T16:23:08.887374+0000","last_peered":"2024-02-18T16:23:08.887374+0000","last_clean":"2024-02-18T16:23:08.887374+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:23:08.887374+0000","last_undegraded":"2024-02-18T16:23:08.887374+0000","last_fullsized":"2024-02-18T16:23:08.887374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.887177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:52.037300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.388978+0000","last_change":"2024-02-18T16:22:57.388978+0000","last_active":"2024-02-18T16:22:57.388978+0000","last_peered":"2024-02-18T16:22:57.388978+0000","last_clean":"2024-02-18T16:22:57.388978+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:57.388978+0000","last_undegraded":"2024-02-18T16:22:57.388978+0000","last_fullsized":"2024-02-18T16:22:57.388978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.388689+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:26.576966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.357962+0000","last_change":"2024-02-18T16:23:03.357962+0000","last_active":"2024-02-18T16:23:03.357962+0000","last_peered":"2024-02-18T16:23:03.357962+0000","last_clean":"2024-02-18T16:23:03.357962+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:23:03.357962+0000","last_undegraded":"2024-02-18T16:23:03.357962+0000","last_fullsized":"2024-02-18T16:23:03.357962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.357709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:29:02.881887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.939178+0000","last_change":"2024-02-18T16:21:09.911546+0000","last_active":"2024-02-18T16:21:40.939178+0000","last_peered":"2024-02-18T16:21:40.939178+0000","last_clean":"2024-02-18T16:21:40.939178+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:21:40.939178+0000","last_undegraded":"2024-02-18T16:21:40.939178+0000","last_fullsized":"2024-02-18T16:21:40.939178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.154670+0000","last_change":"2024-02-18T16:23:19.154731+0000","last_active":"2024-02-18T16:23:19.154670+0000","last_peered":"2024-02-18T16:23:19.154670+0000","last_clean":"2024-02-18T16:23:19.154670+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:23:19.154670+0000","last_undegraded":"2024-02-18T16:23:19.154670+0000","last_fullsized":"2024-02-18T16:23:19.154670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.154433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:31.359635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.948982+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:21:40.948982+0000","last_peered":"2024-02-18T16:21:40.948982+0000","last_clean":"2024-02-18T16:21:40.948982+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:21:40.948982+0000","last_undegraded":"2024-02-18T16:21:40.948982+0000","last_fullsized":"2024-02-18T16:21:40.948982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.683276+0000","last_change":"2024-02-18T16:22:56.683330+0000","last_active":"2024-02-18T16:22:56.683276+0000","last_peered":"2024-02-18T16:22:56.683276+0000","last_clean":"2024-02-18T16:22:56.683276+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:22:56.683276+0000","last_undegraded":"2024-02-18T16:22:56.683276+0000","last_fullsized":"2024-02-18T16:22:56.683276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.683085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:46:21.980224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.770082+0000","last_change":"2024-02-18T16:23:19.770167+0000","last_active":"2024-02-18T16:23:19.770082+0000","last_peered":"2024-02-18T16:23:19.770082+0000","last_clean":"2024-02-18T16:23:19.770082+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:23:19.770082+0000","last_undegraded":"2024-02-18T16:23:19.770082+0000","last_fullsized":"2024-02-18T16:23:19.770082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.769894+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:21.405998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.790722+0000","last_change":"2024-02-18T16:22:48.790722+0000","last_active":"2024-02-18T16:22:48.790722+0000","last_peered":"2024-02-18T16:22:48.790722+0000","last_clean":"2024-02-18T16:22:48.790722+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:48.790722+0000","last_undegraded":"2024-02-18T16:22:48.790722+0000","last_fullsized":"2024-02-18T16:22:48.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.790462+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:30:37.353769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.931834+0000","last_change":"2024-02-18T16:21:09.924100+0000","last_active":"2024-02-18T16:21:40.931834+0000","last_peered":"2024-02-18T16:21:40.931834+0000","last_clean":"2024-02-18T16:21:40.931834+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:21:40.931834+0000","last_undegraded":"2024-02-18T16:21:40.931834+0000","last_fullsized":"2024-02-18T16:21:40.931834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.906480+0000","last_change":"2024-02-18T16:23:19.906619+0000","last_active":"2024-02-18T16:23:19.906480+0000","last_peered":"2024-02-18T16:23:19.906480+0000","last_clean":"2024-02-18T16:23:19.906480+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:23:19.906480+0000","last_undegraded":"2024-02-18T16:23:19.906480+0000","last_fullsized":"2024-02-18T16:23:19.906480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.906135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:30.198039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.929965+0000","last_change":"2024-02-18T16:20:59.859857+0000","last_active":"2024-02-18T16:21:40.929965+0000","last_peered":"2024-02-18T16:21:40.929965+0000","last_clean":"2024-02-18T16:21:40.929965+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:21:40.929965+0000","last_undegraded":"2024-02-18T16:21:40.929965+0000","last_fullsized":"2024-02-18T16:21:40.929965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.684007+0000","last_change":"2024-02-18T16:22:57.684114+0000","last_active":"2024-02-18T16:22:57.684007+0000","last_peered":"2024-02-18T16:22:57.684007+0000","last_clean":"2024-02-18T16:22:57.684007+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:22:57.684007+0000","last_undegraded":"2024-02-18T16:22:57.684007+0000","last_fullsized":"2024-02-18T16:22:57.684007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.683775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:46.393290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.747350+0000","last_change":"2024-02-18T16:22:51.747441+0000","last_active":"2024-02-18T16:22:51.747350+0000","last_peered":"2024-02-18T16:22:51.747350+0000","last_clean":"2024-02-18T16:22:51.747350+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:51.747350+0000","last_undegraded":"2024-02-18T16:22:51.747350+0000","last_fullsized":"2024-02-18T16:22:51.747350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.747142+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:31.805590+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.481423+0000","last_change":"2024-02-18T16:22:50.481478+0000","last_active":"2024-02-18T16:22:50.481423+0000","last_peered":"2024-02-18T16:22:50.481423+0000","last_clean":"2024-02-18T16:22:50.481423+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:22:50.481423+0000","last_undegraded":"2024-02-18T16:22:50.481423+0000","last_fullsized":"2024-02-18T16:22:50.481423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.481235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:40.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.432992+0000","last_change":"2024-02-18T16:21:09.927008+0000","last_active":"2024-02-18T16:21:46.432992+0000","last_peered":"2024-02-18T16:21:46.432992+0000","last_clean":"2024-02-18T16:21:46.432992+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:21:46.432992+0000","last_undegraded":"2024-02-18T16:21:46.432992+0000","last_fullsized":"2024-02-18T16:21:46.432992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.951497+0000","last_change":"2024-02-18T16:23:14.951553+0000","last_active":"2024-02-18T16:23:14.951497+0000","last_peered":"2024-02-18T16:23:14.951497+0000","last_clean":"2024-02-18T16:23:14.951497+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:23:14.951497+0000","last_undegraded":"2024-02-18T16:23:14.951497+0000","last_fullsized":"2024-02-18T16:23:14.951497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.951301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:43:05.081514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.951717+0000","last_change":"2024-02-18T16:20:59.872971+0000","last_active":"2024-02-18T16:21:40.951717+0000","last_peered":"2024-02-18T16:21:40.951717+0000","last_clean":"2024-02-18T16:21:40.951717+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:21:40.951717+0000","last_undegraded":"2024-02-18T16:21:40.951717+0000","last_fullsized":"2024-02-18T16:21:40.951717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.877569+0000","last_change":"2024-02-18T16:23:09.877623+0000","last_active":"2024-02-18T16:23:09.877569+0000","last_peered":"2024-02-18T16:23:09.877569+0000","last_clean":"2024-02-18T16:23:09.877569+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:23:09.877569+0000","last_undegraded":"2024-02-18T16:23:09.877569+0000","last_fullsized":"2024-02-18T16:23:09.877569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.877375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:51.281775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.395608+0000","last_change":"2024-02-18T16:22:54.395705+0000","last_active":"2024-02-18T16:22:54.395608+0000","last_peered":"2024-02-18T16:22:54.395608+0000","last_clean":"2024-02-18T16:22:54.395608+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:54.395608+0000","last_undegraded":"2024-02-18T16:22:54.395608+0000","last_fullsized":"2024-02-18T16:22:54.395608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.395421+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:31.781895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.641372+0000","last_change":"2024-02-18T16:23:11.641433+0000","last_active":"2024-02-18T16:23:11.641372+0000","last_peered":"2024-02-18T16:23:11.641372+0000","last_clean":"2024-02-18T16:23:11.641372+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:23:11.641372+0000","last_undegraded":"2024-02-18T16:23:11.641372+0000","last_fullsized":"2024-02-18T16:23:11.641372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.641157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:04.618665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.954314+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:21:40.954314+0000","last_peered":"2024-02-18T16:21:40.954314+0000","last_clean":"2024-02-18T16:21:40.954314+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:21:40.954314+0000","last_undegraded":"2024-02-18T16:21:40.954314+0000","last_fullsized":"2024-02-18T16:21:40.954314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:46.436088+0000","last_change":"2024-02-18T16:21:01.855576+0000","last_active":"2024-02-18T16:21:46.436088+0000","last_peered":"2024-02-18T16:21:46.436088+0000","last_clean":"2024-02-18T16:21:46.436088+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:21:46.436088+0000","last_undegraded":"2024-02-18T16:21:46.436088+0000","last_fullsized":"2024-02-18T16:21:46.436088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.123637+0000","last_change":"2024-02-18T16:23:18.123711+0000","last_active":"2024-02-18T16:23:18.123637+0000","last_peered":"2024-02-18T16:23:18.123637+0000","last_clean":"2024-02-18T16:23:18.123637+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:23:18.123637+0000","last_undegraded":"2024-02-18T16:23:18.123637+0000","last_fullsized":"2024-02-18T16:23:18.123637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.123439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:33.386838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":210,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.716139+0000","last_change":"2024-02-18T16:23:05.716209+0000","last_active":"2024-02-18T16:23:05.716139+0000","last_peered":"2024-02-18T16:23:05.716139+0000","last_clean":"2024-02-18T16:23:05.716139+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:23:05.716139+0000","last_undegraded":"2024-02-18T16:23:05.716139+0000","last_fullsized":"2024-02-18T16:23:05.716139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.715931+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:36:20.412885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.822931+0000","last_change":"2024-02-18T16:22:56.822998+0000","last_active":"2024-02-18T16:22:56.822931+0000","last_peered":"2024-02-18T16:22:56.822931+0000","last_clean":"2024-02-18T16:22:56.822931+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:56.822931+0000","last_undegraded":"2024-02-18T16:22:56.822931+0000","last_fullsized":"2024-02-18T16:22:56.822931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.822745+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:54.548170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.652464+0000","last_change":"2024-02-18T16:23:10.652614+0000","last_active":"2024-02-18T16:23:10.652464+0000","last_peered":"2024-02-18T16:23:10.652464+0000","last_clean":"2024-02-18T16:23:10.652464+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:23:10.652464+0000","last_undegraded":"2024-02-18T16:23:10.652464+0000","last_fullsized":"2024-02-18T16:23:10.652464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.652245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:14:12.784143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.950949+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:21:40.950949+0000","last_peered":"2024-02-18T16:21:40.950949+0000","last_clean":"2024-02-18T16:21:40.950949+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:21:40.950949+0000","last_undegraded":"2024-02-18T16:21:40.950949+0000","last_fullsized":"2024-02-18T16:21:40.950949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.939700+0000","last_change":"2024-02-18T16:23:15.939764+0000","last_active":"2024-02-18T16:23:15.939700+0000","last_peered":"2024-02-18T16:23:15.939700+0000","last_clean":"2024-02-18T16:23:15.939700+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:23:15.939700+0000","last_undegraded":"2024-02-18T16:23:15.939700+0000","last_fullsized":"2024-02-18T16:23:15.939700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.939493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:39.219610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728312+0000","last_change":"2024-02-18T16:20:59.855832+0000","last_active":"2024-02-18T16:22:47.728312+0000","last_peered":"2024-02-18T16:22:47.728312+0000","last_clean":"2024-02-18T16:22:47.728312+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:22:47.728312+0000","last_undegraded":"2024-02-18T16:22:47.728312+0000","last_fullsized":"2024-02-18T16:22:47.728312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.713077+0000","last_change":"2024-02-18T16:23:04.713141+0000","last_active":"2024-02-18T16:23:04.713077+0000","last_peered":"2024-02-18T16:23:04.713077+0000","last_clean":"2024-02-18T16:23:04.713077+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:23:04.713077+0000","last_undegraded":"2024-02-18T16:23:04.713077+0000","last_fullsized":"2024-02-18T16:23:04.713077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.712885+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:17:24.627531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'38","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.770182+0000","last_change":"2024-02-18T16:23:00.770286+0000","last_active":"2024-02-18T16:23:00.770182+0000","last_peered":"2024-02-18T16:23:00.770182+0000","last_clean":"2024-02-18T16:23:00.770182+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:23:00.770182+0000","last_undegraded":"2024-02-18T16:23:00.770182+0000","last_fullsized":"2024-02-18T16:23:00.770182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.769987+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:07.581229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.449610+0000","last_change":"2024-02-18T16:22:52.449715+0000","last_active":"2024-02-18T16:22:52.449610+0000","last_peered":"2024-02-18T16:22:52.449610+0000","last_clean":"2024-02-18T16:22:52.449610+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:22:52.449610+0000","last_undegraded":"2024-02-18T16:22:52.449610+0000","last_fullsized":"2024-02-18T16:22:52.449610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.449362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:25.393949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:30.467458+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:30.467458+0000","last_peered":"2024-02-18T16:22:30.467458+0000","last_clean":"2024-02-18T16:22:30.467458+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:30.467458+0000","last_undegraded":"2024-02-18T16:22:30.467458+0000","last_fullsized":"2024-02-18T16:22:30.467458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.762175+0000","last_change":"2024-02-18T16:23:13.762175+0000","last_active":"2024-02-18T16:23:13.762175+0000","last_peered":"2024-02-18T16:23:13.762175+0000","last_clean":"2024-02-18T16:23:13.762175+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:23:13.762175+0000","last_undegraded":"2024-02-18T16:23:13.762175+0000","last_fullsized":"2024-02-18T16:23:13.762175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.761893+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:09:58.046238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194662+0000","last_change":"2024-02-18T16:20:59.838011+0000","last_active":"2024-02-18T16:22:48.194662+0000","last_peered":"2024-02-18T16:22:48.194662+0000","last_clean":"2024-02-18T16:22:48.194662+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:22:48.194662+0000","last_undegraded":"2024-02-18T16:22:48.194662+0000","last_fullsized":"2024-02-18T16:22:48.194662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.090108+0000","last_change":"2024-02-18T16:23:17.090161+0000","last_active":"2024-02-18T16:23:17.090108+0000","last_peered":"2024-02-18T16:23:17.090108+0000","last_clean":"2024-02-18T16:23:17.090108+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:23:17.090108+0000","last_undegraded":"2024-02-18T16:23:17.090108+0000","last_fullsized":"2024-02-18T16:23:17.090108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.089913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267824+0000","last_change":"2024-02-18T16:20:59.850717+0000","last_active":"2024-02-18T16:22:47.267824+0000","last_peered":"2024-02-18T16:22:47.267824+0000","last_clean":"2024-02-18T16:22:47.267824+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:22:47.267824+0000","last_undegraded":"2024-02-18T16:22:47.267824+0000","last_fullsized":"2024-02-18T16:22:47.267824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.695632+0000","last_change":"2024-02-18T16:23:06.695632+0000","last_active":"2024-02-18T16:23:06.695632+0000","last_peered":"2024-02-18T16:23:06.695632+0000","last_clean":"2024-02-18T16:23:06.695632+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:23:06.695632+0000","last_undegraded":"2024-02-18T16:23:06.695632+0000","last_fullsized":"2024-02-18T16:23:06.695632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.695361+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:14:59.478331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660371+0000","last_change":"2024-02-18T16:20:59.865570+0000","last_active":"2024-02-18T16:22:48.660371+0000","last_peered":"2024-02-18T16:22:48.660371+0000","last_clean":"2024-02-18T16:22:48.660371+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:22:48.660371+0000","last_undegraded":"2024-02-18T16:22:48.660371+0000","last_fullsized":"2024-02-18T16:22:48.660371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268242+0000","last_change":"2024-02-18T16:21:01.844340+0000","last_active":"2024-02-18T16:22:47.268242+0000","last_peered":"2024-02-18T16:22:47.268242+0000","last_clean":"2024-02-18T16:22:47.268242+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:22:47.268242+0000","last_undegraded":"2024-02-18T16:22:47.268242+0000","last_fullsized":"2024-02-18T16:22:47.268242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267768+0000","last_change":"2024-02-18T16:20:59.857706+0000","last_active":"2024-02-18T16:22:47.267768+0000","last_peered":"2024-02-18T16:22:47.267768+0000","last_clean":"2024-02-18T16:22:47.267768+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:22:47.267768+0000","last_undegraded":"2024-02-18T16:22:47.267768+0000","last_fullsized":"2024-02-18T16:22:47.267768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.185309+0000","last_change":"2024-02-18T16:23:13.185363+0000","last_active":"2024-02-18T16:23:13.185309+0000","last_peered":"2024-02-18T16:23:13.185309+0000","last_clean":"2024-02-18T16:23:13.185309+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:23:13.185309+0000","last_undegraded":"2024-02-18T16:23:13.185309+0000","last_fullsized":"2024-02-18T16:23:13.185309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.185106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:23.477010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267726+0000","last_change":"2024-02-18T16:20:59.859871+0000","last_active":"2024-02-18T16:22:47.267726+0000","last_peered":"2024-02-18T16:22:47.267726+0000","last_clean":"2024-02-18T16:22:47.267726+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:22:47.267726+0000","last_undegraded":"2024-02-18T16:22:47.267726+0000","last_fullsized":"2024-02-18T16:22:47.267726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:36.096435+0000","last_change":"2024-02-18T16:21:40.963827+0000","last_active":"2024-02-18T16:22:36.096435+0000","last_peered":"2024-02-18T16:22:36.096435+0000","last_clean":"2024-02-18T16:22:36.096435+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:22:36.096435+0000","last_undegraded":"2024-02-18T16:22:36.096435+0000","last_fullsized":"2024-02-18T16:22:36.096435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728191+0000","last_change":"2024-02-18T16:20:59.861914+0000","last_active":"2024-02-18T16:22:47.728191+0000","last_peered":"2024-02-18T16:22:47.728191+0000","last_clean":"2024-02-18T16:22:47.728191+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:22:47.728191+0000","last_undegraded":"2024-02-18T16:22:47.728191+0000","last_fullsized":"2024-02-18T16:22:47.728191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268298+0000","last_change":"2024-02-18T16:21:01.843302+0000","last_active":"2024-02-18T16:22:47.268298+0000","last_peered":"2024-02-18T16:22:47.268298+0000","last_clean":"2024-02-18T16:22:47.268298+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:22:47.268298+0000","last_undegraded":"2024-02-18T16:22:47.268298+0000","last_fullsized":"2024-02-18T16:22:47.268298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.194838+0000","last_change":"2024-02-18T16:20:59.835435+0000","last_active":"2024-02-18T16:22:48.194838+0000","last_peered":"2024-02-18T16:22:48.194838+0000","last_clean":"2024-02-18T16:22:48.194838+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:22:48.194838+0000","last_undegraded":"2024-02-18T16:22:48.194838+0000","last_fullsized":"2024-02-18T16:22:48.194838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.756466+0000","last_change":"2024-02-18T16:23:22.756531+0000","last_active":"2024-02-18T16:23:22.756466+0000","last_peered":"2024-02-18T16:23:22.756466+0000","last_clean":"2024-02-18T16:23:22.756466+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:23:22.756466+0000","last_undegraded":"2024-02-18T16:23:22.756466+0000","last_fullsized":"2024-02-18T16:23:22.756466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.756253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.697727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.267777+0000","last_change":"2024-02-18T16:20:59.859552+0000","last_active":"2024-02-18T16:22:47.267777+0000","last_peered":"2024-02-18T16:22:47.267777+0000","last_clean":"2024-02-18T16:22:47.267777+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:22:47.267777+0000","last_undegraded":"2024-02-18T16:22:47.267777+0000","last_fullsized":"2024-02-18T16:22:47.267777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728795+0000","last_change":"2024-02-18T16:21:01.840265+0000","last_active":"2024-02-18T16:22:47.728795+0000","last_peered":"2024-02-18T16:22:47.728795+0000","last_clean":"2024-02-18T16:22:47.728795+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:22:47.728795+0000","last_undegraded":"2024-02-18T16:22:47.728795+0000","last_fullsized":"2024-02-18T16:22:47.728795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660368+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:22:48.660368+0000","last_peered":"2024-02-18T16:22:48.660368+0000","last_clean":"2024-02-18T16:22:48.660368+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:22:48.660368+0000","last_undegraded":"2024-02-18T16:22:48.660368+0000","last_fullsized":"2024-02-18T16:22:48.660368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661054+0000","last_change":"2024-02-18T16:21:01.853933+0000","last_active":"2024-02-18T16:22:48.661054+0000","last_peered":"2024-02-18T16:22:48.661054+0000","last_clean":"2024-02-18T16:22:48.661054+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:22:48.661054+0000","last_undegraded":"2024-02-18T16:22:48.661054+0000","last_fullsized":"2024-02-18T16:22:48.661054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268201+0000","last_change":"2024-02-18T16:20:59.853659+0000","last_active":"2024-02-18T16:22:47.268201+0000","last_peered":"2024-02-18T16:22:47.268201+0000","last_clean":"2024-02-18T16:22:47.268201+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:22:47.268201+0000","last_undegraded":"2024-02-18T16:22:47.268201+0000","last_fullsized":"2024-02-18T16:22:47.268201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.212996+0000","last_change":"2024-02-18T16:23:12.212996+0000","last_active":"2024-02-18T16:23:12.212996+0000","last_peered":"2024-02-18T16:23:12.212996+0000","last_clean":"2024-02-18T16:23:12.212996+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:23:12.212996+0000","last_undegraded":"2024-02-18T16:23:12.212996+0000","last_fullsized":"2024-02-18T16:23:12.212996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.212729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.222143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728297+0000","last_change":"2024-02-18T16:20:59.859832+0000","last_active":"2024-02-18T16:22:47.728297+0000","last_peered":"2024-02-18T16:22:47.728297+0000","last_clean":"2024-02-18T16:22:47.728297+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:22:47.728297+0000","last_undegraded":"2024-02-18T16:22:47.728297+0000","last_fullsized":"2024-02-18T16:22:47.728297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728907+0000","last_change":"2024-02-18T16:21:01.839367+0000","last_active":"2024-02-18T16:22:47.728907+0000","last_peered":"2024-02-18T16:22:47.728907+0000","last_clean":"2024-02-18T16:22:47.728907+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:22:47.728907+0000","last_undegraded":"2024-02-18T16:22:47.728907+0000","last_fullsized":"2024-02-18T16:22:47.728907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728266+0000","last_change":"2024-02-18T16:20:59.859222+0000","last_active":"2024-02-18T16:22:47.728266+0000","last_peered":"2024-02-18T16:22:47.728266+0000","last_clean":"2024-02-18T16:22:47.728266+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:22:47.728266+0000","last_undegraded":"2024-02-18T16:22:47.728266+0000","last_fullsized":"2024-02-18T16:22:47.728266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.693758+0000","last_change":"2024-02-18T16:23:08.693758+0000","last_active":"2024-02-18T16:23:08.693758+0000","last_peered":"2024-02-18T16:23:08.693758+0000","last_clean":"2024-02-18T16:23:08.693758+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:23:08.693758+0000","last_undegraded":"2024-02-18T16:23:08.693758+0000","last_fullsized":"2024-02-18T16:23:08.693758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.693466+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:30:43.884820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660556+0000","last_change":"2024-02-18T16:20:59.863633+0000","last_active":"2024-02-18T16:22:48.660556+0000","last_peered":"2024-02-18T16:22:48.660556+0000","last_clean":"2024-02-18T16:22:48.660556+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:22:48.660556+0000","last_undegraded":"2024-02-18T16:22:48.660556+0000","last_fullsized":"2024-02-18T16:22:48.660556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.728843+0000","last_change":"2024-02-18T16:21:01.843918+0000","last_active":"2024-02-18T16:22:47.728843+0000","last_peered":"2024-02-18T16:22:47.728843+0000","last_clean":"2024-02-18T16:22:47.728843+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:22:47.728843+0000","last_undegraded":"2024-02-18T16:22:47.728843+0000","last_fullsized":"2024-02-18T16:22:47.728843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660469+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:22:48.660469+0000","last_peered":"2024-02-18T16:22:48.660469+0000","last_clean":"2024-02-18T16:22:48.660469+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:22:48.660469+0000","last_undegraded":"2024-02-18T16:22:48.660469+0000","last_fullsized":"2024-02-18T16:22:48.660469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661209+0000","last_change":"2024-02-18T16:21:01.855777+0000","last_active":"2024-02-18T16:22:48.661209+0000","last_peered":"2024-02-18T16:22:48.661209+0000","last_clean":"2024-02-18T16:22:48.661209+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:22:48.661209+0000","last_undegraded":"2024-02-18T16:22:48.661209+0000","last_fullsized":"2024-02-18T16:22:48.661209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.875104+0000","last_change":"2024-02-18T16:23:20.875163+0000","last_active":"2024-02-18T16:23:20.875104+0000","last_peered":"2024-02-18T16:23:20.875104+0000","last_clean":"2024-02-18T16:23:20.875104+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:23:20.875104+0000","last_undegraded":"2024-02-18T16:23:20.875104+0000","last_fullsized":"2024-02-18T16:23:20.875104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.874900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:20.030506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.750625+0000","last_change":"2024-02-18T16:23:18.750690+0000","last_active":"2024-02-18T16:23:18.750625+0000","last_peered":"2024-02-18T16:23:18.750625+0000","last_clean":"2024-02-18T16:23:18.750625+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:23:18.750625+0000","last_undegraded":"2024-02-18T16:23:18.750625+0000","last_fullsized":"2024-02-18T16:23:18.750625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.750433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:02.263592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660554+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:22:48.660554+0000","last_peered":"2024-02-18T16:22:48.660554+0000","last_clean":"2024-02-18T16:22:48.660554+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:22:48.660554+0000","last_undegraded":"2024-02-18T16:22:48.660554+0000","last_fullsized":"2024-02-18T16:22:48.660554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660560+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:22:48.660560+0000","last_peered":"2024-02-18T16:22:48.660560+0000","last_clean":"2024-02-18T16:22:48.660560+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:22:48.660560+0000","last_undegraded":"2024-02-18T16:22:48.660560+0000","last_fullsized":"2024-02-18T16:22:48.660560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.165270+0000","last_change":"2024-02-18T16:23:14.165328+0000","last_active":"2024-02-18T16:23:14.165270+0000","last_peered":"2024-02-18T16:23:14.165270+0000","last_clean":"2024-02-18T16:23:14.165270+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:23:14.165270+0000","last_undegraded":"2024-02-18T16:23:14.165270+0000","last_fullsized":"2024-02-18T16:23:14.165270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.165073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:13.320679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.268037+0000","last_change":"2024-02-18T16:20:59.856141+0000","last_active":"2024-02-18T16:22:47.268037+0000","last_peered":"2024-02-18T16:22:47.268037+0000","last_clean":"2024-02-18T16:22:47.268037+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:22:47.268037+0000","last_undegraded":"2024-02-18T16:22:47.268037+0000","last_fullsized":"2024-02-18T16:22:47.268037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:21:40.944861+0000","last_change":"2024-02-18T16:21:01.839351+0000","last_active":"2024-02-18T16:21:40.944861+0000","last_peered":"2024-02-18T16:21:40.944861+0000","last_clean":"2024-02-18T16:21:40.944861+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:21:40.944861+0000","last_undegraded":"2024-02-18T16:21:40.944861+0000","last_fullsized":"2024-02-18T16:21:40.944861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:00.802167+0000","last_clean_scrub_stamp":"2024-02-18T16:21:00.802167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1422,"ondisk_log_size":1422,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705700,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.88,"15min":0.88},"last":0.752},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.55900000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76400000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.78000000000000003}]},{"osd":1,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.77100000000000002,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.48499999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.77900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.52200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80600000000000005,"5min":1.2,"15min":1.2},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.50800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69099999999999995,"5min":1.319,"15min":1.319},"last":0.55100000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705700,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76700000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.1599999999999999,"15min":1.26},"min":{"1min":0.38800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.68400000000000005,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.96299999999999997,"15min":1.0289999999999999},"min":{"1min":0.29999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.71999999999999997,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.374,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":1.5589999999999999,"15min":1.7010000000000001},"min":{"1min":0.46700000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81599999999999995,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.59799999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705699,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.52500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.625,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68899999999999995}]},{"osd":2,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.46999999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78300000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55300000000000005}]},{"osd":3,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.47699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.55500000000000005,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.60799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.748}]},{"osd":2,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93200000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:23:29.871 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.871 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.871 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.872 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.872 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.872 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.872 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.872 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.873 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.873 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.873 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.873 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.873 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.873 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.874 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.874 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.874 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.874 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.874 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.875 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.876 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.876 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.876 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.876 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.877 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.877 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.877 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.877 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.877 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.877 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.878 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.878 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.878 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.878 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.878 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.879 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.879 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.879 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.879 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-18T16:20:44.740634+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=44, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.879 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.879 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.880 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.880 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.880 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.880 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.880 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.881 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.881 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.881 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.881 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.881 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-18T16:21:06.845711+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=6, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.882 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.882 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.882 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.882 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.882 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.882 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.883 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.883 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.883 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.883 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.883 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.884 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.884 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.884 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.884 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.884 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.885 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.885 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.885 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.885 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.885 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.885 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.886 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.886 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.886 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.886 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.886 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.887 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.887 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.887 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.888 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.888 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.888 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.888 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.888 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.889 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.889 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.889 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.889 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.889 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.889 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.890 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.890 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.890 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.890 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.890 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.890 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.891 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.891 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.891 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.891 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.891 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.891 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.892 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.892 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.892 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.892 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.892 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.892 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.893 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.893 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.893 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.893 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.893 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-18T16:21:00.802167+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=0, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:29.893 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-18T16:23:49.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:23:50.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.010+0000 7f41d69b8640 1 Processor -- start 2024-02-18T16:23:50.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.010+0000 7f41d69b8640 1 -- start start 2024-02-18T16:23:50.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41d69b8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41d009ddc0 0x7f41d0130e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:50.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41d69b8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d009ac90 con 0x7f41d012aeb0 2024-02-18T16:23:50.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41d69b8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d012b9a0 con 0x7f41d009ddc0 2024-02-18T16:23:50.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41cffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f41d012aeb0 0x7f41d012b290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34814/0 (socket says 172.21.15.80:34814) 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41cffff640 1 -- 172.21.15.80:0/1315745135 learned_addr learned my addr 172.21.15.80:0/1315745135 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41cf7fe640 1 --2- 172.21.15.80:0/1315745135 >> v2:172.21.15.80:3300/0 conn(0x7f41d009ddc0 0x7f41d0130e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697262238 0 0) 0x7f41d009ac90 con 0x7f41d012aeb0 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b8003530 con 0x7f41d012aeb0 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220360336 0 0) 0x7f41b8003530 con 0x7f41d012aeb0 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 >> v2:172.21.15.80:3300/0 conn(0x7f41d009ddc0 msgr2=0x7f41d0130e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 --2- 172.21.15.80:0/1315745135 >> v2:172.21.15.80:3300/0 conn(0x7f41d009ddc0 0x7f41d0130e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:50.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d009af50 con 0x7f41d012aeb0 2024-02-18T16:23:50.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4147525989 0 0) 0x7f41c80015b0 con 0x7f41d012aeb0 2024-02-18T16:23:50.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 >> v1:172.21.15.80:6789/0 conn(0x7f41d012aeb0 legacy=0x7f41d012b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:50.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 --2- 172.21.15.80:0/1315745135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:50.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d012b9a0 con 0x7f41b80039d0 2024-02-18T16:23:50.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41cffff640 1 --2- 172.21.15.80:0/1315745135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:50.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41cffff640 1 -- 172.21.15.80:0/1315745135 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8003530 con 0x7f41b80039d0 2024-02-18T16:23:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41cffff640 1 --2- 172.21.15.80:0/1315745135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41b8003dd0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f41c8007f10 tx=0x7f41c801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80227fc0b18f0e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41d009a520 con 0x7f41b80039d0 2024-02-18T16:23:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c8005af0 con 0x7f41b80039d0 2024-02-18T16:23:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.014+0000 7f41ceffd640 1 -- 172.21.15.80:0/1315745135 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41c8005dd0 con 0x7f41b80039d0 2024-02-18T16:23:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/1315745135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 msgr2=0x7f41b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:50.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 --2- 172.21.15.80:0/1315745135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41b8003dd0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f41c8007f10 tx=0x7f41c801cbc0 comp rx=0 tx=0).stop 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/1315745135 shutdown_connections 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 --2- 172.21.15.80:0/1315745135 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41b8003dd0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 --2- 172.21.15.80:0/1315745135 >> v2:172.21.15.80:3300/0 conn(0x7f41d009ddc0 0x7f41d0130e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/1315745135 >> 172.21.15.80:0/1315745135 conn(0x7f41d009d070 msgr2=0x7f41d009d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/1315745135 shutdown_connections 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/1315745135 wait complete. 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 Processor -- start 2024-02-18T16:23:50.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- start start 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41d01c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d006e7c0 con 0x7f41b80039d0 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41d01c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41cffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41d01c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43728/0 (socket says 172.21.15.80:43728) 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41cffff640 1 -- 172.21.15.80:0/645473950 learned_addr learned my addr 172.21.15.80:0/645473950 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41cffff640 1 -- 172.21.15.80:0/645473950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d006d310 con 0x7f41b80039d0 2024-02-18T16:23:50.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41cffff640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41d01c5480 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f41c8000c10 tx=0x7f41b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41c80013c0 con 0x7f41b80039d0 2024-02-18T16:23:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c8001520 con 0x7f41b80039d0 2024-02-18T16:23:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d006e440 con 0x7f41b80039d0 2024-02-18T16:23:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41c8005c60 con 0x7f41b80039d0 2024-02-18T16:23:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d01c59c0 con 0x7f41b80039d0 2024-02-18T16:23:50.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.018+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d0130800 con 0x7f41b80039d0 2024-02-18T16:23:50.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.022+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f41c80ab070 con 0x7f41b80039d0 2024-02-18T16:23:50.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.022+0000 7f41ccff9640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41bc035a10 0x7f41bc037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:23:50.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.022+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f41c80e2490 con 0x7f41b80039d0 2024-02-18T16:23:50.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.022+0000 7f41cf7fe640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41bc035a10 0x7f41bc037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:23:50.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.022+0000 7f41cf7fe640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41bc035a10 0x7f41bc037ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009890 tx=0x7f41c4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:23:50.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.026+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f41c80b7790 con 0x7f41b80039d0 2024-02-18T16:23:50.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.178+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41d006ee70 con 0x7f41bc035a10 2024-02-18T16:23:50.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.226+0000 7f41ccff9640 1 -- 172.21.15.80:0/645473950 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673268 (secure 0 0 0) 0x7f41d006ee70 con 0x7f41bc035a10 2024-02-18T16:23:50.242 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:23:50.248 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:23:50.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41bc035a10 msgr2=0x7f41bc037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:50.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41bc035a10 0x7f41bc037ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009890 tx=0x7f41c4009190 comp rx=0 tx=0).stop 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 msgr2=0x7f41d01c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41d01c5480 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f41c8000c10 tx=0x7f41b8005800 comp rx=0 tx=0).stop 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 shutdown_connections 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f41bc035a10 0x7f41bc037ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 --2- 172.21.15.80:0/645473950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41b80039d0 0x7f41d01c5480 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 >> 172.21.15.80:0/645473950 conn(0x7f41d009d070 msgr2=0x7f41d0127fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 shutdown_connections 2024-02-18T16:23:50.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:23:50.230+0000 7f41d69b8640 1 -- 172.21.15.80:0/645473950 wait complete. 2024-02-18T16:23:50.261 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-02-18T16:23:49.839904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3970,"ondisk_log_size":3970,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148312,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339048,"statfs":{"total":386547056640,"available":386395185152,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":378,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006097"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.916811+0000","last_change":"2024-02-18T16:23:22.916928+0000","last_active":"2024-02-18T16:23:22.916811+0000","last_peered":"2024-02-18T16:23:22.916811+0000","last_clean":"2024-02-18T16:23:22.916811+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:23:22.916811+0000","last_undegraded":"2024-02-18T16:23:22.916811+0000","last_fullsized":"2024-02-18T16:23:22.916811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.916517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:21.117744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.750600+0000","last_change":"2024-02-18T16:23:16.750600+0000","last_active":"2024-02-18T16:23:16.750600+0000","last_peered":"2024-02-18T16:23:16.750600+0000","last_clean":"2024-02-18T16:23:16.750600+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:23:16.750600+0000","last_undegraded":"2024-02-18T16:23:16.750600+0000","last_fullsized":"2024-02-18T16:23:16.750600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.750307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.951534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.161692+0000","last_change":"2024-02-18T16:23:20.161755+0000","last_active":"2024-02-18T16:23:20.161692+0000","last_peered":"2024-02-18T16:23:20.161692+0000","last_clean":"2024-02-18T16:23:20.161692+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:23:20.161692+0000","last_undegraded":"2024-02-18T16:23:20.161692+0000","last_fullsized":"2024-02-18T16:23:20.161692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.161465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:08.032544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.737788+0000","last_change":"2024-02-18T16:23:23.737788+0000","last_active":"2024-02-18T16:23:23.737788+0000","last_peered":"2024-02-18T16:23:23.737788+0000","last_clean":"2024-02-18T16:23:23.737788+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:23:23.737788+0000","last_undegraded":"2024-02-18T16:23:23.737788+0000","last_fullsized":"2024-02-18T16:23:23.737788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.737502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:54.805702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.730979+0000","last_change":"2024-02-18T16:23:41.731135+0000","last_active":"2024-02-18T16:23:41.730979+0000","last_peered":"2024-02-18T16:23:41.730979+0000","last_clean":"2024-02-18T16:23:41.730979+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:23:41.730979+0000","last_undegraded":"2024-02-18T16:23:41.730979+0000","last_fullsized":"2024-02-18T16:23:41.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:41.730728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:41.730728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.730728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:09:17.826198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.635085+0000","last_change":"2024-02-18T16:23:09.635085+0000","last_active":"2024-02-18T16:23:09.635085+0000","last_peered":"2024-02-18T16:23:09.635085+0000","last_clean":"2024-02-18T16:23:09.635085+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:23:09.635085+0000","last_undegraded":"2024-02-18T16:23:09.635085+0000","last_fullsized":"2024-02-18T16:23:09.635085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.634784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:09.758604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.731501+0000","last_change":"2024-02-18T16:23:33.731558+0000","last_active":"2024-02-18T16:23:33.731501+0000","last_peered":"2024-02-18T16:23:33.731501+0000","last_clean":"2024-02-18T16:23:33.731501+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:23:33.731501+0000","last_undegraded":"2024-02-18T16:23:33.731501+0000","last_fullsized":"2024-02-18T16:23:33.731501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.731298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.731298+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.731298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:26.514268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.751173+0000","last_change":"2024-02-18T16:23:03.751173+0000","last_active":"2024-02-18T16:23:03.751173+0000","last_peered":"2024-02-18T16:23:03.751173+0000","last_clean":"2024-02-18T16:23:03.751173+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:23:03.751173+0000","last_undegraded":"2024-02-18T16:23:03.751173+0000","last_fullsized":"2024-02-18T16:23:03.751173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.750777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:02.603622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.754228+0000","last_change":"2024-02-18T16:23:46.754303+0000","last_active":"2024-02-18T16:23:46.754228+0000","last_peered":"2024-02-18T16:23:46.754228+0000","last_clean":"2024-02-18T16:23:46.754228+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:23:46.754228+0000","last_undegraded":"2024-02-18T16:23:46.754228+0000","last_fullsized":"2024-02-18T16:23:46.754228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:46.753986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:46.753986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.753986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:21:21.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.783795+0000","last_change":"2024-02-18T16:23:17.783856+0000","last_active":"2024-02-18T16:23:17.783795+0000","last_peered":"2024-02-18T16:23:17.783795+0000","last_clean":"2024-02-18T16:23:17.783795+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:23:17.783795+0000","last_undegraded":"2024-02-18T16:23:17.783795+0000","last_fullsized":"2024-02-18T16:23:17.783795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.783609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.839510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.821387+0000","last_change":"2024-02-18T16:23:30.821444+0000","last_active":"2024-02-18T16:23:30.821387+0000","last_peered":"2024-02-18T16:23:30.821387+0000","last_clean":"2024-02-18T16:23:30.821387+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:23:30.821387+0000","last_undegraded":"2024-02-18T16:23:30.821387+0000","last_fullsized":"2024-02-18T16:23:30.821387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.821199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.821199+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.821199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:29.674043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.784360+0000","last_change":"2024-02-18T16:23:22.784418+0000","last_active":"2024-02-18T16:23:22.784360+0000","last_peered":"2024-02-18T16:23:22.784360+0000","last_clean":"2024-02-18T16:23:22.784360+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:23:22.784360+0000","last_undegraded":"2024-02-18T16:23:22.784360+0000","last_fullsized":"2024-02-18T16:23:22.784360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.784173+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:14.537344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660794+0000","last_change":"2024-02-18T16:20:59.847775+0000","last_active":"2024-02-18T16:22:48.660794+0000","last_peered":"2024-02-18T16:22:48.660794+0000","last_clean":"2024-02-18T16:22:48.660794+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:22:48.660794+0000","last_undegraded":"2024-02-18T16:22:48.660794+0000","last_fullsized":"2024-02-18T16:22:48.660794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.991352+0000","last_change":"2024-02-18T16:23:13.991423+0000","last_active":"2024-02-18T16:23:13.991352+0000","last_peered":"2024-02-18T16:23:13.991352+0000","last_clean":"2024-02-18T16:23:13.991352+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:23:13.991352+0000","last_undegraded":"2024-02-18T16:23:13.991352+0000","last_fullsized":"2024-02-18T16:23:13.991352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.991156+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:26.734895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.213484+0000","last_change":"2024-02-18T16:23:38.213630+0000","last_active":"2024-02-18T16:23:38.213484+0000","last_peered":"2024-02-18T16:23:38.213484+0000","last_clean":"2024-02-18T16:23:38.213484+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:23:38.213484+0000","last_undegraded":"2024-02-18T16:23:38.213484+0000","last_fullsized":"2024-02-18T16:23:38.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:38.213236+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:38.213236+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.213236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:34:57.885442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.883579+0000","last_change":"2024-02-18T16:23:21.883639+0000","last_active":"2024-02-18T16:23:21.883579+0000","last_peered":"2024-02-18T16:23:21.883579+0000","last_clean":"2024-02-18T16:23:21.883579+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:23:21.883579+0000","last_undegraded":"2024-02-18T16:23:21.883579+0000","last_fullsized":"2024-02-18T16:23:21.883579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.883366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:05.625702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.746411+0000","last_change":"2024-02-18T16:23:37.746574+0000","last_active":"2024-02-18T16:23:37.746411+0000","last_peered":"2024-02-18T16:23:37.746411+0000","last_clean":"2024-02-18T16:23:37.746411+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:23:37.746411+0000","last_undegraded":"2024-02-18T16:23:37.746411+0000","last_fullsized":"2024-02-18T16:23:37.746411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:37.746133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:37.746133+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.746133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:33:52.796407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.808047+0000","last_change":"2024-02-18T16:23:27.808113+0000","last_active":"2024-02-18T16:23:27.808047+0000","last_peered":"2024-02-18T16:23:27.808047+0000","last_clean":"2024-02-18T16:23:27.808047+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:23:27.808047+0000","last_undegraded":"2024-02-18T16:23:27.808047+0000","last_fullsized":"2024-02-18T16:23:27.808047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:27.807847+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:27.807847+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.807847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:20.590817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.727308+0000","last_change":"2024-02-18T16:23:19.727308+0000","last_active":"2024-02-18T16:23:19.727308+0000","last_peered":"2024-02-18T16:23:19.727308+0000","last_clean":"2024-02-18T16:23:19.727308+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:23:19.727308+0000","last_undegraded":"2024-02-18T16:23:19.727308+0000","last_fullsized":"2024-02-18T16:23:19.727308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.727029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:34:32.149408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.946153+0000","last_change":"2024-02-18T16:23:16.946153+0000","last_active":"2024-02-18T16:23:16.946153+0000","last_peered":"2024-02-18T16:23:16.946153+0000","last_clean":"2024-02-18T16:23:16.946153+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:23:16.946153+0000","last_undegraded":"2024-02-18T16:23:16.946153+0000","last_fullsized":"2024-02-18T16:23:16.946153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.945824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:28.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.715031+0000","last_change":"2024-02-18T16:23:09.715031+0000","last_active":"2024-02-18T16:23:09.715031+0000","last_peered":"2024-02-18T16:23:09.715031+0000","last_clean":"2024-02-18T16:23:09.715031+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:23:09.715031+0000","last_undegraded":"2024-02-18T16:23:09.715031+0000","last_fullsized":"2024-02-18T16:23:09.715031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.714755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.994872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.725548+0000","last_change":"2024-02-18T16:23:23.725548+0000","last_active":"2024-02-18T16:23:23.725548+0000","last_peered":"2024-02-18T16:23:23.725548+0000","last_clean":"2024-02-18T16:23:23.725548+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:23:23.725548+0000","last_undegraded":"2024-02-18T16:23:23.725548+0000","last_fullsized":"2024-02-18T16:23:23.725548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.725287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:05:10.067817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.180481+0000","last_change":"2024-02-18T16:23:31.180547+0000","last_active":"2024-02-18T16:23:31.180481+0000","last_peered":"2024-02-18T16:23:31.180481+0000","last_clean":"2024-02-18T16:23:31.180481+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:23:31.180481+0000","last_undegraded":"2024-02-18T16:23:31.180481+0000","last_fullsized":"2024-02-18T16:23:31.180481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:31.180290+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:31.180290+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.180290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:45:14.817248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.818695+0000","last_change":"2024-02-18T16:23:29.818755+0000","last_active":"2024-02-18T16:23:29.818695+0000","last_peered":"2024-02-18T16:23:29.818695+0000","last_clean":"2024-02-18T16:23:29.818695+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:23:29.818695+0000","last_undegraded":"2024-02-18T16:23:29.818695+0000","last_fullsized":"2024-02-18T16:23:29.818695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:29.818491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:29.818491+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.818491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:16:34.224985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.884583+0000","last_change":"2024-02-18T16:23:23.884704+0000","last_active":"2024-02-18T16:23:23.884583+0000","last_peered":"2024-02-18T16:23:23.884583+0000","last_clean":"2024-02-18T16:23:23.884583+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:23:23.884583+0000","last_undegraded":"2024-02-18T16:23:23.884583+0000","last_fullsized":"2024-02-18T16:23:23.884583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.884277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.884277+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.884277+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:07.940178+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.136656+0000","last_change":"2024-02-18T16:23:24.136726+0000","last_active":"2024-02-18T16:23:24.136656+0000","last_peered":"2024-02-18T16:23:24.136656+0000","last_clean":"2024-02-18T16:23:24.136656+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:23:24.136656+0000","last_undegraded":"2024-02-18T16:23:24.136656+0000","last_fullsized":"2024-02-18T16:23:24.136656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:24.136457+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:24.136457+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.136457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:22.989302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.728657+0000","last_change":"2024-02-18T16:23:20.728657+0000","last_active":"2024-02-18T16:23:20.728657+0000","last_peered":"2024-02-18T16:23:20.728657+0000","last_clean":"2024-02-18T16:23:20.728657+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:23:20.728657+0000","last_undegraded":"2024-02-18T16:23:20.728657+0000","last_fullsized":"2024-02-18T16:23:20.728657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.728399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:20.792298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660650+0000","last_change":"2024-02-18T16:20:59.859965+0000","last_active":"2024-02-18T16:22:48.660650+0000","last_peered":"2024-02-18T16:22:48.660650+0000","last_clean":"2024-02-18T16:22:48.660650+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:22:48.660650+0000","last_undegraded":"2024-02-18T16:22:48.660650+0000","last_fullsized":"2024-02-18T16:22:48.660650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.923769+0000","last_change":"2024-02-18T16:23:41.923837+0000","last_active":"2024-02-18T16:23:41.923769+0000","last_peered":"2024-02-18T16:23:41.923769+0000","last_clean":"2024-02-18T16:23:41.923769+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:23:41.923769+0000","last_undegraded":"2024-02-18T16:23:41.923769+0000","last_fullsized":"2024-02-18T16:23:41.923769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:41.923509+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:41.923509+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.923509+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:32:12.867890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.708169+0000","last_change":"2024-02-18T16:23:29.708258+0000","last_active":"2024-02-18T16:23:29.708169+0000","last_peered":"2024-02-18T16:23:29.708169+0000","last_clean":"2024-02-18T16:23:29.708169+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:23:29.708169+0000","last_undegraded":"2024-02-18T16:23:29.708169+0000","last_fullsized":"2024-02-18T16:23:29.708169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:29.707944+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:29.707944+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.707944+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:23.851740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:48.797737+0000","last_change":"2024-02-18T16:23:48.797805+0000","last_active":"2024-02-18T16:23:48.797737+0000","last_peered":"2024-02-18T16:23:48.797737+0000","last_clean":"2024-02-18T16:23:48.797737+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:23:48.797737+0000","last_undegraded":"2024-02-18T16:23:48.797737+0000","last_fullsized":"2024-02-18T16:23:48.797737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:48.797530+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:48.797530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:48.797530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:28:04.985948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.907189+0000","last_change":"2024-02-18T16:22:49.907189+0000","last_active":"2024-02-18T16:22:49.907189+0000","last_peered":"2024-02-18T16:22:49.907189+0000","last_clean":"2024-02-18T16:22:49.907189+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:22:49.907189+0000","last_undegraded":"2024-02-18T16:22:49.907189+0000","last_fullsized":"2024-02-18T16:22:49.907189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.906822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:01.255503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.689035+0000","last_change":"2024-02-18T16:23:15.689035+0000","last_active":"2024-02-18T16:23:15.689035+0000","last_peered":"2024-02-18T16:23:15.689035+0000","last_clean":"2024-02-18T16:23:15.689035+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:23:15.689035+0000","last_undegraded":"2024-02-18T16:23:15.689035+0000","last_fullsized":"2024-02-18T16:23:15.689035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.688708+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:06.486435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.716776+0000","last_change":"2024-02-18T16:23:10.716776+0000","last_active":"2024-02-18T16:23:10.716776+0000","last_peered":"2024-02-18T16:23:10.716776+0000","last_clean":"2024-02-18T16:23:10.716776+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:23:10.716776+0000","last_undegraded":"2024-02-18T16:23:10.716776+0000","last_fullsized":"2024-02-18T16:23:10.716776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.716530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:22.065211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.931479+0000","last_change":"2024-02-18T16:23:42.931545+0000","last_active":"2024-02-18T16:23:42.931479+0000","last_peered":"2024-02-18T16:23:42.931479+0000","last_clean":"2024-02-18T16:23:42.931479+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:23:42.931479+0000","last_undegraded":"2024-02-18T16:23:42.931479+0000","last_fullsized":"2024-02-18T16:23:42.931479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:42.931280+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:42.931280+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.931280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:13.999480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.649753+0000","last_change":"2024-02-18T16:23:07.649753+0000","last_active":"2024-02-18T16:23:07.649753+0000","last_peered":"2024-02-18T16:23:07.649753+0000","last_clean":"2024-02-18T16:23:07.649753+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:23:07.649753+0000","last_undegraded":"2024-02-18T16:23:07.649753+0000","last_fullsized":"2024-02-18T16:23:07.649753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.649419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:13.854686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.779853+0000","last_change":"2024-02-18T16:23:31.780013+0000","last_active":"2024-02-18T16:23:31.779853+0000","last_peered":"2024-02-18T16:23:31.779853+0000","last_clean":"2024-02-18T16:23:31.779853+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:23:31.779853+0000","last_undegraded":"2024-02-18T16:23:31.779853+0000","last_fullsized":"2024-02-18T16:23:31.779853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:31.779619+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:31.779619+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.779619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:39.346374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.257769+0000","last_change":"2024-02-18T16:23:10.257769+0000","last_active":"2024-02-18T16:23:10.257769+0000","last_peered":"2024-02-18T16:23:10.257769+0000","last_clean":"2024-02-18T16:23:10.257769+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:23:10.257769+0000","last_undegraded":"2024-02-18T16:23:10.257769+0000","last_fullsized":"2024-02-18T16:23:10.257769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.257505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:21.606186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.663488+0000","last_change":"2024-02-18T16:22:55.663488+0000","last_active":"2024-02-18T16:22:55.663488+0000","last_peered":"2024-02-18T16:22:55.663488+0000","last_clean":"2024-02-18T16:22:55.663488+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:22:55.663488+0000","last_undegraded":"2024-02-18T16:22:55.663488+0000","last_fullsized":"2024-02-18T16:22:55.663488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.663204+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:33.049677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.622314+0000","last_change":"2024-02-18T16:23:02.622314+0000","last_active":"2024-02-18T16:23:02.622314+0000","last_peered":"2024-02-18T16:23:02.622314+0000","last_clean":"2024-02-18T16:23:02.622314+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:23:02.622314+0000","last_undegraded":"2024-02-18T16:23:02.622314+0000","last_fullsized":"2024-02-18T16:23:02.622314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.622050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.772173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.264439+0000","last_change":"2024-02-18T16:23:45.264499+0000","last_active":"2024-02-18T16:23:45.264439+0000","last_peered":"2024-02-18T16:23:45.264439+0000","last_clean":"2024-02-18T16:23:45.264439+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:23:45.264439+0000","last_undegraded":"2024-02-18T16:23:45.264439+0000","last_fullsized":"2024-02-18T16:23:45.264439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:45.264234+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:45.264234+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.264234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:58:55.811553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.724757+0000","last_change":"2024-02-18T16:23:43.724846+0000","last_active":"2024-02-18T16:23:43.724757+0000","last_peered":"2024-02-18T16:23:43.724757+0000","last_clean":"2024-02-18T16:23:43.724757+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:23:43.724757+0000","last_undegraded":"2024-02-18T16:23:43.724757+0000","last_fullsized":"2024-02-18T16:23:43.724757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-18T16:23:43.724551+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-18T16:23:43.724551+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.724551+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:51.394951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659946+0000","last_change":"2024-02-18T16:20:59.849924+0000","last_active":"2024-02-18T16:22:48.659946+0000","last_peered":"2024-02-18T16:22:48.659946+0000","last_clean":"2024-02-18T16:22:48.659946+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:22:48.659946+0000","last_undegraded":"2024-02-18T16:22:48.659946+0000","last_fullsized":"2024-02-18T16:22:48.659946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.707046+0000","last_change":"2024-02-18T16:23:41.707099+0000","last_active":"2024-02-18T16:23:41.707046+0000","last_peered":"2024-02-18T16:23:41.707046+0000","last_clean":"2024-02-18T16:23:41.707046+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:23:41.707046+0000","last_undegraded":"2024-02-18T16:23:41.707046+0000","last_fullsized":"2024-02-18T16:23:41.707046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:41.706854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:41.706854+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.706854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:32.504580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.873532+0000","last_change":"2024-02-18T16:22:56.873532+0000","last_active":"2024-02-18T16:22:56.873532+0000","last_peered":"2024-02-18T16:22:56.873532+0000","last_clean":"2024-02-18T16:22:56.873532+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:22:56.873532+0000","last_undegraded":"2024-02-18T16:22:56.873532+0000","last_fullsized":"2024-02-18T16:22:56.873532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.873112+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:36.931560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.812587+0000","last_change":"2024-02-18T16:23:20.812587+0000","last_active":"2024-02-18T16:23:20.812587+0000","last_peered":"2024-02-18T16:23:20.812587+0000","last_clean":"2024-02-18T16:23:20.812587+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:23:20.812587+0000","last_undegraded":"2024-02-18T16:23:20.812587+0000","last_fullsized":"2024-02-18T16:23:20.812587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.812325+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:19:44.799795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.687518+0000","last_change":"2024-02-18T16:23:38.687518+0000","last_active":"2024-02-18T16:23:38.687518+0000","last_peered":"2024-02-18T16:23:38.687518+0000","last_clean":"2024-02-18T16:23:38.687518+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:23:38.687518+0000","last_undegraded":"2024-02-18T16:23:38.687518+0000","last_fullsized":"2024-02-18T16:23:38.687518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:38.687161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:38.687161+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.687161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:53.241419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.125274+0000","last_change":"2024-02-18T16:23:25.125274+0000","last_active":"2024-02-18T16:23:25.125274+0000","last_peered":"2024-02-18T16:23:25.125274+0000","last_clean":"2024-02-18T16:23:25.125274+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:23:25.125274+0000","last_undegraded":"2024-02-18T16:23:25.125274+0000","last_fullsized":"2024-02-18T16:23:25.125274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:25.125006+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:25.125006+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.125006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:32.691761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.777566+0000","last_change":"2024-02-18T16:23:31.777666+0000","last_active":"2024-02-18T16:23:31.777566+0000","last_peered":"2024-02-18T16:23:31.777566+0000","last_clean":"2024-02-18T16:23:31.777566+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:23:31.777566+0000","last_undegraded":"2024-02-18T16:23:31.777566+0000","last_fullsized":"2024-02-18T16:23:31.777566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:31.777340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:31.777340+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.777340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:24.754848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661923+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:22:48.661923+0000","last_peered":"2024-02-18T16:22:48.661923+0000","last_clean":"2024-02-18T16:22:48.661923+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:22:48.661923+0000","last_undegraded":"2024-02-18T16:22:48.661923+0000","last_fullsized":"2024-02-18T16:22:48.661923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.859501+0000","last_change":"2024-02-18T16:22:58.859501+0000","last_active":"2024-02-18T16:22:58.859501+0000","last_peered":"2024-02-18T16:22:58.859501+0000","last_clean":"2024-02-18T16:22:58.859501+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:58.859501+0000","last_undegraded":"2024-02-18T16:22:58.859501+0000","last_fullsized":"2024-02-18T16:22:58.859501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.859048+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:31.803635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":332,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.257854+0000","last_change":"2024-02-18T16:23:07.257854+0000","last_active":"2024-02-18T16:23:07.257854+0000","last_peered":"2024-02-18T16:23:07.257854+0000","last_clean":"2024-02-18T16:23:07.257854+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:23:07.257854+0000","last_undegraded":"2024-02-18T16:23:07.257854+0000","last_fullsized":"2024-02-18T16:23:07.257854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.257430+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.001169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.733976+0000","last_change":"2024-02-18T16:23:34.734036+0000","last_active":"2024-02-18T16:23:34.733976+0000","last_peered":"2024-02-18T16:23:34.733976+0000","last_clean":"2024-02-18T16:23:34.733976+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:23:34.733976+0000","last_undegraded":"2024-02-18T16:23:34.733976+0000","last_fullsized":"2024-02-18T16:23:34.733976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.733782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.733782+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.733782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:31:17.679963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.677698+0000","last_change":"2024-02-18T16:23:36.677830+0000","last_active":"2024-02-18T16:23:36.677698+0000","last_peered":"2024-02-18T16:23:36.677698+0000","last_clean":"2024-02-18T16:23:36.677698+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:23:36.677698+0000","last_undegraded":"2024-02-18T16:23:36.677698+0000","last_fullsized":"2024-02-18T16:23:36.677698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.677442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.677442+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.677442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:36.801262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.628366+0000","last_change":"2024-02-18T16:23:01.628366+0000","last_active":"2024-02-18T16:23:01.628366+0000","last_peered":"2024-02-18T16:23:01.628366+0000","last_clean":"2024-02-18T16:23:01.628366+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:23:01.628366+0000","last_undegraded":"2024-02-18T16:23:01.628366+0000","last_fullsized":"2024-02-18T16:23:01.628366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.628086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:49:06.387306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.868488+0000","last_change":"2024-02-18T16:23:00.868488+0000","last_active":"2024-02-18T16:23:00.868488+0000","last_peered":"2024-02-18T16:23:00.868488+0000","last_clean":"2024-02-18T16:23:00.868488+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:23:00.868488+0000","last_undegraded":"2024-02-18T16:23:00.868488+0000","last_fullsized":"2024-02-18T16:23:00.868488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.868066+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:38.254540+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.249222+0000","last_change":"2024-02-18T16:23:11.249222+0000","last_active":"2024-02-18T16:23:11.249222+0000","last_peered":"2024-02-18T16:23:11.249222+0000","last_clean":"2024-02-18T16:23:11.249222+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:23:11.249222+0000","last_undegraded":"2024-02-18T16:23:11.249222+0000","last_fullsized":"2024-02-18T16:23:11.249222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.248957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.900091+0000","last_change":"2024-02-18T16:23:11.900091+0000","last_active":"2024-02-18T16:23:11.900091+0000","last_peered":"2024-02-18T16:23:11.900091+0000","last_clean":"2024-02-18T16:23:11.900091+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:23:11.900091+0000","last_undegraded":"2024-02-18T16:23:11.900091+0000","last_fullsized":"2024-02-18T16:23:11.900091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.899800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:40.591864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.803942+0000","last_change":"2024-02-18T16:23:30.804000+0000","last_active":"2024-02-18T16:23:30.803942+0000","last_peered":"2024-02-18T16:23:30.803942+0000","last_clean":"2024-02-18T16:23:30.803942+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:23:30.803942+0000","last_undegraded":"2024-02-18T16:23:30.803942+0000","last_fullsized":"2024-02-18T16:23:30.803942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.803736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.803736+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.803736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:32:08.517864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.779880+0000","last_change":"2024-02-18T16:23:32.779936+0000","last_active":"2024-02-18T16:23:32.779880+0000","last_peered":"2024-02-18T16:23:32.779880+0000","last_clean":"2024-02-18T16:23:32.779880+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:23:32.779880+0000","last_undegraded":"2024-02-18T16:23:32.779880+0000","last_fullsized":"2024-02-18T16:23:32.779880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.779679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.779679+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.779679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:52:14.743598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.348633+0000","last_change":"2024-02-18T16:23:04.348633+0000","last_active":"2024-02-18T16:23:04.348633+0000","last_peered":"2024-02-18T16:23:04.348633+0000","last_clean":"2024-02-18T16:23:04.348633+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:23:04.348633+0000","last_undegraded":"2024-02-18T16:23:04.348633+0000","last_fullsized":"2024-02-18T16:23:04.348633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.348289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:35.555767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.694029+0000","last_change":"2024-02-18T16:23:14.694029+0000","last_active":"2024-02-18T16:23:14.694029+0000","last_peered":"2024-02-18T16:23:14.694029+0000","last_clean":"2024-02-18T16:23:14.694029+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:23:14.694029+0000","last_undegraded":"2024-02-18T16:23:14.694029+0000","last_fullsized":"2024-02-18T16:23:14.694029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.693728+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:39.653173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.442044+0000","last_change":"2024-02-18T16:22:49.442044+0000","last_active":"2024-02-18T16:22:49.442044+0000","last_peered":"2024-02-18T16:22:49.442044+0000","last_clean":"2024-02-18T16:22:49.442044+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:22:49.442044+0000","last_undegraded":"2024-02-18T16:22:49.442044+0000","last_fullsized":"2024-02-18T16:22:49.442044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.441791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:45:05.815867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.959752+0000","last_change":"2024-02-18T16:23:47.959903+0000","last_active":"2024-02-18T16:23:47.959752+0000","last_peered":"2024-02-18T16:23:47.959752+0000","last_clean":"2024-02-18T16:23:47.959752+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:23:47.959752+0000","last_undegraded":"2024-02-18T16:23:47.959752+0000","last_fullsized":"2024-02-18T16:23:47.959752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:47.959494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:47.959494+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.959494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:18.822463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.816662+0000","last_change":"2024-02-18T16:23:27.816811+0000","last_active":"2024-02-18T16:23:27.816662+0000","last_peered":"2024-02-18T16:23:27.816662+0000","last_clean":"2024-02-18T16:23:27.816662+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:23:27.816662+0000","last_undegraded":"2024-02-18T16:23:27.816662+0000","last_fullsized":"2024-02-18T16:23:27.816662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:27.816419+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:27.816419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.816419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:38.157707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.716911+0000","last_change":"2024-02-18T16:23:38.716974+0000","last_active":"2024-02-18T16:23:38.716911+0000","last_peered":"2024-02-18T16:23:38.716911+0000","last_clean":"2024-02-18T16:23:38.716911+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:23:38.716911+0000","last_undegraded":"2024-02-18T16:23:38.716911+0000","last_fullsized":"2024-02-18T16:23:38.716911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:38.716716+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:38.716716+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.716716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:57:01.976300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.288342+0000","last_change":"2024-02-18T16:23:06.288342+0000","last_active":"2024-02-18T16:23:06.288342+0000","last_peered":"2024-02-18T16:23:06.288342+0000","last_clean":"2024-02-18T16:23:06.288342+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:23:06.288342+0000","last_undegraded":"2024-02-18T16:23:06.288342+0000","last_fullsized":"2024-02-18T16:23:06.288342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.288089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:53.929609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.866009+0000","last_change":"2024-02-18T16:22:54.866009+0000","last_active":"2024-02-18T16:22:54.866009+0000","last_peered":"2024-02-18T16:22:54.866009+0000","last_clean":"2024-02-18T16:22:54.866009+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:54.866009+0000","last_undegraded":"2024-02-18T16:22:54.866009+0000","last_fullsized":"2024-02-18T16:22:54.866009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.865742+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:38.608078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.424493+0000","last_change":"2024-02-18T16:22:59.424493+0000","last_active":"2024-02-18T16:22:59.424493+0000","last_peered":"2024-02-18T16:22:59.424493+0000","last_clean":"2024-02-18T16:22:59.424493+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:59.424493+0000","last_undegraded":"2024-02-18T16:22:59.424493+0000","last_fullsized":"2024-02-18T16:22:59.424493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.424108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:27.706578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:48.251492+0000","last_change":"2024-02-18T16:23:48.251547+0000","last_active":"2024-02-18T16:23:48.251492+0000","last_peered":"2024-02-18T16:23:48.251492+0000","last_clean":"2024-02-18T16:23:48.251492+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:23:48.251492+0000","last_undegraded":"2024-02-18T16:23:48.251492+0000","last_fullsized":"2024-02-18T16:23:48.251492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:48.251299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:48.251299+0000","last_clean_scrub_stamp":"2024-02-18T16:23:48.251299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:42.395094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.950077+0000","last_change":"2024-02-18T16:23:17.950077+0000","last_active":"2024-02-18T16:23:17.950077+0000","last_peered":"2024-02-18T16:23:17.950077+0000","last_clean":"2024-02-18T16:23:17.950077+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:23:17.950077+0000","last_undegraded":"2024-02-18T16:23:17.950077+0000","last_fullsized":"2024-02-18T16:23:17.950077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.949811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:22.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659841+0000","last_change":"2024-02-18T16:20:59.871783+0000","last_active":"2024-02-18T16:22:48.659841+0000","last_peered":"2024-02-18T16:22:48.659841+0000","last_clean":"2024-02-18T16:22:48.659841+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:22:48.659841+0000","last_undegraded":"2024-02-18T16:22:48.659841+0000","last_fullsized":"2024-02-18T16:22:48.659841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.385292+0000","last_change":"2024-02-18T16:23:02.385292+0000","last_active":"2024-02-18T16:23:02.385292+0000","last_peered":"2024-02-18T16:23:02.385292+0000","last_clean":"2024-02-18T16:23:02.385292+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:23:02.385292+0000","last_undegraded":"2024-02-18T16:23:02.385292+0000","last_fullsized":"2024-02-18T16:23:02.385292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.384857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.736442+0000","last_change":"2024-02-18T16:23:18.736442+0000","last_active":"2024-02-18T16:23:18.736442+0000","last_peered":"2024-02-18T16:23:18.736442+0000","last_clean":"2024-02-18T16:23:18.736442+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:23:18.736442+0000","last_undegraded":"2024-02-18T16:23:18.736442+0000","last_fullsized":"2024-02-18T16:23:18.736442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.736028+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:33.973183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.419003+0000","last_change":"2024-02-18T16:22:48.419003+0000","last_active":"2024-02-18T16:22:48.419003+0000","last_peered":"2024-02-18T16:22:48.419003+0000","last_clean":"2024-02-18T16:22:48.419003+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:22:48.419003+0000","last_undegraded":"2024-02-18T16:22:48.419003+0000","last_fullsized":"2024-02-18T16:22:48.419003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.418904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:26.809828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.254723+0000","last_change":"2024-02-18T16:23:42.254793+0000","last_active":"2024-02-18T16:23:42.254723+0000","last_peered":"2024-02-18T16:23:42.254723+0000","last_clean":"2024-02-18T16:23:42.254723+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:23:42.254723+0000","last_undegraded":"2024-02-18T16:23:42.254723+0000","last_fullsized":"2024-02-18T16:23:42.254723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:42.254513+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:42.254513+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.254513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:34.007683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.722614+0000","last_change":"2024-02-18T16:23:39.722667+0000","last_active":"2024-02-18T16:23:39.722614+0000","last_peered":"2024-02-18T16:23:39.722614+0000","last_clean":"2024-02-18T16:23:39.722614+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:23:39.722614+0000","last_undegraded":"2024-02-18T16:23:39.722614+0000","last_fullsized":"2024-02-18T16:23:39.722614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.722399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.722399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.722399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:20:54.340576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.169671+0000","last_change":"2024-02-18T16:23:32.169748+0000","last_active":"2024-02-18T16:23:32.169671+0000","last_peered":"2024-02-18T16:23:32.169671+0000","last_clean":"2024-02-18T16:23:32.169671+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:23:32.169671+0000","last_undegraded":"2024-02-18T16:23:32.169671+0000","last_fullsized":"2024-02-18T16:23:32.169671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.169474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.169474+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.169474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:46.723732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.895970+0000","last_change":"2024-02-18T16:23:06.895970+0000","last_active":"2024-02-18T16:23:06.895970+0000","last_peered":"2024-02-18T16:23:06.895970+0000","last_clean":"2024-02-18T16:23:06.895970+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:23:06.895970+0000","last_undegraded":"2024-02-18T16:23:06.895970+0000","last_fullsized":"2024-02-18T16:23:06.895970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.895683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:21.766945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.716444+0000","last_change":"2024-02-18T16:22:53.716444+0000","last_active":"2024-02-18T16:22:53.716444+0000","last_peered":"2024-02-18T16:22:53.716444+0000","last_clean":"2024-02-18T16:22:53.716444+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:53.716444+0000","last_undegraded":"2024-02-18T16:22:53.716444+0000","last_fullsized":"2024-02-18T16:22:53.716444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.716166+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:15:00.689979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.730325+0000","last_change":"2024-02-18T16:23:16.730325+0000","last_active":"2024-02-18T16:23:16.730325+0000","last_peered":"2024-02-18T16:23:16.730325+0000","last_clean":"2024-02-18T16:23:16.730325+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:23:16.730325+0000","last_undegraded":"2024-02-18T16:23:16.730325+0000","last_fullsized":"2024-02-18T16:23:16.730325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.729880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:09.848063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.726227+0000","last_change":"2024-02-18T16:23:36.726292+0000","last_active":"2024-02-18T16:23:36.726227+0000","last_peered":"2024-02-18T16:23:36.726227+0000","last_clean":"2024-02-18T16:23:36.726227+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:23:36.726227+0000","last_undegraded":"2024-02-18T16:23:36.726227+0000","last_fullsized":"2024-02-18T16:23:36.726227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.726011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.726011+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.726011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:02:08.073508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.775757+0000","last_change":"2024-02-18T16:22:59.775757+0000","last_active":"2024-02-18T16:22:59.775757+0000","last_peered":"2024-02-18T16:22:59.775757+0000","last_clean":"2024-02-18T16:22:59.775757+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:59.775757+0000","last_undegraded":"2024-02-18T16:22:59.775757+0000","last_fullsized":"2024-02-18T16:22:59.775757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.775299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:17:59.839199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659874+0000","last_change":"2024-02-18T16:20:59.860244+0000","last_active":"2024-02-18T16:22:48.659874+0000","last_peered":"2024-02-18T16:22:48.659874+0000","last_clean":"2024-02-18T16:22:48.659874+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:22:48.659874+0000","last_undegraded":"2024-02-18T16:22:48.659874+0000","last_fullsized":"2024-02-18T16:22:48.659874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.315310+0000","last_change":"2024-02-18T16:23:05.315310+0000","last_active":"2024-02-18T16:23:05.315310+0000","last_peered":"2024-02-18T16:23:05.315310+0000","last_clean":"2024-02-18T16:23:05.315310+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:23:05.315310+0000","last_undegraded":"2024-02-18T16:23:05.315310+0000","last_fullsized":"2024-02-18T16:23:05.315310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.315056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:34.007120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.877151+0000","last_change":"2024-02-18T16:23:04.877151+0000","last_active":"2024-02-18T16:23:04.877151+0000","last_peered":"2024-02-18T16:23:04.877151+0000","last_clean":"2024-02-18T16:23:04.877151+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:23:04.877151+0000","last_undegraded":"2024-02-18T16:23:04.877151+0000","last_fullsized":"2024-02-18T16:23:04.877151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.876858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:34.375957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":334,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.770013+0000","last_change":"2024-02-18T16:22:51.770013+0000","last_active":"2024-02-18T16:22:51.770013+0000","last_peered":"2024-02-18T16:22:51.770013+0000","last_clean":"2024-02-18T16:22:51.770013+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:51.770013+0000","last_undegraded":"2024-02-18T16:22:51.770013+0000","last_fullsized":"2024-02-18T16:22:51.770013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.769642+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:23:26.328772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.126785+0000","last_change":"2024-02-18T16:23:15.126785+0000","last_active":"2024-02-18T16:23:15.126785+0000","last_peered":"2024-02-18T16:23:15.126785+0000","last_clean":"2024-02-18T16:23:15.126785+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:23:15.126785+0000","last_undegraded":"2024-02-18T16:23:15.126785+0000","last_fullsized":"2024-02-18T16:23:15.126785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.126508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:58.868844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.699084+0000","last_change":"2024-02-18T16:23:37.699156+0000","last_active":"2024-02-18T16:23:37.699084+0000","last_peered":"2024-02-18T16:23:37.699084+0000","last_clean":"2024-02-18T16:23:37.699084+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:23:37.699084+0000","last_undegraded":"2024-02-18T16:23:37.699084+0000","last_fullsized":"2024-02-18T16:23:37.699084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:37.698893+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:37.698893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.698893+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:45:21.335851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.789240+0000","last_change":"2024-02-18T16:23:47.789302+0000","last_active":"2024-02-18T16:23:47.789240+0000","last_peered":"2024-02-18T16:23:47.789240+0000","last_clean":"2024-02-18T16:23:47.789240+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:23:47.789240+0000","last_undegraded":"2024-02-18T16:23:47.789240+0000","last_fullsized":"2024-02-18T16:23:47.789240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:47.789011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:47.789011+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.789011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:26.898024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'6","reported_seq":540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.656384+0000","last_change":"2024-02-18T16:23:00.656384+0000","last_active":"2024-02-18T16:23:00.656384+0000","last_peered":"2024-02-18T16:23:00.656384+0000","last_clean":"2024-02-18T16:23:00.656384+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:23:00.656384+0000","last_undegraded":"2024-02-18T16:23:00.656384+0000","last_fullsized":"2024-02-18T16:23:00.656384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.655960+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:31:46.016785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":581,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.749256+0000","last_change":"2024-02-18T16:23:17.749256+0000","last_active":"2024-02-18T16:23:17.749256+0000","last_peered":"2024-02-18T16:23:17.749256+0000","last_clean":"2024-02-18T16:23:17.749256+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:23:17.749256+0000","last_undegraded":"2024-02-18T16:23:17.749256+0000","last_fullsized":"2024-02-18T16:23:17.749256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.748943+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:25.419343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":365,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.693788+0000","last_change":"2024-02-18T16:22:58.693788+0000","last_active":"2024-02-18T16:22:58.693788+0000","last_peered":"2024-02-18T16:22:58.693788+0000","last_clean":"2024-02-18T16:22:58.693788+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:58.693788+0000","last_undegraded":"2024-02-18T16:22:58.693788+0000","last_fullsized":"2024-02-18T16:22:58.693788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.693538+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:28.192638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.897770+0000","last_change":"2024-02-18T16:22:59.897770+0000","last_active":"2024-02-18T16:22:59.897770+0000","last_peered":"2024-02-18T16:22:59.897770+0000","last_clean":"2024-02-18T16:22:59.897770+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:22:59.897770+0000","last_undegraded":"2024-02-18T16:22:59.897770+0000","last_fullsized":"2024-02-18T16:22:59.897770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.897511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:17:33.837107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.740243+0000","last_change":"2024-02-18T16:23:12.740243+0000","last_active":"2024-02-18T16:23:12.740243+0000","last_peered":"2024-02-18T16:23:12.740243+0000","last_clean":"2024-02-18T16:23:12.740243+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:23:12.740243+0000","last_undegraded":"2024-02-18T16:23:12.740243+0000","last_fullsized":"2024-02-18T16:23:12.740243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.739975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.749389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.757260+0000","last_change":"2024-02-18T16:23:42.757382+0000","last_active":"2024-02-18T16:23:42.757260+0000","last_peered":"2024-02-18T16:23:42.757260+0000","last_clean":"2024-02-18T16:23:42.757260+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:23:42.757260+0000","last_undegraded":"2024-02-18T16:23:42.757260+0000","last_fullsized":"2024-02-18T16:23:42.757260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:42.757028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:42.757028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.757028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:47:18.356551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.918122+0000","last_change":"2024-02-18T16:22:48.918122+0000","last_active":"2024-02-18T16:22:48.918122+0000","last_peered":"2024-02-18T16:22:48.918122+0000","last_clean":"2024-02-18T16:22:48.918122+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:22:48.918122+0000","last_undegraded":"2024-02-18T16:22:48.918122+0000","last_fullsized":"2024-02-18T16:22:48.918122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.917868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:12.197986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.726450+0000","last_change":"2024-02-18T16:22:52.726450+0000","last_active":"2024-02-18T16:22:52.726450+0000","last_peered":"2024-02-18T16:22:52.726450+0000","last_clean":"2024-02-18T16:22:52.726450+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:52.726450+0000","last_undegraded":"2024-02-18T16:22:52.726450+0000","last_fullsized":"2024-02-18T16:22:52.726450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.726227+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:01.503665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.749676+0000","last_change":"2024-02-18T16:22:50.749676+0000","last_active":"2024-02-18T16:22:50.749676+0000","last_peered":"2024-02-18T16:22:50.749676+0000","last_clean":"2024-02-18T16:22:50.749676+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:22:50.749676+0000","last_undegraded":"2024-02-18T16:22:50.749676+0000","last_fullsized":"2024-02-18T16:22:50.749676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.749316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:31.018219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.891076+0000","last_change":"2024-02-18T16:23:44.891135+0000","last_active":"2024-02-18T16:23:44.891076+0000","last_peered":"2024-02-18T16:23:44.891076+0000","last_clean":"2024-02-18T16:23:44.891076+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:23:44.891076+0000","last_undegraded":"2024-02-18T16:23:44.891076+0000","last_fullsized":"2024-02-18T16:23:44.891076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:44.890826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:44.890826+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.890826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:41:07.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.684394+0000","last_change":"2024-02-18T16:23:05.684394+0000","last_active":"2024-02-18T16:23:05.684394+0000","last_peered":"2024-02-18T16:23:05.684394+0000","last_clean":"2024-02-18T16:23:05.684394+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:23:05.684394+0000","last_undegraded":"2024-02-18T16:23:05.684394+0000","last_fullsized":"2024-02-18T16:23:05.684394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.684138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:51:47.648057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.816728+0000","last_change":"2024-02-18T16:23:32.816808+0000","last_active":"2024-02-18T16:23:32.816728+0000","last_peered":"2024-02-18T16:23:32.816728+0000","last_clean":"2024-02-18T16:23:32.816728+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:23:32.816728+0000","last_undegraded":"2024-02-18T16:23:32.816728+0000","last_fullsized":"2024-02-18T16:23:32.816728+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-02-18T16:23:32.816528+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-02-18T16:23:32.816528+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.816528+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:56:28.658709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659462+0000","last_change":"2024-02-18T16:20:51.775828+0000","last_active":"2024-02-18T16:22:48.659462+0000","last_peered":"2024-02-18T16:22:48.659462+0000","last_clean":"2024-02-18T16:22:48.659462+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:22:48.659462+0000","last_undegraded":"2024-02-18T16:22:48.659462+0000","last_fullsized":"2024-02-18T16:22:48.659462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659514+0000","last_change":"2024-02-18T16:20:59.861045+0000","last_active":"2024-02-18T16:22:48.659514+0000","last_peered":"2024-02-18T16:22:48.659514+0000","last_clean":"2024-02-18T16:22:48.659514+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:22:48.659514+0000","last_undegraded":"2024-02-18T16:22:48.659514+0000","last_fullsized":"2024-02-18T16:22:48.659514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.664877+0000","last_change":"2024-02-18T16:23:03.664877+0000","last_active":"2024-02-18T16:23:03.664877+0000","last_peered":"2024-02-18T16:23:03.664877+0000","last_clean":"2024-02-18T16:23:03.664877+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:23:03.664877+0000","last_undegraded":"2024-02-18T16:23:03.664877+0000","last_fullsized":"2024-02-18T16:23:03.664877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.664624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:45.069024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'84","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.776665+0000","last_change":"2024-02-18T16:23:21.776848+0000","last_active":"2024-02-18T16:23:21.776665+0000","last_peered":"2024-02-18T16:23:21.776665+0000","last_clean":"2024-02-18T16:23:21.776665+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:23:21.776665+0000","last_undegraded":"2024-02-18T16:23:21.776665+0000","last_fullsized":"2024-02-18T16:23:21.776665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.776429+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:19.871412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.479778+0000","last_change":"2024-02-18T16:22:51.479778+0000","last_active":"2024-02-18T16:22:51.479778+0000","last_peered":"2024-02-18T16:22:51.479778+0000","last_clean":"2024-02-18T16:22:51.479778+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:22:51.479778+0000","last_undegraded":"2024-02-18T16:22:51.479778+0000","last_fullsized":"2024-02-18T16:22:51.479778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.479526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:00.256964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.875952+0000","last_change":"2024-02-18T16:22:55.875952+0000","last_active":"2024-02-18T16:22:55.875952+0000","last_peered":"2024-02-18T16:22:55.875952+0000","last_clean":"2024-02-18T16:22:55.875952+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:55.875952+0000","last_undegraded":"2024-02-18T16:22:55.875952+0000","last_fullsized":"2024-02-18T16:22:55.875952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.875669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:33.784174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.711566+0000","last_change":"2024-02-18T16:23:30.711619+0000","last_active":"2024-02-18T16:23:30.711566+0000","last_peered":"2024-02-18T16:23:30.711566+0000","last_clean":"2024-02-18T16:23:30.711566+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:23:30.711566+0000","last_undegraded":"2024-02-18T16:23:30.711566+0000","last_fullsized":"2024-02-18T16:23:30.711566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.711338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.711338+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.711338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:21:28.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659370+0000","last_change":"2024-02-18T16:20:51.775661+0000","last_active":"2024-02-18T16:22:48.659370+0000","last_peered":"2024-02-18T16:22:48.659370+0000","last_clean":"2024-02-18T16:22:48.659370+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:22:48.659370+0000","last_undegraded":"2024-02-18T16:22:48.659370+0000","last_fullsized":"2024-02-18T16:22:48.659370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.178848+0000","last_change":"2024-02-18T16:23:35.178912+0000","last_active":"2024-02-18T16:23:35.178848+0000","last_peered":"2024-02-18T16:23:35.178848+0000","last_clean":"2024-02-18T16:23:35.178848+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:23:35.178848+0000","last_undegraded":"2024-02-18T16:23:35.178848+0000","last_fullsized":"2024-02-18T16:23:35.178848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.178612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.178612+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.178612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:25.976338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.880298+0000","last_change":"2024-02-18T16:22:50.880298+0000","last_active":"2024-02-18T16:22:50.880298+0000","last_peered":"2024-02-18T16:22:50.880298+0000","last_clean":"2024-02-18T16:22:50.880298+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:22:50.880298+0000","last_undegraded":"2024-02-18T16:22:50.880298+0000","last_fullsized":"2024-02-18T16:22:50.880298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.879993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:40:55.016859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.676283+0000","last_change":"2024-02-18T16:22:48.676283+0000","last_active":"2024-02-18T16:22:48.676283+0000","last_peered":"2024-02-18T16:22:48.676283+0000","last_clean":"2024-02-18T16:22:48.676283+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:48.676283+0000","last_undegraded":"2024-02-18T16:22:48.676283+0000","last_fullsized":"2024-02-18T16:22:48.676283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.676008+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:36.238448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.648672+0000","last_change":"2024-02-18T16:23:12.648672+0000","last_active":"2024-02-18T16:23:12.648672+0000","last_peered":"2024-02-18T16:23:12.648672+0000","last_clean":"2024-02-18T16:23:12.648672+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:23:12.648672+0000","last_undegraded":"2024-02-18T16:23:12.648672+0000","last_fullsized":"2024-02-18T16:23:12.648672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.648341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:17:59.693351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.918277+0000","last_change":"2024-02-18T16:23:46.918348+0000","last_active":"2024-02-18T16:23:46.918277+0000","last_peered":"2024-02-18T16:23:46.918277+0000","last_clean":"2024-02-18T16:23:46.918277+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:23:46.918277+0000","last_undegraded":"2024-02-18T16:23:46.918277+0000","last_fullsized":"2024-02-18T16:23:46.918277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:46.918054+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:46.918054+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.918054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:04:52.821578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.238351+0000","last_change":"2024-02-18T16:23:41.238416+0000","last_active":"2024-02-18T16:23:41.238351+0000","last_peered":"2024-02-18T16:23:41.238351+0000","last_clean":"2024-02-18T16:23:41.238351+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:23:41.238351+0000","last_undegraded":"2024-02-18T16:23:41.238351+0000","last_fullsized":"2024-02-18T16:23:41.238351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:41.238156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:41.238156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.238156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:11.430893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.815989+0000","last_change":"2024-02-18T16:23:29.816093+0000","last_active":"2024-02-18T16:23:29.815989+0000","last_peered":"2024-02-18T16:23:29.815989+0000","last_clean":"2024-02-18T16:23:29.815989+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:23:29.815989+0000","last_undegraded":"2024-02-18T16:23:29.815989+0000","last_fullsized":"2024-02-18T16:23:29.815989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:29.815772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:29.815772+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.815772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:42.184598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.174668+0000","last_change":"2024-02-18T16:23:36.174727+0000","last_active":"2024-02-18T16:23:36.174668+0000","last_peered":"2024-02-18T16:23:36.174668+0000","last_clean":"2024-02-18T16:23:36.174668+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:23:36.174668+0000","last_undegraded":"2024-02-18T16:23:36.174668+0000","last_fullsized":"2024-02-18T16:23:36.174668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.174453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.174453+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.174453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:29.292636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.949902+0000","last_change":"2024-02-18T16:23:12.949902+0000","last_active":"2024-02-18T16:23:12.949902+0000","last_peered":"2024-02-18T16:23:12.949902+0000","last_clean":"2024-02-18T16:23:12.949902+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:23:12.949902+0000","last_undegraded":"2024-02-18T16:23:12.949902+0000","last_fullsized":"2024-02-18T16:23:12.949902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.949503+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:07:00.591023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.880194+0000","last_change":"2024-02-18T16:23:01.880194+0000","last_active":"2024-02-18T16:23:01.880194+0000","last_peered":"2024-02-18T16:23:01.880194+0000","last_clean":"2024-02-18T16:23:01.880194+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:23:01.880194+0000","last_undegraded":"2024-02-18T16:23:01.880194+0000","last_fullsized":"2024-02-18T16:23:01.880194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.879908+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:49.968692+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.417911+0000","last_change":"2024-02-18T16:22:55.417911+0000","last_active":"2024-02-18T16:22:55.417911+0000","last_peered":"2024-02-18T16:22:55.417911+0000","last_clean":"2024-02-18T16:22:55.417911+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:22:55.417911+0000","last_undegraded":"2024-02-18T16:22:55.417911+0000","last_fullsized":"2024-02-18T16:22:55.417911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.417642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:43.506426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663147+0000","last_change":"2024-02-18T16:21:09.926127+0000","last_active":"2024-02-18T16:22:48.663147+0000","last_peered":"2024-02-18T16:22:48.663147+0000","last_clean":"2024-02-18T16:22:48.663147+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:22:48.663147+0000","last_undegraded":"2024-02-18T16:22:48.663147+0000","last_fullsized":"2024-02-18T16:22:48.663147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.122969+0000","last_change":"2024-02-18T16:23:21.123024+0000","last_active":"2024-02-18T16:23:21.122969+0000","last_peered":"2024-02-18T16:23:21.122969+0000","last_clean":"2024-02-18T16:23:21.122969+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:23:21.122969+0000","last_undegraded":"2024-02-18T16:23:21.122969+0000","last_fullsized":"2024-02-18T16:23:21.122969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.122778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:31.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659406+0000","last_change":"2024-02-18T16:20:51.775513+0000","last_active":"2024-02-18T16:22:48.659406+0000","last_peered":"2024-02-18T16:22:48.659406+0000","last_clean":"2024-02-18T16:22:48.659406+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:22:48.659406+0000","last_undegraded":"2024-02-18T16:22:48.659406+0000","last_fullsized":"2024-02-18T16:22:48.659406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.910035+0000","last_change":"2024-02-18T16:23:18.910098+0000","last_active":"2024-02-18T16:23:18.910035+0000","last_peered":"2024-02-18T16:23:18.910035+0000","last_clean":"2024-02-18T16:23:18.910035+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:23:18.910035+0000","last_undegraded":"2024-02-18T16:23:18.910035+0000","last_fullsized":"2024-02-18T16:23:18.910035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.909845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:53:00.919260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.247235+0000","last_change":"2024-02-18T16:23:08.247235+0000","last_active":"2024-02-18T16:23:08.247235+0000","last_peered":"2024-02-18T16:23:08.247235+0000","last_clean":"2024-02-18T16:23:08.247235+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:23:08.247235+0000","last_undegraded":"2024-02-18T16:23:08.247235+0000","last_fullsized":"2024-02-18T16:23:08.247235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.246981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:42:58.377194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.623260+0000","last_change":"2024-02-18T16:23:08.623260+0000","last_active":"2024-02-18T16:23:08.623260+0000","last_peered":"2024-02-18T16:23:08.623260+0000","last_clean":"2024-02-18T16:23:08.623260+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:23:08.623260+0000","last_undegraded":"2024-02-18T16:23:08.623260+0000","last_fullsized":"2024-02-18T16:23:08.623260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.622991+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:02.281198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.734333+0000","last_change":"2024-02-18T16:23:24.734440+0000","last_active":"2024-02-18T16:23:24.734333+0000","last_peered":"2024-02-18T16:23:24.734333+0000","last_clean":"2024-02-18T16:23:24.734333+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:23:24.734333+0000","last_undegraded":"2024-02-18T16:23:24.734333+0000","last_fullsized":"2024-02-18T16:23:24.734333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:24.734087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:24.734087+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.734087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:05:01.465216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.736675+0000","last_change":"2024-02-18T16:23:14.736675+0000","last_active":"2024-02-18T16:23:14.736675+0000","last_peered":"2024-02-18T16:23:14.736675+0000","last_clean":"2024-02-18T16:23:14.736675+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:23:14.736675+0000","last_undegraded":"2024-02-18T16:23:14.736675+0000","last_fullsized":"2024-02-18T16:23:14.736675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.736262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.555313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.756320+0000","last_change":"2024-02-18T16:23:15.756377+0000","last_active":"2024-02-18T16:23:15.756320+0000","last_peered":"2024-02-18T16:23:15.756320+0000","last_clean":"2024-02-18T16:23:15.756320+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:23:15.756320+0000","last_undegraded":"2024-02-18T16:23:15.756320+0000","last_fullsized":"2024-02-18T16:23:15.756320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.756123+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.498459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.674953+0000","last_change":"2024-02-18T16:23:35.675009+0000","last_active":"2024-02-18T16:23:35.674953+0000","last_peered":"2024-02-18T16:23:35.674953+0000","last_clean":"2024-02-18T16:23:35.674953+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:23:35.674953+0000","last_undegraded":"2024-02-18T16:23:35.674953+0000","last_fullsized":"2024-02-18T16:23:35.674953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.674755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.674755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.674755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:29.332962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.190506+0000","last_change":"2024-02-18T16:23:33.190695+0000","last_active":"2024-02-18T16:23:33.190506+0000","last_peered":"2024-02-18T16:23:33.190506+0000","last_clean":"2024-02-18T16:23:33.190506+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:23:33.190506+0000","last_undegraded":"2024-02-18T16:23:33.190506+0000","last_fullsized":"2024-02-18T16:23:33.190506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.190286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.190286+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.190286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:20:47.808463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.699853+0000","last_change":"2024-02-18T16:23:40.699853+0000","last_active":"2024-02-18T16:23:40.699853+0000","last_peered":"2024-02-18T16:23:40.699853+0000","last_clean":"2024-02-18T16:23:40.699853+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:23:40.699853+0000","last_undegraded":"2024-02-18T16:23:40.699853+0000","last_fullsized":"2024-02-18T16:23:40.699853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.699606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.699606+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.699606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:05.659051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.420257+0000","last_change":"2024-02-18T16:22:56.420257+0000","last_active":"2024-02-18T16:22:56.420257+0000","last_peered":"2024-02-18T16:22:56.420257+0000","last_clean":"2024-02-18T16:22:56.420257+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:56.420257+0000","last_undegraded":"2024-02-18T16:22:56.420257+0000","last_fullsized":"2024-02-18T16:22:56.420257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.419970+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:02.428762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.748170+0000","last_change":"2024-02-18T16:22:49.748170+0000","last_active":"2024-02-18T16:22:49.748170+0000","last_peered":"2024-02-18T16:22:49.748170+0000","last_clean":"2024-02-18T16:22:49.748170+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:22:49.748170+0000","last_undegraded":"2024-02-18T16:22:49.748170+0000","last_fullsized":"2024-02-18T16:22:49.748170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.747885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:10:50.889318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.294458+0000","last_change":"2024-02-18T16:23:43.294517+0000","last_active":"2024-02-18T16:23:43.294458+0000","last_peered":"2024-02-18T16:23:43.294458+0000","last_clean":"2024-02-18T16:23:43.294458+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:23:43.294458+0000","last_undegraded":"2024-02-18T16:23:43.294458+0000","last_fullsized":"2024-02-18T16:23:43.294458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-18T16:23:43.294263+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-18T16:23:43.294263+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.294263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:14.362463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.714159+0000","last_change":"2024-02-18T16:23:11.714272+0000","last_active":"2024-02-18T16:23:11.714159+0000","last_peered":"2024-02-18T16:23:11.714159+0000","last_clean":"2024-02-18T16:23:11.714159+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:23:11.714159+0000","last_undegraded":"2024-02-18T16:23:11.714159+0000","last_fullsized":"2024-02-18T16:23:11.714159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.713937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.850804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.160180+0000","last_change":"2024-02-18T16:23:22.160243+0000","last_active":"2024-02-18T16:23:22.160180+0000","last_peered":"2024-02-18T16:23:22.160180+0000","last_clean":"2024-02-18T16:23:22.160180+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:23:22.160180+0000","last_undegraded":"2024-02-18T16:23:22.160180+0000","last_fullsized":"2024-02-18T16:23:22.160180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.159961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.101435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659615+0000","last_change":"2024-02-18T16:20:51.775527+0000","last_active":"2024-02-18T16:22:48.659615+0000","last_peered":"2024-02-18T16:22:48.659615+0000","last_clean":"2024-02-18T16:22:48.659615+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:22:48.659615+0000","last_undegraded":"2024-02-18T16:22:48.659615+0000","last_fullsized":"2024-02-18T16:22:48.659615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.818376+0000","last_change":"2024-02-18T16:22:58.818376+0000","last_active":"2024-02-18T16:22:58.818376+0000","last_peered":"2024-02-18T16:22:58.818376+0000","last_clean":"2024-02-18T16:22:58.818376+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:22:58.818376+0000","last_undegraded":"2024-02-18T16:22:58.818376+0000","last_fullsized":"2024-02-18T16:22:58.818376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.818107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:11.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.707930+0000","last_change":"2024-02-18T16:22:49.707930+0000","last_active":"2024-02-18T16:22:49.707930+0000","last_peered":"2024-02-18T16:22:49.707930+0000","last_clean":"2024-02-18T16:22:49.707930+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:22:49.707930+0000","last_undegraded":"2024-02-18T16:22:49.707930+0000","last_fullsized":"2024-02-18T16:22:49.707930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.707617+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:28.098540+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.735695+0000","last_change":"2024-02-18T16:22:50.735695+0000","last_active":"2024-02-18T16:22:50.735695+0000","last_peered":"2024-02-18T16:22:50.735695+0000","last_clean":"2024-02-18T16:22:50.735695+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:50.735695+0000","last_undegraded":"2024-02-18T16:22:50.735695+0000","last_fullsized":"2024-02-18T16:22:50.735695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.735438+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:28.643943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.688241+0000","last_change":"2024-02-18T16:23:32.688296+0000","last_active":"2024-02-18T16:23:32.688241+0000","last_peered":"2024-02-18T16:23:32.688241+0000","last_clean":"2024-02-18T16:23:32.688241+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:23:32.688241+0000","last_undegraded":"2024-02-18T16:23:32.688241+0000","last_fullsized":"2024-02-18T16:23:32.688241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.688045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.688045+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.688045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:58:07.099132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.703777+0000","last_change":"2024-02-18T16:23:33.703851+0000","last_active":"2024-02-18T16:23:33.703777+0000","last_peered":"2024-02-18T16:23:33.703777+0000","last_clean":"2024-02-18T16:23:33.703777+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:23:33.703777+0000","last_undegraded":"2024-02-18T16:23:33.703777+0000","last_fullsized":"2024-02-18T16:23:33.703777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:33.703579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:33.703579+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.703579+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:12:52.322217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.797372+0000","last_change":"2024-02-18T16:23:44.797437+0000","last_active":"2024-02-18T16:23:44.797372+0000","last_peered":"2024-02-18T16:23:44.797372+0000","last_clean":"2024-02-18T16:23:44.797372+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:23:44.797372+0000","last_undegraded":"2024-02-18T16:23:44.797372+0000","last_fullsized":"2024-02-18T16:23:44.797372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.797152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.797152+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.797152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:08:07.995733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.224158+0000","last_change":"2024-02-18T16:23:34.224211+0000","last_active":"2024-02-18T16:23:34.224158+0000","last_peered":"2024-02-18T16:23:34.224158+0000","last_clean":"2024-02-18T16:23:34.224158+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:23:34.224158+0000","last_undegraded":"2024-02-18T16:23:34.224158+0000","last_fullsized":"2024-02-18T16:23:34.224158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.223963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.223963+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.223963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:59.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.835162+0000","last_change":"2024-02-18T16:22:53.835162+0000","last_active":"2024-02-18T16:22:53.835162+0000","last_peered":"2024-02-18T16:22:53.835162+0000","last_clean":"2024-02-18T16:22:53.835162+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:22:53.835162+0000","last_undegraded":"2024-02-18T16:22:53.835162+0000","last_fullsized":"2024-02-18T16:22:53.835162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.834880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:45:52.990486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.796672+0000","last_change":"2024-02-18T16:23:02.796672+0000","last_active":"2024-02-18T16:23:02.796672+0000","last_peered":"2024-02-18T16:23:02.796672+0000","last_clean":"2024-02-18T16:23:02.796672+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:23:02.796672+0000","last_undegraded":"2024-02-18T16:23:02.796672+0000","last_fullsized":"2024-02-18T16:23:02.796672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.796510+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:15.165336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.432203+0000","last_change":"2024-02-18T16:22:53.432203+0000","last_active":"2024-02-18T16:22:53.432203+0000","last_peered":"2024-02-18T16:22:53.432203+0000","last_clean":"2024-02-18T16:22:53.432203+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:53.432203+0000","last_undegraded":"2024-02-18T16:22:53.432203+0000","last_fullsized":"2024-02-18T16:22:53.432203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.431945+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:16.067812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.886911+0000","last_change":"2024-02-18T16:23:43.886978+0000","last_active":"2024-02-18T16:23:43.886911+0000","last_peered":"2024-02-18T16:23:43.886911+0000","last_clean":"2024-02-18T16:23:43.886911+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:23:43.886911+0000","last_undegraded":"2024-02-18T16:23:43.886911+0000","last_fullsized":"2024-02-18T16:23:43.886911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-18T16:23:43.886686+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-18T16:23:43.886686+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.886686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:05:20.617815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.849175+0000","last_change":"2024-02-18T16:23:25.849283+0000","last_active":"2024-02-18T16:23:25.849175+0000","last_peered":"2024-02-18T16:23:25.849175+0000","last_clean":"2024-02-18T16:23:25.849175+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:23:25.849175+0000","last_undegraded":"2024-02-18T16:23:25.849175+0000","last_fullsized":"2024-02-18T16:23:25.849175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.848950+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:38.054152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.719789+0000","last_change":"2024-02-18T16:23:21.719847+0000","last_active":"2024-02-18T16:23:21.719789+0000","last_peered":"2024-02-18T16:23:21.719789+0000","last_clean":"2024-02-18T16:23:21.719789+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:23:21.719789+0000","last_undegraded":"2024-02-18T16:23:21.719789+0000","last_fullsized":"2024-02-18T16:23:21.719789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.719594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:28.530836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659496+0000","last_change":"2024-02-18T16:20:52.282300+0000","last_active":"2024-02-18T16:22:48.659496+0000","last_peered":"2024-02-18T16:22:48.659496+0000","last_clean":"2024-02-18T16:22:48.659496+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:22:48.659496+0000","last_undegraded":"2024-02-18T16:22:48.659496+0000","last_fullsized":"2024-02-18T16:22:48.659496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:50.754986+0000","last_clean_scrub_stamp":"2024-02-18T16:20:50.754986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.848661+0000","last_change":"2024-02-18T16:22:55.848661+0000","last_active":"2024-02-18T16:22:55.848661+0000","last_peered":"2024-02-18T16:22:55.848661+0000","last_clean":"2024-02-18T16:22:55.848661+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:22:55.848661+0000","last_undegraded":"2024-02-18T16:22:55.848661+0000","last_fullsized":"2024-02-18T16:22:55.848661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.848402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:19.446935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.898018+0000","last_change":"2024-02-18T16:22:57.898018+0000","last_active":"2024-02-18T16:22:57.898018+0000","last_peered":"2024-02-18T16:22:57.898018+0000","last_clean":"2024-02-18T16:22:57.898018+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:57.898018+0000","last_undegraded":"2024-02-18T16:22:57.898018+0000","last_fullsized":"2024-02-18T16:22:57.898018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.897660+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:13.070415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.433639+0000","last_change":"2024-02-18T16:22:47.433639+0000","last_active":"2024-02-18T16:22:47.433639+0000","last_peered":"2024-02-18T16:22:47.433639+0000","last_clean":"2024-02-18T16:22:47.433639+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:22:47.433639+0000","last_undegraded":"2024-02-18T16:22:47.433639+0000","last_fullsized":"2024-02-18T16:22:47.433639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_clean_scrub_stamp":"2024-02-18T16:22:47.433513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:34.995953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.868860+0000","last_change":"2024-02-18T16:23:07.868860+0000","last_active":"2024-02-18T16:23:07.868860+0000","last_peered":"2024-02-18T16:23:07.868860+0000","last_clean":"2024-02-18T16:23:07.868860+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:23:07.868860+0000","last_undegraded":"2024-02-18T16:23:07.868860+0000","last_fullsized":"2024-02-18T16:23:07.868860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.868484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:40.791749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.906138+0000","last_change":"2024-02-18T16:23:03.906138+0000","last_active":"2024-02-18T16:23:03.906138+0000","last_peered":"2024-02-18T16:23:03.906138+0000","last_clean":"2024-02-18T16:23:03.906138+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:23:03.906138+0000","last_undegraded":"2024-02-18T16:23:03.906138+0000","last_fullsized":"2024-02-18T16:23:03.906138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.905867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:52.615381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.756988+0000","last_change":"2024-02-18T16:23:44.757135+0000","last_active":"2024-02-18T16:23:44.756988+0000","last_peered":"2024-02-18T16:23:44.756988+0000","last_clean":"2024-02-18T16:23:44.756988+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:23:44.756988+0000","last_undegraded":"2024-02-18T16:23:44.756988+0000","last_fullsized":"2024-02-18T16:23:44.756988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.756736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.756736+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.756736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:35:04.428942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.659990+0000","last_change":"2024-02-18T16:20:59.871802+0000","last_active":"2024-02-18T16:22:48.659990+0000","last_peered":"2024-02-18T16:22:48.659990+0000","last_clean":"2024-02-18T16:22:48.659990+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:22:48.659990+0000","last_undegraded":"2024-02-18T16:22:48.659990+0000","last_fullsized":"2024-02-18T16:22:48.659990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.662609+0000","last_change":"2024-02-18T16:22:59.662609+0000","last_active":"2024-02-18T16:22:59.662609+0000","last_peered":"2024-02-18T16:22:59.662609+0000","last_clean":"2024-02-18T16:22:59.662609+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:22:59.662609+0000","last_undegraded":"2024-02-18T16:22:59.662609+0000","last_fullsized":"2024-02-18T16:22:59.662609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.662355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:03.409762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.873759+0000","last_change":"2024-02-18T16:22:52.873759+0000","last_active":"2024-02-18T16:22:52.873759+0000","last_peered":"2024-02-18T16:22:52.873759+0000","last_clean":"2024-02-18T16:22:52.873759+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:52.873759+0000","last_undegraded":"2024-02-18T16:22:52.873759+0000","last_fullsized":"2024-02-18T16:22:52.873759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.873343+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:03.165248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.654661+0000","last_change":"2024-02-18T16:23:13.654661+0000","last_active":"2024-02-18T16:23:13.654661+0000","last_peered":"2024-02-18T16:23:13.654661+0000","last_clean":"2024-02-18T16:23:13.654661+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:23:13.654661+0000","last_undegraded":"2024-02-18T16:23:13.654661+0000","last_fullsized":"2024-02-18T16:23:13.654661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.654400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:20:57.367640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.311152+0000","last_change":"2024-02-18T16:23:44.311208+0000","last_active":"2024-02-18T16:23:44.311152+0000","last_peered":"2024-02-18T16:23:44.311152+0000","last_clean":"2024-02-18T16:23:44.311152+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:23:44.311152+0000","last_undegraded":"2024-02-18T16:23:44.311152+0000","last_fullsized":"2024-02-18T16:23:44.311152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.310949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.310949+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.310949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:41:06.755737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.698302+0000","last_change":"2024-02-18T16:23:07.698302+0000","last_active":"2024-02-18T16:23:07.698302+0000","last_peered":"2024-02-18T16:23:07.698302+0000","last_clean":"2024-02-18T16:23:07.698302+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:23:07.698302+0000","last_undegraded":"2024-02-18T16:23:07.698302+0000","last_fullsized":"2024-02-18T16:23:07.698302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.697990+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.441729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.714368+0000","last_change":"2024-02-18T16:23:34.714540+0000","last_active":"2024-02-18T16:23:34.714368+0000","last_peered":"2024-02-18T16:23:34.714368+0000","last_clean":"2024-02-18T16:23:34.714368+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:23:34.714368+0000","last_undegraded":"2024-02-18T16:23:34.714368+0000","last_fullsized":"2024-02-18T16:23:34.714368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:34.714111+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:34.714111+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.714111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:40.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.819086+0000","last_change":"2024-02-18T16:22:57.819086+0000","last_active":"2024-02-18T16:22:57.819086+0000","last_peered":"2024-02-18T16:22:57.819086+0000","last_clean":"2024-02-18T16:22:57.819086+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:22:57.819086+0000","last_undegraded":"2024-02-18T16:22:57.819086+0000","last_fullsized":"2024-02-18T16:22:57.819086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.818829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:13.082229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.400353+0000","last_change":"2024-02-18T16:23:00.400353+0000","last_active":"2024-02-18T16:23:00.400353+0000","last_peered":"2024-02-18T16:23:00.400353+0000","last_clean":"2024-02-18T16:23:00.400353+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:23:00.400353+0000","last_undegraded":"2024-02-18T16:23:00.400353+0000","last_fullsized":"2024-02-18T16:23:00.400353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.400088+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:15.271349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.801018+0000","last_change":"2024-02-18T16:22:52.801018+0000","last_active":"2024-02-18T16:22:52.801018+0000","last_peered":"2024-02-18T16:22:52.801018+0000","last_clean":"2024-02-18T16:22:52.801018+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:22:52.801018+0000","last_undegraded":"2024-02-18T16:22:52.801018+0000","last_fullsized":"2024-02-18T16:22:52.801018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.800725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:35:16.840171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.260185+0000","last_change":"2024-02-18T16:23:46.260299+0000","last_active":"2024-02-18T16:23:46.260185+0000","last_peered":"2024-02-18T16:23:46.260185+0000","last_clean":"2024-02-18T16:23:46.260185+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:23:46.260185+0000","last_undegraded":"2024-02-18T16:23:46.260185+0000","last_fullsized":"2024-02-18T16:23:46.260185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:46.259927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:46.259927+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.259927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:04:52.163451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.086901+0000","last_change":"2024-02-18T16:23:16.086901+0000","last_active":"2024-02-18T16:23:16.086901+0000","last_peered":"2024-02-18T16:23:16.086901+0000","last_clean":"2024-02-18T16:23:16.086901+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:23:16.086901+0000","last_undegraded":"2024-02-18T16:23:16.086901+0000","last_fullsized":"2024-02-18T16:23:16.086901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.086590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.287817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.854024+0000","last_change":"2024-02-18T16:23:24.854082+0000","last_active":"2024-02-18T16:23:24.854024+0000","last_peered":"2024-02-18T16:23:24.854024+0000","last_clean":"2024-02-18T16:23:24.854024+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:23:24.854024+0000","last_undegraded":"2024-02-18T16:23:24.854024+0000","last_fullsized":"2024-02-18T16:23:24.854024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:24.853825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:24.853825+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.853825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:40.117224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.876247+0000","last_change":"2024-02-18T16:23:05.876247+0000","last_active":"2024-02-18T16:23:05.876247+0000","last_peered":"2024-02-18T16:23:05.876247+0000","last_clean":"2024-02-18T16:23:05.876247+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:23:05.876247+0000","last_undegraded":"2024-02-18T16:23:05.876247+0000","last_fullsized":"2024-02-18T16:23:05.876247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.875986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:34.158456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.361892+0000","last_change":"2024-02-18T16:23:01.361892+0000","last_active":"2024-02-18T16:23:01.361892+0000","last_peered":"2024-02-18T16:23:01.361892+0000","last_clean":"2024-02-18T16:23:01.361892+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:23:01.361892+0000","last_undegraded":"2024-02-18T16:23:01.361892+0000","last_fullsized":"2024-02-18T16:23:01.361892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.361622+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:34.284887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.674935+0000","last_change":"2024-02-18T16:22:54.674935+0000","last_active":"2024-02-18T16:22:54.674935+0000","last_peered":"2024-02-18T16:22:54.674935+0000","last_clean":"2024-02-18T16:22:54.674935+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:22:54.674935+0000","last_undegraded":"2024-02-18T16:22:54.674935+0000","last_fullsized":"2024-02-18T16:22:54.674935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.674677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:17.310545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663763+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:22:48.663763+0000","last_peered":"2024-02-18T16:22:48.663763+0000","last_clean":"2024-02-18T16:22:48.663763+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:22:48.663763+0000","last_undegraded":"2024-02-18T16:22:48.663763+0000","last_fullsized":"2024-02-18T16:22:48.663763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.720342+0000","last_change":"2024-02-18T16:23:31.720408+0000","last_active":"2024-02-18T16:23:31.720342+0000","last_peered":"2024-02-18T16:23:31.720342+0000","last_clean":"2024-02-18T16:23:31.720342+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:23:31.720342+0000","last_undegraded":"2024-02-18T16:23:31.720342+0000","last_fullsized":"2024-02-18T16:23:31.720342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:31.720139+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:31.720139+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.720139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:31:17.845563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.845951+0000","last_change":"2024-02-18T16:23:33.846011+0000","last_active":"2024-02-18T16:23:33.845951+0000","last_peered":"2024-02-18T16:23:33.845951+0000","last_clean":"2024-02-18T16:23:33.845951+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:23:33.845951+0000","last_undegraded":"2024-02-18T16:23:33.845951+0000","last_fullsized":"2024-02-18T16:23:33.845951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.845721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.845721+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.845721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:17.558961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.913473+0000","last_change":"2024-02-18T16:22:51.913473+0000","last_active":"2024-02-18T16:22:51.913473+0000","last_peered":"2024-02-18T16:22:51.913473+0000","last_clean":"2024-02-18T16:22:51.913473+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:22:51.913473+0000","last_undegraded":"2024-02-18T16:22:51.913473+0000","last_fullsized":"2024-02-18T16:22:51.913473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.913196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:37:17.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.903715+0000","last_change":"2024-02-18T16:23:02.903715+0000","last_active":"2024-02-18T16:23:02.903715+0000","last_peered":"2024-02-18T16:23:02.903715+0000","last_clean":"2024-02-18T16:23:02.903715+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:23:02.903715+0000","last_undegraded":"2024-02-18T16:23:02.903715+0000","last_fullsized":"2024-02-18T16:23:02.903715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.903414+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:08.912206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.831594+0000","last_change":"2024-02-18T16:22:53.831594+0000","last_active":"2024-02-18T16:22:53.831594+0000","last_peered":"2024-02-18T16:22:53.831594+0000","last_clean":"2024-02-18T16:22:53.831594+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:22:53.831594+0000","last_undegraded":"2024-02-18T16:22:53.831594+0000","last_fullsized":"2024-02-18T16:22:53.831594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.831178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:41.393618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.730259+0000","last_change":"2024-02-18T16:23:35.730411+0000","last_active":"2024-02-18T16:23:35.730259+0000","last_peered":"2024-02-18T16:23:35.730259+0000","last_clean":"2024-02-18T16:23:35.730259+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:23:35.730259+0000","last_undegraded":"2024-02-18T16:23:35.730259+0000","last_fullsized":"2024-02-18T16:23:35.730259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.729964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.729964+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.729964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:33:15.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660080+0000","last_change":"2024-02-18T16:20:59.857099+0000","last_active":"2024-02-18T16:22:48.660080+0000","last_peered":"2024-02-18T16:22:48.660080+0000","last_clean":"2024-02-18T16:22:48.660080+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:22:48.660080+0000","last_undegraded":"2024-02-18T16:22:48.660080+0000","last_fullsized":"2024-02-18T16:22:48.660080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.208927+0000","last_change":"2024-02-18T16:23:09.208983+0000","last_active":"2024-02-18T16:23:09.208927+0000","last_peered":"2024-02-18T16:23:09.208927+0000","last_clean":"2024-02-18T16:23:09.208927+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:23:09.208927+0000","last_undegraded":"2024-02-18T16:23:09.208927+0000","last_fullsized":"2024-02-18T16:23:09.208927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.208729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.488847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.424028+0000","last_change":"2024-02-18T16:22:58.424028+0000","last_active":"2024-02-18T16:22:58.424028+0000","last_peered":"2024-02-18T16:22:58.424028+0000","last_clean":"2024-02-18T16:22:58.424028+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:58.424028+0000","last_undegraded":"2024-02-18T16:22:58.424028+0000","last_fullsized":"2024-02-18T16:22:58.424028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.423765+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:19.745145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.869606+0000","last_change":"2024-02-18T16:22:54.869606+0000","last_active":"2024-02-18T16:22:54.869606+0000","last_peered":"2024-02-18T16:22:54.869606+0000","last_clean":"2024-02-18T16:22:54.869606+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:22:54.869606+0000","last_undegraded":"2024-02-18T16:22:54.869606+0000","last_fullsized":"2024-02-18T16:22:54.869606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.869352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:33.260275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.270335+0000","last_change":"2024-02-18T16:23:47.270394+0000","last_active":"2024-02-18T16:23:47.270335+0000","last_peered":"2024-02-18T16:23:47.270335+0000","last_clean":"2024-02-18T16:23:47.270335+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:23:47.270335+0000","last_undegraded":"2024-02-18T16:23:47.270335+0000","last_fullsized":"2024-02-18T16:23:47.270335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:47.270144+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:47.270144+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.270144+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:18.133113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.153440+0000","last_change":"2024-02-18T16:23:23.153502+0000","last_active":"2024-02-18T16:23:23.153440+0000","last_peered":"2024-02-18T16:23:23.153440+0000","last_clean":"2024-02-18T16:23:23.153440+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:23:23.153440+0000","last_undegraded":"2024-02-18T16:23:23.153440+0000","last_fullsized":"2024-02-18T16:23:23.153440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.153242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:35.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.883148+0000","last_change":"2024-02-18T16:23:34.883208+0000","last_active":"2024-02-18T16:23:34.883148+0000","last_peered":"2024-02-18T16:23:34.883148+0000","last_clean":"2024-02-18T16:23:34.883148+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:23:34.883148+0000","last_undegraded":"2024-02-18T16:23:34.883148+0000","last_fullsized":"2024-02-18T16:23:34.883148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.882944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.882944+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.882944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:59.842389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.898942+0000","last_change":"2024-02-18T16:23:10.898998+0000","last_active":"2024-02-18T16:23:10.898942+0000","last_peered":"2024-02-18T16:23:10.898942+0000","last_clean":"2024-02-18T16:23:10.898942+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:23:10.898942+0000","last_undegraded":"2024-02-18T16:23:10.898942+0000","last_fullsized":"2024-02-18T16:23:10.898942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.898746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:42.106224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.722806+0000","last_change":"2024-02-18T16:23:04.722806+0000","last_active":"2024-02-18T16:23:04.722806+0000","last_peered":"2024-02-18T16:23:04.722806+0000","last_clean":"2024-02-18T16:23:04.722806+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:23:04.722806+0000","last_undegraded":"2024-02-18T16:23:04.722806+0000","last_fullsized":"2024-02-18T16:23:04.722806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.722326+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:12.289082+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.699736+0000","last_change":"2024-02-18T16:23:06.699736+0000","last_active":"2024-02-18T16:23:06.699736+0000","last_peered":"2024-02-18T16:23:06.699736+0000","last_clean":"2024-02-18T16:23:06.699736+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:23:06.699736+0000","last_undegraded":"2024-02-18T16:23:06.699736+0000","last_fullsized":"2024-02-18T16:23:06.699736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.699466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:54.340986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663328+0000","last_change":"2024-02-18T16:21:09.924594+0000","last_active":"2024-02-18T16:22:48.663328+0000","last_peered":"2024-02-18T16:22:48.663328+0000","last_clean":"2024-02-18T16:22:48.663328+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:22:48.663328+0000","last_undegraded":"2024-02-18T16:22:48.663328+0000","last_fullsized":"2024-02-18T16:22:48.663328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.756244+0000","last_change":"2024-02-18T16:23:01.756244+0000","last_active":"2024-02-18T16:23:01.756244+0000","last_peered":"2024-02-18T16:23:01.756244+0000","last_clean":"2024-02-18T16:23:01.756244+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:23:01.756244+0000","last_undegraded":"2024-02-18T16:23:01.756244+0000","last_fullsized":"2024-02-18T16:23:01.756244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.755900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:58.697375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.933399+0000","last_change":"2024-02-18T16:23:35.933459+0000","last_active":"2024-02-18T16:23:35.933399+0000","last_peered":"2024-02-18T16:23:35.933399+0000","last_clean":"2024-02-18T16:23:35.933399+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:23:35.933399+0000","last_undegraded":"2024-02-18T16:23:35.933399+0000","last_fullsized":"2024-02-18T16:23:35.933399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.933180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.933180+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.933180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:26.730906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.887431+0000","last_change":"2024-02-18T16:23:08.887431+0000","last_active":"2024-02-18T16:23:08.887431+0000","last_peered":"2024-02-18T16:23:08.887431+0000","last_clean":"2024-02-18T16:23:08.887431+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:23:08.887431+0000","last_undegraded":"2024-02-18T16:23:08.887431+0000","last_fullsized":"2024-02-18T16:23:08.887431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.887177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:52.037300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.388978+0000","last_change":"2024-02-18T16:22:57.388978+0000","last_active":"2024-02-18T16:22:57.388978+0000","last_peered":"2024-02-18T16:22:57.388978+0000","last_clean":"2024-02-18T16:22:57.388978+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:57.388978+0000","last_undegraded":"2024-02-18T16:22:57.388978+0000","last_fullsized":"2024-02-18T16:22:57.388978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.388689+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:26.576966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.357962+0000","last_change":"2024-02-18T16:23:03.357962+0000","last_active":"2024-02-18T16:23:03.357962+0000","last_peered":"2024-02-18T16:23:03.357962+0000","last_clean":"2024-02-18T16:23:03.357962+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:23:03.357962+0000","last_undegraded":"2024-02-18T16:23:03.357962+0000","last_fullsized":"2024-02-18T16:23:03.357962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.357709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:29:02.881887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.713891+0000","last_change":"2024-02-18T16:23:28.713891+0000","last_active":"2024-02-18T16:23:28.713891+0000","last_peered":"2024-02-18T16:23:28.713891+0000","last_clean":"2024-02-18T16:23:28.713891+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:23:28.713891+0000","last_undegraded":"2024-02-18T16:23:28.713891+0000","last_fullsized":"2024-02-18T16:23:28.713891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.713636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.713636+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.713636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:56:59.576605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.154731+0000","last_change":"2024-02-18T16:23:19.154731+0000","last_active":"2024-02-18T16:23:19.154731+0000","last_peered":"2024-02-18T16:23:19.154731+0000","last_clean":"2024-02-18T16:23:19.154731+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:23:19.154731+0000","last_undegraded":"2024-02-18T16:23:19.154731+0000","last_fullsized":"2024-02-18T16:23:19.154731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.154433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:31.359635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660190+0000","last_change":"2024-02-18T16:20:59.872411+0000","last_active":"2024-02-18T16:22:48.660190+0000","last_peered":"2024-02-18T16:22:48.660190+0000","last_clean":"2024-02-18T16:22:48.660190+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:22:48.660190+0000","last_undegraded":"2024-02-18T16:22:48.660190+0000","last_fullsized":"2024-02-18T16:22:48.660190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.683330+0000","last_change":"2024-02-18T16:22:56.683330+0000","last_active":"2024-02-18T16:22:56.683330+0000","last_peered":"2024-02-18T16:22:56.683330+0000","last_clean":"2024-02-18T16:22:56.683330+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:22:56.683330+0000","last_undegraded":"2024-02-18T16:22:56.683330+0000","last_fullsized":"2024-02-18T16:22:56.683330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.683085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:46:21.980224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.770082+0000","last_change":"2024-02-18T16:23:19.770167+0000","last_active":"2024-02-18T16:23:19.770082+0000","last_peered":"2024-02-18T16:23:19.770082+0000","last_clean":"2024-02-18T16:23:19.770082+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:23:19.770082+0000","last_undegraded":"2024-02-18T16:23:19.770082+0000","last_fullsized":"2024-02-18T16:23:19.770082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.769894+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:21.405998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.790722+0000","last_change":"2024-02-18T16:22:48.790722+0000","last_active":"2024-02-18T16:22:48.790722+0000","last_peered":"2024-02-18T16:22:48.790722+0000","last_clean":"2024-02-18T16:22:48.790722+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:48.790722+0000","last_undegraded":"2024-02-18T16:22:48.790722+0000","last_fullsized":"2024-02-18T16:22:48.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.790462+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:30:37.353769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.762158+0000","last_change":"2024-02-18T16:23:40.762232+0000","last_active":"2024-02-18T16:23:40.762158+0000","last_peered":"2024-02-18T16:23:40.762158+0000","last_clean":"2024-02-18T16:23:40.762158+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:23:40.762158+0000","last_undegraded":"2024-02-18T16:23:40.762158+0000","last_fullsized":"2024-02-18T16:23:40.762158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.761955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.761955+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.761955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:02.420065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.906619+0000","last_change":"2024-02-18T16:23:19.906619+0000","last_active":"2024-02-18T16:23:19.906619+0000","last_peered":"2024-02-18T16:23:19.906619+0000","last_clean":"2024-02-18T16:23:19.906619+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:23:19.906619+0000","last_undegraded":"2024-02-18T16:23:19.906619+0000","last_fullsized":"2024-02-18T16:23:19.906619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.906135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:30.198039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.904887+0000","last_change":"2024-02-18T16:23:39.904947+0000","last_active":"2024-02-18T16:23:39.904887+0000","last_peered":"2024-02-18T16:23:39.904887+0000","last_clean":"2024-02-18T16:23:39.904887+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:23:39.904887+0000","last_undegraded":"2024-02-18T16:23:39.904887+0000","last_fullsized":"2024-02-18T16:23:39.904887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.904651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.904651+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.904651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:41.540756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.684114+0000","last_change":"2024-02-18T16:22:57.684114+0000","last_active":"2024-02-18T16:22:57.684114+0000","last_peered":"2024-02-18T16:22:57.684114+0000","last_clean":"2024-02-18T16:22:57.684114+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:22:57.684114+0000","last_undegraded":"2024-02-18T16:22:57.684114+0000","last_fullsized":"2024-02-18T16:22:57.684114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.683775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:46.393290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.747441+0000","last_change":"2024-02-18T16:22:51.747441+0000","last_active":"2024-02-18T16:22:51.747441+0000","last_peered":"2024-02-18T16:22:51.747441+0000","last_clean":"2024-02-18T16:22:51.747441+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:51.747441+0000","last_undegraded":"2024-02-18T16:22:51.747441+0000","last_fullsized":"2024-02-18T16:22:51.747441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.747142+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:31.805590+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.481478+0000","last_change":"2024-02-18T16:22:50.481478+0000","last_active":"2024-02-18T16:22:50.481478+0000","last_peered":"2024-02-18T16:22:50.481478+0000","last_clean":"2024-02-18T16:22:50.481478+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:22:50.481478+0000","last_undegraded":"2024-02-18T16:22:50.481478+0000","last_fullsized":"2024-02-18T16:22:50.481478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.481235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:40.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.884323+0000","last_change":"2024-02-18T16:23:45.884384+0000","last_active":"2024-02-18T16:23:45.884323+0000","last_peered":"2024-02-18T16:23:45.884323+0000","last_clean":"2024-02-18T16:23:45.884323+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:23:45.884323+0000","last_undegraded":"2024-02-18T16:23:45.884323+0000","last_fullsized":"2024-02-18T16:23:45.884323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:45.884134+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:45.884134+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.884134+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:58:56.431453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.951553+0000","last_change":"2024-02-18T16:23:14.951553+0000","last_active":"2024-02-18T16:23:14.951553+0000","last_peered":"2024-02-18T16:23:14.951553+0000","last_clean":"2024-02-18T16:23:14.951553+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:23:14.951553+0000","last_undegraded":"2024-02-18T16:23:14.951553+0000","last_fullsized":"2024-02-18T16:23:14.951553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.951301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:43:05.081514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.723530+0000","last_change":"2024-02-18T16:23:39.723591+0000","last_active":"2024-02-18T16:23:39.723530+0000","last_peered":"2024-02-18T16:23:39.723530+0000","last_clean":"2024-02-18T16:23:39.723530+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:23:39.723530+0000","last_undegraded":"2024-02-18T16:23:39.723530+0000","last_fullsized":"2024-02-18T16:23:39.723530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.723325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.723325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.723325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:11:20.026076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.877623+0000","last_change":"2024-02-18T16:23:09.877623+0000","last_active":"2024-02-18T16:23:09.877623+0000","last_peered":"2024-02-18T16:23:09.877623+0000","last_clean":"2024-02-18T16:23:09.877623+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:23:09.877623+0000","last_undegraded":"2024-02-18T16:23:09.877623+0000","last_fullsized":"2024-02-18T16:23:09.877623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.877375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:51.281775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.395705+0000","last_change":"2024-02-18T16:22:54.395705+0000","last_active":"2024-02-18T16:22:54.395705+0000","last_peered":"2024-02-18T16:22:54.395705+0000","last_clean":"2024-02-18T16:22:54.395705+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:54.395705+0000","last_undegraded":"2024-02-18T16:22:54.395705+0000","last_fullsized":"2024-02-18T16:22:54.395705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.395421+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:31.781895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.641433+0000","last_change":"2024-02-18T16:23:11.641433+0000","last_active":"2024-02-18T16:23:11.641433+0000","last_peered":"2024-02-18T16:23:11.641433+0000","last_clean":"2024-02-18T16:23:11.641433+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:23:11.641433+0000","last_undegraded":"2024-02-18T16:23:11.641433+0000","last_fullsized":"2024-02-18T16:23:11.641433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.641157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:04.618665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663480+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:22:48.663480+0000","last_peered":"2024-02-18T16:22:48.663480+0000","last_clean":"2024-02-18T16:22:48.663480+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:22:48.663480+0000","last_undegraded":"2024-02-18T16:22:48.663480+0000","last_fullsized":"2024-02-18T16:22:48.663480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.706755+0000","last_change":"2024-02-18T16:23:26.706755+0000","last_active":"2024-02-18T16:23:26.706755+0000","last_peered":"2024-02-18T16:23:26.706755+0000","last_clean":"2024-02-18T16:23:26.706755+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:23:26.706755+0000","last_undegraded":"2024-02-18T16:23:26.706755+0000","last_fullsized":"2024-02-18T16:23:26.706755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:26.706488+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:26.706488+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.706488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:35:36.196305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.123637+0000","last_change":"2024-02-18T16:23:18.123711+0000","last_active":"2024-02-18T16:23:18.123637+0000","last_peered":"2024-02-18T16:23:18.123637+0000","last_clean":"2024-02-18T16:23:18.123637+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:23:18.123637+0000","last_undegraded":"2024-02-18T16:23:18.123637+0000","last_fullsized":"2024-02-18T16:23:18.123637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.123439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:33.386838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.716209+0000","last_change":"2024-02-18T16:23:05.716209+0000","last_active":"2024-02-18T16:23:05.716209+0000","last_peered":"2024-02-18T16:23:05.716209+0000","last_clean":"2024-02-18T16:23:05.716209+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:23:05.716209+0000","last_undegraded":"2024-02-18T16:23:05.716209+0000","last_fullsized":"2024-02-18T16:23:05.716209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.715931+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:36:20.412885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.822998+0000","last_change":"2024-02-18T16:22:56.822998+0000","last_active":"2024-02-18T16:22:56.822998+0000","last_peered":"2024-02-18T16:22:56.822998+0000","last_clean":"2024-02-18T16:22:56.822998+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:56.822998+0000","last_undegraded":"2024-02-18T16:22:56.822998+0000","last_fullsized":"2024-02-18T16:22:56.822998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.822745+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:54.548170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.652614+0000","last_change":"2024-02-18T16:23:10.652614+0000","last_active":"2024-02-18T16:23:10.652614+0000","last_peered":"2024-02-18T16:23:10.652614+0000","last_clean":"2024-02-18T16:23:10.652614+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:23:10.652614+0000","last_undegraded":"2024-02-18T16:23:10.652614+0000","last_fullsized":"2024-02-18T16:23:10.652614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.652245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:14:12.784143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663411+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:22:48.663411+0000","last_peered":"2024-02-18T16:22:48.663411+0000","last_clean":"2024-02-18T16:22:48.663411+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:22:48.663411+0000","last_undegraded":"2024-02-18T16:22:48.663411+0000","last_fullsized":"2024-02-18T16:22:48.663411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.939764+0000","last_change":"2024-02-18T16:23:15.939764+0000","last_active":"2024-02-18T16:23:15.939764+0000","last_peered":"2024-02-18T16:23:15.939764+0000","last_clean":"2024-02-18T16:23:15.939764+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:23:15.939764+0000","last_undegraded":"2024-02-18T16:23:15.939764+0000","last_fullsized":"2024-02-18T16:23:15.939764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.939493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:39.219610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.969407+0000","last_change":"2024-02-18T16:23:36.969466+0000","last_active":"2024-02-18T16:23:36.969407+0000","last_peered":"2024-02-18T16:23:36.969407+0000","last_clean":"2024-02-18T16:23:36.969407+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:23:36.969407+0000","last_undegraded":"2024-02-18T16:23:36.969407+0000","last_fullsized":"2024-02-18T16:23:36.969407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.969188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.969188+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.969188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:30.087371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.713141+0000","last_change":"2024-02-18T16:23:04.713141+0000","last_active":"2024-02-18T16:23:04.713141+0000","last_peered":"2024-02-18T16:23:04.713141+0000","last_clean":"2024-02-18T16:23:04.713141+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:23:04.713141+0000","last_undegraded":"2024-02-18T16:23:04.713141+0000","last_fullsized":"2024-02-18T16:23:04.713141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.712885+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:17:24.627531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.770286+0000","last_change":"2024-02-18T16:23:00.770286+0000","last_active":"2024-02-18T16:23:00.770286+0000","last_peered":"2024-02-18T16:23:00.770286+0000","last_clean":"2024-02-18T16:23:00.770286+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:23:00.770286+0000","last_undegraded":"2024-02-18T16:23:00.770286+0000","last_fullsized":"2024-02-18T16:23:00.770286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.769987+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:07.581229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.449715+0000","last_change":"2024-02-18T16:22:52.449715+0000","last_active":"2024-02-18T16:22:52.449715+0000","last_peered":"2024-02-18T16:22:52.449715+0000","last_clean":"2024-02-18T16:22:52.449715+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:22:52.449715+0000","last_undegraded":"2024-02-18T16:22:52.449715+0000","last_fullsized":"2024-02-18T16:22:52.449715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.449362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:25.393949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663591+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:48.663591+0000","last_peered":"2024-02-18T16:22:48.663591+0000","last_clean":"2024-02-18T16:22:48.663591+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:48.663591+0000","last_undegraded":"2024-02-18T16:22:48.663591+0000","last_fullsized":"2024-02-18T16:22:48.663591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.762175+0000","last_change":"2024-02-18T16:23:13.762175+0000","last_active":"2024-02-18T16:23:13.762175+0000","last_peered":"2024-02-18T16:23:13.762175+0000","last_clean":"2024-02-18T16:23:13.762175+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:23:13.762175+0000","last_undegraded":"2024-02-18T16:23:13.762175+0000","last_fullsized":"2024-02-18T16:23:13.762175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.761893+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:09:58.046238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.821835+0000","last_change":"2024-02-18T16:23:26.821900+0000","last_active":"2024-02-18T16:23:26.821835+0000","last_peered":"2024-02-18T16:23:26.821835+0000","last_clean":"2024-02-18T16:23:26.821835+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:23:26.821835+0000","last_undegraded":"2024-02-18T16:23:26.821835+0000","last_fullsized":"2024-02-18T16:23:26.821835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:26.821602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:26.821602+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.821602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:14.692681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.090108+0000","last_change":"2024-02-18T16:23:17.090161+0000","last_active":"2024-02-18T16:23:17.090108+0000","last_peered":"2024-02-18T16:23:17.090108+0000","last_clean":"2024-02-18T16:23:17.090108+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:23:17.090108+0000","last_undegraded":"2024-02-18T16:23:17.090108+0000","last_fullsized":"2024-02-18T16:23:17.090108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.089913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.206720+0000","last_change":"2024-02-18T16:23:37.206785+0000","last_active":"2024-02-18T16:23:37.206720+0000","last_peered":"2024-02-18T16:23:37.206720+0000","last_clean":"2024-02-18T16:23:37.206720+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:23:37.206720+0000","last_undegraded":"2024-02-18T16:23:37.206720+0000","last_fullsized":"2024-02-18T16:23:37.206720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:37.206498+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:37.206498+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.206498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:44.876898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.695632+0000","last_change":"2024-02-18T16:23:06.695632+0000","last_active":"2024-02-18T16:23:06.695632+0000","last_peered":"2024-02-18T16:23:06.695632+0000","last_clean":"2024-02-18T16:23:06.695632+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:23:06.695632+0000","last_undegraded":"2024-02-18T16:23:06.695632+0000","last_fullsized":"2024-02-18T16:23:06.695632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.695361+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:14:59.478331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.802543+0000","last_change":"2024-02-18T16:23:43.802710+0000","last_active":"2024-02-18T16:23:43.802543+0000","last_peered":"2024-02-18T16:23:43.802543+0000","last_clean":"2024-02-18T16:23:43.802543+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:23:43.802543+0000","last_undegraded":"2024-02-18T16:23:43.802543+0000","last_fullsized":"2024-02-18T16:23:43.802543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:43.802187+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:43.802187+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.802187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:47.826817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.181619+0000","last_change":"2024-02-18T16:23:29.181684+0000","last_active":"2024-02-18T16:23:29.181619+0000","last_peered":"2024-02-18T16:23:29.181619+0000","last_clean":"2024-02-18T16:23:29.181619+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:23:29.181619+0000","last_undegraded":"2024-02-18T16:23:29.181619+0000","last_fullsized":"2024-02-18T16:23:29.181619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:29.181423+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:29.181423+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.181423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:22.839630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.178294+0000","last_change":"2024-02-18T16:23:30.178437+0000","last_active":"2024-02-18T16:23:30.178294+0000","last_peered":"2024-02-18T16:23:30.178294+0000","last_clean":"2024-02-18T16:23:30.178294+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:23:30.178294+0000","last_undegraded":"2024-02-18T16:23:30.178294+0000","last_fullsized":"2024-02-18T16:23:30.178294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.178051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.178051+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.178051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:30.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.185309+0000","last_change":"2024-02-18T16:23:13.185363+0000","last_active":"2024-02-18T16:23:13.185309+0000","last_peered":"2024-02-18T16:23:13.185309+0000","last_clean":"2024-02-18T16:23:13.185309+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:23:13.185309+0000","last_undegraded":"2024-02-18T16:23:13.185309+0000","last_fullsized":"2024-02-18T16:23:13.185309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.185106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:23.477010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.128487+0000","last_change":"2024-02-18T16:23:26.128566+0000","last_active":"2024-02-18T16:23:26.128487+0000","last_peered":"2024-02-18T16:23:26.128487+0000","last_clean":"2024-02-18T16:23:26.128487+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:23:26.128487+0000","last_undegraded":"2024-02-18T16:23:26.128487+0000","last_fullsized":"2024-02-18T16:23:26.128487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:26.128280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:26.128280+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.128280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:52:08.092199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.719359+0000","last_change":"2024-02-18T16:23:42.719359+0000","last_active":"2024-02-18T16:23:42.719359+0000","last_peered":"2024-02-18T16:23:42.719359+0000","last_clean":"2024-02-18T16:23:42.719359+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:23:42.719359+0000","last_undegraded":"2024-02-18T16:23:42.719359+0000","last_fullsized":"2024-02-18T16:23:42.719359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:42.719100+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:42.719100+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.719100+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:35.837283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.779164+0000","last_change":"2024-02-18T16:23:25.779308+0000","last_active":"2024-02-18T16:23:25.779164+0000","last_peered":"2024-02-18T16:23:25.779164+0000","last_clean":"2024-02-18T16:23:25.779164+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:23:25.779164+0000","last_undegraded":"2024-02-18T16:23:25.779164+0000","last_fullsized":"2024-02-18T16:23:25.779164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.778902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.778902+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.778902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:34:06.641181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.127529+0000","last_change":"2024-02-18T16:23:27.127580+0000","last_active":"2024-02-18T16:23:27.127529+0000","last_peered":"2024-02-18T16:23:27.127529+0000","last_clean":"2024-02-18T16:23:27.127529+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:23:27.127529+0000","last_undegraded":"2024-02-18T16:23:27.127529+0000","last_fullsized":"2024-02-18T16:23:27.127529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:27.127342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:27.127342+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.127342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:19.910312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.861175+0000","last_change":"2024-02-18T16:23:28.861242+0000","last_active":"2024-02-18T16:23:28.861175+0000","last_peered":"2024-02-18T16:23:28.861175+0000","last_clean":"2024-02-18T16:23:28.861175+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:23:28.861175+0000","last_undegraded":"2024-02-18T16:23:28.861175+0000","last_fullsized":"2024-02-18T16:23:28.861175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.860971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.860971+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.860971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:25.802445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.756466+0000","last_change":"2024-02-18T16:23:22.756531+0000","last_active":"2024-02-18T16:23:22.756466+0000","last_peered":"2024-02-18T16:23:22.756466+0000","last_clean":"2024-02-18T16:23:22.756466+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:23:22.756466+0000","last_undegraded":"2024-02-18T16:23:22.756466+0000","last_fullsized":"2024-02-18T16:23:22.756466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.756253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.697727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.165521+0000","last_change":"2024-02-18T16:23:28.165582+0000","last_active":"2024-02-18T16:23:28.165521+0000","last_peered":"2024-02-18T16:23:28.165521+0000","last_clean":"2024-02-18T16:23:28.165521+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:23:28.165521+0000","last_undegraded":"2024-02-18T16:23:28.165521+0000","last_fullsized":"2024-02-18T16:23:28.165521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.165316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.165316+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.165316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:34.370583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.779865+0000","last_change":"2024-02-18T16:23:28.779917+0000","last_active":"2024-02-18T16:23:28.779865+0000","last_peered":"2024-02-18T16:23:28.779865+0000","last_clean":"2024-02-18T16:23:28.779865+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:23:28.779865+0000","last_undegraded":"2024-02-18T16:23:28.779865+0000","last_fullsized":"2024-02-18T16:23:28.779865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.779667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.779667+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.779667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:00:05.304973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660368+0000","last_change":"2024-02-18T16:20:59.854340+0000","last_active":"2024-02-18T16:22:48.660368+0000","last_peered":"2024-02-18T16:22:48.660368+0000","last_clean":"2024-02-18T16:22:48.660368+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:22:48.660368+0000","last_undegraded":"2024-02-18T16:22:48.660368+0000","last_fullsized":"2024-02-18T16:22:48.660368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.737010+0000","last_change":"2024-02-18T16:23:27.737075+0000","last_active":"2024-02-18T16:23:27.737010+0000","last_peered":"2024-02-18T16:23:27.737010+0000","last_clean":"2024-02-18T16:23:27.737010+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:23:27.737010+0000","last_undegraded":"2024-02-18T16:23:27.737010+0000","last_fullsized":"2024-02-18T16:23:27.737010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:27.736808+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:27.736808+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.736808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:56:21.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.213659+0000","last_change":"2024-02-18T16:23:39.213721+0000","last_active":"2024-02-18T16:23:39.213659+0000","last_peered":"2024-02-18T16:23:39.213659+0000","last_clean":"2024-02-18T16:23:39.213659+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:23:39.213659+0000","last_undegraded":"2024-02-18T16:23:39.213659+0000","last_fullsized":"2024-02-18T16:23:39.213659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:39.213463+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:39.213463+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.213463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:27:12.046770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.212996+0000","last_change":"2024-02-18T16:23:12.212996+0000","last_active":"2024-02-18T16:23:12.212996+0000","last_peered":"2024-02-18T16:23:12.212996+0000","last_clean":"2024-02-18T16:23:12.212996+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:23:12.212996+0000","last_undegraded":"2024-02-18T16:23:12.212996+0000","last_fullsized":"2024-02-18T16:23:12.212996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.212729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.222143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.941128+0000","last_change":"2024-02-18T16:23:38.941193+0000","last_active":"2024-02-18T16:23:38.941128+0000","last_peered":"2024-02-18T16:23:38.941128+0000","last_clean":"2024-02-18T16:23:38.941128+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:23:38.941128+0000","last_undegraded":"2024-02-18T16:23:38.941128+0000","last_fullsized":"2024-02-18T16:23:38.941128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:38.940925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:38.940925+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.940925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:54.178081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.757093+0000","last_change":"2024-02-18T16:23:24.757151+0000","last_active":"2024-02-18T16:23:24.757093+0000","last_peered":"2024-02-18T16:23:24.757093+0000","last_clean":"2024-02-18T16:23:24.757093+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:23:24.757093+0000","last_undegraded":"2024-02-18T16:23:24.757093+0000","last_fullsized":"2024-02-18T16:23:24.757093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:24.756900+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:24.756900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.756900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:41.262573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.956312+0000","last_change":"2024-02-18T16:23:37.956378+0000","last_active":"2024-02-18T16:23:37.956312+0000","last_peered":"2024-02-18T16:23:37.956312+0000","last_clean":"2024-02-18T16:23:37.956312+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:23:37.956312+0000","last_undegraded":"2024-02-18T16:23:37.956312+0000","last_fullsized":"2024-02-18T16:23:37.956312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:37.956099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:37.956099+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.956099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:29.927127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.693758+0000","last_change":"2024-02-18T16:23:08.693758+0000","last_active":"2024-02-18T16:23:08.693758+0000","last_peered":"2024-02-18T16:23:08.693758+0000","last_clean":"2024-02-18T16:23:08.693758+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:23:08.693758+0000","last_undegraded":"2024-02-18T16:23:08.693758+0000","last_fullsized":"2024-02-18T16:23:08.693758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.693466+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:30:43.884820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.780137+0000","last_change":"2024-02-18T16:23:45.780294+0000","last_active":"2024-02-18T16:23:45.780137+0000","last_peered":"2024-02-18T16:23:45.780137+0000","last_clean":"2024-02-18T16:23:45.780137+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:23:45.780137+0000","last_undegraded":"2024-02-18T16:23:45.780137+0000","last_fullsized":"2024-02-18T16:23:45.780137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:45.779887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:45.779887+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.779887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:30.311975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.923282+0000","last_change":"2024-02-18T16:23:40.923356+0000","last_active":"2024-02-18T16:23:40.923282+0000","last_peered":"2024-02-18T16:23:40.923282+0000","last_clean":"2024-02-18T16:23:40.923282+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:23:40.923282+0000","last_undegraded":"2024-02-18T16:23:40.923282+0000","last_fullsized":"2024-02-18T16:23:40.923282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:40.923088+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:40.923088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.923088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:39.018071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660469+0000","last_change":"2024-02-18T16:20:59.872678+0000","last_active":"2024-02-18T16:22:48.660469+0000","last_peered":"2024-02-18T16:22:48.660469+0000","last_clean":"2024-02-18T16:22:48.660469+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:22:48.660469+0000","last_undegraded":"2024-02-18T16:22:48.660469+0000","last_fullsized":"2024-02-18T16:22:48.660469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.736468+0000","last_change":"2024-02-18T16:23:25.736525+0000","last_active":"2024-02-18T16:23:25.736468+0000","last_peered":"2024-02-18T16:23:25.736468+0000","last_clean":"2024-02-18T16:23:25.736468+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:23:25.736468+0000","last_undegraded":"2024-02-18T16:23:25.736468+0000","last_fullsized":"2024-02-18T16:23:25.736468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.736273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.736273+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.736273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:40:48.181060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.875104+0000","last_change":"2024-02-18T16:23:20.875163+0000","last_active":"2024-02-18T16:23:20.875104+0000","last_peered":"2024-02-18T16:23:20.875104+0000","last_clean":"2024-02-18T16:23:20.875104+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:23:20.875104+0000","last_undegraded":"2024-02-18T16:23:20.875104+0000","last_fullsized":"2024-02-18T16:23:20.875104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.874900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:20.030506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.750625+0000","last_change":"2024-02-18T16:23:18.750690+0000","last_active":"2024-02-18T16:23:18.750625+0000","last_peered":"2024-02-18T16:23:18.750625+0000","last_clean":"2024-02-18T16:23:18.750625+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:23:18.750625+0000","last_undegraded":"2024-02-18T16:23:18.750625+0000","last_fullsized":"2024-02-18T16:23:18.750625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.750433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:02.263592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660554+0000","last_change":"2024-02-18T16:20:59.872618+0000","last_active":"2024-02-18T16:22:48.660554+0000","last_peered":"2024-02-18T16:22:48.660554+0000","last_clean":"2024-02-18T16:22:48.660554+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:22:48.660554+0000","last_undegraded":"2024-02-18T16:22:48.660554+0000","last_fullsized":"2024-02-18T16:22:48.660554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.660560+0000","last_change":"2024-02-18T16:20:59.854681+0000","last_active":"2024-02-18T16:22:48.660560+0000","last_peered":"2024-02-18T16:22:48.660560+0000","last_clean":"2024-02-18T16:22:48.660560+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:22:48.660560+0000","last_undegraded":"2024-02-18T16:22:48.660560+0000","last_fullsized":"2024-02-18T16:22:48.660560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:20:58.788895+0000","last_clean_scrub_stamp":"2024-02-18T16:20:58.788895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.165328+0000","last_change":"2024-02-18T16:23:14.165328+0000","last_active":"2024-02-18T16:23:14.165328+0000","last_peered":"2024-02-18T16:23:14.165328+0000","last_clean":"2024-02-18T16:23:14.165328+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:23:14.165328+0000","last_undegraded":"2024-02-18T16:23:14.165328+0000","last_fullsized":"2024-02-18T16:23:14.165328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.165073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:13.320679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.237166+0000","last_change":"2024-02-18T16:23:40.237226+0000","last_active":"2024-02-18T16:23:40.237166+0000","last_peered":"2024-02-18T16:23:40.237166+0000","last_clean":"2024-02-18T16:23:40.237166+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:23:40.237166+0000","last_undegraded":"2024-02-18T16:23:40.237166+0000","last_fullsized":"2024-02-18T16:23:40.237166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.236966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.236966+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.236966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:04.224436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.757028+0000","last_change":"2024-02-18T16:23:26.757028+0000","last_active":"2024-02-18T16:23:26.757028+0000","last_peered":"2024-02-18T16:23:26.757028+0000","last_clean":"2024-02-18T16:23:26.757028+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:23:26.757028+0000","last_undegraded":"2024-02-18T16:23:26.757028+0000","last_fullsized":"2024-02-18T16:23:26.757028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:26.756605+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:26.756605+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.756605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:13:18.607706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1422,"ondisk_log_size":1422,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705705,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.88,"15min":0.88},"last":0.755},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.55900000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76400000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.77100000000000002,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.628},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.48499999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.77900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Feb 18 16:22:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.52200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80600000000000005,"5min":1.2,"15min":1.2},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.50800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69099999999999995,"5min":1.319,"15min":1.319},"last":0.51200000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705705,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.54800000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.80700000000000005,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76700000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.1599999999999999,"15min":1.26},"min":{"1min":0.38800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.68400000000000005,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.96299999999999997,"15min":1.0289999999999999},"min":{"1min":0.29999999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.71999999999999997,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Feb 18 16:22:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.374,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.85999999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":1.5589999999999999,"15min":1.7010000000000001},"min":{"1min":0.46700000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81599999999999995,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.67900000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.52500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.625,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81499999999999995,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.46999999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.628},{"interface":"front","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78300000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.67300000000000004}]},{"osd":3,"last update":"Sun Feb 18 16:22:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.47699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.55500000000000005,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82899999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.79300000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80600000000000005,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93200000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Sun Feb 18 16:22:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.76800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:23:50.272 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.273 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.273 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.274 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.274 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.274 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.275 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.275 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.275 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.275 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.275 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.276 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.276 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-18T16:20:50.754986+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=50, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.276 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.277 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.277 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.277 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.277 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.278 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.278 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.278 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.279 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.279 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.279 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.279 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-18T16:20:58.788895+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=20, tm_sec=58, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:23:50.280 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-18T16:24:10.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:24:10.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a3694640 1 Processor -- start 2024-02-18T16:24:10.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a3694640 1 -- start start 2024-02-18T16:24:10.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a3694640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f189c1290f0 0x7f189c12c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:10.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a3694640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c095ee0 con 0x7f189c128d10 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a3694640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c096320 con 0x7f189c1290f0 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a0c2f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f189c1290f0 0x7f189c12c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a1430640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f189c128d10 0x7f189c12bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39402/0 (socket says 172.21.15.80:39402) 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.402+0000 7f18a0c2f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f189c1290f0 0x7f189c12c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35324/0 (socket says 172.21.15.80:35324) 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a1430640 1 -- 172.21.15.80:0/3839971438 learned_addr learned my addr 172.21.15.80:0/3839971438 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a0c2f640 1 -- 172.21.15.80:0/3839971438 >> v1:172.21.15.80:6789/0 conn(0x7f189c128d10 legacy=0x7f189c12bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a0c2f640 1 -- 172.21.15.80:0/3839971438 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c128620 con 0x7f189c1290f0 2024-02-18T16:24:10.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f1893fff640 1 -- 172.21.15.80:0/3839971438 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183291792 0 0) 0x7f189c095ee0 con 0x7f189c128d10 2024-02-18T16:24:10.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a0c2f640 1 --2- 172.21.15.80:0/3839971438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c1290f0 0x7f189c12c230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f188c009740 tx=0x7f188c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486c44bb5678dff0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:10.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f1893fff640 1 -- 172.21.15.80:0/3839971438 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188c0ac530 con 0x7f189c1290f0 2024-02-18T16:24:10.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f1893fff640 1 -- 172.21.15.80:0/3839971438 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0a8050 con 0x7f189c1290f0 2024-02-18T16:24:10.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f1893fff640 1 -- 172.21.15.80:0/3839971438 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188c0ac7e0 con 0x7f189c1290f0 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 -- 172.21.15.80:0/3839971438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c1290f0 msgr2=0x7f189c12c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 --2- 172.21.15.80:0/3839971438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c1290f0 0x7f189c12c230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f188c009740 tx=0x7f188c01c490 comp rx=0 tx=0).stop 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 -- 172.21.15.80:0/3839971438 shutdown_connections 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 --2- 172.21.15.80:0/3839971438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c1290f0 0x7f189c12c230 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 -- 172.21.15.80:0/3839971438 >> 172.21.15.80:0/3839971438 conn(0x7f189c09a2f0 msgr2=0x7f189c09a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 -- 172.21.15.80:0/3839971438 shutdown_connections 2024-02-18T16:24:10.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.406+0000 7f18a3694640 1 -- 172.21.15.80:0/3839971438 wait complete. 2024-02-18T16:24:10.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 Processor -- start 2024-02-18T16:24:10.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 -- start start 2024-02-18T16:24:10.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 0x7f189c1c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c131710 con 0x7f189c128d10 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a1430640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 0x7f189c1c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a1430640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 0x7f189c1c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35340/0 (socket says 172.21.15.80:35340) 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a1430640 1 -- 172.21.15.80:0/779319873 learned_addr learned my addr 172.21.15.80:0/779319873 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a1430640 1 -- 172.21.15.80:0/779319873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009420 con 0x7f189c128d10 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a1430640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 0x7f189c1c3010 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f189800c420 tx=0x7f189800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:10.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18980074d0 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898007630 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1898004960 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c0980b0 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c130450 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c067e00 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1898004ac0 con 0x7f189c128d10 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f1891ffb640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1880035a10 0x7f1880037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:10.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f1898047dc0 con 0x7f189c128d10 2024-02-18T16:24:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a0c2f640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1880035a10 0x7f1880037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:10.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.410+0000 7f18a0c2f640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1880035a10 0x7f1880037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f188c0ae000 tx=0x7f188c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:10.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.414+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f189801abc0 con 0x7f189c128d10 2024-02-18T16:24:10.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.566+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f189c09bcd0 con 0x7f1880035a10 2024-02-18T16:24:10.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.614+0000 7f1891ffb640 1 -- 172.21.15.80:0/779319873 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673927 (secure 0 0 0) 0x7f189c09bcd0 con 0x7f1880035a10 2024-02-18T16:24:10.627 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:24:10.633 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1880035a10 msgr2=0x7f1880037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1880035a10 0x7f1880037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f188c0ae000 tx=0x7f188c0a7000 comp rx=0 tx=0).stop 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 msgr2=0x7f189c1c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 0x7f189c1c3010 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f189800c420 tx=0x7f189800c8e0 comp rx=0 tx=0).stop 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 shutdown_connections 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f1880035a10 0x7f1880037ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 --2- 172.21.15.80:0/779319873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f189c128d10 0x7f189c1c3010 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:10.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 >> 172.21.15.80:0/779319873 conn(0x7f189c09a2f0 msgr2=0x7f189c121940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:24:10.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 shutdown_connections 2024-02-18T16:24:10.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:10.622+0000 7f18a3694640 1 -- 172.21.15.80:0/779319873 wait complete. 2024-02-18T16:24:10.646 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-02-18T16:24:09.850543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3970,"ondisk_log_size":3970,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152472,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334888,"statfs":{"total":386547056640,"available":386390925312,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005964"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.916811+0000","last_change":"2024-02-18T16:23:22.916928+0000","last_active":"2024-02-18T16:23:22.916811+0000","last_peered":"2024-02-18T16:23:22.916811+0000","last_clean":"2024-02-18T16:23:22.916811+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:23:22.916811+0000","last_undegraded":"2024-02-18T16:23:22.916811+0000","last_fullsized":"2024-02-18T16:23:22.916811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.916517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:21.117744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.750600+0000","last_change":"2024-02-18T16:23:16.750600+0000","last_active":"2024-02-18T16:23:16.750600+0000","last_peered":"2024-02-18T16:23:16.750600+0000","last_clean":"2024-02-18T16:23:16.750600+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:23:16.750600+0000","last_undegraded":"2024-02-18T16:23:16.750600+0000","last_fullsized":"2024-02-18T16:23:16.750600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.750307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.951534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.161692+0000","last_change":"2024-02-18T16:23:20.161755+0000","last_active":"2024-02-18T16:23:20.161692+0000","last_peered":"2024-02-18T16:23:20.161692+0000","last_clean":"2024-02-18T16:23:20.161692+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:23:20.161692+0000","last_undegraded":"2024-02-18T16:23:20.161692+0000","last_fullsized":"2024-02-18T16:23:20.161692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.161465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:08.032544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.737788+0000","last_change":"2024-02-18T16:23:23.737788+0000","last_active":"2024-02-18T16:23:23.737788+0000","last_peered":"2024-02-18T16:23:23.737788+0000","last_clean":"2024-02-18T16:23:23.737788+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:23:23.737788+0000","last_undegraded":"2024-02-18T16:23:23.737788+0000","last_fullsized":"2024-02-18T16:23:23.737788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.737502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:54.805702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.730979+0000","last_change":"2024-02-18T16:23:41.731135+0000","last_active":"2024-02-18T16:23:41.730979+0000","last_peered":"2024-02-18T16:23:41.730979+0000","last_clean":"2024-02-18T16:23:41.730979+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:23:41.730979+0000","last_undegraded":"2024-02-18T16:23:41.730979+0000","last_fullsized":"2024-02-18T16:23:41.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:41.730728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:41.730728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.730728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:09:17.826198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.635085+0000","last_change":"2024-02-18T16:23:09.635085+0000","last_active":"2024-02-18T16:23:09.635085+0000","last_peered":"2024-02-18T16:23:09.635085+0000","last_clean":"2024-02-18T16:23:09.635085+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:23:09.635085+0000","last_undegraded":"2024-02-18T16:23:09.635085+0000","last_fullsized":"2024-02-18T16:23:09.635085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.634784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:09.758604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.731501+0000","last_change":"2024-02-18T16:23:33.731558+0000","last_active":"2024-02-18T16:23:33.731501+0000","last_peered":"2024-02-18T16:23:33.731501+0000","last_clean":"2024-02-18T16:23:33.731501+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:23:33.731501+0000","last_undegraded":"2024-02-18T16:23:33.731501+0000","last_fullsized":"2024-02-18T16:23:33.731501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.731298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.731298+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.731298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:26.514268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.751173+0000","last_change":"2024-02-18T16:23:03.751173+0000","last_active":"2024-02-18T16:23:03.751173+0000","last_peered":"2024-02-18T16:23:03.751173+0000","last_clean":"2024-02-18T16:23:03.751173+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:23:03.751173+0000","last_undegraded":"2024-02-18T16:23:03.751173+0000","last_fullsized":"2024-02-18T16:23:03.751173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.750777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:02.603622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.754228+0000","last_change":"2024-02-18T16:23:46.754303+0000","last_active":"2024-02-18T16:23:46.754228+0000","last_peered":"2024-02-18T16:23:46.754228+0000","last_clean":"2024-02-18T16:23:46.754228+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:23:46.754228+0000","last_undegraded":"2024-02-18T16:23:46.754228+0000","last_fullsized":"2024-02-18T16:23:46.754228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:46.753986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:46.753986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.753986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:21:21.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.783795+0000","last_change":"2024-02-18T16:23:17.783856+0000","last_active":"2024-02-18T16:23:17.783795+0000","last_peered":"2024-02-18T16:23:17.783795+0000","last_clean":"2024-02-18T16:23:17.783795+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:23:17.783795+0000","last_undegraded":"2024-02-18T16:23:17.783795+0000","last_fullsized":"2024-02-18T16:23:17.783795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.783609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.839510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.821387+0000","last_change":"2024-02-18T16:23:30.821444+0000","last_active":"2024-02-18T16:23:30.821387+0000","last_peered":"2024-02-18T16:23:30.821387+0000","last_clean":"2024-02-18T16:23:30.821387+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:23:30.821387+0000","last_undegraded":"2024-02-18T16:23:30.821387+0000","last_fullsized":"2024-02-18T16:23:30.821387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.821199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.821199+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.821199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:29.674043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.784360+0000","last_change":"2024-02-18T16:23:22.784418+0000","last_active":"2024-02-18T16:23:22.784360+0000","last_peered":"2024-02-18T16:23:22.784360+0000","last_clean":"2024-02-18T16:23:22.784360+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:23:22.784360+0000","last_undegraded":"2024-02-18T16:23:22.784360+0000","last_fullsized":"2024-02-18T16:23:22.784360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.784173+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:14.537344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:03.815631+0000","last_change":"2024-02-18T16:24:03.815706+0000","last_active":"2024-02-18T16:24:03.815631+0000","last_peered":"2024-02-18T16:24:03.815631+0000","last_clean":"2024-02-18T16:24:03.815631+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:24:03.815631+0000","last_undegraded":"2024-02-18T16:24:03.815631+0000","last_fullsized":"2024-02-18T16:24:03.815631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:24:03.815384+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:24:03.815384+0000","last_clean_scrub_stamp":"2024-02-18T16:24:03.815384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:07.096890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.991352+0000","last_change":"2024-02-18T16:23:13.991423+0000","last_active":"2024-02-18T16:23:13.991352+0000","last_peered":"2024-02-18T16:23:13.991352+0000","last_clean":"2024-02-18T16:23:13.991352+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:23:13.991352+0000","last_undegraded":"2024-02-18T16:23:13.991352+0000","last_fullsized":"2024-02-18T16:23:13.991352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.991156+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:26.734895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.213484+0000","last_change":"2024-02-18T16:23:38.213630+0000","last_active":"2024-02-18T16:23:38.213484+0000","last_peered":"2024-02-18T16:23:38.213484+0000","last_clean":"2024-02-18T16:23:38.213484+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:23:38.213484+0000","last_undegraded":"2024-02-18T16:23:38.213484+0000","last_fullsized":"2024-02-18T16:23:38.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:38.213236+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:38.213236+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.213236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:34:57.885442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.883579+0000","last_change":"2024-02-18T16:23:21.883639+0000","last_active":"2024-02-18T16:23:21.883579+0000","last_peered":"2024-02-18T16:23:21.883579+0000","last_clean":"2024-02-18T16:23:21.883579+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:23:21.883579+0000","last_undegraded":"2024-02-18T16:23:21.883579+0000","last_fullsized":"2024-02-18T16:23:21.883579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.883366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:05.625702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.746411+0000","last_change":"2024-02-18T16:23:37.746574+0000","last_active":"2024-02-18T16:23:37.746411+0000","last_peered":"2024-02-18T16:23:37.746411+0000","last_clean":"2024-02-18T16:23:37.746411+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:23:37.746411+0000","last_undegraded":"2024-02-18T16:23:37.746411+0000","last_fullsized":"2024-02-18T16:23:37.746411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:37.746133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:37.746133+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.746133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:33:52.796407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.808047+0000","last_change":"2024-02-18T16:23:27.808113+0000","last_active":"2024-02-18T16:23:27.808047+0000","last_peered":"2024-02-18T16:23:27.808047+0000","last_clean":"2024-02-18T16:23:27.808047+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:23:27.808047+0000","last_undegraded":"2024-02-18T16:23:27.808047+0000","last_fullsized":"2024-02-18T16:23:27.808047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:27.807847+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:27.807847+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.807847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:20.590817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.727308+0000","last_change":"2024-02-18T16:23:19.727308+0000","last_active":"2024-02-18T16:23:19.727308+0000","last_peered":"2024-02-18T16:23:19.727308+0000","last_clean":"2024-02-18T16:23:19.727308+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:23:19.727308+0000","last_undegraded":"2024-02-18T16:23:19.727308+0000","last_fullsized":"2024-02-18T16:23:19.727308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.727029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:34:32.149408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.946153+0000","last_change":"2024-02-18T16:23:16.946153+0000","last_active":"2024-02-18T16:23:16.946153+0000","last_peered":"2024-02-18T16:23:16.946153+0000","last_clean":"2024-02-18T16:23:16.946153+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:23:16.946153+0000","last_undegraded":"2024-02-18T16:23:16.946153+0000","last_fullsized":"2024-02-18T16:23:16.946153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.945824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:28.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.715031+0000","last_change":"2024-02-18T16:23:09.715031+0000","last_active":"2024-02-18T16:23:09.715031+0000","last_peered":"2024-02-18T16:23:09.715031+0000","last_clean":"2024-02-18T16:23:09.715031+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:23:09.715031+0000","last_undegraded":"2024-02-18T16:23:09.715031+0000","last_fullsized":"2024-02-18T16:23:09.715031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.714755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.994872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.725548+0000","last_change":"2024-02-18T16:23:23.725548+0000","last_active":"2024-02-18T16:23:23.725548+0000","last_peered":"2024-02-18T16:23:23.725548+0000","last_clean":"2024-02-18T16:23:23.725548+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:23:23.725548+0000","last_undegraded":"2024-02-18T16:23:23.725548+0000","last_fullsized":"2024-02-18T16:23:23.725548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.725287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:05:10.067817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.180481+0000","last_change":"2024-02-18T16:23:31.180547+0000","last_active":"2024-02-18T16:23:31.180481+0000","last_peered":"2024-02-18T16:23:31.180481+0000","last_clean":"2024-02-18T16:23:31.180481+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:23:31.180481+0000","last_undegraded":"2024-02-18T16:23:31.180481+0000","last_fullsized":"2024-02-18T16:23:31.180481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:31.180290+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:31.180290+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.180290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:45:14.817248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.818695+0000","last_change":"2024-02-18T16:23:29.818755+0000","last_active":"2024-02-18T16:23:29.818695+0000","last_peered":"2024-02-18T16:23:29.818695+0000","last_clean":"2024-02-18T16:23:29.818695+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:23:29.818695+0000","last_undegraded":"2024-02-18T16:23:29.818695+0000","last_fullsized":"2024-02-18T16:23:29.818695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:29.818491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:29.818491+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.818491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:16:34.224985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.884583+0000","last_change":"2024-02-18T16:23:23.884704+0000","last_active":"2024-02-18T16:23:23.884583+0000","last_peered":"2024-02-18T16:23:23.884583+0000","last_clean":"2024-02-18T16:23:23.884583+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:23:23.884583+0000","last_undegraded":"2024-02-18T16:23:23.884583+0000","last_fullsized":"2024-02-18T16:23:23.884583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.884277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.884277+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.884277+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:07.940178+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.136656+0000","last_change":"2024-02-18T16:23:24.136726+0000","last_active":"2024-02-18T16:23:24.136656+0000","last_peered":"2024-02-18T16:23:24.136656+0000","last_clean":"2024-02-18T16:23:24.136656+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:23:24.136656+0000","last_undegraded":"2024-02-18T16:23:24.136656+0000","last_fullsized":"2024-02-18T16:23:24.136656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:24.136457+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:24.136457+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.136457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:22.989302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.728657+0000","last_change":"2024-02-18T16:23:20.728657+0000","last_active":"2024-02-18T16:23:20.728657+0000","last_peered":"2024-02-18T16:23:20.728657+0000","last_clean":"2024-02-18T16:23:20.728657+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:23:20.728657+0000","last_undegraded":"2024-02-18T16:23:20.728657+0000","last_fullsized":"2024-02-18T16:23:20.728657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.728399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:20.792298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:53.816802+0000","last_change":"2024-02-18T16:23:53.816869+0000","last_active":"2024-02-18T16:23:53.816802+0000","last_peered":"2024-02-18T16:23:53.816802+0000","last_clean":"2024-02-18T16:23:53.816802+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:23:53.816802+0000","last_undegraded":"2024-02-18T16:23:53.816802+0000","last_fullsized":"2024-02-18T16:23:53.816802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:53.816602+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:53.816602+0000","last_clean_scrub_stamp":"2024-02-18T16:23:53.816602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:51:40.691240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.923769+0000","last_change":"2024-02-18T16:23:41.923837+0000","last_active":"2024-02-18T16:23:41.923769+0000","last_peered":"2024-02-18T16:23:41.923769+0000","last_clean":"2024-02-18T16:23:41.923769+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:23:41.923769+0000","last_undegraded":"2024-02-18T16:23:41.923769+0000","last_fullsized":"2024-02-18T16:23:41.923769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:41.923509+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:41.923509+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.923509+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:32:12.867890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.708169+0000","last_change":"2024-02-18T16:23:29.708258+0000","last_active":"2024-02-18T16:23:29.708169+0000","last_peered":"2024-02-18T16:23:29.708169+0000","last_clean":"2024-02-18T16:23:29.708169+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:23:29.708169+0000","last_undegraded":"2024-02-18T16:23:29.708169+0000","last_fullsized":"2024-02-18T16:23:29.708169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:29.707944+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:29.707944+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.707944+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:23.851740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:48.797737+0000","last_change":"2024-02-18T16:23:48.797805+0000","last_active":"2024-02-18T16:23:48.797737+0000","last_peered":"2024-02-18T16:23:48.797737+0000","last_clean":"2024-02-18T16:23:48.797737+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:23:48.797737+0000","last_undegraded":"2024-02-18T16:23:48.797737+0000","last_fullsized":"2024-02-18T16:23:48.797737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:48.797530+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:48.797530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:48.797530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:28:04.985948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.907189+0000","last_change":"2024-02-18T16:22:49.907189+0000","last_active":"2024-02-18T16:22:49.907189+0000","last_peered":"2024-02-18T16:22:49.907189+0000","last_clean":"2024-02-18T16:22:49.907189+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:22:49.907189+0000","last_undegraded":"2024-02-18T16:22:49.907189+0000","last_fullsized":"2024-02-18T16:22:49.907189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.906822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:01.255503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.689035+0000","last_change":"2024-02-18T16:23:15.689035+0000","last_active":"2024-02-18T16:23:15.689035+0000","last_peered":"2024-02-18T16:23:15.689035+0000","last_clean":"2024-02-18T16:23:15.689035+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:23:15.689035+0000","last_undegraded":"2024-02-18T16:23:15.689035+0000","last_fullsized":"2024-02-18T16:23:15.689035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.688708+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:06.486435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.716776+0000","last_change":"2024-02-18T16:23:10.716776+0000","last_active":"2024-02-18T16:23:10.716776+0000","last_peered":"2024-02-18T16:23:10.716776+0000","last_clean":"2024-02-18T16:23:10.716776+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:23:10.716776+0000","last_undegraded":"2024-02-18T16:23:10.716776+0000","last_fullsized":"2024-02-18T16:23:10.716776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.716530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:22.065211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.931479+0000","last_change":"2024-02-18T16:23:42.931545+0000","last_active":"2024-02-18T16:23:42.931479+0000","last_peered":"2024-02-18T16:23:42.931479+0000","last_clean":"2024-02-18T16:23:42.931479+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:23:42.931479+0000","last_undegraded":"2024-02-18T16:23:42.931479+0000","last_fullsized":"2024-02-18T16:23:42.931479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:42.931280+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:42.931280+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.931280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:13.999480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.649753+0000","last_change":"2024-02-18T16:23:07.649753+0000","last_active":"2024-02-18T16:23:07.649753+0000","last_peered":"2024-02-18T16:23:07.649753+0000","last_clean":"2024-02-18T16:23:07.649753+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:23:07.649753+0000","last_undegraded":"2024-02-18T16:23:07.649753+0000","last_fullsized":"2024-02-18T16:23:07.649753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.649419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:13.854686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.779853+0000","last_change":"2024-02-18T16:23:31.780013+0000","last_active":"2024-02-18T16:23:31.779853+0000","last_peered":"2024-02-18T16:23:31.779853+0000","last_clean":"2024-02-18T16:23:31.779853+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:23:31.779853+0000","last_undegraded":"2024-02-18T16:23:31.779853+0000","last_fullsized":"2024-02-18T16:23:31.779853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:31.779619+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:31.779619+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.779619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:39.346374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.257769+0000","last_change":"2024-02-18T16:23:10.257769+0000","last_active":"2024-02-18T16:23:10.257769+0000","last_peered":"2024-02-18T16:23:10.257769+0000","last_clean":"2024-02-18T16:23:10.257769+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:23:10.257769+0000","last_undegraded":"2024-02-18T16:23:10.257769+0000","last_fullsized":"2024-02-18T16:23:10.257769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.257505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:21.606186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.663488+0000","last_change":"2024-02-18T16:22:55.663488+0000","last_active":"2024-02-18T16:22:55.663488+0000","last_peered":"2024-02-18T16:22:55.663488+0000","last_clean":"2024-02-18T16:22:55.663488+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:22:55.663488+0000","last_undegraded":"2024-02-18T16:22:55.663488+0000","last_fullsized":"2024-02-18T16:22:55.663488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.663204+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:33.049677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.622314+0000","last_change":"2024-02-18T16:23:02.622314+0000","last_active":"2024-02-18T16:23:02.622314+0000","last_peered":"2024-02-18T16:23:02.622314+0000","last_clean":"2024-02-18T16:23:02.622314+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:23:02.622314+0000","last_undegraded":"2024-02-18T16:23:02.622314+0000","last_fullsized":"2024-02-18T16:23:02.622314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.622050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.772173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.264439+0000","last_change":"2024-02-18T16:23:45.264499+0000","last_active":"2024-02-18T16:23:45.264439+0000","last_peered":"2024-02-18T16:23:45.264439+0000","last_clean":"2024-02-18T16:23:45.264439+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:23:45.264439+0000","last_undegraded":"2024-02-18T16:23:45.264439+0000","last_fullsized":"2024-02-18T16:23:45.264439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:45.264234+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:45.264234+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.264234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:58:55.811553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'12","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.724846+0000","last_change":"2024-02-18T16:23:43.724846+0000","last_active":"2024-02-18T16:23:43.724846+0000","last_peered":"2024-02-18T16:23:43.724846+0000","last_clean":"2024-02-18T16:23:43.724846+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:23:43.724846+0000","last_undegraded":"2024-02-18T16:23:43.724846+0000","last_fullsized":"2024-02-18T16:23:43.724846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-18T16:23:43.724551+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-18T16:23:43.724551+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.724551+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:51.394951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:04.791474+0000","last_change":"2024-02-18T16:24:04.791544+0000","last_active":"2024-02-18T16:24:04.791474+0000","last_peered":"2024-02-18T16:24:04.791474+0000","last_clean":"2024-02-18T16:24:04.791474+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:24:04.791474+0000","last_undegraded":"2024-02-18T16:24:04.791474+0000","last_fullsized":"2024-02-18T16:24:04.791474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:04.791241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:04.791241+0000","last_clean_scrub_stamp":"2024-02-18T16:24:04.791241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:20:51.203169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.707099+0000","last_change":"2024-02-18T16:23:41.707099+0000","last_active":"2024-02-18T16:23:41.707099+0000","last_peered":"2024-02-18T16:23:41.707099+0000","last_clean":"2024-02-18T16:23:41.707099+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:23:41.707099+0000","last_undegraded":"2024-02-18T16:23:41.707099+0000","last_fullsized":"2024-02-18T16:23:41.707099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:41.706854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:41.706854+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.706854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:32.504580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.873532+0000","last_change":"2024-02-18T16:22:56.873532+0000","last_active":"2024-02-18T16:22:56.873532+0000","last_peered":"2024-02-18T16:22:56.873532+0000","last_clean":"2024-02-18T16:22:56.873532+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:22:56.873532+0000","last_undegraded":"2024-02-18T16:22:56.873532+0000","last_fullsized":"2024-02-18T16:22:56.873532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.873112+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:36.931560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.812587+0000","last_change":"2024-02-18T16:23:20.812587+0000","last_active":"2024-02-18T16:23:20.812587+0000","last_peered":"2024-02-18T16:23:20.812587+0000","last_clean":"2024-02-18T16:23:20.812587+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:23:20.812587+0000","last_undegraded":"2024-02-18T16:23:20.812587+0000","last_fullsized":"2024-02-18T16:23:20.812587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.812325+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:19:44.799795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.687518+0000","last_change":"2024-02-18T16:23:38.687518+0000","last_active":"2024-02-18T16:23:38.687518+0000","last_peered":"2024-02-18T16:23:38.687518+0000","last_clean":"2024-02-18T16:23:38.687518+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:23:38.687518+0000","last_undegraded":"2024-02-18T16:23:38.687518+0000","last_fullsized":"2024-02-18T16:23:38.687518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:38.687161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:38.687161+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.687161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:53.241419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.125274+0000","last_change":"2024-02-18T16:23:25.125274+0000","last_active":"2024-02-18T16:23:25.125274+0000","last_peered":"2024-02-18T16:23:25.125274+0000","last_clean":"2024-02-18T16:23:25.125274+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:23:25.125274+0000","last_undegraded":"2024-02-18T16:23:25.125274+0000","last_fullsized":"2024-02-18T16:23:25.125274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:25.125006+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:25.125006+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.125006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:32.691761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.777566+0000","last_change":"2024-02-18T16:23:31.777666+0000","last_active":"2024-02-18T16:23:31.777566+0000","last_peered":"2024-02-18T16:23:31.777566+0000","last_clean":"2024-02-18T16:23:31.777566+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:23:31.777566+0000","last_undegraded":"2024-02-18T16:23:31.777566+0000","last_fullsized":"2024-02-18T16:23:31.777566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:31.777340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:31.777340+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.777340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:24.754848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.661923+0000","last_change":"2024-02-18T16:21:40.960144+0000","last_active":"2024-02-18T16:22:48.661923+0000","last_peered":"2024-02-18T16:22:48.661923+0000","last_clean":"2024-02-18T16:22:48.661923+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:22:48.661923+0000","last_undegraded":"2024-02-18T16:22:48.661923+0000","last_fullsized":"2024-02-18T16:22:48.661923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:02.815768+0000","last_clean_scrub_stamp":"2024-02-18T16:21:02.815768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.859501+0000","last_change":"2024-02-18T16:22:58.859501+0000","last_active":"2024-02-18T16:22:58.859501+0000","last_peered":"2024-02-18T16:22:58.859501+0000","last_clean":"2024-02-18T16:22:58.859501+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:58.859501+0000","last_undegraded":"2024-02-18T16:22:58.859501+0000","last_fullsized":"2024-02-18T16:22:58.859501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.859048+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:31.803635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":332,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.257854+0000","last_change":"2024-02-18T16:23:07.257854+0000","last_active":"2024-02-18T16:23:07.257854+0000","last_peered":"2024-02-18T16:23:07.257854+0000","last_clean":"2024-02-18T16:23:07.257854+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:23:07.257854+0000","last_undegraded":"2024-02-18T16:23:07.257854+0000","last_fullsized":"2024-02-18T16:23:07.257854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.257430+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.001169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.733976+0000","last_change":"2024-02-18T16:23:34.734036+0000","last_active":"2024-02-18T16:23:34.733976+0000","last_peered":"2024-02-18T16:23:34.733976+0000","last_clean":"2024-02-18T16:23:34.733976+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:23:34.733976+0000","last_undegraded":"2024-02-18T16:23:34.733976+0000","last_fullsized":"2024-02-18T16:23:34.733976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.733782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.733782+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.733782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:31:17.679963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.677698+0000","last_change":"2024-02-18T16:23:36.677830+0000","last_active":"2024-02-18T16:23:36.677698+0000","last_peered":"2024-02-18T16:23:36.677698+0000","last_clean":"2024-02-18T16:23:36.677698+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:23:36.677698+0000","last_undegraded":"2024-02-18T16:23:36.677698+0000","last_fullsized":"2024-02-18T16:23:36.677698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.677442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.677442+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.677442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:36.801262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.628366+0000","last_change":"2024-02-18T16:23:01.628366+0000","last_active":"2024-02-18T16:23:01.628366+0000","last_peered":"2024-02-18T16:23:01.628366+0000","last_clean":"2024-02-18T16:23:01.628366+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:23:01.628366+0000","last_undegraded":"2024-02-18T16:23:01.628366+0000","last_fullsized":"2024-02-18T16:23:01.628366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.628086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:49:06.387306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.868488+0000","last_change":"2024-02-18T16:23:00.868488+0000","last_active":"2024-02-18T16:23:00.868488+0000","last_peered":"2024-02-18T16:23:00.868488+0000","last_clean":"2024-02-18T16:23:00.868488+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:23:00.868488+0000","last_undegraded":"2024-02-18T16:23:00.868488+0000","last_fullsized":"2024-02-18T16:23:00.868488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.868066+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:38.254540+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.249222+0000","last_change":"2024-02-18T16:23:11.249222+0000","last_active":"2024-02-18T16:23:11.249222+0000","last_peered":"2024-02-18T16:23:11.249222+0000","last_clean":"2024-02-18T16:23:11.249222+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:23:11.249222+0000","last_undegraded":"2024-02-18T16:23:11.249222+0000","last_fullsized":"2024-02-18T16:23:11.249222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.248957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.900091+0000","last_change":"2024-02-18T16:23:11.900091+0000","last_active":"2024-02-18T16:23:11.900091+0000","last_peered":"2024-02-18T16:23:11.900091+0000","last_clean":"2024-02-18T16:23:11.900091+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:23:11.900091+0000","last_undegraded":"2024-02-18T16:23:11.900091+0000","last_fullsized":"2024-02-18T16:23:11.900091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.899800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:40.591864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.803942+0000","last_change":"2024-02-18T16:23:30.804000+0000","last_active":"2024-02-18T16:23:30.803942+0000","last_peered":"2024-02-18T16:23:30.803942+0000","last_clean":"2024-02-18T16:23:30.803942+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:23:30.803942+0000","last_undegraded":"2024-02-18T16:23:30.803942+0000","last_fullsized":"2024-02-18T16:23:30.803942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.803736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.803736+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.803736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:32:08.517864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.779880+0000","last_change":"2024-02-18T16:23:32.779936+0000","last_active":"2024-02-18T16:23:32.779880+0000","last_peered":"2024-02-18T16:23:32.779880+0000","last_clean":"2024-02-18T16:23:32.779880+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:23:32.779880+0000","last_undegraded":"2024-02-18T16:23:32.779880+0000","last_fullsized":"2024-02-18T16:23:32.779880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.779679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.779679+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.779679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:52:14.743598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.348633+0000","last_change":"2024-02-18T16:23:04.348633+0000","last_active":"2024-02-18T16:23:04.348633+0000","last_peered":"2024-02-18T16:23:04.348633+0000","last_clean":"2024-02-18T16:23:04.348633+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:23:04.348633+0000","last_undegraded":"2024-02-18T16:23:04.348633+0000","last_fullsized":"2024-02-18T16:23:04.348633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.348289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:35.555767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.694029+0000","last_change":"2024-02-18T16:23:14.694029+0000","last_active":"2024-02-18T16:23:14.694029+0000","last_peered":"2024-02-18T16:23:14.694029+0000","last_clean":"2024-02-18T16:23:14.694029+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:23:14.694029+0000","last_undegraded":"2024-02-18T16:23:14.694029+0000","last_fullsized":"2024-02-18T16:23:14.694029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.693728+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:39.653173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.442044+0000","last_change":"2024-02-18T16:22:49.442044+0000","last_active":"2024-02-18T16:22:49.442044+0000","last_peered":"2024-02-18T16:22:49.442044+0000","last_clean":"2024-02-18T16:22:49.442044+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:22:49.442044+0000","last_undegraded":"2024-02-18T16:22:49.442044+0000","last_fullsized":"2024-02-18T16:22:49.442044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.441791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:45:05.815867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.959752+0000","last_change":"2024-02-18T16:23:47.959903+0000","last_active":"2024-02-18T16:23:47.959752+0000","last_peered":"2024-02-18T16:23:47.959752+0000","last_clean":"2024-02-18T16:23:47.959752+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:23:47.959752+0000","last_undegraded":"2024-02-18T16:23:47.959752+0000","last_fullsized":"2024-02-18T16:23:47.959752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:47.959494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:47.959494+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.959494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:18.822463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.816662+0000","last_change":"2024-02-18T16:23:27.816811+0000","last_active":"2024-02-18T16:23:27.816662+0000","last_peered":"2024-02-18T16:23:27.816662+0000","last_clean":"2024-02-18T16:23:27.816662+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:23:27.816662+0000","last_undegraded":"2024-02-18T16:23:27.816662+0000","last_fullsized":"2024-02-18T16:23:27.816662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:27.816419+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:27.816419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.816419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:38.157707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.716911+0000","last_change":"2024-02-18T16:23:38.716974+0000","last_active":"2024-02-18T16:23:38.716911+0000","last_peered":"2024-02-18T16:23:38.716911+0000","last_clean":"2024-02-18T16:23:38.716911+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:23:38.716911+0000","last_undegraded":"2024-02-18T16:23:38.716911+0000","last_fullsized":"2024-02-18T16:23:38.716911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:38.716716+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:38.716716+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.716716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:57:01.976300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.288342+0000","last_change":"2024-02-18T16:23:06.288342+0000","last_active":"2024-02-18T16:23:06.288342+0000","last_peered":"2024-02-18T16:23:06.288342+0000","last_clean":"2024-02-18T16:23:06.288342+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:23:06.288342+0000","last_undegraded":"2024-02-18T16:23:06.288342+0000","last_fullsized":"2024-02-18T16:23:06.288342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.288089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:53.929609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.866009+0000","last_change":"2024-02-18T16:22:54.866009+0000","last_active":"2024-02-18T16:22:54.866009+0000","last_peered":"2024-02-18T16:22:54.866009+0000","last_clean":"2024-02-18T16:22:54.866009+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:54.866009+0000","last_undegraded":"2024-02-18T16:22:54.866009+0000","last_fullsized":"2024-02-18T16:22:54.866009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.865742+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:38.608078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.424493+0000","last_change":"2024-02-18T16:22:59.424493+0000","last_active":"2024-02-18T16:22:59.424493+0000","last_peered":"2024-02-18T16:22:59.424493+0000","last_clean":"2024-02-18T16:22:59.424493+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:59.424493+0000","last_undegraded":"2024-02-18T16:22:59.424493+0000","last_fullsized":"2024-02-18T16:22:59.424493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.424108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:27.706578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:48.251492+0000","last_change":"2024-02-18T16:23:48.251547+0000","last_active":"2024-02-18T16:23:48.251492+0000","last_peered":"2024-02-18T16:23:48.251492+0000","last_clean":"2024-02-18T16:23:48.251492+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:23:48.251492+0000","last_undegraded":"2024-02-18T16:23:48.251492+0000","last_fullsized":"2024-02-18T16:23:48.251492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:48.251299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:48.251299+0000","last_clean_scrub_stamp":"2024-02-18T16:23:48.251299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:42.395094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.950077+0000","last_change":"2024-02-18T16:23:17.950077+0000","last_active":"2024-02-18T16:23:17.950077+0000","last_peered":"2024-02-18T16:23:17.950077+0000","last_clean":"2024-02-18T16:23:17.950077+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:23:17.950077+0000","last_undegraded":"2024-02-18T16:23:17.950077+0000","last_fullsized":"2024-02-18T16:23:17.950077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.949811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:22.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:50.774592+0000","last_change":"2024-02-18T16:23:50.774672+0000","last_active":"2024-02-18T16:23:50.774592+0000","last_peered":"2024-02-18T16:23:50.774592+0000","last_clean":"2024-02-18T16:23:50.774592+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:23:50.774592+0000","last_undegraded":"2024-02-18T16:23:50.774592+0000","last_fullsized":"2024-02-18T16:23:50.774592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:50.774340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:50.774340+0000","last_clean_scrub_stamp":"2024-02-18T16:23:50.774340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:30:09.435543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.385292+0000","last_change":"2024-02-18T16:23:02.385292+0000","last_active":"2024-02-18T16:23:02.385292+0000","last_peered":"2024-02-18T16:23:02.385292+0000","last_clean":"2024-02-18T16:23:02.385292+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:23:02.385292+0000","last_undegraded":"2024-02-18T16:23:02.385292+0000","last_fullsized":"2024-02-18T16:23:02.385292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.384857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.736442+0000","last_change":"2024-02-18T16:23:18.736442+0000","last_active":"2024-02-18T16:23:18.736442+0000","last_peered":"2024-02-18T16:23:18.736442+0000","last_clean":"2024-02-18T16:23:18.736442+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:23:18.736442+0000","last_undegraded":"2024-02-18T16:23:18.736442+0000","last_fullsized":"2024-02-18T16:23:18.736442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.736028+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:33.973183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.419003+0000","last_change":"2024-02-18T16:22:48.419003+0000","last_active":"2024-02-18T16:22:48.419003+0000","last_peered":"2024-02-18T16:22:48.419003+0000","last_clean":"2024-02-18T16:22:48.419003+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:22:48.419003+0000","last_undegraded":"2024-02-18T16:22:48.419003+0000","last_fullsized":"2024-02-18T16:22:48.419003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.418904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:26.809828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.254723+0000","last_change":"2024-02-18T16:23:42.254793+0000","last_active":"2024-02-18T16:23:42.254723+0000","last_peered":"2024-02-18T16:23:42.254723+0000","last_clean":"2024-02-18T16:23:42.254723+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:23:42.254723+0000","last_undegraded":"2024-02-18T16:23:42.254723+0000","last_fullsized":"2024-02-18T16:23:42.254723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:42.254513+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:42.254513+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.254513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:34.007683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.722667+0000","last_change":"2024-02-18T16:23:39.722667+0000","last_active":"2024-02-18T16:23:39.722667+0000","last_peered":"2024-02-18T16:23:39.722667+0000","last_clean":"2024-02-18T16:23:39.722667+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:23:39.722667+0000","last_undegraded":"2024-02-18T16:23:39.722667+0000","last_fullsized":"2024-02-18T16:23:39.722667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.722399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.722399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.722399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:20:54.340576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.169671+0000","last_change":"2024-02-18T16:23:32.169748+0000","last_active":"2024-02-18T16:23:32.169671+0000","last_peered":"2024-02-18T16:23:32.169671+0000","last_clean":"2024-02-18T16:23:32.169671+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:23:32.169671+0000","last_undegraded":"2024-02-18T16:23:32.169671+0000","last_fullsized":"2024-02-18T16:23:32.169671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.169474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.169474+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.169474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:46.723732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.895970+0000","last_change":"2024-02-18T16:23:06.895970+0000","last_active":"2024-02-18T16:23:06.895970+0000","last_peered":"2024-02-18T16:23:06.895970+0000","last_clean":"2024-02-18T16:23:06.895970+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:23:06.895970+0000","last_undegraded":"2024-02-18T16:23:06.895970+0000","last_fullsized":"2024-02-18T16:23:06.895970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.895683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:21.766945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.716444+0000","last_change":"2024-02-18T16:22:53.716444+0000","last_active":"2024-02-18T16:22:53.716444+0000","last_peered":"2024-02-18T16:22:53.716444+0000","last_clean":"2024-02-18T16:22:53.716444+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:53.716444+0000","last_undegraded":"2024-02-18T16:22:53.716444+0000","last_fullsized":"2024-02-18T16:22:53.716444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.716166+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:15:00.689979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.730325+0000","last_change":"2024-02-18T16:23:16.730325+0000","last_active":"2024-02-18T16:23:16.730325+0000","last_peered":"2024-02-18T16:23:16.730325+0000","last_clean":"2024-02-18T16:23:16.730325+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:23:16.730325+0000","last_undegraded":"2024-02-18T16:23:16.730325+0000","last_fullsized":"2024-02-18T16:23:16.730325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.729880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:09.848063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.726227+0000","last_change":"2024-02-18T16:23:36.726292+0000","last_active":"2024-02-18T16:23:36.726227+0000","last_peered":"2024-02-18T16:23:36.726227+0000","last_clean":"2024-02-18T16:23:36.726227+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:23:36.726227+0000","last_undegraded":"2024-02-18T16:23:36.726227+0000","last_fullsized":"2024-02-18T16:23:36.726227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.726011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.726011+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.726011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:02:08.073508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.775757+0000","last_change":"2024-02-18T16:22:59.775757+0000","last_active":"2024-02-18T16:22:59.775757+0000","last_peered":"2024-02-18T16:22:59.775757+0000","last_clean":"2024-02-18T16:22:59.775757+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:59.775757+0000","last_undegraded":"2024-02-18T16:22:59.775757+0000","last_fullsized":"2024-02-18T16:22:59.775757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.775299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:17:59.839199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:51.770478+0000","last_change":"2024-02-18T16:23:51.770541+0000","last_active":"2024-02-18T16:23:51.770478+0000","last_peered":"2024-02-18T16:23:51.770478+0000","last_clean":"2024-02-18T16:23:51.770478+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:23:51.770478+0000","last_undegraded":"2024-02-18T16:23:51.770478+0000","last_fullsized":"2024-02-18T16:23:51.770478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:51.770271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:51.770271+0000","last_clean_scrub_stamp":"2024-02-18T16:23:51.770271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:07:34.900673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.315310+0000","last_change":"2024-02-18T16:23:05.315310+0000","last_active":"2024-02-18T16:23:05.315310+0000","last_peered":"2024-02-18T16:23:05.315310+0000","last_clean":"2024-02-18T16:23:05.315310+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:23:05.315310+0000","last_undegraded":"2024-02-18T16:23:05.315310+0000","last_fullsized":"2024-02-18T16:23:05.315310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.315056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:34.007120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.877151+0000","last_change":"2024-02-18T16:23:04.877151+0000","last_active":"2024-02-18T16:23:04.877151+0000","last_peered":"2024-02-18T16:23:04.877151+0000","last_clean":"2024-02-18T16:23:04.877151+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:23:04.877151+0000","last_undegraded":"2024-02-18T16:23:04.877151+0000","last_fullsized":"2024-02-18T16:23:04.877151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.876858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:34.375957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":334,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.770013+0000","last_change":"2024-02-18T16:22:51.770013+0000","last_active":"2024-02-18T16:22:51.770013+0000","last_peered":"2024-02-18T16:22:51.770013+0000","last_clean":"2024-02-18T16:22:51.770013+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:51.770013+0000","last_undegraded":"2024-02-18T16:22:51.770013+0000","last_fullsized":"2024-02-18T16:22:51.770013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.769642+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:23:26.328772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.126785+0000","last_change":"2024-02-18T16:23:15.126785+0000","last_active":"2024-02-18T16:23:15.126785+0000","last_peered":"2024-02-18T16:23:15.126785+0000","last_clean":"2024-02-18T16:23:15.126785+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:23:15.126785+0000","last_undegraded":"2024-02-18T16:23:15.126785+0000","last_fullsized":"2024-02-18T16:23:15.126785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.126508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:58.868844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.699084+0000","last_change":"2024-02-18T16:23:37.699156+0000","last_active":"2024-02-18T16:23:37.699084+0000","last_peered":"2024-02-18T16:23:37.699084+0000","last_clean":"2024-02-18T16:23:37.699084+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:23:37.699084+0000","last_undegraded":"2024-02-18T16:23:37.699084+0000","last_fullsized":"2024-02-18T16:23:37.699084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:37.698893+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:37.698893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.698893+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:45:21.335851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.789240+0000","last_change":"2024-02-18T16:23:47.789302+0000","last_active":"2024-02-18T16:23:47.789240+0000","last_peered":"2024-02-18T16:23:47.789240+0000","last_clean":"2024-02-18T16:23:47.789240+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:23:47.789240+0000","last_undegraded":"2024-02-18T16:23:47.789240+0000","last_fullsized":"2024-02-18T16:23:47.789240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:47.789011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:47.789011+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.789011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:26.898024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'6","reported_seq":540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.656384+0000","last_change":"2024-02-18T16:23:00.656384+0000","last_active":"2024-02-18T16:23:00.656384+0000","last_peered":"2024-02-18T16:23:00.656384+0000","last_clean":"2024-02-18T16:23:00.656384+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:23:00.656384+0000","last_undegraded":"2024-02-18T16:23:00.656384+0000","last_fullsized":"2024-02-18T16:23:00.656384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.655960+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:31:46.016785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":581,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.749256+0000","last_change":"2024-02-18T16:23:17.749256+0000","last_active":"2024-02-18T16:23:17.749256+0000","last_peered":"2024-02-18T16:23:17.749256+0000","last_clean":"2024-02-18T16:23:17.749256+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:23:17.749256+0000","last_undegraded":"2024-02-18T16:23:17.749256+0000","last_fullsized":"2024-02-18T16:23:17.749256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.748943+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:25.419343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":365,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.693788+0000","last_change":"2024-02-18T16:22:58.693788+0000","last_active":"2024-02-18T16:22:58.693788+0000","last_peered":"2024-02-18T16:22:58.693788+0000","last_clean":"2024-02-18T16:22:58.693788+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:58.693788+0000","last_undegraded":"2024-02-18T16:22:58.693788+0000","last_fullsized":"2024-02-18T16:22:58.693788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.693538+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:28.192638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.897770+0000","last_change":"2024-02-18T16:22:59.897770+0000","last_active":"2024-02-18T16:22:59.897770+0000","last_peered":"2024-02-18T16:22:59.897770+0000","last_clean":"2024-02-18T16:22:59.897770+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:22:59.897770+0000","last_undegraded":"2024-02-18T16:22:59.897770+0000","last_fullsized":"2024-02-18T16:22:59.897770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.897511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:17:33.837107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.740243+0000","last_change":"2024-02-18T16:23:12.740243+0000","last_active":"2024-02-18T16:23:12.740243+0000","last_peered":"2024-02-18T16:23:12.740243+0000","last_clean":"2024-02-18T16:23:12.740243+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:23:12.740243+0000","last_undegraded":"2024-02-18T16:23:12.740243+0000","last_fullsized":"2024-02-18T16:23:12.740243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.739975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.749389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.757260+0000","last_change":"2024-02-18T16:23:42.757382+0000","last_active":"2024-02-18T16:23:42.757260+0000","last_peered":"2024-02-18T16:23:42.757260+0000","last_clean":"2024-02-18T16:23:42.757260+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:23:42.757260+0000","last_undegraded":"2024-02-18T16:23:42.757260+0000","last_fullsized":"2024-02-18T16:23:42.757260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:42.757028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:42.757028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.757028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:47:18.356551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.918122+0000","last_change":"2024-02-18T16:22:48.918122+0000","last_active":"2024-02-18T16:22:48.918122+0000","last_peered":"2024-02-18T16:22:48.918122+0000","last_clean":"2024-02-18T16:22:48.918122+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:22:48.918122+0000","last_undegraded":"2024-02-18T16:22:48.918122+0000","last_fullsized":"2024-02-18T16:22:48.918122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.917868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:12.197986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.726450+0000","last_change":"2024-02-18T16:22:52.726450+0000","last_active":"2024-02-18T16:22:52.726450+0000","last_peered":"2024-02-18T16:22:52.726450+0000","last_clean":"2024-02-18T16:22:52.726450+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:52.726450+0000","last_undegraded":"2024-02-18T16:22:52.726450+0000","last_fullsized":"2024-02-18T16:22:52.726450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.726227+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:01.503665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.749676+0000","last_change":"2024-02-18T16:22:50.749676+0000","last_active":"2024-02-18T16:22:50.749676+0000","last_peered":"2024-02-18T16:22:50.749676+0000","last_clean":"2024-02-18T16:22:50.749676+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:22:50.749676+0000","last_undegraded":"2024-02-18T16:22:50.749676+0000","last_fullsized":"2024-02-18T16:22:50.749676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.749316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:31.018219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.891076+0000","last_change":"2024-02-18T16:23:44.891135+0000","last_active":"2024-02-18T16:23:44.891076+0000","last_peered":"2024-02-18T16:23:44.891076+0000","last_clean":"2024-02-18T16:23:44.891076+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:23:44.891076+0000","last_undegraded":"2024-02-18T16:23:44.891076+0000","last_fullsized":"2024-02-18T16:23:44.891076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:44.890826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:44.890826+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.890826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:41:07.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.684394+0000","last_change":"2024-02-18T16:23:05.684394+0000","last_active":"2024-02-18T16:23:05.684394+0000","last_peered":"2024-02-18T16:23:05.684394+0000","last_clean":"2024-02-18T16:23:05.684394+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:23:05.684394+0000","last_undegraded":"2024-02-18T16:23:05.684394+0000","last_fullsized":"2024-02-18T16:23:05.684394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.684138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:51:47.648057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.816728+0000","last_change":"2024-02-18T16:23:32.816808+0000","last_active":"2024-02-18T16:23:32.816728+0000","last_peered":"2024-02-18T16:23:32.816728+0000","last_clean":"2024-02-18T16:23:32.816728+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:23:32.816728+0000","last_undegraded":"2024-02-18T16:23:32.816728+0000","last_fullsized":"2024-02-18T16:23:32.816728+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-02-18T16:23:32.816528+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-02-18T16:23:32.816528+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.816528+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:56:28.658709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:01.880881+0000","last_change":"2024-02-18T16:24:01.880940+0000","last_active":"2024-02-18T16:24:01.880881+0000","last_peered":"2024-02-18T16:24:01.880881+0000","last_clean":"2024-02-18T16:24:01.880881+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:24:01.880881+0000","last_undegraded":"2024-02-18T16:24:01.880881+0000","last_fullsized":"2024-02-18T16:24:01.880881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:01.880615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:01.880615+0000","last_clean_scrub_stamp":"2024-02-18T16:24:01.880615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:20:15.577844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:49.776478+0000","last_change":"2024-02-18T16:23:49.776539+0000","last_active":"2024-02-18T16:23:49.776478+0000","last_peered":"2024-02-18T16:23:49.776478+0000","last_clean":"2024-02-18T16:23:49.776478+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:23:49.776478+0000","last_undegraded":"2024-02-18T16:23:49.776478+0000","last_fullsized":"2024-02-18T16:23:49.776478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:49.776258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:49.776258+0000","last_clean_scrub_stamp":"2024-02-18T16:23:49.776258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:34:20.699351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.664877+0000","last_change":"2024-02-18T16:23:03.664877+0000","last_active":"2024-02-18T16:23:03.664877+0000","last_peered":"2024-02-18T16:23:03.664877+0000","last_clean":"2024-02-18T16:23:03.664877+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:23:03.664877+0000","last_undegraded":"2024-02-18T16:23:03.664877+0000","last_fullsized":"2024-02-18T16:23:03.664877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.664624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:45.069024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'84","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.776665+0000","last_change":"2024-02-18T16:23:21.776848+0000","last_active":"2024-02-18T16:23:21.776665+0000","last_peered":"2024-02-18T16:23:21.776665+0000","last_clean":"2024-02-18T16:23:21.776665+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:23:21.776665+0000","last_undegraded":"2024-02-18T16:23:21.776665+0000","last_fullsized":"2024-02-18T16:23:21.776665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.776429+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:19.871412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.479778+0000","last_change":"2024-02-18T16:22:51.479778+0000","last_active":"2024-02-18T16:22:51.479778+0000","last_peered":"2024-02-18T16:22:51.479778+0000","last_clean":"2024-02-18T16:22:51.479778+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:22:51.479778+0000","last_undegraded":"2024-02-18T16:22:51.479778+0000","last_fullsized":"2024-02-18T16:22:51.479778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.479526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:00.256964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.875952+0000","last_change":"2024-02-18T16:22:55.875952+0000","last_active":"2024-02-18T16:22:55.875952+0000","last_peered":"2024-02-18T16:22:55.875952+0000","last_clean":"2024-02-18T16:22:55.875952+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:55.875952+0000","last_undegraded":"2024-02-18T16:22:55.875952+0000","last_fullsized":"2024-02-18T16:22:55.875952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.875669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:33.784174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.711566+0000","last_change":"2024-02-18T16:23:30.711619+0000","last_active":"2024-02-18T16:23:30.711566+0000","last_peered":"2024-02-18T16:23:30.711566+0000","last_clean":"2024-02-18T16:23:30.711566+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:23:30.711566+0000","last_undegraded":"2024-02-18T16:23:30.711566+0000","last_fullsized":"2024-02-18T16:23:30.711566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.711338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.711338+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.711338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:21:28.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:59.926045+0000","last_change":"2024-02-18T16:23:59.926102+0000","last_active":"2024-02-18T16:23:59.926045+0000","last_peered":"2024-02-18T16:23:59.926045+0000","last_clean":"2024-02-18T16:23:59.926045+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:23:59.926045+0000","last_undegraded":"2024-02-18T16:23:59.926045+0000","last_fullsized":"2024-02-18T16:23:59.926045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:59.925837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:59.925837+0000","last_clean_scrub_stamp":"2024-02-18T16:23:59.925837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:37.822894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.178848+0000","last_change":"2024-02-18T16:23:35.178912+0000","last_active":"2024-02-18T16:23:35.178848+0000","last_peered":"2024-02-18T16:23:35.178848+0000","last_clean":"2024-02-18T16:23:35.178848+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:23:35.178848+0000","last_undegraded":"2024-02-18T16:23:35.178848+0000","last_fullsized":"2024-02-18T16:23:35.178848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.178612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.178612+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.178612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:25.976338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.880298+0000","last_change":"2024-02-18T16:22:50.880298+0000","last_active":"2024-02-18T16:22:50.880298+0000","last_peered":"2024-02-18T16:22:50.880298+0000","last_clean":"2024-02-18T16:22:50.880298+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:22:50.880298+0000","last_undegraded":"2024-02-18T16:22:50.880298+0000","last_fullsized":"2024-02-18T16:22:50.880298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.879993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:40:55.016859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.676283+0000","last_change":"2024-02-18T16:22:48.676283+0000","last_active":"2024-02-18T16:22:48.676283+0000","last_peered":"2024-02-18T16:22:48.676283+0000","last_clean":"2024-02-18T16:22:48.676283+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:48.676283+0000","last_undegraded":"2024-02-18T16:22:48.676283+0000","last_fullsized":"2024-02-18T16:22:48.676283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.676008+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:36.238448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.648672+0000","last_change":"2024-02-18T16:23:12.648672+0000","last_active":"2024-02-18T16:23:12.648672+0000","last_peered":"2024-02-18T16:23:12.648672+0000","last_clean":"2024-02-18T16:23:12.648672+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:23:12.648672+0000","last_undegraded":"2024-02-18T16:23:12.648672+0000","last_fullsized":"2024-02-18T16:23:12.648672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.648341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:17:59.693351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.918277+0000","last_change":"2024-02-18T16:23:46.918348+0000","last_active":"2024-02-18T16:23:46.918277+0000","last_peered":"2024-02-18T16:23:46.918277+0000","last_clean":"2024-02-18T16:23:46.918277+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:23:46.918277+0000","last_undegraded":"2024-02-18T16:23:46.918277+0000","last_fullsized":"2024-02-18T16:23:46.918277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:46.918054+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:46.918054+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.918054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:04:52.821578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.238351+0000","last_change":"2024-02-18T16:23:41.238416+0000","last_active":"2024-02-18T16:23:41.238351+0000","last_peered":"2024-02-18T16:23:41.238351+0000","last_clean":"2024-02-18T16:23:41.238351+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:23:41.238351+0000","last_undegraded":"2024-02-18T16:23:41.238351+0000","last_fullsized":"2024-02-18T16:23:41.238351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:41.238156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:41.238156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.238156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:11.430893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.815989+0000","last_change":"2024-02-18T16:23:29.816093+0000","last_active":"2024-02-18T16:23:29.815989+0000","last_peered":"2024-02-18T16:23:29.815989+0000","last_clean":"2024-02-18T16:23:29.815989+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:23:29.815989+0000","last_undegraded":"2024-02-18T16:23:29.815989+0000","last_fullsized":"2024-02-18T16:23:29.815989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:29.815772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:29.815772+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.815772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:42.184598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.174668+0000","last_change":"2024-02-18T16:23:36.174727+0000","last_active":"2024-02-18T16:23:36.174668+0000","last_peered":"2024-02-18T16:23:36.174668+0000","last_clean":"2024-02-18T16:23:36.174668+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:23:36.174668+0000","last_undegraded":"2024-02-18T16:23:36.174668+0000","last_fullsized":"2024-02-18T16:23:36.174668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.174453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.174453+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.174453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:29.292636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.949902+0000","last_change":"2024-02-18T16:23:12.949902+0000","last_active":"2024-02-18T16:23:12.949902+0000","last_peered":"2024-02-18T16:23:12.949902+0000","last_clean":"2024-02-18T16:23:12.949902+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:23:12.949902+0000","last_undegraded":"2024-02-18T16:23:12.949902+0000","last_fullsized":"2024-02-18T16:23:12.949902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.949503+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:07:00.591023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.880194+0000","last_change":"2024-02-18T16:23:01.880194+0000","last_active":"2024-02-18T16:23:01.880194+0000","last_peered":"2024-02-18T16:23:01.880194+0000","last_clean":"2024-02-18T16:23:01.880194+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:23:01.880194+0000","last_undegraded":"2024-02-18T16:23:01.880194+0000","last_fullsized":"2024-02-18T16:23:01.880194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.879908+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:49.968692+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.417911+0000","last_change":"2024-02-18T16:22:55.417911+0000","last_active":"2024-02-18T16:22:55.417911+0000","last_peered":"2024-02-18T16:22:55.417911+0000","last_clean":"2024-02-18T16:22:55.417911+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:22:55.417911+0000","last_undegraded":"2024-02-18T16:22:55.417911+0000","last_fullsized":"2024-02-18T16:22:55.417911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.417642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:43.506426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:08.809868+0000","last_change":"2024-02-18T16:24:08.809927+0000","last_active":"2024-02-18T16:24:08.809868+0000","last_peered":"2024-02-18T16:24:08.809868+0000","last_clean":"2024-02-18T16:24:08.809868+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:24:08.809868+0000","last_undegraded":"2024-02-18T16:24:08.809868+0000","last_fullsized":"2024-02-18T16:24:08.809868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:08.809642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:08.809642+0000","last_clean_scrub_stamp":"2024-02-18T16:24:08.809642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:25:42.614858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.122969+0000","last_change":"2024-02-18T16:23:21.123024+0000","last_active":"2024-02-18T16:23:21.122969+0000","last_peered":"2024-02-18T16:23:21.122969+0000","last_clean":"2024-02-18T16:23:21.122969+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:23:21.122969+0000","last_undegraded":"2024-02-18T16:23:21.122969+0000","last_fullsized":"2024-02-18T16:23:21.122969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.122778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:31.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:00.910451+0000","last_change":"2024-02-18T16:24:00.910577+0000","last_active":"2024-02-18T16:24:00.910451+0000","last_peered":"2024-02-18T16:24:00.910451+0000","last_clean":"2024-02-18T16:24:00.910451+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:24:00.910451+0000","last_undegraded":"2024-02-18T16:24:00.910451+0000","last_fullsized":"2024-02-18T16:24:00.910451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:00.910181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:00.910181+0000","last_clean_scrub_stamp":"2024-02-18T16:24:00.910181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:45:09.351901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.910035+0000","last_change":"2024-02-18T16:23:18.910098+0000","last_active":"2024-02-18T16:23:18.910035+0000","last_peered":"2024-02-18T16:23:18.910035+0000","last_clean":"2024-02-18T16:23:18.910035+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:23:18.910035+0000","last_undegraded":"2024-02-18T16:23:18.910035+0000","last_fullsized":"2024-02-18T16:23:18.910035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.909845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:53:00.919260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.247235+0000","last_change":"2024-02-18T16:23:08.247235+0000","last_active":"2024-02-18T16:23:08.247235+0000","last_peered":"2024-02-18T16:23:08.247235+0000","last_clean":"2024-02-18T16:23:08.247235+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:23:08.247235+0000","last_undegraded":"2024-02-18T16:23:08.247235+0000","last_fullsized":"2024-02-18T16:23:08.247235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.246981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:42:58.377194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.623260+0000","last_change":"2024-02-18T16:23:08.623260+0000","last_active":"2024-02-18T16:23:08.623260+0000","last_peered":"2024-02-18T16:23:08.623260+0000","last_clean":"2024-02-18T16:23:08.623260+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:23:08.623260+0000","last_undegraded":"2024-02-18T16:23:08.623260+0000","last_fullsized":"2024-02-18T16:23:08.623260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.622991+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:02.281198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.734333+0000","last_change":"2024-02-18T16:23:24.734440+0000","last_active":"2024-02-18T16:23:24.734333+0000","last_peered":"2024-02-18T16:23:24.734333+0000","last_clean":"2024-02-18T16:23:24.734333+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:23:24.734333+0000","last_undegraded":"2024-02-18T16:23:24.734333+0000","last_fullsized":"2024-02-18T16:23:24.734333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:24.734087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:24.734087+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.734087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:05:01.465216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.736675+0000","last_change":"2024-02-18T16:23:14.736675+0000","last_active":"2024-02-18T16:23:14.736675+0000","last_peered":"2024-02-18T16:23:14.736675+0000","last_clean":"2024-02-18T16:23:14.736675+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:23:14.736675+0000","last_undegraded":"2024-02-18T16:23:14.736675+0000","last_fullsized":"2024-02-18T16:23:14.736675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.736262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.555313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.756320+0000","last_change":"2024-02-18T16:23:15.756377+0000","last_active":"2024-02-18T16:23:15.756320+0000","last_peered":"2024-02-18T16:23:15.756320+0000","last_clean":"2024-02-18T16:23:15.756320+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:23:15.756320+0000","last_undegraded":"2024-02-18T16:23:15.756320+0000","last_fullsized":"2024-02-18T16:23:15.756320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.756123+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.498459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.674953+0000","last_change":"2024-02-18T16:23:35.675009+0000","last_active":"2024-02-18T16:23:35.674953+0000","last_peered":"2024-02-18T16:23:35.674953+0000","last_clean":"2024-02-18T16:23:35.674953+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:23:35.674953+0000","last_undegraded":"2024-02-18T16:23:35.674953+0000","last_fullsized":"2024-02-18T16:23:35.674953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.674755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.674755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.674755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:29.332962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.190506+0000","last_change":"2024-02-18T16:23:33.190695+0000","last_active":"2024-02-18T16:23:33.190506+0000","last_peered":"2024-02-18T16:23:33.190506+0000","last_clean":"2024-02-18T16:23:33.190506+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:23:33.190506+0000","last_undegraded":"2024-02-18T16:23:33.190506+0000","last_fullsized":"2024-02-18T16:23:33.190506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.190286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.190286+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.190286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:20:47.808463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.699853+0000","last_change":"2024-02-18T16:23:40.699853+0000","last_active":"2024-02-18T16:23:40.699853+0000","last_peered":"2024-02-18T16:23:40.699853+0000","last_clean":"2024-02-18T16:23:40.699853+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:23:40.699853+0000","last_undegraded":"2024-02-18T16:23:40.699853+0000","last_fullsized":"2024-02-18T16:23:40.699853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.699606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.699606+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.699606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:05.659051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.420257+0000","last_change":"2024-02-18T16:22:56.420257+0000","last_active":"2024-02-18T16:22:56.420257+0000","last_peered":"2024-02-18T16:22:56.420257+0000","last_clean":"2024-02-18T16:22:56.420257+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:56.420257+0000","last_undegraded":"2024-02-18T16:22:56.420257+0000","last_fullsized":"2024-02-18T16:22:56.420257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.419970+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:02.428762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.748170+0000","last_change":"2024-02-18T16:22:49.748170+0000","last_active":"2024-02-18T16:22:49.748170+0000","last_peered":"2024-02-18T16:22:49.748170+0000","last_clean":"2024-02-18T16:22:49.748170+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:22:49.748170+0000","last_undegraded":"2024-02-18T16:22:49.748170+0000","last_fullsized":"2024-02-18T16:22:49.748170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.747885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:10:50.889318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.294458+0000","last_change":"2024-02-18T16:23:43.294517+0000","last_active":"2024-02-18T16:23:43.294458+0000","last_peered":"2024-02-18T16:23:43.294458+0000","last_clean":"2024-02-18T16:23:43.294458+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:23:43.294458+0000","last_undegraded":"2024-02-18T16:23:43.294458+0000","last_fullsized":"2024-02-18T16:23:43.294458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-18T16:23:43.294263+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-18T16:23:43.294263+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.294263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:14.362463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.714159+0000","last_change":"2024-02-18T16:23:11.714272+0000","last_active":"2024-02-18T16:23:11.714159+0000","last_peered":"2024-02-18T16:23:11.714159+0000","last_clean":"2024-02-18T16:23:11.714159+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:23:11.714159+0000","last_undegraded":"2024-02-18T16:23:11.714159+0000","last_fullsized":"2024-02-18T16:23:11.714159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.713937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.850804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.160180+0000","last_change":"2024-02-18T16:23:22.160243+0000","last_active":"2024-02-18T16:23:22.160180+0000","last_peered":"2024-02-18T16:23:22.160180+0000","last_clean":"2024-02-18T16:23:22.160180+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:23:22.160180+0000","last_undegraded":"2024-02-18T16:23:22.160180+0000","last_fullsized":"2024-02-18T16:23:22.160180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.159961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.101435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:58.881209+0000","last_change":"2024-02-18T16:23:58.881269+0000","last_active":"2024-02-18T16:23:58.881209+0000","last_peered":"2024-02-18T16:23:58.881209+0000","last_clean":"2024-02-18T16:23:58.881209+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:23:58.881209+0000","last_undegraded":"2024-02-18T16:23:58.881209+0000","last_fullsized":"2024-02-18T16:23:58.881209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:58.881007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:58.881007+0000","last_clean_scrub_stamp":"2024-02-18T16:23:58.881007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:17:19.956008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.818376+0000","last_change":"2024-02-18T16:22:58.818376+0000","last_active":"2024-02-18T16:22:58.818376+0000","last_peered":"2024-02-18T16:22:58.818376+0000","last_clean":"2024-02-18T16:22:58.818376+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:22:58.818376+0000","last_undegraded":"2024-02-18T16:22:58.818376+0000","last_fullsized":"2024-02-18T16:22:58.818376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.818107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:11.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.707930+0000","last_change":"2024-02-18T16:22:49.707930+0000","last_active":"2024-02-18T16:22:49.707930+0000","last_peered":"2024-02-18T16:22:49.707930+0000","last_clean":"2024-02-18T16:22:49.707930+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:22:49.707930+0000","last_undegraded":"2024-02-18T16:22:49.707930+0000","last_fullsized":"2024-02-18T16:22:49.707930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.707617+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:28.098540+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.735695+0000","last_change":"2024-02-18T16:22:50.735695+0000","last_active":"2024-02-18T16:22:50.735695+0000","last_peered":"2024-02-18T16:22:50.735695+0000","last_clean":"2024-02-18T16:22:50.735695+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:50.735695+0000","last_undegraded":"2024-02-18T16:22:50.735695+0000","last_fullsized":"2024-02-18T16:22:50.735695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.735438+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:28.643943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.688241+0000","last_change":"2024-02-18T16:23:32.688296+0000","last_active":"2024-02-18T16:23:32.688241+0000","last_peered":"2024-02-18T16:23:32.688241+0000","last_clean":"2024-02-18T16:23:32.688241+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:23:32.688241+0000","last_undegraded":"2024-02-18T16:23:32.688241+0000","last_fullsized":"2024-02-18T16:23:32.688241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.688045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.688045+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.688045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:58:07.099132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.703777+0000","last_change":"2024-02-18T16:23:33.703851+0000","last_active":"2024-02-18T16:23:33.703777+0000","last_peered":"2024-02-18T16:23:33.703777+0000","last_clean":"2024-02-18T16:23:33.703777+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:23:33.703777+0000","last_undegraded":"2024-02-18T16:23:33.703777+0000","last_fullsized":"2024-02-18T16:23:33.703777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:33.703579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:33.703579+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.703579+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:12:52.322217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.797372+0000","last_change":"2024-02-18T16:23:44.797437+0000","last_active":"2024-02-18T16:23:44.797372+0000","last_peered":"2024-02-18T16:23:44.797372+0000","last_clean":"2024-02-18T16:23:44.797372+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:23:44.797372+0000","last_undegraded":"2024-02-18T16:23:44.797372+0000","last_fullsized":"2024-02-18T16:23:44.797372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.797152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.797152+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.797152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:08:07.995733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.224158+0000","last_change":"2024-02-18T16:23:34.224211+0000","last_active":"2024-02-18T16:23:34.224158+0000","last_peered":"2024-02-18T16:23:34.224158+0000","last_clean":"2024-02-18T16:23:34.224158+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:23:34.224158+0000","last_undegraded":"2024-02-18T16:23:34.224158+0000","last_fullsized":"2024-02-18T16:23:34.224158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.223963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.223963+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.223963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:59.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.835162+0000","last_change":"2024-02-18T16:22:53.835162+0000","last_active":"2024-02-18T16:22:53.835162+0000","last_peered":"2024-02-18T16:22:53.835162+0000","last_clean":"2024-02-18T16:22:53.835162+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:22:53.835162+0000","last_undegraded":"2024-02-18T16:22:53.835162+0000","last_fullsized":"2024-02-18T16:22:53.835162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.834880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:45:52.990486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.796672+0000","last_change":"2024-02-18T16:23:02.796672+0000","last_active":"2024-02-18T16:23:02.796672+0000","last_peered":"2024-02-18T16:23:02.796672+0000","last_clean":"2024-02-18T16:23:02.796672+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:23:02.796672+0000","last_undegraded":"2024-02-18T16:23:02.796672+0000","last_fullsized":"2024-02-18T16:23:02.796672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.796510+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:15.165336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.432203+0000","last_change":"2024-02-18T16:22:53.432203+0000","last_active":"2024-02-18T16:22:53.432203+0000","last_peered":"2024-02-18T16:22:53.432203+0000","last_clean":"2024-02-18T16:22:53.432203+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:53.432203+0000","last_undegraded":"2024-02-18T16:22:53.432203+0000","last_fullsized":"2024-02-18T16:22:53.432203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.431945+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:16.067812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.886911+0000","last_change":"2024-02-18T16:23:43.886978+0000","last_active":"2024-02-18T16:23:43.886911+0000","last_peered":"2024-02-18T16:23:43.886911+0000","last_clean":"2024-02-18T16:23:43.886911+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:23:43.886911+0000","last_undegraded":"2024-02-18T16:23:43.886911+0000","last_fullsized":"2024-02-18T16:23:43.886911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-18T16:23:43.886686+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-18T16:23:43.886686+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.886686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:05:20.617815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.849175+0000","last_change":"2024-02-18T16:23:25.849283+0000","last_active":"2024-02-18T16:23:25.849175+0000","last_peered":"2024-02-18T16:23:25.849175+0000","last_clean":"2024-02-18T16:23:25.849175+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:23:25.849175+0000","last_undegraded":"2024-02-18T16:23:25.849175+0000","last_fullsized":"2024-02-18T16:23:25.849175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.848950+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:38.054152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.719789+0000","last_change":"2024-02-18T16:23:21.719847+0000","last_active":"2024-02-18T16:23:21.719789+0000","last_peered":"2024-02-18T16:23:21.719789+0000","last_clean":"2024-02-18T16:23:21.719789+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:23:21.719789+0000","last_undegraded":"2024-02-18T16:23:21.719789+0000","last_fullsized":"2024-02-18T16:23:21.719789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.719594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:28.530836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:02.863217+0000","last_change":"2024-02-18T16:24:02.863272+0000","last_active":"2024-02-18T16:24:02.863217+0000","last_peered":"2024-02-18T16:24:02.863217+0000","last_clean":"2024-02-18T16:24:02.863217+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:24:02.863217+0000","last_undegraded":"2024-02-18T16:24:02.863217+0000","last_fullsized":"2024-02-18T16:24:02.863217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:02.863018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:02.863018+0000","last_clean_scrub_stamp":"2024-02-18T16:24:02.863018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:00:38.572426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.848661+0000","last_change":"2024-02-18T16:22:55.848661+0000","last_active":"2024-02-18T16:22:55.848661+0000","last_peered":"2024-02-18T16:22:55.848661+0000","last_clean":"2024-02-18T16:22:55.848661+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:22:55.848661+0000","last_undegraded":"2024-02-18T16:22:55.848661+0000","last_fullsized":"2024-02-18T16:22:55.848661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.848402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:19.446935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.898018+0000","last_change":"2024-02-18T16:22:57.898018+0000","last_active":"2024-02-18T16:22:57.898018+0000","last_peered":"2024-02-18T16:22:57.898018+0000","last_clean":"2024-02-18T16:22:57.898018+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:57.898018+0000","last_undegraded":"2024-02-18T16:22:57.898018+0000","last_fullsized":"2024-02-18T16:22:57.898018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.897660+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:13.070415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.433639+0000","last_change":"2024-02-18T16:22:47.433639+0000","last_active":"2024-02-18T16:22:47.433639+0000","last_peered":"2024-02-18T16:22:47.433639+0000","last_clean":"2024-02-18T16:22:47.433639+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:22:47.433639+0000","last_undegraded":"2024-02-18T16:22:47.433639+0000","last_fullsized":"2024-02-18T16:22:47.433639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_clean_scrub_stamp":"2024-02-18T16:22:47.433513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:34.995953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.868860+0000","last_change":"2024-02-18T16:23:07.868860+0000","last_active":"2024-02-18T16:23:07.868860+0000","last_peered":"2024-02-18T16:23:07.868860+0000","last_clean":"2024-02-18T16:23:07.868860+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:23:07.868860+0000","last_undegraded":"2024-02-18T16:23:07.868860+0000","last_fullsized":"2024-02-18T16:23:07.868860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.868484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:40.791749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.906138+0000","last_change":"2024-02-18T16:23:03.906138+0000","last_active":"2024-02-18T16:23:03.906138+0000","last_peered":"2024-02-18T16:23:03.906138+0000","last_clean":"2024-02-18T16:23:03.906138+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:23:03.906138+0000","last_undegraded":"2024-02-18T16:23:03.906138+0000","last_fullsized":"2024-02-18T16:23:03.906138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.905867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:52.615381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.756988+0000","last_change":"2024-02-18T16:23:44.757135+0000","last_active":"2024-02-18T16:23:44.756988+0000","last_peered":"2024-02-18T16:23:44.756988+0000","last_clean":"2024-02-18T16:23:44.756988+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:23:44.756988+0000","last_undegraded":"2024-02-18T16:23:44.756988+0000","last_fullsized":"2024-02-18T16:23:44.756988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.756736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.756736+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.756736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:35:04.428942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:52.777360+0000","last_change":"2024-02-18T16:23:52.777423+0000","last_active":"2024-02-18T16:23:52.777360+0000","last_peered":"2024-02-18T16:23:52.777360+0000","last_clean":"2024-02-18T16:23:52.777360+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:23:52.777360+0000","last_undegraded":"2024-02-18T16:23:52.777360+0000","last_fullsized":"2024-02-18T16:23:52.777360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:52.777153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:52.777153+0000","last_clean_scrub_stamp":"2024-02-18T16:23:52.777153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:06:06.902390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.662609+0000","last_change":"2024-02-18T16:22:59.662609+0000","last_active":"2024-02-18T16:22:59.662609+0000","last_peered":"2024-02-18T16:22:59.662609+0000","last_clean":"2024-02-18T16:22:59.662609+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:22:59.662609+0000","last_undegraded":"2024-02-18T16:22:59.662609+0000","last_fullsized":"2024-02-18T16:22:59.662609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.662355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:03.409762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.873759+0000","last_change":"2024-02-18T16:22:52.873759+0000","last_active":"2024-02-18T16:22:52.873759+0000","last_peered":"2024-02-18T16:22:52.873759+0000","last_clean":"2024-02-18T16:22:52.873759+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:52.873759+0000","last_undegraded":"2024-02-18T16:22:52.873759+0000","last_fullsized":"2024-02-18T16:22:52.873759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.873343+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:03.165248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.654661+0000","last_change":"2024-02-18T16:23:13.654661+0000","last_active":"2024-02-18T16:23:13.654661+0000","last_peered":"2024-02-18T16:23:13.654661+0000","last_clean":"2024-02-18T16:23:13.654661+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:23:13.654661+0000","last_undegraded":"2024-02-18T16:23:13.654661+0000","last_fullsized":"2024-02-18T16:23:13.654661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.654400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:20:57.367640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.311152+0000","last_change":"2024-02-18T16:23:44.311208+0000","last_active":"2024-02-18T16:23:44.311152+0000","last_peered":"2024-02-18T16:23:44.311152+0000","last_clean":"2024-02-18T16:23:44.311152+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:23:44.311152+0000","last_undegraded":"2024-02-18T16:23:44.311152+0000","last_fullsized":"2024-02-18T16:23:44.311152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.310949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.310949+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.310949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:41:06.755737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.698302+0000","last_change":"2024-02-18T16:23:07.698302+0000","last_active":"2024-02-18T16:23:07.698302+0000","last_peered":"2024-02-18T16:23:07.698302+0000","last_clean":"2024-02-18T16:23:07.698302+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:23:07.698302+0000","last_undegraded":"2024-02-18T16:23:07.698302+0000","last_fullsized":"2024-02-18T16:23:07.698302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.697990+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.441729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.714368+0000","last_change":"2024-02-18T16:23:34.714540+0000","last_active":"2024-02-18T16:23:34.714368+0000","last_peered":"2024-02-18T16:23:34.714368+0000","last_clean":"2024-02-18T16:23:34.714368+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:23:34.714368+0000","last_undegraded":"2024-02-18T16:23:34.714368+0000","last_fullsized":"2024-02-18T16:23:34.714368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:34.714111+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:34.714111+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.714111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:40.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.819086+0000","last_change":"2024-02-18T16:22:57.819086+0000","last_active":"2024-02-18T16:22:57.819086+0000","last_peered":"2024-02-18T16:22:57.819086+0000","last_clean":"2024-02-18T16:22:57.819086+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:22:57.819086+0000","last_undegraded":"2024-02-18T16:22:57.819086+0000","last_fullsized":"2024-02-18T16:22:57.819086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.818829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:13.082229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.400353+0000","last_change":"2024-02-18T16:23:00.400353+0000","last_active":"2024-02-18T16:23:00.400353+0000","last_peered":"2024-02-18T16:23:00.400353+0000","last_clean":"2024-02-18T16:23:00.400353+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:23:00.400353+0000","last_undegraded":"2024-02-18T16:23:00.400353+0000","last_fullsized":"2024-02-18T16:23:00.400353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.400088+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:15.271349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.801018+0000","last_change":"2024-02-18T16:22:52.801018+0000","last_active":"2024-02-18T16:22:52.801018+0000","last_peered":"2024-02-18T16:22:52.801018+0000","last_clean":"2024-02-18T16:22:52.801018+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:22:52.801018+0000","last_undegraded":"2024-02-18T16:22:52.801018+0000","last_fullsized":"2024-02-18T16:22:52.801018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.800725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:35:16.840171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.260185+0000","last_change":"2024-02-18T16:23:46.260299+0000","last_active":"2024-02-18T16:23:46.260185+0000","last_peered":"2024-02-18T16:23:46.260185+0000","last_clean":"2024-02-18T16:23:46.260185+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:23:46.260185+0000","last_undegraded":"2024-02-18T16:23:46.260185+0000","last_fullsized":"2024-02-18T16:23:46.260185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:46.259927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:46.259927+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.259927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:04:52.163451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.086901+0000","last_change":"2024-02-18T16:23:16.086901+0000","last_active":"2024-02-18T16:23:16.086901+0000","last_peered":"2024-02-18T16:23:16.086901+0000","last_clean":"2024-02-18T16:23:16.086901+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:23:16.086901+0000","last_undegraded":"2024-02-18T16:23:16.086901+0000","last_fullsized":"2024-02-18T16:23:16.086901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.086590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.287817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.854024+0000","last_change":"2024-02-18T16:23:24.854082+0000","last_active":"2024-02-18T16:23:24.854024+0000","last_peered":"2024-02-18T16:23:24.854024+0000","last_clean":"2024-02-18T16:23:24.854024+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:23:24.854024+0000","last_undegraded":"2024-02-18T16:23:24.854024+0000","last_fullsized":"2024-02-18T16:23:24.854024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:24.853825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:24.853825+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.853825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:40.117224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.876247+0000","last_change":"2024-02-18T16:23:05.876247+0000","last_active":"2024-02-18T16:23:05.876247+0000","last_peered":"2024-02-18T16:23:05.876247+0000","last_clean":"2024-02-18T16:23:05.876247+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:23:05.876247+0000","last_undegraded":"2024-02-18T16:23:05.876247+0000","last_fullsized":"2024-02-18T16:23:05.876247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.875986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:34.158456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.361892+0000","last_change":"2024-02-18T16:23:01.361892+0000","last_active":"2024-02-18T16:23:01.361892+0000","last_peered":"2024-02-18T16:23:01.361892+0000","last_clean":"2024-02-18T16:23:01.361892+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:23:01.361892+0000","last_undegraded":"2024-02-18T16:23:01.361892+0000","last_fullsized":"2024-02-18T16:23:01.361892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.361622+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:34.284887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.674935+0000","last_change":"2024-02-18T16:22:54.674935+0000","last_active":"2024-02-18T16:22:54.674935+0000","last_peered":"2024-02-18T16:22:54.674935+0000","last_clean":"2024-02-18T16:22:54.674935+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:22:54.674935+0000","last_undegraded":"2024-02-18T16:22:54.674935+0000","last_fullsized":"2024-02-18T16:22:54.674935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.674677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:17.310545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663763+0000","last_change":"2024-02-18T16:21:09.927490+0000","last_active":"2024-02-18T16:22:48.663763+0000","last_peered":"2024-02-18T16:22:48.663763+0000","last_clean":"2024-02-18T16:22:48.663763+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:22:48.663763+0000","last_undegraded":"2024-02-18T16:22:48.663763+0000","last_fullsized":"2024-02-18T16:22:48.663763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.720342+0000","last_change":"2024-02-18T16:23:31.720408+0000","last_active":"2024-02-18T16:23:31.720342+0000","last_peered":"2024-02-18T16:23:31.720342+0000","last_clean":"2024-02-18T16:23:31.720342+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:23:31.720342+0000","last_undegraded":"2024-02-18T16:23:31.720342+0000","last_fullsized":"2024-02-18T16:23:31.720342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:31.720139+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:31.720139+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.720139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:31:17.845563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.845951+0000","last_change":"2024-02-18T16:23:33.846011+0000","last_active":"2024-02-18T16:23:33.845951+0000","last_peered":"2024-02-18T16:23:33.845951+0000","last_clean":"2024-02-18T16:23:33.845951+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:23:33.845951+0000","last_undegraded":"2024-02-18T16:23:33.845951+0000","last_fullsized":"2024-02-18T16:23:33.845951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.845721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.845721+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.845721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:17.558961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.913473+0000","last_change":"2024-02-18T16:22:51.913473+0000","last_active":"2024-02-18T16:22:51.913473+0000","last_peered":"2024-02-18T16:22:51.913473+0000","last_clean":"2024-02-18T16:22:51.913473+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:22:51.913473+0000","last_undegraded":"2024-02-18T16:22:51.913473+0000","last_fullsized":"2024-02-18T16:22:51.913473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.913196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:37:17.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.903715+0000","last_change":"2024-02-18T16:23:02.903715+0000","last_active":"2024-02-18T16:23:02.903715+0000","last_peered":"2024-02-18T16:23:02.903715+0000","last_clean":"2024-02-18T16:23:02.903715+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:23:02.903715+0000","last_undegraded":"2024-02-18T16:23:02.903715+0000","last_fullsized":"2024-02-18T16:23:02.903715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.903414+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:08.912206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.831594+0000","last_change":"2024-02-18T16:22:53.831594+0000","last_active":"2024-02-18T16:22:53.831594+0000","last_peered":"2024-02-18T16:22:53.831594+0000","last_clean":"2024-02-18T16:22:53.831594+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:22:53.831594+0000","last_undegraded":"2024-02-18T16:22:53.831594+0000","last_fullsized":"2024-02-18T16:22:53.831594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.831178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:41.393618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.730259+0000","last_change":"2024-02-18T16:23:35.730411+0000","last_active":"2024-02-18T16:23:35.730259+0000","last_peered":"2024-02-18T16:23:35.730259+0000","last_clean":"2024-02-18T16:23:35.730259+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:23:35.730259+0000","last_undegraded":"2024-02-18T16:23:35.730259+0000","last_fullsized":"2024-02-18T16:23:35.730259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.729964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.729964+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.729964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:33:15.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:55.823352+0000","last_change":"2024-02-18T16:23:55.823422+0000","last_active":"2024-02-18T16:23:55.823352+0000","last_peered":"2024-02-18T16:23:55.823352+0000","last_clean":"2024-02-18T16:23:55.823352+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:23:55.823352+0000","last_undegraded":"2024-02-18T16:23:55.823352+0000","last_fullsized":"2024-02-18T16:23:55.823352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:55.823145+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:55.823145+0000","last_clean_scrub_stamp":"2024-02-18T16:23:55.823145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:07:08.887342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.208927+0000","last_change":"2024-02-18T16:23:09.208983+0000","last_active":"2024-02-18T16:23:09.208927+0000","last_peered":"2024-02-18T16:23:09.208927+0000","last_clean":"2024-02-18T16:23:09.208927+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:23:09.208927+0000","last_undegraded":"2024-02-18T16:23:09.208927+0000","last_fullsized":"2024-02-18T16:23:09.208927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.208729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.488847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.424028+0000","last_change":"2024-02-18T16:22:58.424028+0000","last_active":"2024-02-18T16:22:58.424028+0000","last_peered":"2024-02-18T16:22:58.424028+0000","last_clean":"2024-02-18T16:22:58.424028+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:58.424028+0000","last_undegraded":"2024-02-18T16:22:58.424028+0000","last_fullsized":"2024-02-18T16:22:58.424028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.423765+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:19.745145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.869606+0000","last_change":"2024-02-18T16:22:54.869606+0000","last_active":"2024-02-18T16:22:54.869606+0000","last_peered":"2024-02-18T16:22:54.869606+0000","last_clean":"2024-02-18T16:22:54.869606+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:22:54.869606+0000","last_undegraded":"2024-02-18T16:22:54.869606+0000","last_fullsized":"2024-02-18T16:22:54.869606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.869352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:33.260275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.270335+0000","last_change":"2024-02-18T16:23:47.270394+0000","last_active":"2024-02-18T16:23:47.270335+0000","last_peered":"2024-02-18T16:23:47.270335+0000","last_clean":"2024-02-18T16:23:47.270335+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:23:47.270335+0000","last_undegraded":"2024-02-18T16:23:47.270335+0000","last_fullsized":"2024-02-18T16:23:47.270335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:47.270144+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:47.270144+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.270144+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:18.133113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.153440+0000","last_change":"2024-02-18T16:23:23.153502+0000","last_active":"2024-02-18T16:23:23.153440+0000","last_peered":"2024-02-18T16:23:23.153440+0000","last_clean":"2024-02-18T16:23:23.153440+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:23:23.153440+0000","last_undegraded":"2024-02-18T16:23:23.153440+0000","last_fullsized":"2024-02-18T16:23:23.153440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.153242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:35.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.883148+0000","last_change":"2024-02-18T16:23:34.883208+0000","last_active":"2024-02-18T16:23:34.883148+0000","last_peered":"2024-02-18T16:23:34.883148+0000","last_clean":"2024-02-18T16:23:34.883148+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:23:34.883148+0000","last_undegraded":"2024-02-18T16:23:34.883148+0000","last_fullsized":"2024-02-18T16:23:34.883148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.882944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.882944+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.882944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:59.842389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.898942+0000","last_change":"2024-02-18T16:23:10.898998+0000","last_active":"2024-02-18T16:23:10.898942+0000","last_peered":"2024-02-18T16:23:10.898942+0000","last_clean":"2024-02-18T16:23:10.898942+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:23:10.898942+0000","last_undegraded":"2024-02-18T16:23:10.898942+0000","last_fullsized":"2024-02-18T16:23:10.898942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.898746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:42.106224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.722806+0000","last_change":"2024-02-18T16:23:04.722806+0000","last_active":"2024-02-18T16:23:04.722806+0000","last_peered":"2024-02-18T16:23:04.722806+0000","last_clean":"2024-02-18T16:23:04.722806+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:23:04.722806+0000","last_undegraded":"2024-02-18T16:23:04.722806+0000","last_fullsized":"2024-02-18T16:23:04.722806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.722326+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:12.289082+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.699736+0000","last_change":"2024-02-18T16:23:06.699736+0000","last_active":"2024-02-18T16:23:06.699736+0000","last_peered":"2024-02-18T16:23:06.699736+0000","last_clean":"2024-02-18T16:23:06.699736+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:23:06.699736+0000","last_undegraded":"2024-02-18T16:23:06.699736+0000","last_fullsized":"2024-02-18T16:23:06.699736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.699466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:54.340986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:07.852538+0000","last_change":"2024-02-18T16:24:07.852682+0000","last_active":"2024-02-18T16:24:07.852538+0000","last_peered":"2024-02-18T16:24:07.852538+0000","last_clean":"2024-02-18T16:24:07.852538+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:24:07.852538+0000","last_undegraded":"2024-02-18T16:24:07.852538+0000","last_fullsized":"2024-02-18T16:24:07.852538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:07.852263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:07.852263+0000","last_clean_scrub_stamp":"2024-02-18T16:24:07.852263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:48.448105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.756244+0000","last_change":"2024-02-18T16:23:01.756244+0000","last_active":"2024-02-18T16:23:01.756244+0000","last_peered":"2024-02-18T16:23:01.756244+0000","last_clean":"2024-02-18T16:23:01.756244+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:23:01.756244+0000","last_undegraded":"2024-02-18T16:23:01.756244+0000","last_fullsized":"2024-02-18T16:23:01.756244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.755900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:58.697375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.933399+0000","last_change":"2024-02-18T16:23:35.933459+0000","last_active":"2024-02-18T16:23:35.933399+0000","last_peered":"2024-02-18T16:23:35.933399+0000","last_clean":"2024-02-18T16:23:35.933399+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:23:35.933399+0000","last_undegraded":"2024-02-18T16:23:35.933399+0000","last_fullsized":"2024-02-18T16:23:35.933399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.933180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.933180+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.933180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:26.730906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.887431+0000","last_change":"2024-02-18T16:23:08.887431+0000","last_active":"2024-02-18T16:23:08.887431+0000","last_peered":"2024-02-18T16:23:08.887431+0000","last_clean":"2024-02-18T16:23:08.887431+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:23:08.887431+0000","last_undegraded":"2024-02-18T16:23:08.887431+0000","last_fullsized":"2024-02-18T16:23:08.887431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.887177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:52.037300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.388978+0000","last_change":"2024-02-18T16:22:57.388978+0000","last_active":"2024-02-18T16:22:57.388978+0000","last_peered":"2024-02-18T16:22:57.388978+0000","last_clean":"2024-02-18T16:22:57.388978+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:57.388978+0000","last_undegraded":"2024-02-18T16:22:57.388978+0000","last_fullsized":"2024-02-18T16:22:57.388978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.388689+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:26.576966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.357962+0000","last_change":"2024-02-18T16:23:03.357962+0000","last_active":"2024-02-18T16:23:03.357962+0000","last_peered":"2024-02-18T16:23:03.357962+0000","last_clean":"2024-02-18T16:23:03.357962+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:23:03.357962+0000","last_undegraded":"2024-02-18T16:23:03.357962+0000","last_fullsized":"2024-02-18T16:23:03.357962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.357709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:29:02.881887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.713891+0000","last_change":"2024-02-18T16:23:28.713891+0000","last_active":"2024-02-18T16:23:28.713891+0000","last_peered":"2024-02-18T16:23:28.713891+0000","last_clean":"2024-02-18T16:23:28.713891+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:23:28.713891+0000","last_undegraded":"2024-02-18T16:23:28.713891+0000","last_fullsized":"2024-02-18T16:23:28.713891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.713636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.713636+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.713636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:56:59.576605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.154731+0000","last_change":"2024-02-18T16:23:19.154731+0000","last_active":"2024-02-18T16:23:19.154731+0000","last_peered":"2024-02-18T16:23:19.154731+0000","last_clean":"2024-02-18T16:23:19.154731+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:23:19.154731+0000","last_undegraded":"2024-02-18T16:23:19.154731+0000","last_fullsized":"2024-02-18T16:23:19.154731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.154433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:31.359635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:54.845117+0000","last_change":"2024-02-18T16:23:54.845175+0000","last_active":"2024-02-18T16:23:54.845117+0000","last_peered":"2024-02-18T16:23:54.845117+0000","last_clean":"2024-02-18T16:23:54.845117+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:23:54.845117+0000","last_undegraded":"2024-02-18T16:23:54.845117+0000","last_fullsized":"2024-02-18T16:23:54.845117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:54.844906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:54.844906+0000","last_clean_scrub_stamp":"2024-02-18T16:23:54.844906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:28:54.687144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.683330+0000","last_change":"2024-02-18T16:22:56.683330+0000","last_active":"2024-02-18T16:22:56.683330+0000","last_peered":"2024-02-18T16:22:56.683330+0000","last_clean":"2024-02-18T16:22:56.683330+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:22:56.683330+0000","last_undegraded":"2024-02-18T16:22:56.683330+0000","last_fullsized":"2024-02-18T16:22:56.683330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.683085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:46:21.980224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.770082+0000","last_change":"2024-02-18T16:23:19.770167+0000","last_active":"2024-02-18T16:23:19.770082+0000","last_peered":"2024-02-18T16:23:19.770082+0000","last_clean":"2024-02-18T16:23:19.770082+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:23:19.770082+0000","last_undegraded":"2024-02-18T16:23:19.770082+0000","last_fullsized":"2024-02-18T16:23:19.770082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.769894+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:21.405998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.790722+0000","last_change":"2024-02-18T16:22:48.790722+0000","last_active":"2024-02-18T16:22:48.790722+0000","last_peered":"2024-02-18T16:22:48.790722+0000","last_clean":"2024-02-18T16:22:48.790722+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:48.790722+0000","last_undegraded":"2024-02-18T16:22:48.790722+0000","last_fullsized":"2024-02-18T16:22:48.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.790462+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:30:37.353769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.762158+0000","last_change":"2024-02-18T16:23:40.762232+0000","last_active":"2024-02-18T16:23:40.762158+0000","last_peered":"2024-02-18T16:23:40.762158+0000","last_clean":"2024-02-18T16:23:40.762158+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:23:40.762158+0000","last_undegraded":"2024-02-18T16:23:40.762158+0000","last_fullsized":"2024-02-18T16:23:40.762158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.761955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.761955+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.761955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:02.420065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.906619+0000","last_change":"2024-02-18T16:23:19.906619+0000","last_active":"2024-02-18T16:23:19.906619+0000","last_peered":"2024-02-18T16:23:19.906619+0000","last_clean":"2024-02-18T16:23:19.906619+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:23:19.906619+0000","last_undegraded":"2024-02-18T16:23:19.906619+0000","last_fullsized":"2024-02-18T16:23:19.906619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.906135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:30.198039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.904887+0000","last_change":"2024-02-18T16:23:39.904947+0000","last_active":"2024-02-18T16:23:39.904887+0000","last_peered":"2024-02-18T16:23:39.904887+0000","last_clean":"2024-02-18T16:23:39.904887+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:23:39.904887+0000","last_undegraded":"2024-02-18T16:23:39.904887+0000","last_fullsized":"2024-02-18T16:23:39.904887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.904651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.904651+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.904651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:41.540756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.684114+0000","last_change":"2024-02-18T16:22:57.684114+0000","last_active":"2024-02-18T16:22:57.684114+0000","last_peered":"2024-02-18T16:22:57.684114+0000","last_clean":"2024-02-18T16:22:57.684114+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:22:57.684114+0000","last_undegraded":"2024-02-18T16:22:57.684114+0000","last_fullsized":"2024-02-18T16:22:57.684114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.683775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:46.393290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.747441+0000","last_change":"2024-02-18T16:22:51.747441+0000","last_active":"2024-02-18T16:22:51.747441+0000","last_peered":"2024-02-18T16:22:51.747441+0000","last_clean":"2024-02-18T16:22:51.747441+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:51.747441+0000","last_undegraded":"2024-02-18T16:22:51.747441+0000","last_fullsized":"2024-02-18T16:22:51.747441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.747142+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:31.805590+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.481478+0000","last_change":"2024-02-18T16:22:50.481478+0000","last_active":"2024-02-18T16:22:50.481478+0000","last_peered":"2024-02-18T16:22:50.481478+0000","last_clean":"2024-02-18T16:22:50.481478+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:22:50.481478+0000","last_undegraded":"2024-02-18T16:22:50.481478+0000","last_fullsized":"2024-02-18T16:22:50.481478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.481235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:40.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.884323+0000","last_change":"2024-02-18T16:23:45.884384+0000","last_active":"2024-02-18T16:23:45.884323+0000","last_peered":"2024-02-18T16:23:45.884323+0000","last_clean":"2024-02-18T16:23:45.884323+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:23:45.884323+0000","last_undegraded":"2024-02-18T16:23:45.884323+0000","last_fullsized":"2024-02-18T16:23:45.884323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:45.884134+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:45.884134+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.884134+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:58:56.431453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.951553+0000","last_change":"2024-02-18T16:23:14.951553+0000","last_active":"2024-02-18T16:23:14.951553+0000","last_peered":"2024-02-18T16:23:14.951553+0000","last_clean":"2024-02-18T16:23:14.951553+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:23:14.951553+0000","last_undegraded":"2024-02-18T16:23:14.951553+0000","last_fullsized":"2024-02-18T16:23:14.951553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.951301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:43:05.081514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.723530+0000","last_change":"2024-02-18T16:23:39.723591+0000","last_active":"2024-02-18T16:23:39.723530+0000","last_peered":"2024-02-18T16:23:39.723530+0000","last_clean":"2024-02-18T16:23:39.723530+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:23:39.723530+0000","last_undegraded":"2024-02-18T16:23:39.723530+0000","last_fullsized":"2024-02-18T16:23:39.723530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.723325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.723325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.723325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:11:20.026076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.877623+0000","last_change":"2024-02-18T16:23:09.877623+0000","last_active":"2024-02-18T16:23:09.877623+0000","last_peered":"2024-02-18T16:23:09.877623+0000","last_clean":"2024-02-18T16:23:09.877623+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:23:09.877623+0000","last_undegraded":"2024-02-18T16:23:09.877623+0000","last_fullsized":"2024-02-18T16:23:09.877623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.877375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:51.281775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.395705+0000","last_change":"2024-02-18T16:22:54.395705+0000","last_active":"2024-02-18T16:22:54.395705+0000","last_peered":"2024-02-18T16:22:54.395705+0000","last_clean":"2024-02-18T16:22:54.395705+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:54.395705+0000","last_undegraded":"2024-02-18T16:22:54.395705+0000","last_fullsized":"2024-02-18T16:22:54.395705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.395421+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:31.781895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.641433+0000","last_change":"2024-02-18T16:23:11.641433+0000","last_active":"2024-02-18T16:23:11.641433+0000","last_peered":"2024-02-18T16:23:11.641433+0000","last_clean":"2024-02-18T16:23:11.641433+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:23:11.641433+0000","last_undegraded":"2024-02-18T16:23:11.641433+0000","last_fullsized":"2024-02-18T16:23:11.641433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.641157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:04.618665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663480+0000","last_change":"2024-02-18T16:21:09.927473+0000","last_active":"2024-02-18T16:22:48.663480+0000","last_peered":"2024-02-18T16:22:48.663480+0000","last_clean":"2024-02-18T16:22:48.663480+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:22:48.663480+0000","last_undegraded":"2024-02-18T16:22:48.663480+0000","last_fullsized":"2024-02-18T16:22:48.663480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.706755+0000","last_change":"2024-02-18T16:23:26.706755+0000","last_active":"2024-02-18T16:23:26.706755+0000","last_peered":"2024-02-18T16:23:26.706755+0000","last_clean":"2024-02-18T16:23:26.706755+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:23:26.706755+0000","last_undegraded":"2024-02-18T16:23:26.706755+0000","last_fullsized":"2024-02-18T16:23:26.706755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:26.706488+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:26.706488+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.706488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:35:36.196305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.123637+0000","last_change":"2024-02-18T16:23:18.123711+0000","last_active":"2024-02-18T16:23:18.123637+0000","last_peered":"2024-02-18T16:23:18.123637+0000","last_clean":"2024-02-18T16:23:18.123637+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:23:18.123637+0000","last_undegraded":"2024-02-18T16:23:18.123637+0000","last_fullsized":"2024-02-18T16:23:18.123637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.123439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:33.386838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.716209+0000","last_change":"2024-02-18T16:23:05.716209+0000","last_active":"2024-02-18T16:23:05.716209+0000","last_peered":"2024-02-18T16:23:05.716209+0000","last_clean":"2024-02-18T16:23:05.716209+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:23:05.716209+0000","last_undegraded":"2024-02-18T16:23:05.716209+0000","last_fullsized":"2024-02-18T16:23:05.716209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.715931+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:36:20.412885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.822998+0000","last_change":"2024-02-18T16:22:56.822998+0000","last_active":"2024-02-18T16:22:56.822998+0000","last_peered":"2024-02-18T16:22:56.822998+0000","last_clean":"2024-02-18T16:22:56.822998+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:56.822998+0000","last_undegraded":"2024-02-18T16:22:56.822998+0000","last_fullsized":"2024-02-18T16:22:56.822998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.822745+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:54.548170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.652614+0000","last_change":"2024-02-18T16:23:10.652614+0000","last_active":"2024-02-18T16:23:10.652614+0000","last_peered":"2024-02-18T16:23:10.652614+0000","last_clean":"2024-02-18T16:23:10.652614+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:23:10.652614+0000","last_undegraded":"2024-02-18T16:23:10.652614+0000","last_fullsized":"2024-02-18T16:23:10.652614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.652245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:14:12.784143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663411+0000","last_change":"2024-02-18T16:21:09.932245+0000","last_active":"2024-02-18T16:22:48.663411+0000","last_peered":"2024-02-18T16:22:48.663411+0000","last_clean":"2024-02-18T16:22:48.663411+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:22:48.663411+0000","last_undegraded":"2024-02-18T16:22:48.663411+0000","last_fullsized":"2024-02-18T16:22:48.663411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.939764+0000","last_change":"2024-02-18T16:23:15.939764+0000","last_active":"2024-02-18T16:23:15.939764+0000","last_peered":"2024-02-18T16:23:15.939764+0000","last_clean":"2024-02-18T16:23:15.939764+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:23:15.939764+0000","last_undegraded":"2024-02-18T16:23:15.939764+0000","last_fullsized":"2024-02-18T16:23:15.939764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.939493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:39.219610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.969407+0000","last_change":"2024-02-18T16:23:36.969466+0000","last_active":"2024-02-18T16:23:36.969407+0000","last_peered":"2024-02-18T16:23:36.969407+0000","last_clean":"2024-02-18T16:23:36.969407+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:23:36.969407+0000","last_undegraded":"2024-02-18T16:23:36.969407+0000","last_fullsized":"2024-02-18T16:23:36.969407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.969188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.969188+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.969188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:30.087371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.713141+0000","last_change":"2024-02-18T16:23:04.713141+0000","last_active":"2024-02-18T16:23:04.713141+0000","last_peered":"2024-02-18T16:23:04.713141+0000","last_clean":"2024-02-18T16:23:04.713141+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:23:04.713141+0000","last_undegraded":"2024-02-18T16:23:04.713141+0000","last_fullsized":"2024-02-18T16:23:04.713141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.712885+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:17:24.627531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.770286+0000","last_change":"2024-02-18T16:23:00.770286+0000","last_active":"2024-02-18T16:23:00.770286+0000","last_peered":"2024-02-18T16:23:00.770286+0000","last_clean":"2024-02-18T16:23:00.770286+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:23:00.770286+0000","last_undegraded":"2024-02-18T16:23:00.770286+0000","last_fullsized":"2024-02-18T16:23:00.770286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.769987+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:07.581229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.449715+0000","last_change":"2024-02-18T16:22:52.449715+0000","last_active":"2024-02-18T16:22:52.449715+0000","last_peered":"2024-02-18T16:22:52.449715+0000","last_clean":"2024-02-18T16:22:52.449715+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:22:52.449715+0000","last_undegraded":"2024-02-18T16:22:52.449715+0000","last_fullsized":"2024-02-18T16:22:52.449715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.449362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:25.393949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.663591+0000","last_change":"2024-02-18T16:21:09.929036+0000","last_active":"2024-02-18T16:22:48.663591+0000","last_peered":"2024-02-18T16:22:48.663591+0000","last_clean":"2024-02-18T16:22:48.663591+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:22:48.663591+0000","last_undegraded":"2024-02-18T16:22:48.663591+0000","last_fullsized":"2024-02-18T16:22:48.663591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:21:08.859744+0000","last_clean_scrub_stamp":"2024-02-18T16:21:08.859744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.762175+0000","last_change":"2024-02-18T16:23:13.762175+0000","last_active":"2024-02-18T16:23:13.762175+0000","last_peered":"2024-02-18T16:23:13.762175+0000","last_clean":"2024-02-18T16:23:13.762175+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:23:13.762175+0000","last_undegraded":"2024-02-18T16:23:13.762175+0000","last_fullsized":"2024-02-18T16:23:13.762175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.761893+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:09:58.046238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.821835+0000","last_change":"2024-02-18T16:23:26.821900+0000","last_active":"2024-02-18T16:23:26.821835+0000","last_peered":"2024-02-18T16:23:26.821835+0000","last_clean":"2024-02-18T16:23:26.821835+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:23:26.821835+0000","last_undegraded":"2024-02-18T16:23:26.821835+0000","last_fullsized":"2024-02-18T16:23:26.821835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:26.821602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:26.821602+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.821602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:14.692681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.090108+0000","last_change":"2024-02-18T16:23:17.090161+0000","last_active":"2024-02-18T16:23:17.090108+0000","last_peered":"2024-02-18T16:23:17.090108+0000","last_clean":"2024-02-18T16:23:17.090108+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:23:17.090108+0000","last_undegraded":"2024-02-18T16:23:17.090108+0000","last_fullsized":"2024-02-18T16:23:17.090108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.089913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.206720+0000","last_change":"2024-02-18T16:23:37.206785+0000","last_active":"2024-02-18T16:23:37.206720+0000","last_peered":"2024-02-18T16:23:37.206720+0000","last_clean":"2024-02-18T16:23:37.206720+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:23:37.206720+0000","last_undegraded":"2024-02-18T16:23:37.206720+0000","last_fullsized":"2024-02-18T16:23:37.206720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:37.206498+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:37.206498+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.206498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:44.876898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.695632+0000","last_change":"2024-02-18T16:23:06.695632+0000","last_active":"2024-02-18T16:23:06.695632+0000","last_peered":"2024-02-18T16:23:06.695632+0000","last_clean":"2024-02-18T16:23:06.695632+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:23:06.695632+0000","last_undegraded":"2024-02-18T16:23:06.695632+0000","last_fullsized":"2024-02-18T16:23:06.695632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.695361+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:14:59.478331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.802543+0000","last_change":"2024-02-18T16:23:43.802710+0000","last_active":"2024-02-18T16:23:43.802543+0000","last_peered":"2024-02-18T16:23:43.802543+0000","last_clean":"2024-02-18T16:23:43.802543+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:23:43.802543+0000","last_undegraded":"2024-02-18T16:23:43.802543+0000","last_fullsized":"2024-02-18T16:23:43.802543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:43.802187+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:43.802187+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.802187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:47.826817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.181619+0000","last_change":"2024-02-18T16:23:29.181684+0000","last_active":"2024-02-18T16:23:29.181619+0000","last_peered":"2024-02-18T16:23:29.181619+0000","last_clean":"2024-02-18T16:23:29.181619+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:23:29.181619+0000","last_undegraded":"2024-02-18T16:23:29.181619+0000","last_fullsized":"2024-02-18T16:23:29.181619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:29.181423+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:29.181423+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.181423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:22.839630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.178294+0000","last_change":"2024-02-18T16:23:30.178437+0000","last_active":"2024-02-18T16:23:30.178294+0000","last_peered":"2024-02-18T16:23:30.178294+0000","last_clean":"2024-02-18T16:23:30.178294+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:23:30.178294+0000","last_undegraded":"2024-02-18T16:23:30.178294+0000","last_fullsized":"2024-02-18T16:23:30.178294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.178051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.178051+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.178051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:30.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.185309+0000","last_change":"2024-02-18T16:23:13.185363+0000","last_active":"2024-02-18T16:23:13.185309+0000","last_peered":"2024-02-18T16:23:13.185309+0000","last_clean":"2024-02-18T16:23:13.185309+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:23:13.185309+0000","last_undegraded":"2024-02-18T16:23:13.185309+0000","last_fullsized":"2024-02-18T16:23:13.185309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.185106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:23.477010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.128487+0000","last_change":"2024-02-18T16:23:26.128566+0000","last_active":"2024-02-18T16:23:26.128487+0000","last_peered":"2024-02-18T16:23:26.128487+0000","last_clean":"2024-02-18T16:23:26.128487+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:23:26.128487+0000","last_undegraded":"2024-02-18T16:23:26.128487+0000","last_fullsized":"2024-02-18T16:23:26.128487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:26.128280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:26.128280+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.128280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:52:08.092199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.719359+0000","last_change":"2024-02-18T16:23:42.719359+0000","last_active":"2024-02-18T16:23:42.719359+0000","last_peered":"2024-02-18T16:23:42.719359+0000","last_clean":"2024-02-18T16:23:42.719359+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:23:42.719359+0000","last_undegraded":"2024-02-18T16:23:42.719359+0000","last_fullsized":"2024-02-18T16:23:42.719359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:42.719100+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:42.719100+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.719100+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:35.837283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.779164+0000","last_change":"2024-02-18T16:23:25.779308+0000","last_active":"2024-02-18T16:23:25.779164+0000","last_peered":"2024-02-18T16:23:25.779164+0000","last_clean":"2024-02-18T16:23:25.779164+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:23:25.779164+0000","last_undegraded":"2024-02-18T16:23:25.779164+0000","last_fullsized":"2024-02-18T16:23:25.779164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.778902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.778902+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.778902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:34:06.641181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.127529+0000","last_change":"2024-02-18T16:23:27.127580+0000","last_active":"2024-02-18T16:23:27.127529+0000","last_peered":"2024-02-18T16:23:27.127529+0000","last_clean":"2024-02-18T16:23:27.127529+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:23:27.127529+0000","last_undegraded":"2024-02-18T16:23:27.127529+0000","last_fullsized":"2024-02-18T16:23:27.127529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:27.127342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:27.127342+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.127342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:19.910312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.861175+0000","last_change":"2024-02-18T16:23:28.861242+0000","last_active":"2024-02-18T16:23:28.861175+0000","last_peered":"2024-02-18T16:23:28.861175+0000","last_clean":"2024-02-18T16:23:28.861175+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:23:28.861175+0000","last_undegraded":"2024-02-18T16:23:28.861175+0000","last_fullsized":"2024-02-18T16:23:28.861175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.860971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.860971+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.860971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:25.802445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.756466+0000","last_change":"2024-02-18T16:23:22.756531+0000","last_active":"2024-02-18T16:23:22.756466+0000","last_peered":"2024-02-18T16:23:22.756466+0000","last_clean":"2024-02-18T16:23:22.756466+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:23:22.756466+0000","last_undegraded":"2024-02-18T16:23:22.756466+0000","last_fullsized":"2024-02-18T16:23:22.756466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.756253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.697727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.165521+0000","last_change":"2024-02-18T16:23:28.165582+0000","last_active":"2024-02-18T16:23:28.165521+0000","last_peered":"2024-02-18T16:23:28.165521+0000","last_clean":"2024-02-18T16:23:28.165521+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:23:28.165521+0000","last_undegraded":"2024-02-18T16:23:28.165521+0000","last_fullsized":"2024-02-18T16:23:28.165521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.165316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.165316+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.165316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:34.370583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.779865+0000","last_change":"2024-02-18T16:23:28.779917+0000","last_active":"2024-02-18T16:23:28.779865+0000","last_peered":"2024-02-18T16:23:28.779865+0000","last_clean":"2024-02-18T16:23:28.779865+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:23:28.779865+0000","last_undegraded":"2024-02-18T16:23:28.779865+0000","last_fullsized":"2024-02-18T16:23:28.779865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.779667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.779667+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.779667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:00:05.304973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:05.800510+0000","last_change":"2024-02-18T16:24:05.800575+0000","last_active":"2024-02-18T16:24:05.800510+0000","last_peered":"2024-02-18T16:24:05.800510+0000","last_clean":"2024-02-18T16:24:05.800510+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:24:05.800510+0000","last_undegraded":"2024-02-18T16:24:05.800510+0000","last_fullsized":"2024-02-18T16:24:05.800510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:05.800282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:05.800282+0000","last_clean_scrub_stamp":"2024-02-18T16:24:05.800282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:44:36.551397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.737010+0000","last_change":"2024-02-18T16:23:27.737075+0000","last_active":"2024-02-18T16:23:27.737010+0000","last_peered":"2024-02-18T16:23:27.737010+0000","last_clean":"2024-02-18T16:23:27.737010+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:23:27.737010+0000","last_undegraded":"2024-02-18T16:23:27.737010+0000","last_fullsized":"2024-02-18T16:23:27.737010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:27.736808+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:27.736808+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.736808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:56:21.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.213659+0000","last_change":"2024-02-18T16:23:39.213721+0000","last_active":"2024-02-18T16:23:39.213659+0000","last_peered":"2024-02-18T16:23:39.213659+0000","last_clean":"2024-02-18T16:23:39.213659+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:23:39.213659+0000","last_undegraded":"2024-02-18T16:23:39.213659+0000","last_fullsized":"2024-02-18T16:23:39.213659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:39.213463+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:39.213463+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.213463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:27:12.046770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.212996+0000","last_change":"2024-02-18T16:23:12.212996+0000","last_active":"2024-02-18T16:23:12.212996+0000","last_peered":"2024-02-18T16:23:12.212996+0000","last_clean":"2024-02-18T16:23:12.212996+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:23:12.212996+0000","last_undegraded":"2024-02-18T16:23:12.212996+0000","last_fullsized":"2024-02-18T16:23:12.212996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.212729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.222143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.941128+0000","last_change":"2024-02-18T16:23:38.941193+0000","last_active":"2024-02-18T16:23:38.941128+0000","last_peered":"2024-02-18T16:23:38.941128+0000","last_clean":"2024-02-18T16:23:38.941128+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:23:38.941128+0000","last_undegraded":"2024-02-18T16:23:38.941128+0000","last_fullsized":"2024-02-18T16:23:38.941128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:38.940925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:38.940925+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.940925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:54.178081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.757093+0000","last_change":"2024-02-18T16:23:24.757151+0000","last_active":"2024-02-18T16:23:24.757093+0000","last_peered":"2024-02-18T16:23:24.757093+0000","last_clean":"2024-02-18T16:23:24.757093+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:23:24.757093+0000","last_undegraded":"2024-02-18T16:23:24.757093+0000","last_fullsized":"2024-02-18T16:23:24.757093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:24.756900+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:24.756900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.756900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:41.262573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.956312+0000","last_change":"2024-02-18T16:23:37.956378+0000","last_active":"2024-02-18T16:23:37.956312+0000","last_peered":"2024-02-18T16:23:37.956312+0000","last_clean":"2024-02-18T16:23:37.956312+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:23:37.956312+0000","last_undegraded":"2024-02-18T16:23:37.956312+0000","last_fullsized":"2024-02-18T16:23:37.956312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:37.956099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:37.956099+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.956099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:29.927127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.693758+0000","last_change":"2024-02-18T16:23:08.693758+0000","last_active":"2024-02-18T16:23:08.693758+0000","last_peered":"2024-02-18T16:23:08.693758+0000","last_clean":"2024-02-18T16:23:08.693758+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:23:08.693758+0000","last_undegraded":"2024-02-18T16:23:08.693758+0000","last_fullsized":"2024-02-18T16:23:08.693758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.693466+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:30:43.884820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.780137+0000","last_change":"2024-02-18T16:23:45.780294+0000","last_active":"2024-02-18T16:23:45.780137+0000","last_peered":"2024-02-18T16:23:45.780137+0000","last_clean":"2024-02-18T16:23:45.780137+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:23:45.780137+0000","last_undegraded":"2024-02-18T16:23:45.780137+0000","last_fullsized":"2024-02-18T16:23:45.780137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:45.779887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:45.779887+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.779887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:30.311975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.923282+0000","last_change":"2024-02-18T16:23:40.923356+0000","last_active":"2024-02-18T16:23:40.923282+0000","last_peered":"2024-02-18T16:23:40.923282+0000","last_clean":"2024-02-18T16:23:40.923282+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:23:40.923282+0000","last_undegraded":"2024-02-18T16:23:40.923282+0000","last_fullsized":"2024-02-18T16:23:40.923282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:40.923088+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:40.923088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.923088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:39.018071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:06.809536+0000","last_change":"2024-02-18T16:24:06.809595+0000","last_active":"2024-02-18T16:24:06.809536+0000","last_peered":"2024-02-18T16:24:06.809536+0000","last_clean":"2024-02-18T16:24:06.809536+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:24:06.809536+0000","last_undegraded":"2024-02-18T16:24:06.809536+0000","last_fullsized":"2024-02-18T16:24:06.809536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:06.809317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:06.809317+0000","last_clean_scrub_stamp":"2024-02-18T16:24:06.809317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:33:12.649311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.736468+0000","last_change":"2024-02-18T16:23:25.736525+0000","last_active":"2024-02-18T16:23:25.736468+0000","last_peered":"2024-02-18T16:23:25.736468+0000","last_clean":"2024-02-18T16:23:25.736468+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:23:25.736468+0000","last_undegraded":"2024-02-18T16:23:25.736468+0000","last_fullsized":"2024-02-18T16:23:25.736468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.736273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.736273+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.736273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:40:48.181060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.875104+0000","last_change":"2024-02-18T16:23:20.875163+0000","last_active":"2024-02-18T16:23:20.875104+0000","last_peered":"2024-02-18T16:23:20.875104+0000","last_clean":"2024-02-18T16:23:20.875104+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:23:20.875104+0000","last_undegraded":"2024-02-18T16:23:20.875104+0000","last_fullsized":"2024-02-18T16:23:20.875104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.874900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:20.030506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.750625+0000","last_change":"2024-02-18T16:23:18.750690+0000","last_active":"2024-02-18T16:23:18.750625+0000","last_peered":"2024-02-18T16:23:18.750625+0000","last_clean":"2024-02-18T16:23:18.750625+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:23:18.750625+0000","last_undegraded":"2024-02-18T16:23:18.750625+0000","last_fullsized":"2024-02-18T16:23:18.750625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.750433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:02.263592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:56.850528+0000","last_change":"2024-02-18T16:23:56.850595+0000","last_active":"2024-02-18T16:23:56.850528+0000","last_peered":"2024-02-18T16:23:56.850528+0000","last_clean":"2024-02-18T16:23:56.850528+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:23:56.850528+0000","last_undegraded":"2024-02-18T16:23:56.850528+0000","last_fullsized":"2024-02-18T16:23:56.850528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:56.850302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:56.850302+0000","last_clean_scrub_stamp":"2024-02-18T16:23:56.850302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:23:50.059676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:57.855634+0000","last_change":"2024-02-18T16:23:57.855753+0000","last_active":"2024-02-18T16:23:57.855634+0000","last_peered":"2024-02-18T16:23:57.855634+0000","last_clean":"2024-02-18T16:23:57.855634+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:23:57.855634+0000","last_undegraded":"2024-02-18T16:23:57.855634+0000","last_fullsized":"2024-02-18T16:23:57.855634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:57.855325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:57.855325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:57.855325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:31:03.050984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.165328+0000","last_change":"2024-02-18T16:23:14.165328+0000","last_active":"2024-02-18T16:23:14.165328+0000","last_peered":"2024-02-18T16:23:14.165328+0000","last_clean":"2024-02-18T16:23:14.165328+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:23:14.165328+0000","last_undegraded":"2024-02-18T16:23:14.165328+0000","last_fullsized":"2024-02-18T16:23:14.165328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.165073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:13.320679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.237166+0000","last_change":"2024-02-18T16:23:40.237226+0000","last_active":"2024-02-18T16:23:40.237166+0000","last_peered":"2024-02-18T16:23:40.237166+0000","last_clean":"2024-02-18T16:23:40.237166+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:23:40.237166+0000","last_undegraded":"2024-02-18T16:23:40.237166+0000","last_fullsized":"2024-02-18T16:23:40.237166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.236966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.236966+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.236966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:04.224436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.757028+0000","last_change":"2024-02-18T16:23:26.757028+0000","last_active":"2024-02-18T16:23:26.757028+0000","last_peered":"2024-02-18T16:23:26.757028+0000","last_clean":"2024-02-18T16:23:26.757028+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:23:26.757028+0000","last_undegraded":"2024-02-18T16:23:26.757028+0000","last_fullsized":"2024-02-18T16:23:26.757028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:26.756605+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:26.756605+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.756605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:13:18.607706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1422,"ondisk_log_size":1422,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39932,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331908,"statfs":{"total":96636764160,"available":96595873792,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":0.88},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.56799999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Sun Feb 18 16:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.48599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.80700000000000005,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.505,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77800000000000002}]},{"osd":2,"last update":"Sun Feb 18 16:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81699999999999995,"5min":1.2,"15min":1.2},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76200000000000001,"5min":1.319,"15min":1.319},"last":0.53200000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:23:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.745,"15min":0.77300000000000002},"min":{"1min":0.56599999999999995,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Sun Feb 18 16:23:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.004,"15min":1.208},"min":{"1min":0.36899999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.66400000000000003,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.86299999999999999,"15min":0.995},"min":{"1min":0.47199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.68200000000000005,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Feb 18 16:23:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.78900000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.3440000000000001,"15min":1.6299999999999999},"min":{"1min":0.59799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79700000000000004,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.68400000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:23:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.434,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.626},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.60099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Feb 18 16:23:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.501,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70699999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.47499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.747,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Feb 18 16:23:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.52300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.87,"15min":0.87},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.56999999999999995,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82199999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68300000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:23:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.48799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.68500000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.88400000000000001}]},{"osd":2,"last update":"Sun Feb 18 16:23:51 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52900000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88100000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89400000000000002,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.83899999999999997}]},{"osd":3,"last update":"Sun Feb 18 16:23:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92200000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.86799999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.91200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:24:10.658 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-18T16:21:02.815768+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=2, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:24:10.659 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:24:10.660 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:24:10.660 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:24:10.660 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-18T16:21:08.859744+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=21, tm_sec=8, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=16, tm_min=22, tm_sec=45, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T16:24:10.661 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-18T16:24:30.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T16:24:30.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.786+0000 7f6cbc067640 1 Processor -- start 2024-02-18T16:24:30.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.786+0000 7f6cbc067640 1 -- start start 2024-02-18T16:24:30.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.786+0000 7f6cbc067640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cb4099320 0x7f6cb4133210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:30.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.786+0000 7f6cbc067640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb409a490 con 0x7f6cb4098830 2024-02-18T16:24:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.786+0000 7f6cbc067640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb4072800 con 0x7f6cb4099320 2024-02-18T16:24:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb9602640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cb4099320 0x7f6cb4133210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb9e03640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cb4098830 0x7f6cb4098c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35200/0 (socket says 172.21.15.80:35200) 2024-02-18T16:24:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb9e03640 1 -- 172.21.15.80:0/894638728 learned_addr learned my addr 172.21.15.80:0/894638728 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:24:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb9602640 1 -- 172.21.15.80:0/894638728 >> v1:172.21.15.80:6789/0 conn(0x7f6cb4098830 legacy=0x7f6cb4098c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:30.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb9602640 1 -- 172.21.15.80:0/894638728 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb409d790 con 0x7f6cb4099320 2024-02-18T16:24:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb9602640 1 --2- 172.21.15.80:0/894638728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4099320 0x7f6cb4133210 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009740 tx=0x7f6ca401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdbbf71607dbfb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:30.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb8e01640 1 -- 172.21.15.80:0/894638728 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ca40ab530 con 0x7f6cb4099320 2024-02-18T16:24:30.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb8e01640 1 -- 172.21.15.80:0/894638728 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40a7050 con 0x7f6cb4099320 2024-02-18T16:24:30.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cb8e01640 1 -- 172.21.15.80:0/894638728 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ca40ab7e0 con 0x7f6cb4099320 2024-02-18T16:24:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 -- 172.21.15.80:0/894638728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4099320 msgr2=0x7f6cb4133210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 --2- 172.21.15.80:0/894638728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4099320 0x7f6cb4133210 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009740 tx=0x7f6ca401c370 comp rx=0 tx=0).stop 2024-02-18T16:24:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 -- 172.21.15.80:0/894638728 shutdown_connections 2024-02-18T16:24:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 --2- 172.21.15.80:0/894638728 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4099320 0x7f6cb4133210 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 -- 172.21.15.80:0/894638728 >> 172.21.15.80:0/894638728 conn(0x7f6cb40a0920 msgr2=0x7f6cb409ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:24:30.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 -- 172.21.15.80:0/894638728 shutdown_connections 2024-02-18T16:24:30.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.790+0000 7f6cbc067640 1 -- 172.21.15.80:0/894638728 wait complete. 2024-02-18T16:24:30.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 Processor -- start 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 -- start start 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 0x7f6cb41c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41330a0 con 0x7f6cb4098830 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cb9e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 0x7f6cb41c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cb9e03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 0x7f6cb41c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34000/0 (socket says 172.21.15.80:34000) 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cb9e03640 1 -- 172.21.15.80:0/3736879650 learned_addr learned my addr 172.21.15.80:0/3736879650 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cb9e03640 1 -- 172.21.15.80:0/3736879650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4009420 con 0x7f6cb4098830 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cb9e03640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 0x7f6cb41c4760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c480 tx=0x7f6cb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:30.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cb0005c20 con 0x7f6cb4098830 2024-02-18T16:24:30.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0005d80 con 0x7f6cb4098830 2024-02-18T16:24:30.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb412d420 con 0x7f6cb4098830 2024-02-18T16:24:30.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cb00071a0 con 0x7f6cb4098830 2024-02-18T16:24:30.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4071b30 con 0x7f6cb4098830 2024-02-18T16:24:30.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6cb0007300 con 0x7f6cb4098830 2024-02-18T16:24:30.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb40714f0 con 0x7f6cb4098830 2024-02-18T16:24:30.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6caa7fc640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6c98035a10 0x7f6c98037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:30.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f6cb0047de0 con 0x7f6cb4098830 2024-02-18T16:24:30.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.794+0000 7f6cb9602640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6c98035a10 0x7f6c98037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:30.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.798+0000 7f6cb9602640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6c98035a10 0x7f6c98037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40ad000 tx=0x7f6ca40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:30.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.798+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6cb004c070 con 0x7f6cb4098830 2024-02-18T16:24:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:30.954+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 --> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6cb4062860 con 0x7f6c98035a10 2024-02-18T16:24:31.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.002+0000 7f6caa7fc640 1 -- 172.21.15.80:0/3736879650 <== mgr.4101 v2:172.21.15.129:6824/4092544777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+674118 (secure 0 0 0) 0x7f6cb4062860 con 0x7f6c98035a10 2024-02-18T16:24:31.016 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-18T16:24:31.022 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-18T16:24:31.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6c98035a10 msgr2=0x7f6c98037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:31.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6c98035a10 0x7f6c98037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40ad000 tx=0x7f6ca40a6000 comp rx=0 tx=0).stop 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 msgr2=0x7f6cb41c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 0x7f6cb41c4760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c480 tx=0x7f6cb000c940 comp rx=0 tx=0).stop 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 shutdown_connections 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f6c98035a10 0x7f6c98037ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 --2- 172.21.15.80:0/3736879650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb4098830 0x7f6cb41c4760 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 >> 172.21.15.80:0/3736879650 conn(0x7f6cb40a0920 msgr2=0x7f6cb409b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:24:31.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 shutdown_connections 2024-02-18T16:24:31.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.006+0000 7f6cbc067640 1 -- 172.21.15.80:0/3736879650 wait complete. 2024-02-18T16:24:31.032 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-02-18T16:24:29.862056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4019,"num_read_kb":3665,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3970,"ondisk_log_size":3970,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152472,"kb_used_data":2808,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334888,"statfs":{"total":386547056640,"available":386390925312,"internally_reserved":0,"allocated":2875392,"data_stored":1773722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006864"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.916811+0000","last_change":"2024-02-18T16:23:22.916928+0000","last_active":"2024-02-18T16:23:22.916811+0000","last_peered":"2024-02-18T16:23:22.916811+0000","last_clean":"2024-02-18T16:23:22.916811+0000","last_became_active":"2024-02-18T16:20:59.847759+0000","last_became_peered":"2024-02-18T16:20:59.847759+0000","last_unstale":"2024-02-18T16:23:22.916811+0000","last_undegraded":"2024-02-18T16:23:22.916811+0000","last_fullsized":"2024-02-18T16:23:22.916811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.916517+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.916517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:21.117744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'6","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.750600+0000","last_change":"2024-02-18T16:23:16.750600+0000","last_active":"2024-02-18T16:23:16.750600+0000","last_peered":"2024-02-18T16:23:16.750600+0000","last_clean":"2024-02-18T16:23:16.750600+0000","last_became_active":"2024-02-18T16:21:01.837045+0000","last_became_peered":"2024-02-18T16:21:01.837045+0000","last_unstale":"2024-02-18T16:23:16.750600+0000","last_undegraded":"2024-02-18T16:23:16.750600+0000","last_fullsized":"2024-02-18T16:23:16.750600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.750307+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.750307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.951534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.161692+0000","last_change":"2024-02-18T16:23:20.161755+0000","last_active":"2024-02-18T16:23:20.161692+0000","last_peered":"2024-02-18T16:23:20.161692+0000","last_clean":"2024-02-18T16:23:20.161692+0000","last_became_active":"2024-02-18T16:20:59.861108+0000","last_became_peered":"2024-02-18T16:20:59.861108+0000","last_unstale":"2024-02-18T16:23:20.161692+0000","last_undegraded":"2024-02-18T16:23:20.161692+0000","last_fullsized":"2024-02-18T16:23:20.161692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.161465+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.161465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:08.032544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.737788+0000","last_change":"2024-02-18T16:23:23.737788+0000","last_active":"2024-02-18T16:23:23.737788+0000","last_peered":"2024-02-18T16:23:23.737788+0000","last_clean":"2024-02-18T16:23:23.737788+0000","last_became_active":"2024-02-18T16:21:01.855199+0000","last_became_peered":"2024-02-18T16:21:01.855199+0000","last_unstale":"2024-02-18T16:23:23.737788+0000","last_undegraded":"2024-02-18T16:23:23.737788+0000","last_fullsized":"2024-02-18T16:23:23.737788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:23.737502+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.737502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:54.805702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.730979+0000","last_change":"2024-02-18T16:23:41.731135+0000","last_active":"2024-02-18T16:23:41.730979+0000","last_peered":"2024-02-18T16:23:41.730979+0000","last_clean":"2024-02-18T16:23:41.730979+0000","last_became_active":"2024-02-18T16:20:59.870332+0000","last_became_peered":"2024-02-18T16:20:59.870332+0000","last_unstale":"2024-02-18T16:23:41.730979+0000","last_undegraded":"2024-02-18T16:23:41.730979+0000","last_fullsized":"2024-02-18T16:23:41.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:41.730728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:41.730728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.730728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:09:17.826198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.635085+0000","last_change":"2024-02-18T16:23:09.635085+0000","last_active":"2024-02-18T16:23:09.635085+0000","last_peered":"2024-02-18T16:23:09.635085+0000","last_clean":"2024-02-18T16:23:09.635085+0000","last_became_active":"2024-02-18T16:21:01.856100+0000","last_became_peered":"2024-02-18T16:21:01.856100+0000","last_unstale":"2024-02-18T16:23:09.635085+0000","last_undegraded":"2024-02-18T16:23:09.635085+0000","last_fullsized":"2024-02-18T16:23:09.635085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:09.634784+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.634784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:09.758604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.731501+0000","last_change":"2024-02-18T16:23:33.731558+0000","last_active":"2024-02-18T16:23:33.731501+0000","last_peered":"2024-02-18T16:23:33.731501+0000","last_clean":"2024-02-18T16:23:33.731501+0000","last_became_active":"2024-02-18T16:20:59.832081+0000","last_became_peered":"2024-02-18T16:20:59.832081+0000","last_unstale":"2024-02-18T16:23:33.731501+0000","last_undegraded":"2024-02-18T16:23:33.731501+0000","last_fullsized":"2024-02-18T16:23:33.731501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.731298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.731298+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.731298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:26.514268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'22","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.751173+0000","last_change":"2024-02-18T16:23:03.751173+0000","last_active":"2024-02-18T16:23:03.751173+0000","last_peered":"2024-02-18T16:23:03.751173+0000","last_clean":"2024-02-18T16:23:03.751173+0000","last_became_active":"2024-02-18T16:21:01.856142+0000","last_became_peered":"2024-02-18T16:21:01.856142+0000","last_unstale":"2024-02-18T16:23:03.751173+0000","last_undegraded":"2024-02-18T16:23:03.751173+0000","last_fullsized":"2024-02-18T16:23:03.751173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-02-18T16:23:03.750777+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.750777+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:02.603622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":86,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.754228+0000","last_change":"2024-02-18T16:23:46.754303+0000","last_active":"2024-02-18T16:23:46.754228+0000","last_peered":"2024-02-18T16:23:46.754228+0000","last_clean":"2024-02-18T16:23:46.754228+0000","last_became_active":"2024-02-18T16:20:59.868044+0000","last_became_peered":"2024-02-18T16:20:59.868044+0000","last_unstale":"2024-02-18T16:23:46.754228+0000","last_undegraded":"2024-02-18T16:23:46.754228+0000","last_fullsized":"2024-02-18T16:23:46.754228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:46.753986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:46.753986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.753986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:21:21.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.783795+0000","last_change":"2024-02-18T16:23:17.783856+0000","last_active":"2024-02-18T16:23:17.783795+0000","last_peered":"2024-02-18T16:23:17.783795+0000","last_clean":"2024-02-18T16:23:17.783795+0000","last_became_active":"2024-02-18T16:21:01.836575+0000","last_became_peered":"2024-02-18T16:21:01.836575+0000","last_unstale":"2024-02-18T16:23:17.783795+0000","last_undegraded":"2024-02-18T16:23:17.783795+0000","last_fullsized":"2024-02-18T16:23:17.783795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:17.783609+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.783609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.839510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.821387+0000","last_change":"2024-02-18T16:23:30.821444+0000","last_active":"2024-02-18T16:23:30.821387+0000","last_peered":"2024-02-18T16:23:30.821387+0000","last_clean":"2024-02-18T16:23:30.821387+0000","last_became_active":"2024-02-18T16:20:59.826665+0000","last_became_peered":"2024-02-18T16:20:59.826665+0000","last_unstale":"2024-02-18T16:23:30.821387+0000","last_undegraded":"2024-02-18T16:23:30.821387+0000","last_fullsized":"2024-02-18T16:23:30.821387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.821199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.821199+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.821199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:29.674043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.784360+0000","last_change":"2024-02-18T16:23:22.784418+0000","last_active":"2024-02-18T16:23:22.784360+0000","last_peered":"2024-02-18T16:23:22.784360+0000","last_clean":"2024-02-18T16:23:22.784360+0000","last_became_active":"2024-02-18T16:21:01.855862+0000","last_became_peered":"2024-02-18T16:21:01.855862+0000","last_unstale":"2024-02-18T16:23:22.784360+0000","last_undegraded":"2024-02-18T16:23:22.784360+0000","last_fullsized":"2024-02-18T16:23:22.784360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:22.784173+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.784173+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:14.537344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:03.815631+0000","last_change":"2024-02-18T16:24:03.815706+0000","last_active":"2024-02-18T16:24:03.815631+0000","last_peered":"2024-02-18T16:24:03.815631+0000","last_clean":"2024-02-18T16:24:03.815631+0000","last_became_active":"2024-02-18T16:20:59.847344+0000","last_became_peered":"2024-02-18T16:20:59.847344+0000","last_unstale":"2024-02-18T16:24:03.815631+0000","last_undegraded":"2024-02-18T16:24:03.815631+0000","last_fullsized":"2024-02-18T16:24:03.815631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:24:03.815384+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:24:03.815384+0000","last_clean_scrub_stamp":"2024-02-18T16:24:03.815384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:07.096890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.991352+0000","last_change":"2024-02-18T16:23:13.991423+0000","last_active":"2024-02-18T16:23:13.991352+0000","last_peered":"2024-02-18T16:23:13.991352+0000","last_clean":"2024-02-18T16:23:13.991352+0000","last_became_active":"2024-02-18T16:21:01.831315+0000","last_became_peered":"2024-02-18T16:21:01.831315+0000","last_unstale":"2024-02-18T16:23:13.991352+0000","last_undegraded":"2024-02-18T16:23:13.991352+0000","last_fullsized":"2024-02-18T16:23:13.991352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:13.991156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.991156+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:26.734895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":44,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.213484+0000","last_change":"2024-02-18T16:23:38.213630+0000","last_active":"2024-02-18T16:23:38.213484+0000","last_peered":"2024-02-18T16:23:38.213484+0000","last_clean":"2024-02-18T16:23:38.213484+0000","last_became_active":"2024-02-18T16:20:59.850013+0000","last_became_peered":"2024-02-18T16:20:59.850013+0000","last_unstale":"2024-02-18T16:23:38.213484+0000","last_undegraded":"2024-02-18T16:23:38.213484+0000","last_fullsized":"2024-02-18T16:23:38.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:38.213236+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:38.213236+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.213236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:34:57.885442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.883579+0000","last_change":"2024-02-18T16:23:21.883639+0000","last_active":"2024-02-18T16:23:21.883579+0000","last_peered":"2024-02-18T16:23:21.883579+0000","last_clean":"2024-02-18T16:23:21.883579+0000","last_became_active":"2024-02-18T16:21:01.845260+0000","last_became_peered":"2024-02-18T16:21:01.845260+0000","last_unstale":"2024-02-18T16:23:21.883579+0000","last_undegraded":"2024-02-18T16:23:21.883579+0000","last_fullsized":"2024-02-18T16:23:21.883579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:21.883366+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.883366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:08:05.625702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.746411+0000","last_change":"2024-02-18T16:23:37.746574+0000","last_active":"2024-02-18T16:23:37.746411+0000","last_peered":"2024-02-18T16:23:37.746411+0000","last_clean":"2024-02-18T16:23:37.746411+0000","last_became_active":"2024-02-18T16:21:01.851773+0000","last_became_peered":"2024-02-18T16:21:01.851773+0000","last_unstale":"2024-02-18T16:23:37.746411+0000","last_undegraded":"2024-02-18T16:23:37.746411+0000","last_fullsized":"2024-02-18T16:23:37.746411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:37.746133+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:37.746133+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.746133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:33:52.796407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.808047+0000","last_change":"2024-02-18T16:23:27.808113+0000","last_active":"2024-02-18T16:23:27.808047+0000","last_peered":"2024-02-18T16:23:27.808047+0000","last_clean":"2024-02-18T16:23:27.808047+0000","last_became_active":"2024-02-18T16:20:59.860710+0000","last_became_peered":"2024-02-18T16:20:59.860710+0000","last_unstale":"2024-02-18T16:23:27.808047+0000","last_undegraded":"2024-02-18T16:23:27.808047+0000","last_fullsized":"2024-02-18T16:23:27.808047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:27.807847+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:27.807847+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.807847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:20.590817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.727308+0000","last_change":"2024-02-18T16:23:19.727308+0000","last_active":"2024-02-18T16:23:19.727308+0000","last_peered":"2024-02-18T16:23:19.727308+0000","last_clean":"2024-02-18T16:23:19.727308+0000","last_became_active":"2024-02-18T16:21:01.833377+0000","last_became_peered":"2024-02-18T16:21:01.833377+0000","last_unstale":"2024-02-18T16:23:19.727308+0000","last_undegraded":"2024-02-18T16:23:19.727308+0000","last_fullsized":"2024-02-18T16:23:19.727308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:19.727029+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.727029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:34:32.149408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.946153+0000","last_change":"2024-02-18T16:23:16.946153+0000","last_active":"2024-02-18T16:23:16.946153+0000","last_peered":"2024-02-18T16:23:16.946153+0000","last_clean":"2024-02-18T16:23:16.946153+0000","last_became_active":"2024-02-18T16:20:59.857814+0000","last_became_peered":"2024-02-18T16:20:59.857814+0000","last_unstale":"2024-02-18T16:23:16.946153+0000","last_undegraded":"2024-02-18T16:23:16.946153+0000","last_fullsized":"2024-02-18T16:23:16.946153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.945824+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.945824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:28.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.715031+0000","last_change":"2024-02-18T16:23:09.715031+0000","last_active":"2024-02-18T16:23:09.715031+0000","last_peered":"2024-02-18T16:23:09.715031+0000","last_clean":"2024-02-18T16:23:09.715031+0000","last_became_active":"2024-02-18T16:21:01.846646+0000","last_became_peered":"2024-02-18T16:21:01.846646+0000","last_unstale":"2024-02-18T16:23:09.715031+0000","last_undegraded":"2024-02-18T16:23:09.715031+0000","last_fullsized":"2024-02-18T16:23:09.715031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:09.714755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.714755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.994872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.725548+0000","last_change":"2024-02-18T16:23:23.725548+0000","last_active":"2024-02-18T16:23:23.725548+0000","last_peered":"2024-02-18T16:23:23.725548+0000","last_clean":"2024-02-18T16:23:23.725548+0000","last_became_active":"2024-02-18T16:20:59.859205+0000","last_became_peered":"2024-02-18T16:20:59.859205+0000","last_unstale":"2024-02-18T16:23:23.725548+0000","last_undegraded":"2024-02-18T16:23:23.725548+0000","last_fullsized":"2024-02-18T16:23:23.725548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.725287+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.725287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:05:10.067817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.180481+0000","last_change":"2024-02-18T16:23:31.180547+0000","last_active":"2024-02-18T16:23:31.180481+0000","last_peered":"2024-02-18T16:23:31.180481+0000","last_clean":"2024-02-18T16:23:31.180481+0000","last_became_active":"2024-02-18T16:21:01.843635+0000","last_became_peered":"2024-02-18T16:21:01.843635+0000","last_unstale":"2024-02-18T16:23:31.180481+0000","last_undegraded":"2024-02-18T16:23:31.180481+0000","last_fullsized":"2024-02-18T16:23:31.180481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:31.180290+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:31.180290+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.180290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:45:14.817248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.818695+0000","last_change":"2024-02-18T16:23:29.818755+0000","last_active":"2024-02-18T16:23:29.818695+0000","last_peered":"2024-02-18T16:23:29.818695+0000","last_clean":"2024-02-18T16:23:29.818695+0000","last_became_active":"2024-02-18T16:20:59.860654+0000","last_became_peered":"2024-02-18T16:20:59.860654+0000","last_unstale":"2024-02-18T16:23:29.818695+0000","last_undegraded":"2024-02-18T16:23:29.818695+0000","last_fullsized":"2024-02-18T16:23:29.818695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:29.818491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:29.818491+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.818491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:16:34.224985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.884583+0000","last_change":"2024-02-18T16:23:23.884704+0000","last_active":"2024-02-18T16:23:23.884583+0000","last_peered":"2024-02-18T16:23:23.884583+0000","last_clean":"2024-02-18T16:23:23.884583+0000","last_became_active":"2024-02-18T16:21:01.846974+0000","last_became_peered":"2024-02-18T16:21:01.846974+0000","last_unstale":"2024-02-18T16:23:23.884583+0000","last_undegraded":"2024-02-18T16:23:23.884583+0000","last_fullsized":"2024-02-18T16:23:23.884583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:23.884277+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.884277+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.884277+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:07.940178+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.136656+0000","last_change":"2024-02-18T16:23:24.136726+0000","last_active":"2024-02-18T16:23:24.136656+0000","last_peered":"2024-02-18T16:23:24.136656+0000","last_clean":"2024-02-18T16:23:24.136656+0000","last_became_active":"2024-02-18T16:20:59.859447+0000","last_became_peered":"2024-02-18T16:20:59.859447+0000","last_unstale":"2024-02-18T16:23:24.136656+0000","last_undegraded":"2024-02-18T16:23:24.136656+0000","last_fullsized":"2024-02-18T16:23:24.136656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:24.136457+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:24.136457+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.136457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:04:22.989302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.728657+0000","last_change":"2024-02-18T16:23:20.728657+0000","last_active":"2024-02-18T16:23:20.728657+0000","last_peered":"2024-02-18T16:23:20.728657+0000","last_clean":"2024-02-18T16:23:20.728657+0000","last_became_active":"2024-02-18T16:21:01.838225+0000","last_became_peered":"2024-02-18T16:21:01.838225+0000","last_unstale":"2024-02-18T16:23:20.728657+0000","last_undegraded":"2024-02-18T16:23:20.728657+0000","last_fullsized":"2024-02-18T16:23:20.728657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:20.728399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.728399+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:20.792298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:53.816802+0000","last_change":"2024-02-18T16:23:53.816869+0000","last_active":"2024-02-18T16:23:53.816802+0000","last_peered":"2024-02-18T16:23:53.816802+0000","last_clean":"2024-02-18T16:23:53.816802+0000","last_became_active":"2024-02-18T16:20:59.859457+0000","last_became_peered":"2024-02-18T16:20:59.859457+0000","last_unstale":"2024-02-18T16:23:53.816802+0000","last_undegraded":"2024-02-18T16:23:53.816802+0000","last_fullsized":"2024-02-18T16:23:53.816802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:53.816602+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:53.816602+0000","last_clean_scrub_stamp":"2024-02-18T16:23:53.816602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:51:40.691240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.923769+0000","last_change":"2024-02-18T16:23:41.923837+0000","last_active":"2024-02-18T16:23:41.923769+0000","last_peered":"2024-02-18T16:23:41.923769+0000","last_clean":"2024-02-18T16:23:41.923769+0000","last_became_active":"2024-02-18T16:21:09.915319+0000","last_became_peered":"2024-02-18T16:21:09.915319+0000","last_unstale":"2024-02-18T16:23:41.923769+0000","last_undegraded":"2024-02-18T16:23:41.923769+0000","last_fullsized":"2024-02-18T16:23:41.923769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-02-18T16:23:41.923509+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-02-18T16:23:41.923509+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.923509+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:32:12.867890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'10","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.708169+0000","last_change":"2024-02-18T16:23:29.708258+0000","last_active":"2024-02-18T16:23:29.708169+0000","last_peered":"2024-02-18T16:23:29.708169+0000","last_clean":"2024-02-18T16:23:29.708169+0000","last_became_active":"2024-02-18T16:21:01.853183+0000","last_became_peered":"2024-02-18T16:21:01.853183+0000","last_unstale":"2024-02-18T16:23:29.708169+0000","last_undegraded":"2024-02-18T16:23:29.708169+0000","last_fullsized":"2024-02-18T16:23:29.708169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:29.707944+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:29.707944+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.707944+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:23.851740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:48.797737+0000","last_change":"2024-02-18T16:23:48.797805+0000","last_active":"2024-02-18T16:23:48.797737+0000","last_peered":"2024-02-18T16:23:48.797737+0000","last_clean":"2024-02-18T16:23:48.797737+0000","last_became_active":"2024-02-18T16:20:59.871160+0000","last_became_peered":"2024-02-18T16:20:59.871160+0000","last_unstale":"2024-02-18T16:23:48.797737+0000","last_undegraded":"2024-02-18T16:23:48.797737+0000","last_fullsized":"2024-02-18T16:23:48.797737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:48.797530+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:48.797530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:48.797530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:28:04.985948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.907189+0000","last_change":"2024-02-18T16:22:49.907189+0000","last_active":"2024-02-18T16:22:49.907189+0000","last_peered":"2024-02-18T16:22:49.907189+0000","last_clean":"2024-02-18T16:22:49.907189+0000","last_became_active":"2024-02-18T16:21:03.855014+0000","last_became_peered":"2024-02-18T16:21:03.855014+0000","last_unstale":"2024-02-18T16:22:49.907189+0000","last_undegraded":"2024-02-18T16:22:49.907189+0000","last_fullsized":"2024-02-18T16:22:49.907189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.906822+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.906822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:01.255503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.689035+0000","last_change":"2024-02-18T16:23:15.689035+0000","last_active":"2024-02-18T16:23:15.689035+0000","last_peered":"2024-02-18T16:23:15.689035+0000","last_clean":"2024-02-18T16:23:15.689035+0000","last_became_active":"2024-02-18T16:21:05.900746+0000","last_became_peered":"2024-02-18T16:21:05.900746+0000","last_unstale":"2024-02-18T16:23:15.689035+0000","last_undegraded":"2024-02-18T16:23:15.689035+0000","last_fullsized":"2024-02-18T16:23:15.689035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:15.688708+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.688708+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:06.486435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.716776+0000","last_change":"2024-02-18T16:23:10.716776+0000","last_active":"2024-02-18T16:23:10.716776+0000","last_peered":"2024-02-18T16:23:10.716776+0000","last_clean":"2024-02-18T16:23:10.716776+0000","last_became_active":"2024-02-18T16:21:07.918034+0000","last_became_peered":"2024-02-18T16:21:07.918034+0000","last_unstale":"2024-02-18T16:23:10.716776+0000","last_undegraded":"2024-02-18T16:23:10.716776+0000","last_fullsized":"2024-02-18T16:23:10.716776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.716530+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.716530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:22.065211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.931479+0000","last_change":"2024-02-18T16:23:42.931545+0000","last_active":"2024-02-18T16:23:42.931479+0000","last_peered":"2024-02-18T16:23:42.931479+0000","last_clean":"2024-02-18T16:23:42.931479+0000","last_became_active":"2024-02-18T16:21:09.915162+0000","last_became_peered":"2024-02-18T16:21:09.915162+0000","last_unstale":"2024-02-18T16:23:42.931479+0000","last_undegraded":"2024-02-18T16:23:42.931479+0000","last_fullsized":"2024-02-18T16:23:42.931479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:42.931280+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:42.931280+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.931280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:13.999480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.649753+0000","last_change":"2024-02-18T16:23:07.649753+0000","last_active":"2024-02-18T16:23:07.649753+0000","last_peered":"2024-02-18T16:23:07.649753+0000","last_clean":"2024-02-18T16:23:07.649753+0000","last_became_active":"2024-02-18T16:21:01.856299+0000","last_became_peered":"2024-02-18T16:21:01.856299+0000","last_unstale":"2024-02-18T16:23:07.649753+0000","last_undegraded":"2024-02-18T16:23:07.649753+0000","last_fullsized":"2024-02-18T16:23:07.649753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:07.649419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.649419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:13.854686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.779853+0000","last_change":"2024-02-18T16:23:31.780013+0000","last_active":"2024-02-18T16:23:31.779853+0000","last_peered":"2024-02-18T16:23:31.779853+0000","last_clean":"2024-02-18T16:23:31.779853+0000","last_became_active":"2024-02-18T16:20:59.829341+0000","last_became_peered":"2024-02-18T16:20:59.829341+0000","last_unstale":"2024-02-18T16:23:31.779853+0000","last_undegraded":"2024-02-18T16:23:31.779853+0000","last_fullsized":"2024-02-18T16:23:31.779853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:31.779619+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:31.779619+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.779619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:39.346374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.257769+0000","last_change":"2024-02-18T16:23:10.257769+0000","last_active":"2024-02-18T16:23:10.257769+0000","last_peered":"2024-02-18T16:23:10.257769+0000","last_clean":"2024-02-18T16:23:10.257769+0000","last_became_active":"2024-02-18T16:21:03.851572+0000","last_became_peered":"2024-02-18T16:21:03.851572+0000","last_unstale":"2024-02-18T16:23:10.257769+0000","last_undegraded":"2024-02-18T16:23:10.257769+0000","last_fullsized":"2024-02-18T16:23:10.257769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.257505+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.257505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:50:21.606186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.663488+0000","last_change":"2024-02-18T16:22:55.663488+0000","last_active":"2024-02-18T16:22:55.663488+0000","last_peered":"2024-02-18T16:22:55.663488+0000","last_clean":"2024-02-18T16:22:55.663488+0000","last_became_active":"2024-02-18T16:21:05.874718+0000","last_became_peered":"2024-02-18T16:21:05.874718+0000","last_unstale":"2024-02-18T16:22:55.663488+0000","last_undegraded":"2024-02-18T16:22:55.663488+0000","last_fullsized":"2024-02-18T16:22:55.663488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:22:55.663204+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.663204+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:33.049677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.622314+0000","last_change":"2024-02-18T16:23:02.622314+0000","last_active":"2024-02-18T16:23:02.622314+0000","last_peered":"2024-02-18T16:23:02.622314+0000","last_clean":"2024-02-18T16:23:02.622314+0000","last_became_active":"2024-02-18T16:21:07.909020+0000","last_became_peered":"2024-02-18T16:21:07.909020+0000","last_unstale":"2024-02-18T16:23:02.622314+0000","last_undegraded":"2024-02-18T16:23:02.622314+0000","last_fullsized":"2024-02-18T16:23:02.622314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.622050+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.622050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.772173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.264439+0000","last_change":"2024-02-18T16:23:45.264499+0000","last_active":"2024-02-18T16:23:45.264439+0000","last_peered":"2024-02-18T16:23:45.264439+0000","last_clean":"2024-02-18T16:23:45.264439+0000","last_became_active":"2024-02-18T16:21:09.925368+0000","last_became_peered":"2024-02-18T16:21:09.925368+0000","last_unstale":"2024-02-18T16:23:45.264439+0000","last_undegraded":"2024-02-18T16:23:45.264439+0000","last_fullsized":"2024-02-18T16:23:45.264439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:45.264234+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:45.264234+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.264234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:58:55.811553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'12","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.724846+0000","last_change":"2024-02-18T16:23:43.724846+0000","last_active":"2024-02-18T16:23:43.724846+0000","last_peered":"2024-02-18T16:23:43.724846+0000","last_clean":"2024-02-18T16:23:43.724846+0000","last_became_active":"2024-02-18T16:21:41.175694+0000","last_became_peered":"2024-02-18T16:21:41.175694+0000","last_unstale":"2024-02-18T16:23:43.724846+0000","last_undegraded":"2024-02-18T16:23:43.724846+0000","last_fullsized":"2024-02-18T16:23:43.724846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-02-18T16:23:43.724551+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-02-18T16:23:43.724551+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.724551+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:51.394951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:04.791474+0000","last_change":"2024-02-18T16:24:04.791544+0000","last_active":"2024-02-18T16:24:04.791474+0000","last_peered":"2024-02-18T16:24:04.791474+0000","last_clean":"2024-02-18T16:24:04.791474+0000","last_became_active":"2024-02-18T16:20:59.847391+0000","last_became_peered":"2024-02-18T16:20:59.847391+0000","last_unstale":"2024-02-18T16:24:04.791474+0000","last_undegraded":"2024-02-18T16:24:04.791474+0000","last_fullsized":"2024-02-18T16:24:04.791474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:04.791241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:04.791241+0000","last_clean_scrub_stamp":"2024-02-18T16:24:04.791241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:20:51.203169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.707099+0000","last_change":"2024-02-18T16:23:41.707099+0000","last_active":"2024-02-18T16:23:41.707099+0000","last_peered":"2024-02-18T16:23:41.707099+0000","last_clean":"2024-02-18T16:23:41.707099+0000","last_became_active":"2024-02-18T16:21:40.954437+0000","last_became_peered":"2024-02-18T16:21:40.954437+0000","last_unstale":"2024-02-18T16:23:41.707099+0000","last_undegraded":"2024-02-18T16:23:41.707099+0000","last_fullsized":"2024-02-18T16:23:41.707099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:41.706854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:41.706854+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.706854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:32.504580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.873532+0000","last_change":"2024-02-18T16:22:56.873532+0000","last_active":"2024-02-18T16:22:56.873532+0000","last_peered":"2024-02-18T16:22:56.873532+0000","last_clean":"2024-02-18T16:22:56.873532+0000","last_became_active":"2024-02-18T16:21:05.894538+0000","last_became_peered":"2024-02-18T16:21:05.894538+0000","last_unstale":"2024-02-18T16:22:56.873532+0000","last_undegraded":"2024-02-18T16:22:56.873532+0000","last_fullsized":"2024-02-18T16:22:56.873532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:22:56.873112+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.873112+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:36.931560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.812587+0000","last_change":"2024-02-18T16:23:20.812587+0000","last_active":"2024-02-18T16:23:20.812587+0000","last_peered":"2024-02-18T16:23:20.812587+0000","last_clean":"2024-02-18T16:23:20.812587+0000","last_became_active":"2024-02-18T16:21:07.917181+0000","last_became_peered":"2024-02-18T16:21:07.917181+0000","last_unstale":"2024-02-18T16:23:20.812587+0000","last_undegraded":"2024-02-18T16:23:20.812587+0000","last_fullsized":"2024-02-18T16:23:20.812587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-02-18T16:23:20.812325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.812325+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:19:44.799795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.687518+0000","last_change":"2024-02-18T16:23:38.687518+0000","last_active":"2024-02-18T16:23:38.687518+0000","last_peered":"2024-02-18T16:23:38.687518+0000","last_clean":"2024-02-18T16:23:38.687518+0000","last_became_active":"2024-02-18T16:21:09.928540+0000","last_became_peered":"2024-02-18T16:21:09.928540+0000","last_unstale":"2024-02-18T16:23:38.687518+0000","last_undegraded":"2024-02-18T16:23:38.687518+0000","last_fullsized":"2024-02-18T16:23:38.687518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:38.687161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:38.687161+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.687161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:53.241419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.125274+0000","last_change":"2024-02-18T16:23:25.125274+0000","last_active":"2024-02-18T16:23:25.125274+0000","last_peered":"2024-02-18T16:23:25.125274+0000","last_clean":"2024-02-18T16:23:25.125274+0000","last_became_active":"2024-02-18T16:21:01.840693+0000","last_became_peered":"2024-02-18T16:21:01.840693+0000","last_unstale":"2024-02-18T16:23:25.125274+0000","last_undegraded":"2024-02-18T16:23:25.125274+0000","last_fullsized":"2024-02-18T16:23:25.125274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:25.125006+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:25.125006+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.125006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:32.691761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.777566+0000","last_change":"2024-02-18T16:23:31.777666+0000","last_active":"2024-02-18T16:23:31.777566+0000","last_peered":"2024-02-18T16:23:31.777566+0000","last_clean":"2024-02-18T16:23:31.777566+0000","last_became_active":"2024-02-18T16:20:59.859726+0000","last_became_peered":"2024-02-18T16:20:59.859726+0000","last_unstale":"2024-02-18T16:23:31.777566+0000","last_undegraded":"2024-02-18T16:23:31.777566+0000","last_fullsized":"2024-02-18T16:23:31.777566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:31.777340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:31.777340+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.777340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:24.754848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:13.828783+0000","last_change":"2024-02-18T16:24:13.828840+0000","last_active":"2024-02-18T16:24:13.828783+0000","last_peered":"2024-02-18T16:24:13.828783+0000","last_clean":"2024-02-18T16:24:13.828783+0000","last_became_active":"2024-02-18T16:21:40.959345+0000","last_became_peered":"2024-02-18T16:21:40.959345+0000","last_unstale":"2024-02-18T16:24:13.828783+0000","last_undegraded":"2024-02-18T16:24:13.828783+0000","last_fullsized":"2024-02-18T16:24:13.828783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:13.828592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:13.828592+0000","last_clean_scrub_stamp":"2024-02-18T16:24:13.828592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:00.721472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.859501+0000","last_change":"2024-02-18T16:22:58.859501+0000","last_active":"2024-02-18T16:22:58.859501+0000","last_peered":"2024-02-18T16:22:58.859501+0000","last_clean":"2024-02-18T16:22:58.859501+0000","last_became_active":"2024-02-18T16:21:05.887368+0000","last_became_peered":"2024-02-18T16:21:05.887368+0000","last_unstale":"2024-02-18T16:22:58.859501+0000","last_undegraded":"2024-02-18T16:22:58.859501+0000","last_fullsized":"2024-02-18T16:22:58.859501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-02-18T16:22:58.859048+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.859048+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:31.803635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":332,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.257854+0000","last_change":"2024-02-18T16:23:07.257854+0000","last_active":"2024-02-18T16:23:07.257854+0000","last_peered":"2024-02-18T16:23:07.257854+0000","last_clean":"2024-02-18T16:23:07.257854+0000","last_became_active":"2024-02-18T16:21:07.906784+0000","last_became_peered":"2024-02-18T16:21:07.906784+0000","last_unstale":"2024-02-18T16:23:07.257854+0000","last_undegraded":"2024-02-18T16:23:07.257854+0000","last_fullsized":"2024-02-18T16:23:07.257854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:23:07.257430+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.257430+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.001169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.733976+0000","last_change":"2024-02-18T16:23:34.734036+0000","last_active":"2024-02-18T16:23:34.733976+0000","last_peered":"2024-02-18T16:23:34.733976+0000","last_clean":"2024-02-18T16:23:34.733976+0000","last_became_active":"2024-02-18T16:21:01.852489+0000","last_became_peered":"2024-02-18T16:21:01.852489+0000","last_unstale":"2024-02-18T16:23:34.733976+0000","last_undegraded":"2024-02-18T16:23:34.733976+0000","last_fullsized":"2024-02-18T16:23:34.733976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.733782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.733782+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.733782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:31:17.679963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.677698+0000","last_change":"2024-02-18T16:23:36.677830+0000","last_active":"2024-02-18T16:23:36.677698+0000","last_peered":"2024-02-18T16:23:36.677698+0000","last_clean":"2024-02-18T16:23:36.677698+0000","last_became_active":"2024-02-18T16:20:59.834439+0000","last_became_peered":"2024-02-18T16:20:59.834439+0000","last_unstale":"2024-02-18T16:23:36.677698+0000","last_undegraded":"2024-02-18T16:23:36.677698+0000","last_fullsized":"2024-02-18T16:23:36.677698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.677442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.677442+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.677442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:36.801262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.628366+0000","last_change":"2024-02-18T16:23:01.628366+0000","last_active":"2024-02-18T16:23:01.628366+0000","last_peered":"2024-02-18T16:23:01.628366+0000","last_clean":"2024-02-18T16:23:01.628366+0000","last_became_active":"2024-02-18T16:21:03.862740+0000","last_became_peered":"2024-02-18T16:21:03.862740+0000","last_unstale":"2024-02-18T16:23:01.628366+0000","last_undegraded":"2024-02-18T16:23:01.628366+0000","last_fullsized":"2024-02-18T16:23:01.628366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.628086+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.628086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:49:06.387306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.868488+0000","last_change":"2024-02-18T16:23:00.868488+0000","last_active":"2024-02-18T16:23:00.868488+0000","last_peered":"2024-02-18T16:23:00.868488+0000","last_clean":"2024-02-18T16:23:00.868488+0000","last_became_active":"2024-02-18T16:21:05.884611+0000","last_became_peered":"2024-02-18T16:21:05.884611+0000","last_unstale":"2024-02-18T16:23:00.868488+0000","last_undegraded":"2024-02-18T16:23:00.868488+0000","last_fullsized":"2024-02-18T16:23:00.868488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:23:00.868066+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.868066+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:38.254540+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.249222+0000","last_change":"2024-02-18T16:23:11.249222+0000","last_active":"2024-02-18T16:23:11.249222+0000","last_peered":"2024-02-18T16:23:11.249222+0000","last_clean":"2024-02-18T16:23:11.249222+0000","last_became_active":"2024-02-18T16:21:07.906893+0000","last_became_peered":"2024-02-18T16:21:07.906893+0000","last_unstale":"2024-02-18T16:23:11.249222+0000","last_undegraded":"2024-02-18T16:23:11.249222+0000","last_fullsized":"2024-02-18T16:23:11.249222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.248957+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.248957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.900091+0000","last_change":"2024-02-18T16:23:11.900091+0000","last_active":"2024-02-18T16:23:11.900091+0000","last_peered":"2024-02-18T16:23:11.900091+0000","last_clean":"2024-02-18T16:23:11.900091+0000","last_became_active":"2024-02-18T16:21:09.917901+0000","last_became_peered":"2024-02-18T16:21:09.917901+0000","last_unstale":"2024-02-18T16:23:11.900091+0000","last_undegraded":"2024-02-18T16:23:11.900091+0000","last_fullsized":"2024-02-18T16:23:11.900091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:11.899800+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.899800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:40.591864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.803942+0000","last_change":"2024-02-18T16:23:30.804000+0000","last_active":"2024-02-18T16:23:30.803942+0000","last_peered":"2024-02-18T16:23:30.803942+0000","last_clean":"2024-02-18T16:23:30.803942+0000","last_became_active":"2024-02-18T16:21:01.842709+0000","last_became_peered":"2024-02-18T16:21:01.842709+0000","last_unstale":"2024-02-18T16:23:30.803942+0000","last_undegraded":"2024-02-18T16:23:30.803942+0000","last_fullsized":"2024-02-18T16:23:30.803942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.803736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.803736+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.803736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:32:08.517864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.779880+0000","last_change":"2024-02-18T16:23:32.779936+0000","last_active":"2024-02-18T16:23:32.779880+0000","last_peered":"2024-02-18T16:23:32.779880+0000","last_clean":"2024-02-18T16:23:32.779880+0000","last_became_active":"2024-02-18T16:20:59.831744+0000","last_became_peered":"2024-02-18T16:20:59.831744+0000","last_unstale":"2024-02-18T16:23:32.779880+0000","last_undegraded":"2024-02-18T16:23:32.779880+0000","last_fullsized":"2024-02-18T16:23:32.779880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.779679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.779679+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.779679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:52:14.743598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.348633+0000","last_change":"2024-02-18T16:23:04.348633+0000","last_active":"2024-02-18T16:23:04.348633+0000","last_peered":"2024-02-18T16:23:04.348633+0000","last_clean":"2024-02-18T16:23:04.348633+0000","last_became_active":"2024-02-18T16:21:03.865211+0000","last_became_peered":"2024-02-18T16:21:03.865211+0000","last_unstale":"2024-02-18T16:23:04.348633+0000","last_undegraded":"2024-02-18T16:23:04.348633+0000","last_fullsized":"2024-02-18T16:23:04.348633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:04.348289+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.348289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:35.555767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.694029+0000","last_change":"2024-02-18T16:23:14.694029+0000","last_active":"2024-02-18T16:23:14.694029+0000","last_peered":"2024-02-18T16:23:14.694029+0000","last_clean":"2024-02-18T16:23:14.694029+0000","last_became_active":"2024-02-18T16:21:05.901582+0000","last_became_peered":"2024-02-18T16:21:05.901582+0000","last_unstale":"2024-02-18T16:23:14.694029+0000","last_undegraded":"2024-02-18T16:23:14.694029+0000","last_fullsized":"2024-02-18T16:23:14.694029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-02-18T16:23:14.693728+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.693728+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:39.653173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.442044+0000","last_change":"2024-02-18T16:22:49.442044+0000","last_active":"2024-02-18T16:22:49.442044+0000","last_peered":"2024-02-18T16:22:49.442044+0000","last_clean":"2024-02-18T16:22:49.442044+0000","last_became_active":"2024-02-18T16:21:07.895811+0000","last_became_peered":"2024-02-18T16:21:07.895811+0000","last_unstale":"2024-02-18T16:22:49.442044+0000","last_undegraded":"2024-02-18T16:22:49.442044+0000","last_fullsized":"2024-02-18T16:22:49.442044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.441791+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.441791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:45:05.815867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.959752+0000","last_change":"2024-02-18T16:23:47.959903+0000","last_active":"2024-02-18T16:23:47.959752+0000","last_peered":"2024-02-18T16:23:47.959752+0000","last_clean":"2024-02-18T16:23:47.959752+0000","last_became_active":"2024-02-18T16:21:09.931467+0000","last_became_peered":"2024-02-18T16:21:09.931467+0000","last_unstale":"2024-02-18T16:23:47.959752+0000","last_undegraded":"2024-02-18T16:23:47.959752+0000","last_fullsized":"2024-02-18T16:23:47.959752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:47.959494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:47.959494+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.959494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:18.822463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.816662+0000","last_change":"2024-02-18T16:23:27.816811+0000","last_active":"2024-02-18T16:23:27.816662+0000","last_peered":"2024-02-18T16:23:27.816662+0000","last_clean":"2024-02-18T16:23:27.816662+0000","last_became_active":"2024-02-18T16:21:01.850728+0000","last_became_peered":"2024-02-18T16:21:01.850728+0000","last_unstale":"2024-02-18T16:23:27.816662+0000","last_undegraded":"2024-02-18T16:23:27.816662+0000","last_fullsized":"2024-02-18T16:23:27.816662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:27.816419+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:27.816419+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.816419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:38.157707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.716911+0000","last_change":"2024-02-18T16:23:38.716974+0000","last_active":"2024-02-18T16:23:38.716911+0000","last_peered":"2024-02-18T16:23:38.716911+0000","last_clean":"2024-02-18T16:23:38.716911+0000","last_became_active":"2024-02-18T16:20:59.871796+0000","last_became_peered":"2024-02-18T16:20:59.871796+0000","last_unstale":"2024-02-18T16:23:38.716911+0000","last_undegraded":"2024-02-18T16:23:38.716911+0000","last_fullsized":"2024-02-18T16:23:38.716911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:38.716716+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:38.716716+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.716716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:57:01.976300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.288342+0000","last_change":"2024-02-18T16:23:06.288342+0000","last_active":"2024-02-18T16:23:06.288342+0000","last_peered":"2024-02-18T16:23:06.288342+0000","last_clean":"2024-02-18T16:23:06.288342+0000","last_became_active":"2024-02-18T16:21:03.860306+0000","last_became_peered":"2024-02-18T16:21:03.860306+0000","last_unstale":"2024-02-18T16:23:06.288342+0000","last_undegraded":"2024-02-18T16:23:06.288342+0000","last_fullsized":"2024-02-18T16:23:06.288342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.288089+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.288089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:53.929609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.866009+0000","last_change":"2024-02-18T16:22:54.866009+0000","last_active":"2024-02-18T16:22:54.866009+0000","last_peered":"2024-02-18T16:22:54.866009+0000","last_clean":"2024-02-18T16:22:54.866009+0000","last_became_active":"2024-02-18T16:21:05.885782+0000","last_became_peered":"2024-02-18T16:21:05.885782+0000","last_unstale":"2024-02-18T16:22:54.866009+0000","last_undegraded":"2024-02-18T16:22:54.866009+0000","last_fullsized":"2024-02-18T16:22:54.866009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:54.865742+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.865742+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:38.608078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.424493+0000","last_change":"2024-02-18T16:22:59.424493+0000","last_active":"2024-02-18T16:22:59.424493+0000","last_peered":"2024-02-18T16:22:59.424493+0000","last_clean":"2024-02-18T16:22:59.424493+0000","last_became_active":"2024-02-18T16:21:07.900647+0000","last_became_peered":"2024-02-18T16:21:07.900647+0000","last_unstale":"2024-02-18T16:22:59.424493+0000","last_undegraded":"2024-02-18T16:22:59.424493+0000","last_fullsized":"2024-02-18T16:22:59.424493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:59.424108+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.424108+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:27.706578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:48.251492+0000","last_change":"2024-02-18T16:23:48.251547+0000","last_active":"2024-02-18T16:23:48.251492+0000","last_peered":"2024-02-18T16:23:48.251492+0000","last_clean":"2024-02-18T16:23:48.251492+0000","last_became_active":"2024-02-18T16:21:09.926116+0000","last_became_peered":"2024-02-18T16:21:09.926116+0000","last_unstale":"2024-02-18T16:23:48.251492+0000","last_undegraded":"2024-02-18T16:23:48.251492+0000","last_fullsized":"2024-02-18T16:23:48.251492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:48.251299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:48.251299+0000","last_clean_scrub_stamp":"2024-02-18T16:23:48.251299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:42.395094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.950077+0000","last_change":"2024-02-18T16:23:17.950077+0000","last_active":"2024-02-18T16:23:17.950077+0000","last_peered":"2024-02-18T16:23:17.950077+0000","last_clean":"2024-02-18T16:23:17.950077+0000","last_became_active":"2024-02-18T16:21:01.836688+0000","last_became_peered":"2024-02-18T16:21:01.836688+0000","last_unstale":"2024-02-18T16:23:17.950077+0000","last_undegraded":"2024-02-18T16:23:17.950077+0000","last_fullsized":"2024-02-18T16:23:17.950077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:17.949811+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.949811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:22.086677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:50.774592+0000","last_change":"2024-02-18T16:23:50.774672+0000","last_active":"2024-02-18T16:23:50.774592+0000","last_peered":"2024-02-18T16:23:50.774592+0000","last_clean":"2024-02-18T16:23:50.774592+0000","last_became_active":"2024-02-18T16:20:59.871289+0000","last_became_peered":"2024-02-18T16:20:59.871289+0000","last_unstale":"2024-02-18T16:23:50.774592+0000","last_undegraded":"2024-02-18T16:23:50.774592+0000","last_fullsized":"2024-02-18T16:23:50.774592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:50.774340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:50.774340+0000","last_clean_scrub_stamp":"2024-02-18T16:23:50.774340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:30:09.435543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.385292+0000","last_change":"2024-02-18T16:23:02.385292+0000","last_active":"2024-02-18T16:23:02.385292+0000","last_peered":"2024-02-18T16:23:02.385292+0000","last_clean":"2024-02-18T16:23:02.385292+0000","last_became_active":"2024-02-18T16:21:03.870601+0000","last_became_peered":"2024-02-18T16:21:03.870601+0000","last_unstale":"2024-02-18T16:23:02.385292+0000","last_undegraded":"2024-02-18T16:23:02.385292+0000","last_fullsized":"2024-02-18T16:23:02.385292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:02.384857+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.384857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:45.534980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.736442+0000","last_change":"2024-02-18T16:23:18.736442+0000","last_active":"2024-02-18T16:23:18.736442+0000","last_peered":"2024-02-18T16:23:18.736442+0000","last_clean":"2024-02-18T16:23:18.736442+0000","last_became_active":"2024-02-18T16:21:05.900650+0000","last_became_peered":"2024-02-18T16:21:05.900650+0000","last_unstale":"2024-02-18T16:23:18.736442+0000","last_undegraded":"2024-02-18T16:23:18.736442+0000","last_fullsized":"2024-02-18T16:23:18.736442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-02-18T16:23:18.736028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.736028+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:33.973183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.419003+0000","last_change":"2024-02-18T16:22:48.419003+0000","last_active":"2024-02-18T16:22:48.419003+0000","last_peered":"2024-02-18T16:22:48.419003+0000","last_clean":"2024-02-18T16:22:48.419003+0000","last_became_active":"2024-02-18T16:21:07.898491+0000","last_became_peered":"2024-02-18T16:21:07.898491+0000","last_unstale":"2024-02-18T16:22:48.419003+0000","last_undegraded":"2024-02-18T16:22:48.419003+0000","last_fullsized":"2024-02-18T16:22:48.419003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.418904+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.418904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:26.809828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.254723+0000","last_change":"2024-02-18T16:23:42.254793+0000","last_active":"2024-02-18T16:23:42.254723+0000","last_peered":"2024-02-18T16:23:42.254723+0000","last_clean":"2024-02-18T16:23:42.254723+0000","last_became_active":"2024-02-18T16:21:09.900988+0000","last_became_peered":"2024-02-18T16:21:09.900988+0000","last_unstale":"2024-02-18T16:23:42.254723+0000","last_undegraded":"2024-02-18T16:23:42.254723+0000","last_fullsized":"2024-02-18T16:23:42.254723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:42.254513+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:42.254513+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.254513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:34.007683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.722667+0000","last_change":"2024-02-18T16:23:39.722667+0000","last_active":"2024-02-18T16:23:39.722667+0000","last_peered":"2024-02-18T16:23:39.722667+0000","last_clean":"2024-02-18T16:23:39.722667+0000","last_became_active":"2024-02-18T16:21:40.942147+0000","last_became_peered":"2024-02-18T16:21:40.942147+0000","last_unstale":"2024-02-18T16:23:39.722667+0000","last_undegraded":"2024-02-18T16:23:39.722667+0000","last_fullsized":"2024-02-18T16:23:39.722667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.722399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.722399+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.722399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:20:54.340576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.169671+0000","last_change":"2024-02-18T16:23:32.169748+0000","last_active":"2024-02-18T16:23:32.169671+0000","last_peered":"2024-02-18T16:23:32.169671+0000","last_clean":"2024-02-18T16:23:32.169671+0000","last_became_active":"2024-02-18T16:20:59.854911+0000","last_became_peered":"2024-02-18T16:20:59.854911+0000","last_unstale":"2024-02-18T16:23:32.169671+0000","last_undegraded":"2024-02-18T16:23:32.169671+0000","last_fullsized":"2024-02-18T16:23:32.169671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.169474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.169474+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.169474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:46.723732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.895970+0000","last_change":"2024-02-18T16:23:06.895970+0000","last_active":"2024-02-18T16:23:06.895970+0000","last_peered":"2024-02-18T16:23:06.895970+0000","last_clean":"2024-02-18T16:23:06.895970+0000","last_became_active":"2024-02-18T16:21:03.857959+0000","last_became_peered":"2024-02-18T16:21:03.857959+0000","last_unstale":"2024-02-18T16:23:06.895970+0000","last_undegraded":"2024-02-18T16:23:06.895970+0000","last_fullsized":"2024-02-18T16:23:06.895970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.895683+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.895683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:21.766945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.716444+0000","last_change":"2024-02-18T16:22:53.716444+0000","last_active":"2024-02-18T16:22:53.716444+0000","last_peered":"2024-02-18T16:22:53.716444+0000","last_clean":"2024-02-18T16:22:53.716444+0000","last_became_active":"2024-02-18T16:21:05.873398+0000","last_became_peered":"2024-02-18T16:21:05.873398+0000","last_unstale":"2024-02-18T16:22:53.716444+0000","last_undegraded":"2024-02-18T16:22:53.716444+0000","last_fullsized":"2024-02-18T16:22:53.716444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:53.716166+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.716166+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:15:00.689979+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.730325+0000","last_change":"2024-02-18T16:23:16.730325+0000","last_active":"2024-02-18T16:23:16.730325+0000","last_peered":"2024-02-18T16:23:16.730325+0000","last_clean":"2024-02-18T16:23:16.730325+0000","last_became_active":"2024-02-18T16:21:07.916925+0000","last_became_peered":"2024-02-18T16:21:07.916925+0000","last_unstale":"2024-02-18T16:23:16.730325+0000","last_undegraded":"2024-02-18T16:23:16.730325+0000","last_fullsized":"2024-02-18T16:23:16.730325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:16.729880+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.729880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:09.848063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.726227+0000","last_change":"2024-02-18T16:23:36.726292+0000","last_active":"2024-02-18T16:23:36.726227+0000","last_peered":"2024-02-18T16:23:36.726227+0000","last_clean":"2024-02-18T16:23:36.726227+0000","last_became_active":"2024-02-18T16:21:09.919358+0000","last_became_peered":"2024-02-18T16:21:09.919358+0000","last_unstale":"2024-02-18T16:23:36.726227+0000","last_undegraded":"2024-02-18T16:23:36.726227+0000","last_fullsized":"2024-02-18T16:23:36.726227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.726011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.726011+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.726011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:02:08.073508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.775757+0000","last_change":"2024-02-18T16:22:59.775757+0000","last_active":"2024-02-18T16:22:59.775757+0000","last_peered":"2024-02-18T16:22:59.775757+0000","last_clean":"2024-02-18T16:22:59.775757+0000","last_became_active":"2024-02-18T16:21:01.857730+0000","last_became_peered":"2024-02-18T16:21:01.857730+0000","last_unstale":"2024-02-18T16:22:59.775757+0000","last_undegraded":"2024-02-18T16:22:59.775757+0000","last_fullsized":"2024-02-18T16:22:59.775757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:22:59.775299+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.775299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:17:59.839199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:51.770478+0000","last_change":"2024-02-18T16:23:51.770541+0000","last_active":"2024-02-18T16:23:51.770478+0000","last_peered":"2024-02-18T16:23:51.770478+0000","last_clean":"2024-02-18T16:23:51.770478+0000","last_became_active":"2024-02-18T16:20:59.859613+0000","last_became_peered":"2024-02-18T16:20:59.859613+0000","last_unstale":"2024-02-18T16:23:51.770478+0000","last_undegraded":"2024-02-18T16:23:51.770478+0000","last_fullsized":"2024-02-18T16:23:51.770478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:51.770271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:51.770271+0000","last_clean_scrub_stamp":"2024-02-18T16:23:51.770271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:07:34.900673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.315310+0000","last_change":"2024-02-18T16:23:05.315310+0000","last_active":"2024-02-18T16:23:05.315310+0000","last_peered":"2024-02-18T16:23:05.315310+0000","last_clean":"2024-02-18T16:23:05.315310+0000","last_became_active":"2024-02-18T16:21:03.865084+0000","last_became_peered":"2024-02-18T16:21:03.865084+0000","last_unstale":"2024-02-18T16:23:05.315310+0000","last_undegraded":"2024-02-18T16:23:05.315310+0000","last_fullsized":"2024-02-18T16:23:05.315310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.315056+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.315056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:44:34.007120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.877151+0000","last_change":"2024-02-18T16:23:04.877151+0000","last_active":"2024-02-18T16:23:04.877151+0000","last_peered":"2024-02-18T16:23:04.877151+0000","last_clean":"2024-02-18T16:23:04.877151+0000","last_became_active":"2024-02-18T16:21:05.872623+0000","last_became_peered":"2024-02-18T16:21:05.872623+0000","last_unstale":"2024-02-18T16:23:04.877151+0000","last_undegraded":"2024-02-18T16:23:04.877151+0000","last_fullsized":"2024-02-18T16:23:04.877151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.876858+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.876858+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:34.375957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":334,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.770013+0000","last_change":"2024-02-18T16:22:51.770013+0000","last_active":"2024-02-18T16:22:51.770013+0000","last_peered":"2024-02-18T16:22:51.770013+0000","last_clean":"2024-02-18T16:22:51.770013+0000","last_became_active":"2024-02-18T16:21:07.903338+0000","last_became_peered":"2024-02-18T16:21:07.903338+0000","last_unstale":"2024-02-18T16:22:51.770013+0000","last_undegraded":"2024-02-18T16:22:51.770013+0000","last_fullsized":"2024-02-18T16:22:51.770013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:51.769642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.769642+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:23:26.328772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.126785+0000","last_change":"2024-02-18T16:23:15.126785+0000","last_active":"2024-02-18T16:23:15.126785+0000","last_peered":"2024-02-18T16:23:15.126785+0000","last_clean":"2024-02-18T16:23:15.126785+0000","last_became_active":"2024-02-18T16:21:09.900855+0000","last_became_peered":"2024-02-18T16:21:09.900855+0000","last_unstale":"2024-02-18T16:23:15.126785+0000","last_undegraded":"2024-02-18T16:23:15.126785+0000","last_fullsized":"2024-02-18T16:23:15.126785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:15.126508+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.126508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:58.868844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.699084+0000","last_change":"2024-02-18T16:23:37.699156+0000","last_active":"2024-02-18T16:23:37.699084+0000","last_peered":"2024-02-18T16:23:37.699084+0000","last_clean":"2024-02-18T16:23:37.699084+0000","last_became_active":"2024-02-18T16:21:01.853970+0000","last_became_peered":"2024-02-18T16:21:01.853970+0000","last_unstale":"2024-02-18T16:23:37.699084+0000","last_undegraded":"2024-02-18T16:23:37.699084+0000","last_fullsized":"2024-02-18T16:23:37.699084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:37.698893+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:37.698893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.698893+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:45:21.335851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.789240+0000","last_change":"2024-02-18T16:23:47.789302+0000","last_active":"2024-02-18T16:23:47.789240+0000","last_peered":"2024-02-18T16:23:47.789240+0000","last_clean":"2024-02-18T16:23:47.789240+0000","last_became_active":"2024-02-18T16:20:59.862742+0000","last_became_peered":"2024-02-18T16:20:59.862742+0000","last_unstale":"2024-02-18T16:23:47.789240+0000","last_undegraded":"2024-02-18T16:23:47.789240+0000","last_fullsized":"2024-02-18T16:23:47.789240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:47.789011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:47.789011+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.789011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:26.898024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'6","reported_seq":540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.656384+0000","last_change":"2024-02-18T16:23:00.656384+0000","last_active":"2024-02-18T16:23:00.656384+0000","last_peered":"2024-02-18T16:23:00.656384+0000","last_clean":"2024-02-18T16:23:00.656384+0000","last_became_active":"2024-02-18T16:21:03.862710+0000","last_became_peered":"2024-02-18T16:21:03.862710+0000","last_unstale":"2024-02-18T16:23:00.656384+0000","last_undegraded":"2024-02-18T16:23:00.656384+0000","last_fullsized":"2024-02-18T16:23:00.656384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:00.655960+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.655960+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:31:46.016785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":581,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.749256+0000","last_change":"2024-02-18T16:23:17.749256+0000","last_active":"2024-02-18T16:23:17.749256+0000","last_peered":"2024-02-18T16:23:17.749256+0000","last_clean":"2024-02-18T16:23:17.749256+0000","last_became_active":"2024-02-18T16:21:05.900133+0000","last_became_peered":"2024-02-18T16:21:05.900133+0000","last_unstale":"2024-02-18T16:23:17.749256+0000","last_undegraded":"2024-02-18T16:23:17.749256+0000","last_fullsized":"2024-02-18T16:23:17.749256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:17.748943+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.748943+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:25.419343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":365,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.693788+0000","last_change":"2024-02-18T16:22:58.693788+0000","last_active":"2024-02-18T16:22:58.693788+0000","last_peered":"2024-02-18T16:22:58.693788+0000","last_clean":"2024-02-18T16:22:58.693788+0000","last_became_active":"2024-02-18T16:21:07.893767+0000","last_became_peered":"2024-02-18T16:21:07.893767+0000","last_unstale":"2024-02-18T16:22:58.693788+0000","last_undegraded":"2024-02-18T16:22:58.693788+0000","last_fullsized":"2024-02-18T16:22:58.693788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:58.693538+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.693538+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:53:28.192638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.897770+0000","last_change":"2024-02-18T16:22:59.897770+0000","last_active":"2024-02-18T16:22:59.897770+0000","last_peered":"2024-02-18T16:22:59.897770+0000","last_clean":"2024-02-18T16:22:59.897770+0000","last_became_active":"2024-02-18T16:21:09.906388+0000","last_became_peered":"2024-02-18T16:21:09.906388+0000","last_unstale":"2024-02-18T16:22:59.897770+0000","last_undegraded":"2024-02-18T16:22:59.897770+0000","last_fullsized":"2024-02-18T16:22:59.897770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:22:59.897511+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.897511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:17:33.837107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.740243+0000","last_change":"2024-02-18T16:23:12.740243+0000","last_active":"2024-02-18T16:23:12.740243+0000","last_peered":"2024-02-18T16:23:12.740243+0000","last_clean":"2024-02-18T16:23:12.740243+0000","last_became_active":"2024-02-18T16:21:01.845324+0000","last_became_peered":"2024-02-18T16:21:01.845324+0000","last_unstale":"2024-02-18T16:23:12.740243+0000","last_undegraded":"2024-02-18T16:23:12.740243+0000","last_fullsized":"2024-02-18T16:23:12.740243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.739975+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.739975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.749389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.757260+0000","last_change":"2024-02-18T16:23:42.757382+0000","last_active":"2024-02-18T16:23:42.757260+0000","last_peered":"2024-02-18T16:23:42.757260+0000","last_clean":"2024-02-18T16:23:42.757260+0000","last_became_active":"2024-02-18T16:20:59.865592+0000","last_became_peered":"2024-02-18T16:20:59.865592+0000","last_unstale":"2024-02-18T16:23:42.757260+0000","last_undegraded":"2024-02-18T16:23:42.757260+0000","last_fullsized":"2024-02-18T16:23:42.757260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:42.757028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:42.757028+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.757028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:47:18.356551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.918122+0000","last_change":"2024-02-18T16:22:48.918122+0000","last_active":"2024-02-18T16:22:48.918122+0000","last_peered":"2024-02-18T16:22:48.918122+0000","last_clean":"2024-02-18T16:22:48.918122+0000","last_became_active":"2024-02-18T16:21:03.856624+0000","last_became_peered":"2024-02-18T16:21:03.856624+0000","last_unstale":"2024-02-18T16:22:48.918122+0000","last_undegraded":"2024-02-18T16:22:48.918122+0000","last_fullsized":"2024-02-18T16:22:48.918122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:48.917868+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.917868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:12.197986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.726450+0000","last_change":"2024-02-18T16:22:52.726450+0000","last_active":"2024-02-18T16:22:52.726450+0000","last_peered":"2024-02-18T16:22:52.726450+0000","last_clean":"2024-02-18T16:22:52.726450+0000","last_became_active":"2024-02-18T16:21:05.876724+0000","last_became_peered":"2024-02-18T16:21:05.876724+0000","last_unstale":"2024-02-18T16:22:52.726450+0000","last_undegraded":"2024-02-18T16:22:52.726450+0000","last_fullsized":"2024-02-18T16:22:52.726450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-02-18T16:22:52.726227+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.726227+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:01.503665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.749676+0000","last_change":"2024-02-18T16:22:50.749676+0000","last_active":"2024-02-18T16:22:50.749676+0000","last_peered":"2024-02-18T16:22:50.749676+0000","last_clean":"2024-02-18T16:22:50.749676+0000","last_became_active":"2024-02-18T16:21:07.899532+0000","last_became_peered":"2024-02-18T16:21:07.899532+0000","last_unstale":"2024-02-18T16:22:50.749676+0000","last_undegraded":"2024-02-18T16:22:50.749676+0000","last_fullsized":"2024-02-18T16:22:50.749676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.749316+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.749316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:31.018219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.891076+0000","last_change":"2024-02-18T16:23:44.891135+0000","last_active":"2024-02-18T16:23:44.891076+0000","last_peered":"2024-02-18T16:23:44.891076+0000","last_clean":"2024-02-18T16:23:44.891076+0000","last_became_active":"2024-02-18T16:21:09.918234+0000","last_became_peered":"2024-02-18T16:21:09.918234+0000","last_unstale":"2024-02-18T16:23:44.891076+0000","last_undegraded":"2024-02-18T16:23:44.891076+0000","last_fullsized":"2024-02-18T16:23:44.891076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:44.890826+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:44.890826+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.890826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:41:07.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.684394+0000","last_change":"2024-02-18T16:23:05.684394+0000","last_active":"2024-02-18T16:23:05.684394+0000","last_peered":"2024-02-18T16:23:05.684394+0000","last_clean":"2024-02-18T16:23:05.684394+0000","last_became_active":"2024-02-18T16:21:01.856709+0000","last_became_peered":"2024-02-18T16:21:01.856709+0000","last_unstale":"2024-02-18T16:23:05.684394+0000","last_undegraded":"2024-02-18T16:23:05.684394+0000","last_fullsized":"2024-02-18T16:23:05.684394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:05.684138+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.684138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:51:47.648057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.816728+0000","last_change":"2024-02-18T16:23:32.816808+0000","last_active":"2024-02-18T16:23:32.816728+0000","last_peered":"2024-02-18T16:23:32.816728+0000","last_clean":"2024-02-18T16:23:32.816728+0000","last_became_active":"2024-02-18T16:20:46.520554+0000","last_became_peered":"2024-02-18T16:20:46.520554+0000","last_unstale":"2024-02-18T16:23:32.816728+0000","last_undegraded":"2024-02-18T16:23:32.816728+0000","last_fullsized":"2024-02-18T16:23:32.816728+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-02-18T16:23:32.816528+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-02-18T16:23:32.816528+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.816528+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:56:28.658709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:01.880881+0000","last_change":"2024-02-18T16:24:01.880940+0000","last_active":"2024-02-18T16:24:01.880881+0000","last_peered":"2024-02-18T16:24:01.880881+0000","last_clean":"2024-02-18T16:24:01.880881+0000","last_became_active":"2024-02-18T16:20:51.775107+0000","last_became_peered":"2024-02-18T16:20:51.775107+0000","last_unstale":"2024-02-18T16:24:01.880881+0000","last_undegraded":"2024-02-18T16:24:01.880881+0000","last_fullsized":"2024-02-18T16:24:01.880881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:01.880615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:01.880615+0000","last_clean_scrub_stamp":"2024-02-18T16:24:01.880615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:20:15.577844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:49.776478+0000","last_change":"2024-02-18T16:23:49.776539+0000","last_active":"2024-02-18T16:23:49.776478+0000","last_peered":"2024-02-18T16:23:49.776478+0000","last_clean":"2024-02-18T16:23:49.776478+0000","last_became_active":"2024-02-18T16:20:59.859934+0000","last_became_peered":"2024-02-18T16:20:59.859934+0000","last_unstale":"2024-02-18T16:23:49.776478+0000","last_undegraded":"2024-02-18T16:23:49.776478+0000","last_fullsized":"2024-02-18T16:23:49.776478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:49.776258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:49.776258+0000","last_clean_scrub_stamp":"2024-02-18T16:23:49.776258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:34:20.699351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.664877+0000","last_change":"2024-02-18T16:23:03.664877+0000","last_active":"2024-02-18T16:23:03.664877+0000","last_peered":"2024-02-18T16:23:03.664877+0000","last_clean":"2024-02-18T16:23:03.664877+0000","last_became_active":"2024-02-18T16:21:03.858650+0000","last_became_peered":"2024-02-18T16:21:03.858650+0000","last_unstale":"2024-02-18T16:23:03.664877+0000","last_undegraded":"2024-02-18T16:23:03.664877+0000","last_fullsized":"2024-02-18T16:23:03.664877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.664624+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.664624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:45.069024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'84","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.776665+0000","last_change":"2024-02-18T16:23:21.776848+0000","last_active":"2024-02-18T16:23:21.776665+0000","last_peered":"2024-02-18T16:23:21.776665+0000","last_clean":"2024-02-18T16:23:21.776665+0000","last_became_active":"2024-02-18T16:21:05.896163+0000","last_became_peered":"2024-02-18T16:21:05.896163+0000","last_unstale":"2024-02-18T16:23:21.776665+0000","last_undegraded":"2024-02-18T16:23:21.776665+0000","last_fullsized":"2024-02-18T16:23:21.776665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-02-18T16:23:21.776429+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.776429+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:19.871412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.479778+0000","last_change":"2024-02-18T16:22:51.479778+0000","last_active":"2024-02-18T16:22:51.479778+0000","last_peered":"2024-02-18T16:22:51.479778+0000","last_clean":"2024-02-18T16:22:51.479778+0000","last_became_active":"2024-02-18T16:21:07.900254+0000","last_became_peered":"2024-02-18T16:21:07.900254+0000","last_unstale":"2024-02-18T16:22:51.479778+0000","last_undegraded":"2024-02-18T16:22:51.479778+0000","last_fullsized":"2024-02-18T16:22:51.479778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.479526+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.479526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:50:00.256964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.875952+0000","last_change":"2024-02-18T16:22:55.875952+0000","last_active":"2024-02-18T16:22:55.875952+0000","last_peered":"2024-02-18T16:22:55.875952+0000","last_clean":"2024-02-18T16:22:55.875952+0000","last_became_active":"2024-02-18T16:21:09.896649+0000","last_became_peered":"2024-02-18T16:21:09.896649+0000","last_unstale":"2024-02-18T16:22:55.875952+0000","last_undegraded":"2024-02-18T16:22:55.875952+0000","last_fullsized":"2024-02-18T16:22:55.875952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-02-18T16:22:55.875669+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.875669+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:33.784174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.711566+0000","last_change":"2024-02-18T16:23:30.711619+0000","last_active":"2024-02-18T16:23:30.711566+0000","last_peered":"2024-02-18T16:23:30.711566+0000","last_clean":"2024-02-18T16:23:30.711566+0000","last_became_active":"2024-02-18T16:21:01.852955+0000","last_became_peered":"2024-02-18T16:21:01.852955+0000","last_unstale":"2024-02-18T16:23:30.711566+0000","last_undegraded":"2024-02-18T16:23:30.711566+0000","last_fullsized":"2024-02-18T16:23:30.711566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.711338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.711338+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.711338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:21:28.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:59.926045+0000","last_change":"2024-02-18T16:23:59.926102+0000","last_active":"2024-02-18T16:23:59.926045+0000","last_peered":"2024-02-18T16:23:59.926045+0000","last_clean":"2024-02-18T16:23:59.926045+0000","last_became_active":"2024-02-18T16:20:51.774348+0000","last_became_peered":"2024-02-18T16:20:51.774348+0000","last_unstale":"2024-02-18T16:23:59.926045+0000","last_undegraded":"2024-02-18T16:23:59.926045+0000","last_fullsized":"2024-02-18T16:23:59.926045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:59.925837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:59.925837+0000","last_clean_scrub_stamp":"2024-02-18T16:23:59.925837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:37.822894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.178848+0000","last_change":"2024-02-18T16:23:35.178912+0000","last_active":"2024-02-18T16:23:35.178848+0000","last_peered":"2024-02-18T16:23:35.178848+0000","last_clean":"2024-02-18T16:23:35.178848+0000","last_became_active":"2024-02-18T16:20:59.847335+0000","last_became_peered":"2024-02-18T16:20:59.847335+0000","last_unstale":"2024-02-18T16:23:35.178848+0000","last_undegraded":"2024-02-18T16:23:35.178848+0000","last_fullsized":"2024-02-18T16:23:35.178848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.178612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.178612+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.178612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:25.976338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.880298+0000","last_change":"2024-02-18T16:22:50.880298+0000","last_active":"2024-02-18T16:22:50.880298+0000","last_peered":"2024-02-18T16:22:50.880298+0000","last_clean":"2024-02-18T16:22:50.880298+0000","last_became_active":"2024-02-18T16:21:03.852295+0000","last_became_peered":"2024-02-18T16:21:03.852295+0000","last_unstale":"2024-02-18T16:22:50.880298+0000","last_undegraded":"2024-02-18T16:22:50.880298+0000","last_fullsized":"2024-02-18T16:22:50.880298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.879993+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.879993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:40:55.016859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.676283+0000","last_change":"2024-02-18T16:22:48.676283+0000","last_active":"2024-02-18T16:22:48.676283+0000","last_peered":"2024-02-18T16:22:48.676283+0000","last_clean":"2024-02-18T16:22:48.676283+0000","last_became_active":"2024-02-18T16:21:05.899489+0000","last_became_peered":"2024-02-18T16:21:05.899489+0000","last_unstale":"2024-02-18T16:22:48.676283+0000","last_undegraded":"2024-02-18T16:22:48.676283+0000","last_fullsized":"2024-02-18T16:22:48.676283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-02-18T16:22:48.676008+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.676008+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:36.238448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.648672+0000","last_change":"2024-02-18T16:23:12.648672+0000","last_active":"2024-02-18T16:23:12.648672+0000","last_peered":"2024-02-18T16:23:12.648672+0000","last_clean":"2024-02-18T16:23:12.648672+0000","last_became_active":"2024-02-18T16:21:07.915283+0000","last_became_peered":"2024-02-18T16:21:07.915283+0000","last_unstale":"2024-02-18T16:23:12.648672+0000","last_undegraded":"2024-02-18T16:23:12.648672+0000","last_fullsized":"2024-02-18T16:23:12.648672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:12.648341+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.648341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:17:59.693351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.918277+0000","last_change":"2024-02-18T16:23:46.918348+0000","last_active":"2024-02-18T16:23:46.918277+0000","last_peered":"2024-02-18T16:23:46.918277+0000","last_clean":"2024-02-18T16:23:46.918277+0000","last_became_active":"2024-02-18T16:21:09.926289+0000","last_became_peered":"2024-02-18T16:21:09.926289+0000","last_unstale":"2024-02-18T16:23:46.918277+0000","last_undegraded":"2024-02-18T16:23:46.918277+0000","last_fullsized":"2024-02-18T16:23:46.918277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:46.918054+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:46.918054+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.918054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:04:52.821578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:41.238351+0000","last_change":"2024-02-18T16:23:41.238416+0000","last_active":"2024-02-18T16:23:41.238351+0000","last_peered":"2024-02-18T16:23:41.238351+0000","last_clean":"2024-02-18T16:23:41.238351+0000","last_became_active":"2024-02-18T16:21:01.844304+0000","last_became_peered":"2024-02-18T16:21:01.844304+0000","last_unstale":"2024-02-18T16:23:41.238351+0000","last_undegraded":"2024-02-18T16:23:41.238351+0000","last_fullsized":"2024-02-18T16:23:41.238351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:41.238156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:41.238156+0000","last_clean_scrub_stamp":"2024-02-18T16:23:41.238156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:21:11.430893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.815989+0000","last_change":"2024-02-18T16:23:29.816093+0000","last_active":"2024-02-18T16:23:29.815989+0000","last_peered":"2024-02-18T16:23:29.815989+0000","last_clean":"2024-02-18T16:23:29.815989+0000","last_became_active":"2024-02-18T16:20:51.775146+0000","last_became_peered":"2024-02-18T16:20:51.775146+0000","last_unstale":"2024-02-18T16:23:29.815989+0000","last_undegraded":"2024-02-18T16:23:29.815989+0000","last_fullsized":"2024-02-18T16:23:29.815989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:29.815772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:29.815772+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.815772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:42.184598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.174668+0000","last_change":"2024-02-18T16:23:36.174727+0000","last_active":"2024-02-18T16:23:36.174668+0000","last_peered":"2024-02-18T16:23:36.174668+0000","last_clean":"2024-02-18T16:23:36.174668+0000","last_became_active":"2024-02-18T16:20:59.849437+0000","last_became_peered":"2024-02-18T16:20:59.849437+0000","last_unstale":"2024-02-18T16:23:36.174668+0000","last_undegraded":"2024-02-18T16:23:36.174668+0000","last_fullsized":"2024-02-18T16:23:36.174668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.174453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.174453+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.174453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:29.292636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.949902+0000","last_change":"2024-02-18T16:23:12.949902+0000","last_active":"2024-02-18T16:23:12.949902+0000","last_peered":"2024-02-18T16:23:12.949902+0000","last_clean":"2024-02-18T16:23:12.949902+0000","last_became_active":"2024-02-18T16:21:03.853615+0000","last_became_peered":"2024-02-18T16:21:03.853615+0000","last_unstale":"2024-02-18T16:23:12.949902+0000","last_undegraded":"2024-02-18T16:23:12.949902+0000","last_fullsized":"2024-02-18T16:23:12.949902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.949503+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.949503+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:07:00.591023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.880194+0000","last_change":"2024-02-18T16:23:01.880194+0000","last_active":"2024-02-18T16:23:01.880194+0000","last_peered":"2024-02-18T16:23:01.880194+0000","last_clean":"2024-02-18T16:23:01.880194+0000","last_became_active":"2024-02-18T16:21:05.882354+0000","last_became_peered":"2024-02-18T16:21:05.882354+0000","last_unstale":"2024-02-18T16:23:01.880194+0000","last_undegraded":"2024-02-18T16:23:01.880194+0000","last_fullsized":"2024-02-18T16:23:01.880194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-02-18T16:23:01.879908+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.879908+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:49.968692+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.417911+0000","last_change":"2024-02-18T16:22:55.417911+0000","last_active":"2024-02-18T16:22:55.417911+0000","last_peered":"2024-02-18T16:22:55.417911+0000","last_clean":"2024-02-18T16:22:55.417911+0000","last_became_active":"2024-02-18T16:21:07.900338+0000","last_became_peered":"2024-02-18T16:21:07.900338+0000","last_unstale":"2024-02-18T16:22:55.417911+0000","last_undegraded":"2024-02-18T16:22:55.417911+0000","last_fullsized":"2024-02-18T16:22:55.417911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.417642+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.417642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:24:43.506426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:08.809868+0000","last_change":"2024-02-18T16:24:08.809927+0000","last_active":"2024-02-18T16:24:08.809868+0000","last_peered":"2024-02-18T16:24:08.809868+0000","last_clean":"2024-02-18T16:24:08.809868+0000","last_became_active":"2024-02-18T16:21:09.925468+0000","last_became_peered":"2024-02-18T16:21:09.925468+0000","last_unstale":"2024-02-18T16:24:08.809868+0000","last_undegraded":"2024-02-18T16:24:08.809868+0000","last_fullsized":"2024-02-18T16:24:08.809868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:08.809642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:08.809642+0000","last_clean_scrub_stamp":"2024-02-18T16:24:08.809642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:25:42.614858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.122969+0000","last_change":"2024-02-18T16:23:21.123024+0000","last_active":"2024-02-18T16:23:21.122969+0000","last_peered":"2024-02-18T16:23:21.122969+0000","last_clean":"2024-02-18T16:23:21.122969+0000","last_became_active":"2024-02-18T16:21:01.837776+0000","last_became_peered":"2024-02-18T16:21:01.837776+0000","last_unstale":"2024-02-18T16:23:21.122969+0000","last_undegraded":"2024-02-18T16:23:21.122969+0000","last_fullsized":"2024-02-18T16:23:21.122969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.122778+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.122778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:18:31.464066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:00.910451+0000","last_change":"2024-02-18T16:24:00.910577+0000","last_active":"2024-02-18T16:24:00.910451+0000","last_peered":"2024-02-18T16:24:00.910451+0000","last_clean":"2024-02-18T16:24:00.910451+0000","last_became_active":"2024-02-18T16:20:51.774626+0000","last_became_peered":"2024-02-18T16:20:51.774626+0000","last_unstale":"2024-02-18T16:24:00.910451+0000","last_undegraded":"2024-02-18T16:24:00.910451+0000","last_fullsized":"2024-02-18T16:24:00.910451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:00.910181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:00.910181+0000","last_clean_scrub_stamp":"2024-02-18T16:24:00.910181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:45:09.351901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.910035+0000","last_change":"2024-02-18T16:23:18.910098+0000","last_active":"2024-02-18T16:23:18.910035+0000","last_peered":"2024-02-18T16:23:18.910035+0000","last_clean":"2024-02-18T16:23:18.910035+0000","last_became_active":"2024-02-18T16:20:59.854664+0000","last_became_peered":"2024-02-18T16:20:59.854664+0000","last_unstale":"2024-02-18T16:23:18.910035+0000","last_undegraded":"2024-02-18T16:23:18.910035+0000","last_fullsized":"2024-02-18T16:23:18.910035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:18.909845+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.909845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:53:00.919260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.247235+0000","last_change":"2024-02-18T16:23:08.247235+0000","last_active":"2024-02-18T16:23:08.247235+0000","last_peered":"2024-02-18T16:23:08.247235+0000","last_clean":"2024-02-18T16:23:08.247235+0000","last_became_active":"2024-02-18T16:21:03.857704+0000","last_became_peered":"2024-02-18T16:21:03.857704+0000","last_unstale":"2024-02-18T16:23:08.247235+0000","last_undegraded":"2024-02-18T16:23:08.247235+0000","last_fullsized":"2024-02-18T16:23:08.247235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.246981+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.246981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:42:58.377194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.623260+0000","last_change":"2024-02-18T16:23:08.623260+0000","last_active":"2024-02-18T16:23:08.623260+0000","last_peered":"2024-02-18T16:23:08.623260+0000","last_clean":"2024-02-18T16:23:08.623260+0000","last_became_active":"2024-02-18T16:21:05.895848+0000","last_became_peered":"2024-02-18T16:21:05.895848+0000","last_unstale":"2024-02-18T16:23:08.623260+0000","last_undegraded":"2024-02-18T16:23:08.623260+0000","last_fullsized":"2024-02-18T16:23:08.623260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-02-18T16:23:08.622991+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.622991+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:02.281198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.734333+0000","last_change":"2024-02-18T16:23:24.734440+0000","last_active":"2024-02-18T16:23:24.734333+0000","last_peered":"2024-02-18T16:23:24.734333+0000","last_clean":"2024-02-18T16:23:24.734333+0000","last_became_active":"2024-02-18T16:21:07.917866+0000","last_became_peered":"2024-02-18T16:21:07.917866+0000","last_unstale":"2024-02-18T16:23:24.734333+0000","last_undegraded":"2024-02-18T16:23:24.734333+0000","last_fullsized":"2024-02-18T16:23:24.734333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:24.734087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:24.734087+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.734087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:05:01.465216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.736675+0000","last_change":"2024-02-18T16:23:14.736675+0000","last_active":"2024-02-18T16:23:14.736675+0000","last_peered":"2024-02-18T16:23:14.736675+0000","last_clean":"2024-02-18T16:23:14.736675+0000","last_became_active":"2024-02-18T16:21:09.915103+0000","last_became_peered":"2024-02-18T16:21:09.915103+0000","last_unstale":"2024-02-18T16:23:14.736675+0000","last_undegraded":"2024-02-18T16:23:14.736675+0000","last_fullsized":"2024-02-18T16:23:14.736675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:14.736262+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.736262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:25.555313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.756320+0000","last_change":"2024-02-18T16:23:15.756377+0000","last_active":"2024-02-18T16:23:15.756320+0000","last_peered":"2024-02-18T16:23:15.756320+0000","last_clean":"2024-02-18T16:23:15.756320+0000","last_became_active":"2024-02-18T16:21:01.844368+0000","last_became_peered":"2024-02-18T16:21:01.844368+0000","last_unstale":"2024-02-18T16:23:15.756320+0000","last_undegraded":"2024-02-18T16:23:15.756320+0000","last_fullsized":"2024-02-18T16:23:15.756320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.756123+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.756123+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:07:59.498459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.674953+0000","last_change":"2024-02-18T16:23:35.675009+0000","last_active":"2024-02-18T16:23:35.674953+0000","last_peered":"2024-02-18T16:23:35.674953+0000","last_clean":"2024-02-18T16:23:35.674953+0000","last_became_active":"2024-02-18T16:20:59.831584+0000","last_became_peered":"2024-02-18T16:20:59.831584+0000","last_unstale":"2024-02-18T16:23:35.674953+0000","last_undegraded":"2024-02-18T16:23:35.674953+0000","last_fullsized":"2024-02-18T16:23:35.674953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.674755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.674755+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.674755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:29.332962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.190506+0000","last_change":"2024-02-18T16:23:33.190695+0000","last_active":"2024-02-18T16:23:33.190506+0000","last_peered":"2024-02-18T16:23:33.190506+0000","last_clean":"2024-02-18T16:23:33.190506+0000","last_became_active":"2024-02-18T16:20:51.776256+0000","last_became_peered":"2024-02-18T16:20:51.776256+0000","last_unstale":"2024-02-18T16:23:33.190506+0000","last_undegraded":"2024-02-18T16:23:33.190506+0000","last_fullsized":"2024-02-18T16:23:33.190506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.190286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.190286+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.190286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:20:47.808463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.699853+0000","last_change":"2024-02-18T16:23:40.699853+0000","last_active":"2024-02-18T16:23:40.699853+0000","last_peered":"2024-02-18T16:23:40.699853+0000","last_clean":"2024-02-18T16:23:40.699853+0000","last_became_active":"2024-02-18T16:21:40.942806+0000","last_became_peered":"2024-02-18T16:21:40.942806+0000","last_unstale":"2024-02-18T16:23:40.699853+0000","last_undegraded":"2024-02-18T16:23:40.699853+0000","last_fullsized":"2024-02-18T16:23:40.699853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.699606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.699606+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.699606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:16:05.659051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.420257+0000","last_change":"2024-02-18T16:22:56.420257+0000","last_active":"2024-02-18T16:22:56.420257+0000","last_peered":"2024-02-18T16:22:56.420257+0000","last_clean":"2024-02-18T16:22:56.420257+0000","last_became_active":"2024-02-18T16:21:05.888839+0000","last_became_peered":"2024-02-18T16:21:05.888839+0000","last_unstale":"2024-02-18T16:22:56.420257+0000","last_undegraded":"2024-02-18T16:22:56.420257+0000","last_fullsized":"2024-02-18T16:22:56.420257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-02-18T16:22:56.419970+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.419970+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:02.428762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.748170+0000","last_change":"2024-02-18T16:22:49.748170+0000","last_active":"2024-02-18T16:22:49.748170+0000","last_peered":"2024-02-18T16:22:49.748170+0000","last_clean":"2024-02-18T16:22:49.748170+0000","last_became_active":"2024-02-18T16:21:07.901477+0000","last_became_peered":"2024-02-18T16:21:07.901477+0000","last_unstale":"2024-02-18T16:22:49.748170+0000","last_undegraded":"2024-02-18T16:22:49.748170+0000","last_fullsized":"2024-02-18T16:22:49.748170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:49.747885+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.747885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:10:50.889318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.294458+0000","last_change":"2024-02-18T16:23:43.294517+0000","last_active":"2024-02-18T16:23:43.294458+0000","last_peered":"2024-02-18T16:23:43.294458+0000","last_clean":"2024-02-18T16:23:43.294458+0000","last_became_active":"2024-02-18T16:21:09.905157+0000","last_became_peered":"2024-02-18T16:21:09.905157+0000","last_unstale":"2024-02-18T16:23:43.294458+0000","last_undegraded":"2024-02-18T16:23:43.294458+0000","last_fullsized":"2024-02-18T16:23:43.294458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-18T16:23:43.294263+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-18T16:23:43.294263+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.294263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:04:14.362463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.714159+0000","last_change":"2024-02-18T16:23:11.714272+0000","last_active":"2024-02-18T16:23:11.714159+0000","last_peered":"2024-02-18T16:23:11.714159+0000","last_clean":"2024-02-18T16:23:11.714159+0000","last_became_active":"2024-02-18T16:21:01.847386+0000","last_became_peered":"2024-02-18T16:21:01.847386+0000","last_unstale":"2024-02-18T16:23:11.714159+0000","last_undegraded":"2024-02-18T16:23:11.714159+0000","last_fullsized":"2024-02-18T16:23:11.714159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:11.713937+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.713937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:41:15.850804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.160180+0000","last_change":"2024-02-18T16:23:22.160243+0000","last_active":"2024-02-18T16:23:22.160180+0000","last_peered":"2024-02-18T16:23:22.160180+0000","last_clean":"2024-02-18T16:23:22.160180+0000","last_became_active":"2024-02-18T16:20:59.860519+0000","last_became_peered":"2024-02-18T16:20:59.860519+0000","last_unstale":"2024-02-18T16:23:22.160180+0000","last_undegraded":"2024-02-18T16:23:22.160180+0000","last_fullsized":"2024-02-18T16:23:22.160180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:22.159961+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.159961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.101435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:58.881209+0000","last_change":"2024-02-18T16:23:58.881269+0000","last_active":"2024-02-18T16:23:58.881209+0000","last_peered":"2024-02-18T16:23:58.881209+0000","last_clean":"2024-02-18T16:23:58.881209+0000","last_became_active":"2024-02-18T16:20:51.774109+0000","last_became_peered":"2024-02-18T16:20:51.774109+0000","last_unstale":"2024-02-18T16:23:58.881209+0000","last_undegraded":"2024-02-18T16:23:58.881209+0000","last_fullsized":"2024-02-18T16:23:58.881209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:58.881007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:58.881007+0000","last_clean_scrub_stamp":"2024-02-18T16:23:58.881007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:17:19.956008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.818376+0000","last_change":"2024-02-18T16:22:58.818376+0000","last_active":"2024-02-18T16:22:58.818376+0000","last_peered":"2024-02-18T16:22:58.818376+0000","last_clean":"2024-02-18T16:22:58.818376+0000","last_became_active":"2024-02-18T16:21:03.848617+0000","last_became_peered":"2024-02-18T16:21:03.848617+0000","last_unstale":"2024-02-18T16:22:58.818376+0000","last_undegraded":"2024-02-18T16:22:58.818376+0000","last_fullsized":"2024-02-18T16:22:58.818376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:58.818107+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.818107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:11.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:49.707930+0000","last_change":"2024-02-18T16:22:49.707930+0000","last_active":"2024-02-18T16:22:49.707930+0000","last_peered":"2024-02-18T16:22:49.707930+0000","last_clean":"2024-02-18T16:22:49.707930+0000","last_became_active":"2024-02-18T16:21:05.897281+0000","last_became_peered":"2024-02-18T16:21:05.897281+0000","last_unstale":"2024-02-18T16:22:49.707930+0000","last_undegraded":"2024-02-18T16:22:49.707930+0000","last_fullsized":"2024-02-18T16:22:49.707930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-02-18T16:22:49.707617+0000","last_clean_scrub_stamp":"2024-02-18T16:22:49.707617+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:28.098540+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.735695+0000","last_change":"2024-02-18T16:22:50.735695+0000","last_active":"2024-02-18T16:22:50.735695+0000","last_peered":"2024-02-18T16:22:50.735695+0000","last_clean":"2024-02-18T16:22:50.735695+0000","last_became_active":"2024-02-18T16:21:07.892547+0000","last_became_peered":"2024-02-18T16:21:07.892547+0000","last_unstale":"2024-02-18T16:22:50.735695+0000","last_undegraded":"2024-02-18T16:22:50.735695+0000","last_fullsized":"2024-02-18T16:22:50.735695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:50.735438+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.735438+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:05:28.643943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:32.688241+0000","last_change":"2024-02-18T16:23:32.688296+0000","last_active":"2024-02-18T16:23:32.688241+0000","last_peered":"2024-02-18T16:23:32.688241+0000","last_clean":"2024-02-18T16:23:32.688241+0000","last_became_active":"2024-02-18T16:21:09.913984+0000","last_became_peered":"2024-02-18T16:21:09.913984+0000","last_unstale":"2024-02-18T16:23:32.688241+0000","last_undegraded":"2024-02-18T16:23:32.688241+0000","last_fullsized":"2024-02-18T16:23:32.688241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:32.688045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:32.688045+0000","last_clean_scrub_stamp":"2024-02-18T16:23:32.688045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:58:07.099132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.703777+0000","last_change":"2024-02-18T16:23:33.703851+0000","last_active":"2024-02-18T16:23:33.703777+0000","last_peered":"2024-02-18T16:23:33.703777+0000","last_clean":"2024-02-18T16:23:33.703777+0000","last_became_active":"2024-02-18T16:21:01.852591+0000","last_became_peered":"2024-02-18T16:21:01.852591+0000","last_unstale":"2024-02-18T16:23:33.703777+0000","last_undegraded":"2024-02-18T16:23:33.703777+0000","last_fullsized":"2024-02-18T16:23:33.703777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:33.703579+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:33.703579+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.703579+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:12:52.322217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.797372+0000","last_change":"2024-02-18T16:23:44.797437+0000","last_active":"2024-02-18T16:23:44.797372+0000","last_peered":"2024-02-18T16:23:44.797372+0000","last_clean":"2024-02-18T16:23:44.797372+0000","last_became_active":"2024-02-18T16:20:59.868155+0000","last_became_peered":"2024-02-18T16:20:59.868155+0000","last_unstale":"2024-02-18T16:23:44.797372+0000","last_undegraded":"2024-02-18T16:23:44.797372+0000","last_fullsized":"2024-02-18T16:23:44.797372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.797152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.797152+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.797152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:08:07.995733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.224158+0000","last_change":"2024-02-18T16:23:34.224211+0000","last_active":"2024-02-18T16:23:34.224158+0000","last_peered":"2024-02-18T16:23:34.224158+0000","last_clean":"2024-02-18T16:23:34.224158+0000","last_became_active":"2024-02-18T16:20:51.776488+0000","last_became_peered":"2024-02-18T16:20:51.776488+0000","last_unstale":"2024-02-18T16:23:34.224158+0000","last_undegraded":"2024-02-18T16:23:34.224158+0000","last_fullsized":"2024-02-18T16:23:34.224158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.223963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.223963+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.223963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:59.183408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.835162+0000","last_change":"2024-02-18T16:22:53.835162+0000","last_active":"2024-02-18T16:22:53.835162+0000","last_peered":"2024-02-18T16:22:53.835162+0000","last_clean":"2024-02-18T16:22:53.835162+0000","last_became_active":"2024-02-18T16:21:03.852078+0000","last_became_peered":"2024-02-18T16:21:03.852078+0000","last_unstale":"2024-02-18T16:22:53.835162+0000","last_undegraded":"2024-02-18T16:22:53.835162+0000","last_fullsized":"2024-02-18T16:22:53.835162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.834880+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.834880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:45:52.990486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.796672+0000","last_change":"2024-02-18T16:23:02.796672+0000","last_active":"2024-02-18T16:23:02.796672+0000","last_peered":"2024-02-18T16:23:02.796672+0000","last_clean":"2024-02-18T16:23:02.796672+0000","last_became_active":"2024-02-18T16:21:05.892494+0000","last_became_peered":"2024-02-18T16:21:05.892494+0000","last_unstale":"2024-02-18T16:23:02.796672+0000","last_undegraded":"2024-02-18T16:23:02.796672+0000","last_fullsized":"2024-02-18T16:23:02.796672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-02-18T16:23:02.796510+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.796510+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:15.165336+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.432203+0000","last_change":"2024-02-18T16:22:53.432203+0000","last_active":"2024-02-18T16:22:53.432203+0000","last_peered":"2024-02-18T16:22:53.432203+0000","last_clean":"2024-02-18T16:22:53.432203+0000","last_became_active":"2024-02-18T16:21:07.892574+0000","last_became_peered":"2024-02-18T16:21:07.892574+0000","last_unstale":"2024-02-18T16:22:53.432203+0000","last_undegraded":"2024-02-18T16:22:53.432203+0000","last_fullsized":"2024-02-18T16:22:53.432203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:53.431945+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.431945+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:16.067812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.886911+0000","last_change":"2024-02-18T16:23:43.886978+0000","last_active":"2024-02-18T16:23:43.886911+0000","last_peered":"2024-02-18T16:23:43.886911+0000","last_clean":"2024-02-18T16:23:43.886911+0000","last_became_active":"2024-02-18T16:21:09.916560+0000","last_became_peered":"2024-02-18T16:21:09.916560+0000","last_unstale":"2024-02-18T16:23:43.886911+0000","last_undegraded":"2024-02-18T16:23:43.886911+0000","last_fullsized":"2024-02-18T16:23:43.886911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-02-18T16:23:43.886686+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-02-18T16:23:43.886686+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.886686+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:05:20.617815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.849175+0000","last_change":"2024-02-18T16:23:25.849283+0000","last_active":"2024-02-18T16:23:25.849175+0000","last_peered":"2024-02-18T16:23:25.849175+0000","last_clean":"2024-02-18T16:23:25.849175+0000","last_became_active":"2024-02-18T16:21:01.848870+0000","last_became_peered":"2024-02-18T16:21:01.848870+0000","last_unstale":"2024-02-18T16:23:25.849175+0000","last_undegraded":"2024-02-18T16:23:25.849175+0000","last_fullsized":"2024-02-18T16:23:25.849175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.848950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.848950+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.848950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:38.054152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:21.719789+0000","last_change":"2024-02-18T16:23:21.719847+0000","last_active":"2024-02-18T16:23:21.719789+0000","last_peered":"2024-02-18T16:23:21.719789+0000","last_clean":"2024-02-18T16:23:21.719789+0000","last_became_active":"2024-02-18T16:20:59.873292+0000","last_became_peered":"2024-02-18T16:20:59.873292+0000","last_unstale":"2024-02-18T16:23:21.719789+0000","last_undegraded":"2024-02-18T16:23:21.719789+0000","last_fullsized":"2024-02-18T16:23:21.719789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:21.719594+0000","last_clean_scrub_stamp":"2024-02-18T16:23:21.719594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:28.530836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:02.863217+0000","last_change":"2024-02-18T16:24:02.863272+0000","last_active":"2024-02-18T16:24:02.863217+0000","last_peered":"2024-02-18T16:24:02.863217+0000","last_clean":"2024-02-18T16:24:02.863217+0000","last_became_active":"2024-02-18T16:20:52.281561+0000","last_became_peered":"2024-02-18T16:20:52.281561+0000","last_unstale":"2024-02-18T16:24:02.863217+0000","last_undegraded":"2024-02-18T16:24:02.863217+0000","last_fullsized":"2024-02-18T16:24:02.863217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:02.863018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:02.863018+0000","last_clean_scrub_stamp":"2024-02-18T16:24:02.863018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:00:38.572426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:55.848661+0000","last_change":"2024-02-18T16:22:55.848661+0000","last_active":"2024-02-18T16:22:55.848661+0000","last_peered":"2024-02-18T16:22:55.848661+0000","last_clean":"2024-02-18T16:22:55.848661+0000","last_became_active":"2024-02-18T16:21:03.849419+0000","last_became_peered":"2024-02-18T16:21:03.849419+0000","last_unstale":"2024-02-18T16:22:55.848661+0000","last_undegraded":"2024-02-18T16:22:55.848661+0000","last_fullsized":"2024-02-18T16:22:55.848661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:55.848402+0000","last_clean_scrub_stamp":"2024-02-18T16:22:55.848402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:18:19.446935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'90","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.898018+0000","last_change":"2024-02-18T16:22:57.898018+0000","last_active":"2024-02-18T16:22:57.898018+0000","last_peered":"2024-02-18T16:22:57.898018+0000","last_clean":"2024-02-18T16:22:57.898018+0000","last_became_active":"2024-02-18T16:21:05.893558+0000","last_became_peered":"2024-02-18T16:21:05.893558+0000","last_unstale":"2024-02-18T16:22:57.898018+0000","last_undegraded":"2024-02-18T16:22:57.898018+0000","last_fullsized":"2024-02-18T16:22:57.898018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-02-18T16:22:57.897660+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.897660+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:30:13.070415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:47.433639+0000","last_change":"2024-02-18T16:22:47.433639+0000","last_active":"2024-02-18T16:22:47.433639+0000","last_peered":"2024-02-18T16:22:47.433639+0000","last_clean":"2024-02-18T16:22:47.433639+0000","last_became_active":"2024-02-18T16:21:07.899125+0000","last_became_peered":"2024-02-18T16:21:07.899125+0000","last_unstale":"2024-02-18T16:22:47.433639+0000","last_undegraded":"2024-02-18T16:22:47.433639+0000","last_fullsized":"2024-02-18T16:22:47.433639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:47.433513+0000","last_clean_scrub_stamp":"2024-02-18T16:22:47.433513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:34.995953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.868860+0000","last_change":"2024-02-18T16:23:07.868860+0000","last_active":"2024-02-18T16:23:07.868860+0000","last_peered":"2024-02-18T16:23:07.868860+0000","last_clean":"2024-02-18T16:23:07.868860+0000","last_became_active":"2024-02-18T16:21:09.906290+0000","last_became_peered":"2024-02-18T16:21:09.906290+0000","last_unstale":"2024-02-18T16:23:07.868860+0000","last_undegraded":"2024-02-18T16:23:07.868860+0000","last_fullsized":"2024-02-18T16:23:07.868860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:07.868484+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.868484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:40.791749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.906138+0000","last_change":"2024-02-18T16:23:03.906138+0000","last_active":"2024-02-18T16:23:03.906138+0000","last_peered":"2024-02-18T16:23:03.906138+0000","last_clean":"2024-02-18T16:23:03.906138+0000","last_became_active":"2024-02-18T16:21:09.911300+0000","last_became_peered":"2024-02-18T16:21:09.911300+0000","last_unstale":"2024-02-18T16:23:03.906138+0000","last_undegraded":"2024-02-18T16:23:03.906138+0000","last_fullsized":"2024-02-18T16:23:03.906138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:03.905867+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.905867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:52.615381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.756988+0000","last_change":"2024-02-18T16:23:44.757135+0000","last_active":"2024-02-18T16:23:44.756988+0000","last_peered":"2024-02-18T16:23:44.756988+0000","last_clean":"2024-02-18T16:23:44.756988+0000","last_became_active":"2024-02-18T16:21:41.182866+0000","last_became_peered":"2024-02-18T16:21:41.182866+0000","last_unstale":"2024-02-18T16:23:44.756988+0000","last_undegraded":"2024-02-18T16:23:44.756988+0000","last_fullsized":"2024-02-18T16:23:44.756988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.756736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.756736+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.756736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:35:04.428942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:52.777360+0000","last_change":"2024-02-18T16:23:52.777423+0000","last_active":"2024-02-18T16:23:52.777360+0000","last_peered":"2024-02-18T16:23:52.777360+0000","last_clean":"2024-02-18T16:23:52.777360+0000","last_became_active":"2024-02-18T16:20:59.870060+0000","last_became_peered":"2024-02-18T16:20:59.870060+0000","last_unstale":"2024-02-18T16:23:52.777360+0000","last_undegraded":"2024-02-18T16:23:52.777360+0000","last_fullsized":"2024-02-18T16:23:52.777360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:52.777153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:52.777153+0000","last_clean_scrub_stamp":"2024-02-18T16:23:52.777153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:06:06.902390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:59.662609+0000","last_change":"2024-02-18T16:22:59.662609+0000","last_active":"2024-02-18T16:22:59.662609+0000","last_peered":"2024-02-18T16:22:59.662609+0000","last_clean":"2024-02-18T16:22:59.662609+0000","last_became_active":"2024-02-18T16:21:03.858554+0000","last_became_peered":"2024-02-18T16:21:03.858554+0000","last_unstale":"2024-02-18T16:22:59.662609+0000","last_undegraded":"2024-02-18T16:22:59.662609+0000","last_fullsized":"2024-02-18T16:22:59.662609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:59.662355+0000","last_clean_scrub_stamp":"2024-02-18T16:22:59.662355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:03:03.409762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.873759+0000","last_change":"2024-02-18T16:22:52.873759+0000","last_active":"2024-02-18T16:22:52.873759+0000","last_peered":"2024-02-18T16:22:52.873759+0000","last_clean":"2024-02-18T16:22:52.873759+0000","last_became_active":"2024-02-18T16:21:05.885190+0000","last_became_peered":"2024-02-18T16:21:05.885190+0000","last_unstale":"2024-02-18T16:22:52.873759+0000","last_undegraded":"2024-02-18T16:22:52.873759+0000","last_fullsized":"2024-02-18T16:22:52.873759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-02-18T16:22:52.873343+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.873343+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:03.165248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.654661+0000","last_change":"2024-02-18T16:23:13.654661+0000","last_active":"2024-02-18T16:23:13.654661+0000","last_peered":"2024-02-18T16:23:13.654661+0000","last_clean":"2024-02-18T16:23:13.654661+0000","last_became_active":"2024-02-18T16:21:07.896882+0000","last_became_peered":"2024-02-18T16:21:07.896882+0000","last_unstale":"2024-02-18T16:23:13.654661+0000","last_undegraded":"2024-02-18T16:23:13.654661+0000","last_fullsized":"2024-02-18T16:23:13.654661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.654400+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.654400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:20:57.367640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:44.311152+0000","last_change":"2024-02-18T16:23:44.311208+0000","last_active":"2024-02-18T16:23:44.311152+0000","last_peered":"2024-02-18T16:23:44.311152+0000","last_clean":"2024-02-18T16:23:44.311152+0000","last_became_active":"2024-02-18T16:21:09.909449+0000","last_became_peered":"2024-02-18T16:21:09.909449+0000","last_unstale":"2024-02-18T16:23:44.311152+0000","last_undegraded":"2024-02-18T16:23:44.311152+0000","last_fullsized":"2024-02-18T16:23:44.311152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:44.310949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:44.310949+0000","last_clean_scrub_stamp":"2024-02-18T16:23:44.310949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:41:06.755737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:07.698302+0000","last_change":"2024-02-18T16:23:07.698302+0000","last_active":"2024-02-18T16:23:07.698302+0000","last_peered":"2024-02-18T16:23:07.698302+0000","last_clean":"2024-02-18T16:23:07.698302+0000","last_became_active":"2024-02-18T16:21:01.851758+0000","last_became_peered":"2024-02-18T16:21:01.851758+0000","last_unstale":"2024-02-18T16:23:07.698302+0000","last_undegraded":"2024-02-18T16:23:07.698302+0000","last_fullsized":"2024-02-18T16:23:07.698302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:07.697990+0000","last_clean_scrub_stamp":"2024-02-18T16:23:07.697990+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:01:20.441729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.714368+0000","last_change":"2024-02-18T16:23:34.714540+0000","last_active":"2024-02-18T16:23:34.714368+0000","last_peered":"2024-02-18T16:23:34.714368+0000","last_clean":"2024-02-18T16:23:34.714368+0000","last_became_active":"2024-02-18T16:20:59.831031+0000","last_became_peered":"2024-02-18T16:20:59.831031+0000","last_unstale":"2024-02-18T16:23:34.714368+0000","last_undegraded":"2024-02-18T16:23:34.714368+0000","last_fullsized":"2024-02-18T16:23:34.714368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:34.714111+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:34.714111+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.714111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:40.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.819086+0000","last_change":"2024-02-18T16:22:57.819086+0000","last_active":"2024-02-18T16:22:57.819086+0000","last_peered":"2024-02-18T16:22:57.819086+0000","last_clean":"2024-02-18T16:22:57.819086+0000","last_became_active":"2024-02-18T16:21:03.849610+0000","last_became_peered":"2024-02-18T16:21:03.849610+0000","last_unstale":"2024-02-18T16:22:57.819086+0000","last_undegraded":"2024-02-18T16:22:57.819086+0000","last_fullsized":"2024-02-18T16:22:57.819086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.818829+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.818829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:13.082229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.400353+0000","last_change":"2024-02-18T16:23:00.400353+0000","last_active":"2024-02-18T16:23:00.400353+0000","last_peered":"2024-02-18T16:23:00.400353+0000","last_clean":"2024-02-18T16:23:00.400353+0000","last_became_active":"2024-02-18T16:21:05.880183+0000","last_became_peered":"2024-02-18T16:21:05.880183+0000","last_unstale":"2024-02-18T16:23:00.400353+0000","last_undegraded":"2024-02-18T16:23:00.400353+0000","last_fullsized":"2024-02-18T16:23:00.400353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-02-18T16:23:00.400088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.400088+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:59:15.271349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.801018+0000","last_change":"2024-02-18T16:22:52.801018+0000","last_active":"2024-02-18T16:22:52.801018+0000","last_peered":"2024-02-18T16:22:52.801018+0000","last_clean":"2024-02-18T16:22:52.801018+0000","last_became_active":"2024-02-18T16:21:07.899487+0000","last_became_peered":"2024-02-18T16:21:07.899487+0000","last_unstale":"2024-02-18T16:22:52.801018+0000","last_undegraded":"2024-02-18T16:22:52.801018+0000","last_fullsized":"2024-02-18T16:22:52.801018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.800725+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.800725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:35:16.840171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:46.260185+0000","last_change":"2024-02-18T16:23:46.260299+0000","last_active":"2024-02-18T16:23:46.260185+0000","last_peered":"2024-02-18T16:23:46.260185+0000","last_clean":"2024-02-18T16:23:46.260185+0000","last_became_active":"2024-02-18T16:21:09.925596+0000","last_became_peered":"2024-02-18T16:21:09.925596+0000","last_unstale":"2024-02-18T16:23:46.260185+0000","last_undegraded":"2024-02-18T16:23:46.260185+0000","last_fullsized":"2024-02-18T16:23:46.260185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:46.259927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:46.259927+0000","last_clean_scrub_stamp":"2024-02-18T16:23:46.259927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:04:52.163451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:16.086901+0000","last_change":"2024-02-18T16:23:16.086901+0000","last_active":"2024-02-18T16:23:16.086901+0000","last_peered":"2024-02-18T16:23:16.086901+0000","last_clean":"2024-02-18T16:23:16.086901+0000","last_became_active":"2024-02-18T16:21:01.846419+0000","last_became_peered":"2024-02-18T16:21:01.846419+0000","last_unstale":"2024-02-18T16:23:16.086901+0000","last_undegraded":"2024-02-18T16:23:16.086901+0000","last_fullsized":"2024-02-18T16:23:16.086901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:16.086590+0000","last_clean_scrub_stamp":"2024-02-18T16:23:16.086590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:14.287817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.854024+0000","last_change":"2024-02-18T16:23:24.854082+0000","last_active":"2024-02-18T16:23:24.854024+0000","last_peered":"2024-02-18T16:23:24.854024+0000","last_clean":"2024-02-18T16:23:24.854024+0000","last_became_active":"2024-02-18T16:20:59.837256+0000","last_became_peered":"2024-02-18T16:20:59.837256+0000","last_unstale":"2024-02-18T16:23:24.854024+0000","last_undegraded":"2024-02-18T16:23:24.854024+0000","last_fullsized":"2024-02-18T16:23:24.854024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:24.853825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:24.853825+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.853825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:40.117224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.876247+0000","last_change":"2024-02-18T16:23:05.876247+0000","last_active":"2024-02-18T16:23:05.876247+0000","last_peered":"2024-02-18T16:23:05.876247+0000","last_clean":"2024-02-18T16:23:05.876247+0000","last_became_active":"2024-02-18T16:21:03.863737+0000","last_became_peered":"2024-02-18T16:21:03.863737+0000","last_unstale":"2024-02-18T16:23:05.876247+0000","last_undegraded":"2024-02-18T16:23:05.876247+0000","last_fullsized":"2024-02-18T16:23:05.876247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:05.875986+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.875986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:35:34.158456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'41","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.361892+0000","last_change":"2024-02-18T16:23:01.361892+0000","last_active":"2024-02-18T16:23:01.361892+0000","last_peered":"2024-02-18T16:23:01.361892+0000","last_clean":"2024-02-18T16:23:01.361892+0000","last_became_active":"2024-02-18T16:21:05.876143+0000","last_became_peered":"2024-02-18T16:21:05.876143+0000","last_unstale":"2024-02-18T16:23:01.361892+0000","last_undegraded":"2024-02-18T16:23:01.361892+0000","last_fullsized":"2024-02-18T16:23:01.361892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-02-18T16:23:01.361622+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.361622+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:44:34.284887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.674935+0000","last_change":"2024-02-18T16:22:54.674935+0000","last_active":"2024-02-18T16:22:54.674935+0000","last_peered":"2024-02-18T16:22:54.674935+0000","last_clean":"2024-02-18T16:22:54.674935+0000","last_became_active":"2024-02-18T16:21:07.893511+0000","last_became_peered":"2024-02-18T16:21:07.893511+0000","last_unstale":"2024-02-18T16:22:54.674935+0000","last_undegraded":"2024-02-18T16:22:54.674935+0000","last_fullsized":"2024-02-18T16:22:54.674935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.674677+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.674677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:39:17.310545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:10.858641+0000","last_change":"2024-02-18T16:24:10.858706+0000","last_active":"2024-02-18T16:24:10.858641+0000","last_peered":"2024-02-18T16:24:10.858641+0000","last_clean":"2024-02-18T16:24:10.858641+0000","last_became_active":"2024-02-18T16:21:09.926264+0000","last_became_peered":"2024-02-18T16:21:09.926264+0000","last_unstale":"2024-02-18T16:24:10.858641+0000","last_undegraded":"2024-02-18T16:24:10.858641+0000","last_fullsized":"2024-02-18T16:24:10.858641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:24:10.858433+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:24:10.858433+0000","last_clean_scrub_stamp":"2024-02-18T16:24:10.858433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:48:10.713592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:31.720342+0000","last_change":"2024-02-18T16:23:31.720408+0000","last_active":"2024-02-18T16:23:31.720342+0000","last_peered":"2024-02-18T16:23:31.720342+0000","last_clean":"2024-02-18T16:23:31.720342+0000","last_became_active":"2024-02-18T16:21:01.852790+0000","last_became_peered":"2024-02-18T16:21:01.852790+0000","last_unstale":"2024-02-18T16:23:31.720342+0000","last_undegraded":"2024-02-18T16:23:31.720342+0000","last_fullsized":"2024-02-18T16:23:31.720342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:31.720139+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:31.720139+0000","last_clean_scrub_stamp":"2024-02-18T16:23:31.720139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:31:17.845563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:33.845951+0000","last_change":"2024-02-18T16:23:33.846011+0000","last_active":"2024-02-18T16:23:33.845951+0000","last_peered":"2024-02-18T16:23:33.845951+0000","last_clean":"2024-02-18T16:23:33.845951+0000","last_became_active":"2024-02-18T16:20:59.850603+0000","last_became_peered":"2024-02-18T16:20:59.850603+0000","last_unstale":"2024-02-18T16:23:33.845951+0000","last_undegraded":"2024-02-18T16:23:33.845951+0000","last_fullsized":"2024-02-18T16:23:33.845951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:33.845721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:33.845721+0000","last_clean_scrub_stamp":"2024-02-18T16:23:33.845721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:21:17.558961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.913473+0000","last_change":"2024-02-18T16:22:51.913473+0000","last_active":"2024-02-18T16:22:51.913473+0000","last_peered":"2024-02-18T16:22:51.913473+0000","last_clean":"2024-02-18T16:22:51.913473+0000","last_became_active":"2024-02-18T16:21:03.852499+0000","last_became_peered":"2024-02-18T16:21:03.852499+0000","last_unstale":"2024-02-18T16:22:51.913473+0000","last_undegraded":"2024-02-18T16:22:51.913473+0000","last_fullsized":"2024-02-18T16:22:51.913473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:51.913196+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.913196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:37:17.371442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:02.903715+0000","last_change":"2024-02-18T16:23:02.903715+0000","last_active":"2024-02-18T16:23:02.903715+0000","last_peered":"2024-02-18T16:23:02.903715+0000","last_clean":"2024-02-18T16:23:02.903715+0000","last_became_active":"2024-02-18T16:21:05.876276+0000","last_became_peered":"2024-02-18T16:21:05.876276+0000","last_unstale":"2024-02-18T16:23:02.903715+0000","last_undegraded":"2024-02-18T16:23:02.903715+0000","last_fullsized":"2024-02-18T16:23:02.903715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:23:02.903414+0000","last_clean_scrub_stamp":"2024-02-18T16:23:02.903414+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:08.912206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:53.831594+0000","last_change":"2024-02-18T16:22:53.831594+0000","last_active":"2024-02-18T16:22:53.831594+0000","last_peered":"2024-02-18T16:22:53.831594+0000","last_clean":"2024-02-18T16:22:53.831594+0000","last_became_active":"2024-02-18T16:21:07.894859+0000","last_became_peered":"2024-02-18T16:21:07.894859+0000","last_unstale":"2024-02-18T16:22:53.831594+0000","last_undegraded":"2024-02-18T16:22:53.831594+0000","last_fullsized":"2024-02-18T16:22:53.831594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:53.831178+0000","last_clean_scrub_stamp":"2024-02-18T16:22:53.831178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:35:41.393618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.730259+0000","last_change":"2024-02-18T16:23:35.730411+0000","last_active":"2024-02-18T16:23:35.730259+0000","last_peered":"2024-02-18T16:23:35.730259+0000","last_clean":"2024-02-18T16:23:35.730259+0000","last_became_active":"2024-02-18T16:21:01.852108+0000","last_became_peered":"2024-02-18T16:21:01.852108+0000","last_unstale":"2024-02-18T16:23:35.730259+0000","last_undegraded":"2024-02-18T16:23:35.730259+0000","last_fullsized":"2024-02-18T16:23:35.730259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.729964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.729964+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.729964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:33:15.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:55.823352+0000","last_change":"2024-02-18T16:23:55.823422+0000","last_active":"2024-02-18T16:23:55.823352+0000","last_peered":"2024-02-18T16:23:55.823352+0000","last_clean":"2024-02-18T16:23:55.823352+0000","last_became_active":"2024-02-18T16:20:59.855188+0000","last_became_peered":"2024-02-18T16:20:59.855188+0000","last_unstale":"2024-02-18T16:23:55.823352+0000","last_undegraded":"2024-02-18T16:23:55.823352+0000","last_fullsized":"2024-02-18T16:23:55.823352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:55.823145+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:55.823145+0000","last_clean_scrub_stamp":"2024-02-18T16:23:55.823145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:07:08.887342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.208927+0000","last_change":"2024-02-18T16:23:09.208983+0000","last_active":"2024-02-18T16:23:09.208927+0000","last_peered":"2024-02-18T16:23:09.208927+0000","last_clean":"2024-02-18T16:23:09.208927+0000","last_became_active":"2024-02-18T16:21:03.856392+0000","last_became_peered":"2024-02-18T16:21:03.856392+0000","last_unstale":"2024-02-18T16:23:09.208927+0000","last_undegraded":"2024-02-18T16:23:09.208927+0000","last_fullsized":"2024-02-18T16:23:09.208927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.208729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.208729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:32.488847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:58.424028+0000","last_change":"2024-02-18T16:22:58.424028+0000","last_active":"2024-02-18T16:22:58.424028+0000","last_peered":"2024-02-18T16:22:58.424028+0000","last_clean":"2024-02-18T16:22:58.424028+0000","last_became_active":"2024-02-18T16:21:05.880065+0000","last_became_peered":"2024-02-18T16:21:05.880065+0000","last_unstale":"2024-02-18T16:22:58.424028+0000","last_undegraded":"2024-02-18T16:22:58.424028+0000","last_fullsized":"2024-02-18T16:22:58.424028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-02-18T16:22:58.423765+0000","last_clean_scrub_stamp":"2024-02-18T16:22:58.423765+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:19.745145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.869606+0000","last_change":"2024-02-18T16:22:54.869606+0000","last_active":"2024-02-18T16:22:54.869606+0000","last_peered":"2024-02-18T16:22:54.869606+0000","last_clean":"2024-02-18T16:22:54.869606+0000","last_became_active":"2024-02-18T16:21:07.890202+0000","last_became_peered":"2024-02-18T16:21:07.890202+0000","last_unstale":"2024-02-18T16:22:54.869606+0000","last_undegraded":"2024-02-18T16:22:54.869606+0000","last_fullsized":"2024-02-18T16:22:54.869606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:54.869352+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.869352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:40:33.260275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:47.270335+0000","last_change":"2024-02-18T16:23:47.270394+0000","last_active":"2024-02-18T16:23:47.270335+0000","last_peered":"2024-02-18T16:23:47.270335+0000","last_clean":"2024-02-18T16:23:47.270335+0000","last_became_active":"2024-02-18T16:21:09.925883+0000","last_became_peered":"2024-02-18T16:21:09.925883+0000","last_unstale":"2024-02-18T16:23:47.270335+0000","last_undegraded":"2024-02-18T16:23:47.270335+0000","last_fullsized":"2024-02-18T16:23:47.270335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:47.270144+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:47.270144+0000","last_clean_scrub_stamp":"2024-02-18T16:23:47.270144+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:57:18.133113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:23.153440+0000","last_change":"2024-02-18T16:23:23.153502+0000","last_active":"2024-02-18T16:23:23.153440+0000","last_peered":"2024-02-18T16:23:23.153440+0000","last_clean":"2024-02-18T16:23:23.153440+0000","last_became_active":"2024-02-18T16:21:01.840527+0000","last_became_peered":"2024-02-18T16:21:01.840527+0000","last_unstale":"2024-02-18T16:23:23.153440+0000","last_undegraded":"2024-02-18T16:23:23.153440+0000","last_fullsized":"2024-02-18T16:23:23.153440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:23.153242+0000","last_clean_scrub_stamp":"2024-02-18T16:23:23.153242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T04:19:35.522068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:34.883148+0000","last_change":"2024-02-18T16:23:34.883208+0000","last_active":"2024-02-18T16:23:34.883148+0000","last_peered":"2024-02-18T16:23:34.883148+0000","last_clean":"2024-02-18T16:23:34.883148+0000","last_became_active":"2024-02-18T16:20:59.853413+0000","last_became_peered":"2024-02-18T16:20:59.853413+0000","last_unstale":"2024-02-18T16:23:34.883148+0000","last_undegraded":"2024-02-18T16:23:34.883148+0000","last_fullsized":"2024-02-18T16:23:34.883148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:34.882944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:34.882944+0000","last_clean_scrub_stamp":"2024-02-18T16:23:34.882944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:15:59.842389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.898942+0000","last_change":"2024-02-18T16:23:10.898998+0000","last_active":"2024-02-18T16:23:10.898942+0000","last_peered":"2024-02-18T16:23:10.898942+0000","last_clean":"2024-02-18T16:23:10.898942+0000","last_became_active":"2024-02-18T16:21:03.853637+0000","last_became_peered":"2024-02-18T16:21:03.853637+0000","last_unstale":"2024-02-18T16:23:10.898942+0000","last_undegraded":"2024-02-18T16:23:10.898942+0000","last_fullsized":"2024-02-18T16:23:10.898942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.898746+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.898746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:50:42.106224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.722806+0000","last_change":"2024-02-18T16:23:04.722806+0000","last_active":"2024-02-18T16:23:04.722806+0000","last_peered":"2024-02-18T16:23:04.722806+0000","last_clean":"2024-02-18T16:23:04.722806+0000","last_became_active":"2024-02-18T16:21:05.894246+0000","last_became_peered":"2024-02-18T16:21:05.894246+0000","last_unstale":"2024-02-18T16:23:04.722806+0000","last_undegraded":"2024-02-18T16:23:04.722806+0000","last_fullsized":"2024-02-18T16:23:04.722806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:23:04.722326+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.722326+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:26:12.289082+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.699736+0000","last_change":"2024-02-18T16:23:06.699736+0000","last_active":"2024-02-18T16:23:06.699736+0000","last_peered":"2024-02-18T16:23:06.699736+0000","last_clean":"2024-02-18T16:23:06.699736+0000","last_became_active":"2024-02-18T16:21:07.917267+0000","last_became_peered":"2024-02-18T16:21:07.917267+0000","last_unstale":"2024-02-18T16:23:06.699736+0000","last_undegraded":"2024-02-18T16:23:06.699736+0000","last_fullsized":"2024-02-18T16:23:06.699736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:06.699466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.699466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:06:54.340986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:07.852538+0000","last_change":"2024-02-18T16:24:07.852682+0000","last_active":"2024-02-18T16:24:07.852538+0000","last_peered":"2024-02-18T16:24:07.852538+0000","last_clean":"2024-02-18T16:24:07.852538+0000","last_became_active":"2024-02-18T16:21:09.924016+0000","last_became_peered":"2024-02-18T16:21:09.924016+0000","last_unstale":"2024-02-18T16:24:07.852538+0000","last_undegraded":"2024-02-18T16:24:07.852538+0000","last_fullsized":"2024-02-18T16:24:07.852538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:07.852263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:07.852263+0000","last_clean_scrub_stamp":"2024-02-18T16:24:07.852263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:25:48.448105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:01.756244+0000","last_change":"2024-02-18T16:23:01.756244+0000","last_active":"2024-02-18T16:23:01.756244+0000","last_peered":"2024-02-18T16:23:01.756244+0000","last_clean":"2024-02-18T16:23:01.756244+0000","last_became_active":"2024-02-18T16:21:01.857696+0000","last_became_peered":"2024-02-18T16:21:01.857696+0000","last_unstale":"2024-02-18T16:23:01.756244+0000","last_undegraded":"2024-02-18T16:23:01.756244+0000","last_fullsized":"2024-02-18T16:23:01.756244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:01.755900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:01.755900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:58.697375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:35.933399+0000","last_change":"2024-02-18T16:23:35.933459+0000","last_active":"2024-02-18T16:23:35.933399+0000","last_peered":"2024-02-18T16:23:35.933399+0000","last_clean":"2024-02-18T16:23:35.933399+0000","last_became_active":"2024-02-18T16:20:59.853330+0000","last_became_peered":"2024-02-18T16:20:59.853330+0000","last_unstale":"2024-02-18T16:23:35.933399+0000","last_undegraded":"2024-02-18T16:23:35.933399+0000","last_fullsized":"2024-02-18T16:23:35.933399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:35.933180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:35.933180+0000","last_clean_scrub_stamp":"2024-02-18T16:23:35.933180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:26.730906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.887431+0000","last_change":"2024-02-18T16:23:08.887431+0000","last_active":"2024-02-18T16:23:08.887431+0000","last_peered":"2024-02-18T16:23:08.887431+0000","last_clean":"2024-02-18T16:23:08.887431+0000","last_became_active":"2024-02-18T16:21:03.854647+0000","last_became_peered":"2024-02-18T16:21:03.854647+0000","last_unstale":"2024-02-18T16:23:08.887431+0000","last_undegraded":"2024-02-18T16:23:08.887431+0000","last_fullsized":"2024-02-18T16:23:08.887431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:08.887177+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.887177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:52.037300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.388978+0000","last_change":"2024-02-18T16:22:57.388978+0000","last_active":"2024-02-18T16:22:57.388978+0000","last_peered":"2024-02-18T16:22:57.388978+0000","last_clean":"2024-02-18T16:22:57.388978+0000","last_became_active":"2024-02-18T16:21:05.888857+0000","last_became_peered":"2024-02-18T16:21:05.888857+0000","last_unstale":"2024-02-18T16:22:57.388978+0000","last_undegraded":"2024-02-18T16:22:57.388978+0000","last_fullsized":"2024-02-18T16:22:57.388978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:22:57.388689+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.388689+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:02:26.576966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:03.357962+0000","last_change":"2024-02-18T16:23:03.357962+0000","last_active":"2024-02-18T16:23:03.357962+0000","last_peered":"2024-02-18T16:23:03.357962+0000","last_clean":"2024-02-18T16:23:03.357962+0000","last_became_active":"2024-02-18T16:21:07.906804+0000","last_became_peered":"2024-02-18T16:21:07.906804+0000","last_unstale":"2024-02-18T16:23:03.357962+0000","last_undegraded":"2024-02-18T16:23:03.357962+0000","last_fullsized":"2024-02-18T16:23:03.357962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:03.357709+0000","last_clean_scrub_stamp":"2024-02-18T16:23:03.357709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:29:02.881887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.713891+0000","last_change":"2024-02-18T16:23:28.713891+0000","last_active":"2024-02-18T16:23:28.713891+0000","last_peered":"2024-02-18T16:23:28.713891+0000","last_clean":"2024-02-18T16:23:28.713891+0000","last_became_active":"2024-02-18T16:21:09.910789+0000","last_became_peered":"2024-02-18T16:21:09.910789+0000","last_unstale":"2024-02-18T16:23:28.713891+0000","last_undegraded":"2024-02-18T16:23:28.713891+0000","last_fullsized":"2024-02-18T16:23:28.713891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.713636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.713636+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.713636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:56:59.576605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.154731+0000","last_change":"2024-02-18T16:23:19.154731+0000","last_active":"2024-02-18T16:23:19.154731+0000","last_peered":"2024-02-18T16:23:19.154731+0000","last_clean":"2024-02-18T16:23:19.154731+0000","last_became_active":"2024-02-18T16:21:01.837516+0000","last_became_peered":"2024-02-18T16:21:01.837516+0000","last_unstale":"2024-02-18T16:23:19.154731+0000","last_undegraded":"2024-02-18T16:23:19.154731+0000","last_fullsized":"2024-02-18T16:23:19.154731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.154433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.154433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:31.359635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:54.845117+0000","last_change":"2024-02-18T16:23:54.845175+0000","last_active":"2024-02-18T16:23:54.845117+0000","last_peered":"2024-02-18T16:23:54.845117+0000","last_clean":"2024-02-18T16:23:54.845117+0000","last_became_active":"2024-02-18T16:20:59.871536+0000","last_became_peered":"2024-02-18T16:20:59.871536+0000","last_unstale":"2024-02-18T16:23:54.845117+0000","last_undegraded":"2024-02-18T16:23:54.845117+0000","last_fullsized":"2024-02-18T16:23:54.845117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:54.844906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:54.844906+0000","last_clean_scrub_stamp":"2024-02-18T16:23:54.844906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:28:54.687144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.683330+0000","last_change":"2024-02-18T16:22:56.683330+0000","last_active":"2024-02-18T16:22:56.683330+0000","last_peered":"2024-02-18T16:22:56.683330+0000","last_clean":"2024-02-18T16:22:56.683330+0000","last_became_active":"2024-02-18T16:21:03.862641+0000","last_became_peered":"2024-02-18T16:21:03.862641+0000","last_unstale":"2024-02-18T16:22:56.683330+0000","last_undegraded":"2024-02-18T16:22:56.683330+0000","last_fullsized":"2024-02-18T16:22:56.683330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:56.683085+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.683085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:46:21.980224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.770082+0000","last_change":"2024-02-18T16:23:19.770167+0000","last_active":"2024-02-18T16:23:19.770082+0000","last_peered":"2024-02-18T16:23:19.770082+0000","last_clean":"2024-02-18T16:23:19.770082+0000","last_became_active":"2024-02-18T16:21:05.896821+0000","last_became_peered":"2024-02-18T16:21:05.896821+0000","last_unstale":"2024-02-18T16:23:19.770082+0000","last_undegraded":"2024-02-18T16:23:19.770082+0000","last_fullsized":"2024-02-18T16:23:19.770082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-02-18T16:23:19.769894+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.769894+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:21.405998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:48.790722+0000","last_change":"2024-02-18T16:22:48.790722+0000","last_active":"2024-02-18T16:22:48.790722+0000","last_peered":"2024-02-18T16:22:48.790722+0000","last_clean":"2024-02-18T16:22:48.790722+0000","last_became_active":"2024-02-18T16:21:07.902366+0000","last_became_peered":"2024-02-18T16:21:07.902366+0000","last_unstale":"2024-02-18T16:22:48.790722+0000","last_undegraded":"2024-02-18T16:22:48.790722+0000","last_fullsized":"2024-02-18T16:22:48.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-02-18T16:22:48.790462+0000","last_clean_scrub_stamp":"2024-02-18T16:22:48.790462+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:30:37.353769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.762158+0000","last_change":"2024-02-18T16:23:40.762232+0000","last_active":"2024-02-18T16:23:40.762158+0000","last_peered":"2024-02-18T16:23:40.762158+0000","last_clean":"2024-02-18T16:23:40.762158+0000","last_became_active":"2024-02-18T16:21:09.923093+0000","last_became_peered":"2024-02-18T16:21:09.923093+0000","last_unstale":"2024-02-18T16:23:40.762158+0000","last_undegraded":"2024-02-18T16:23:40.762158+0000","last_fullsized":"2024-02-18T16:23:40.762158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.761955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.761955+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.761955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:26:02.420065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:19.906619+0000","last_change":"2024-02-18T16:23:19.906619+0000","last_active":"2024-02-18T16:23:19.906619+0000","last_peered":"2024-02-18T16:23:19.906619+0000","last_clean":"2024-02-18T16:23:19.906619+0000","last_became_active":"2024-02-18T16:21:01.837077+0000","last_became_peered":"2024-02-18T16:21:01.837077+0000","last_unstale":"2024-02-18T16:23:19.906619+0000","last_undegraded":"2024-02-18T16:23:19.906619+0000","last_fullsized":"2024-02-18T16:23:19.906619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-18T16:23:19.906135+0000","last_clean_scrub_stamp":"2024-02-18T16:23:19.906135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:30.198039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.904887+0000","last_change":"2024-02-18T16:23:39.904947+0000","last_active":"2024-02-18T16:23:39.904887+0000","last_peered":"2024-02-18T16:23:39.904887+0000","last_clean":"2024-02-18T16:23:39.904887+0000","last_became_active":"2024-02-18T16:20:59.856825+0000","last_became_peered":"2024-02-18T16:20:59.856825+0000","last_unstale":"2024-02-18T16:23:39.904887+0000","last_undegraded":"2024-02-18T16:23:39.904887+0000","last_fullsized":"2024-02-18T16:23:39.904887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.904651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.904651+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.904651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:03:41.540756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:57.684114+0000","last_change":"2024-02-18T16:22:57.684114+0000","last_active":"2024-02-18T16:22:57.684114+0000","last_peered":"2024-02-18T16:22:57.684114+0000","last_clean":"2024-02-18T16:22:57.684114+0000","last_became_active":"2024-02-18T16:21:03.867559+0000","last_became_peered":"2024-02-18T16:21:03.867559+0000","last_unstale":"2024-02-18T16:22:57.684114+0000","last_undegraded":"2024-02-18T16:22:57.684114+0000","last_fullsized":"2024-02-18T16:22:57.684114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:57.683775+0000","last_clean_scrub_stamp":"2024-02-18T16:22:57.683775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:57:46.393290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:51.747441+0000","last_change":"2024-02-18T16:22:51.747441+0000","last_active":"2024-02-18T16:22:51.747441+0000","last_peered":"2024-02-18T16:22:51.747441+0000","last_clean":"2024-02-18T16:22:51.747441+0000","last_became_active":"2024-02-18T16:21:05.883346+0000","last_became_peered":"2024-02-18T16:21:05.883346+0000","last_unstale":"2024-02-18T16:22:51.747441+0000","last_undegraded":"2024-02-18T16:22:51.747441+0000","last_fullsized":"2024-02-18T16:22:51.747441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-02-18T16:22:51.747142+0000","last_clean_scrub_stamp":"2024-02-18T16:22:51.747142+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:06:31.805590+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:50.481478+0000","last_change":"2024-02-18T16:22:50.481478+0000","last_active":"2024-02-18T16:22:50.481478+0000","last_peered":"2024-02-18T16:22:50.481478+0000","last_clean":"2024-02-18T16:22:50.481478+0000","last_became_active":"2024-02-18T16:21:07.894276+0000","last_became_peered":"2024-02-18T16:21:07.894276+0000","last_unstale":"2024-02-18T16:22:50.481478+0000","last_undegraded":"2024-02-18T16:22:50.481478+0000","last_fullsized":"2024-02-18T16:22:50.481478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:50.481235+0000","last_clean_scrub_stamp":"2024-02-18T16:22:50.481235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:40.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.884323+0000","last_change":"2024-02-18T16:23:45.884384+0000","last_active":"2024-02-18T16:23:45.884323+0000","last_peered":"2024-02-18T16:23:45.884323+0000","last_clean":"2024-02-18T16:23:45.884323+0000","last_became_active":"2024-02-18T16:21:09.926460+0000","last_became_peered":"2024-02-18T16:21:09.926460+0000","last_unstale":"2024-02-18T16:23:45.884323+0000","last_undegraded":"2024-02-18T16:23:45.884323+0000","last_fullsized":"2024-02-18T16:23:45.884323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:45.884134+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:45.884134+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.884134+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:58:56.431453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.951553+0000","last_change":"2024-02-18T16:23:14.951553+0000","last_active":"2024-02-18T16:23:14.951553+0000","last_peered":"2024-02-18T16:23:14.951553+0000","last_clean":"2024-02-18T16:23:14.951553+0000","last_became_active":"2024-02-18T16:21:01.831591+0000","last_became_peered":"2024-02-18T16:21:01.831591+0000","last_unstale":"2024-02-18T16:23:14.951553+0000","last_undegraded":"2024-02-18T16:23:14.951553+0000","last_fullsized":"2024-02-18T16:23:14.951553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.951301+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.951301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:43:05.081514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.723530+0000","last_change":"2024-02-18T16:23:39.723591+0000","last_active":"2024-02-18T16:23:39.723530+0000","last_peered":"2024-02-18T16:23:39.723530+0000","last_clean":"2024-02-18T16:23:39.723530+0000","last_became_active":"2024-02-18T16:20:59.871786+0000","last_became_peered":"2024-02-18T16:20:59.871786+0000","last_unstale":"2024-02-18T16:23:39.723530+0000","last_undegraded":"2024-02-18T16:23:39.723530+0000","last_fullsized":"2024-02-18T16:23:39.723530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:39.723325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:39.723325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.723325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:11:20.026076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:09.877623+0000","last_change":"2024-02-18T16:23:09.877623+0000","last_active":"2024-02-18T16:23:09.877623+0000","last_peered":"2024-02-18T16:23:09.877623+0000","last_clean":"2024-02-18T16:23:09.877623+0000","last_became_active":"2024-02-18T16:21:03.853039+0000","last_became_peered":"2024-02-18T16:21:03.853039+0000","last_unstale":"2024-02-18T16:23:09.877623+0000","last_undegraded":"2024-02-18T16:23:09.877623+0000","last_fullsized":"2024-02-18T16:23:09.877623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:09.877375+0000","last_clean_scrub_stamp":"2024-02-18T16:23:09.877375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:34:51.281775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:54.395705+0000","last_change":"2024-02-18T16:22:54.395705+0000","last_active":"2024-02-18T16:22:54.395705+0000","last_peered":"2024-02-18T16:22:54.395705+0000","last_clean":"2024-02-18T16:22:54.395705+0000","last_became_active":"2024-02-18T16:21:05.894195+0000","last_became_peered":"2024-02-18T16:21:05.894195+0000","last_unstale":"2024-02-18T16:22:54.395705+0000","last_undegraded":"2024-02-18T16:22:54.395705+0000","last_fullsized":"2024-02-18T16:22:54.395705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-02-18T16:22:54.395421+0000","last_clean_scrub_stamp":"2024-02-18T16:22:54.395421+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:04:31.781895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:11.641433+0000","last_change":"2024-02-18T16:23:11.641433+0000","last_active":"2024-02-18T16:23:11.641433+0000","last_peered":"2024-02-18T16:23:11.641433+0000","last_clean":"2024-02-18T16:23:11.641433+0000","last_became_active":"2024-02-18T16:21:07.907148+0000","last_became_peered":"2024-02-18T16:21:07.907148+0000","last_unstale":"2024-02-18T16:23:11.641433+0000","last_undegraded":"2024-02-18T16:23:11.641433+0000","last_fullsized":"2024-02-18T16:23:11.641433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:11.641157+0000","last_clean_scrub_stamp":"2024-02-18T16:23:11.641157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:03:04.618665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:09.833648+0000","last_change":"2024-02-18T16:24:09.833706+0000","last_active":"2024-02-18T16:24:09.833648+0000","last_peered":"2024-02-18T16:24:09.833648+0000","last_clean":"2024-02-18T16:24:09.833648+0000","last_became_active":"2024-02-18T16:21:09.925942+0000","last_became_peered":"2024-02-18T16:21:09.925942+0000","last_unstale":"2024-02-18T16:24:09.833648+0000","last_undegraded":"2024-02-18T16:24:09.833648+0000","last_fullsized":"2024-02-18T16:24:09.833648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:09.833436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:09.833436+0000","last_clean_scrub_stamp":"2024-02-18T16:24:09.833436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:10:04.397560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.706755+0000","last_change":"2024-02-18T16:23:26.706755+0000","last_active":"2024-02-18T16:23:26.706755+0000","last_peered":"2024-02-18T16:23:26.706755+0000","last_clean":"2024-02-18T16:23:26.706755+0000","last_became_active":"2024-02-18T16:21:01.854709+0000","last_became_peered":"2024-02-18T16:21:01.854709+0000","last_unstale":"2024-02-18T16:23:26.706755+0000","last_undegraded":"2024-02-18T16:23:26.706755+0000","last_fullsized":"2024-02-18T16:23:26.706755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:26.706488+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:26.706488+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.706488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:35:36.196305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.123637+0000","last_change":"2024-02-18T16:23:18.123711+0000","last_active":"2024-02-18T16:23:18.123637+0000","last_peered":"2024-02-18T16:23:18.123637+0000","last_clean":"2024-02-18T16:23:18.123637+0000","last_became_active":"2024-02-18T16:20:59.861170+0000","last_became_peered":"2024-02-18T16:20:59.861170+0000","last_unstale":"2024-02-18T16:23:18.123637+0000","last_undegraded":"2024-02-18T16:23:18.123637+0000","last_fullsized":"2024-02-18T16:23:18.123637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:18.123439+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.123439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:54:33.386838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:05.716209+0000","last_change":"2024-02-18T16:23:05.716209+0000","last_active":"2024-02-18T16:23:05.716209+0000","last_peered":"2024-02-18T16:23:05.716209+0000","last_clean":"2024-02-18T16:23:05.716209+0000","last_became_active":"2024-02-18T16:21:03.857908+0000","last_became_peered":"2024-02-18T16:21:03.857908+0000","last_unstale":"2024-02-18T16:23:05.716209+0000","last_undegraded":"2024-02-18T16:23:05.716209+0000","last_fullsized":"2024-02-18T16:23:05.716209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-02-18T16:23:05.715931+0000","last_clean_scrub_stamp":"2024-02-18T16:23:05.715931+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:36:20.412885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:56.822998+0000","last_change":"2024-02-18T16:22:56.822998+0000","last_active":"2024-02-18T16:22:56.822998+0000","last_peered":"2024-02-18T16:22:56.822998+0000","last_clean":"2024-02-18T16:22:56.822998+0000","last_became_active":"2024-02-18T16:21:05.885694+0000","last_became_peered":"2024-02-18T16:21:05.885694+0000","last_unstale":"2024-02-18T16:22:56.822998+0000","last_undegraded":"2024-02-18T16:22:56.822998+0000","last_fullsized":"2024-02-18T16:22:56.822998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-02-18T16:22:56.822745+0000","last_clean_scrub_stamp":"2024-02-18T16:22:56.822745+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:54.548170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:10.652614+0000","last_change":"2024-02-18T16:23:10.652614+0000","last_active":"2024-02-18T16:23:10.652614+0000","last_peered":"2024-02-18T16:23:10.652614+0000","last_clean":"2024-02-18T16:23:10.652614+0000","last_became_active":"2024-02-18T16:21:07.912014+0000","last_became_peered":"2024-02-18T16:21:07.912014+0000","last_unstale":"2024-02-18T16:23:10.652614+0000","last_undegraded":"2024-02-18T16:23:10.652614+0000","last_fullsized":"2024-02-18T16:23:10.652614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:10.652245+0000","last_clean_scrub_stamp":"2024-02-18T16:23:10.652245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:14:12.784143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:12.785030+0000","last_change":"2024-02-18T16:24:12.785095+0000","last_active":"2024-02-18T16:24:12.785030+0000","last_peered":"2024-02-18T16:24:12.785030+0000","last_clean":"2024-02-18T16:24:12.785030+0000","last_became_active":"2024-02-18T16:21:09.931625+0000","last_became_peered":"2024-02-18T16:21:09.931625+0000","last_unstale":"2024-02-18T16:24:12.785030+0000","last_undegraded":"2024-02-18T16:24:12.785030+0000","last_fullsized":"2024-02-18T16:24:12.785030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:24:12.784817+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:24:12.784817+0000","last_clean_scrub_stamp":"2024-02-18T16:24:12.784817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:09:23.968308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:15.939764+0000","last_change":"2024-02-18T16:23:15.939764+0000","last_active":"2024-02-18T16:23:15.939764+0000","last_peered":"2024-02-18T16:23:15.939764+0000","last_clean":"2024-02-18T16:23:15.939764+0000","last_became_active":"2024-02-18T16:21:01.832947+0000","last_became_peered":"2024-02-18T16:21:01.832947+0000","last_unstale":"2024-02-18T16:23:15.939764+0000","last_undegraded":"2024-02-18T16:23:15.939764+0000","last_fullsized":"2024-02-18T16:23:15.939764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:15.939493+0000","last_clean_scrub_stamp":"2024-02-18T16:23:15.939493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:32:39.219610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:36.969407+0000","last_change":"2024-02-18T16:23:36.969466+0000","last_active":"2024-02-18T16:23:36.969407+0000","last_peered":"2024-02-18T16:23:36.969407+0000","last_clean":"2024-02-18T16:23:36.969407+0000","last_became_active":"2024-02-18T16:20:59.853707+0000","last_became_peered":"2024-02-18T16:20:59.853707+0000","last_unstale":"2024-02-18T16:23:36.969407+0000","last_undegraded":"2024-02-18T16:23:36.969407+0000","last_fullsized":"2024-02-18T16:23:36.969407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:36.969188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:36.969188+0000","last_clean_scrub_stamp":"2024-02-18T16:23:36.969188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:30.087371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:04.713141+0000","last_change":"2024-02-18T16:23:04.713141+0000","last_active":"2024-02-18T16:23:04.713141+0000","last_peered":"2024-02-18T16:23:04.713141+0000","last_clean":"2024-02-18T16:23:04.713141+0000","last_became_active":"2024-02-18T16:21:03.862251+0000","last_became_peered":"2024-02-18T16:21:03.862251+0000","last_unstale":"2024-02-18T16:23:04.713141+0000","last_undegraded":"2024-02-18T16:23:04.713141+0000","last_fullsized":"2024-02-18T16:23:04.713141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-02-18T16:23:04.712885+0000","last_clean_scrub_stamp":"2024-02-18T16:23:04.712885+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:17:24.627531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:00.770286+0000","last_change":"2024-02-18T16:23:00.770286+0000","last_active":"2024-02-18T16:23:00.770286+0000","last_peered":"2024-02-18T16:23:00.770286+0000","last_clean":"2024-02-18T16:23:00.770286+0000","last_became_active":"2024-02-18T16:21:05.890154+0000","last_became_peered":"2024-02-18T16:21:05.890154+0000","last_unstale":"2024-02-18T16:23:00.770286+0000","last_undegraded":"2024-02-18T16:23:00.770286+0000","last_fullsized":"2024-02-18T16:23:00.770286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-02-18T16:23:00.769987+0000","last_clean_scrub_stamp":"2024-02-18T16:23:00.769987+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:07.581229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:22:52.449715+0000","last_change":"2024-02-18T16:22:52.449715+0000","last_active":"2024-02-18T16:22:52.449715+0000","last_peered":"2024-02-18T16:22:52.449715+0000","last_clean":"2024-02-18T16:22:52.449715+0000","last_became_active":"2024-02-18T16:21:07.894045+0000","last_became_peered":"2024-02-18T16:21:07.894045+0000","last_unstale":"2024-02-18T16:22:52.449715+0000","last_undegraded":"2024-02-18T16:22:52.449715+0000","last_fullsized":"2024-02-18T16:22:52.449715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:22:52.449362+0000","last_clean_scrub_stamp":"2024-02-18T16:22:52.449362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:53:25.393949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:11.827003+0000","last_change":"2024-02-18T16:24:11.827131+0000","last_active":"2024-02-18T16:24:11.827003+0000","last_peered":"2024-02-18T16:24:11.827003+0000","last_clean":"2024-02-18T16:24:11.827003+0000","last_became_active":"2024-02-18T16:21:09.928230+0000","last_became_peered":"2024-02-18T16:21:09.928230+0000","last_unstale":"2024-02-18T16:24:11.827003+0000","last_undegraded":"2024-02-18T16:24:11.827003+0000","last_fullsized":"2024-02-18T16:24:11.827003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:24:11.826749+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:24:11.826749+0000","last_clean_scrub_stamp":"2024-02-18T16:24:11.826749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:13:59.570902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.762175+0000","last_change":"2024-02-18T16:23:13.762175+0000","last_active":"2024-02-18T16:23:13.762175+0000","last_peered":"2024-02-18T16:23:13.762175+0000","last_clean":"2024-02-18T16:23:13.762175+0000","last_became_active":"2024-02-18T16:21:01.845417+0000","last_became_peered":"2024-02-18T16:21:01.845417+0000","last_unstale":"2024-02-18T16:23:13.762175+0000","last_undegraded":"2024-02-18T16:23:13.762175+0000","last_fullsized":"2024-02-18T16:23:13.762175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-02-18T16:23:13.761893+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.761893+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:09:58.046238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.821835+0000","last_change":"2024-02-18T16:23:26.821900+0000","last_active":"2024-02-18T16:23:26.821835+0000","last_peered":"2024-02-18T16:23:26.821835+0000","last_clean":"2024-02-18T16:23:26.821835+0000","last_became_active":"2024-02-18T16:20:59.837180+0000","last_became_peered":"2024-02-18T16:20:59.837180+0000","last_unstale":"2024-02-18T16:23:26.821835+0000","last_undegraded":"2024-02-18T16:23:26.821835+0000","last_fullsized":"2024-02-18T16:23:26.821835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:26.821602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:26.821602+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.821602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T22:48:14.692681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:17.090108+0000","last_change":"2024-02-18T16:23:17.090161+0000","last_active":"2024-02-18T16:23:17.090108+0000","last_peered":"2024-02-18T16:23:17.090108+0000","last_clean":"2024-02-18T16:23:17.090108+0000","last_became_active":"2024-02-18T16:21:01.837483+0000","last_became_peered":"2024-02-18T16:21:01.837483+0000","last_unstale":"2024-02-18T16:23:17.090108+0000","last_undegraded":"2024-02-18T16:23:17.090108+0000","last_fullsized":"2024-02-18T16:23:17.090108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:17.089913+0000","last_clean_scrub_stamp":"2024-02-18T16:23:17.089913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:27:01.145814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.206720+0000","last_change":"2024-02-18T16:23:37.206785+0000","last_active":"2024-02-18T16:23:37.206720+0000","last_peered":"2024-02-18T16:23:37.206720+0000","last_clean":"2024-02-18T16:23:37.206720+0000","last_became_active":"2024-02-18T16:20:59.847635+0000","last_became_peered":"2024-02-18T16:20:59.847635+0000","last_unstale":"2024-02-18T16:23:37.206720+0000","last_undegraded":"2024-02-18T16:23:37.206720+0000","last_fullsized":"2024-02-18T16:23:37.206720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:37.206498+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:37.206498+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.206498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:41:44.876898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:06.695632+0000","last_change":"2024-02-18T16:23:06.695632+0000","last_active":"2024-02-18T16:23:06.695632+0000","last_peered":"2024-02-18T16:23:06.695632+0000","last_clean":"2024-02-18T16:23:06.695632+0000","last_became_active":"2024-02-18T16:21:01.856527+0000","last_became_peered":"2024-02-18T16:21:01.856527+0000","last_unstale":"2024-02-18T16:23:06.695632+0000","last_undegraded":"2024-02-18T16:23:06.695632+0000","last_fullsized":"2024-02-18T16:23:06.695632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:06.695361+0000","last_clean_scrub_stamp":"2024-02-18T16:23:06.695361+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:14:59.478331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:43.802543+0000","last_change":"2024-02-18T16:23:43.802710+0000","last_active":"2024-02-18T16:23:43.802543+0000","last_peered":"2024-02-18T16:23:43.802543+0000","last_clean":"2024-02-18T16:23:43.802543+0000","last_became_active":"2024-02-18T16:20:59.863488+0000","last_became_peered":"2024-02-18T16:20:59.863488+0000","last_unstale":"2024-02-18T16:23:43.802543+0000","last_undegraded":"2024-02-18T16:23:43.802543+0000","last_fullsized":"2024-02-18T16:23:43.802543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:43.802187+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:43.802187+0000","last_clean_scrub_stamp":"2024-02-18T16:23:43.802187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:54:47.826817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:29.181619+0000","last_change":"2024-02-18T16:23:29.181684+0000","last_active":"2024-02-18T16:23:29.181619+0000","last_peered":"2024-02-18T16:23:29.181619+0000","last_clean":"2024-02-18T16:23:29.181619+0000","last_became_active":"2024-02-18T16:21:01.840194+0000","last_became_peered":"2024-02-18T16:21:01.840194+0000","last_unstale":"2024-02-18T16:23:29.181619+0000","last_undegraded":"2024-02-18T16:23:29.181619+0000","last_fullsized":"2024-02-18T16:23:29.181619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:29.181423+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:29.181423+0000","last_clean_scrub_stamp":"2024-02-18T16:23:29.181423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:28:22.839630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:30.178294+0000","last_change":"2024-02-18T16:23:30.178437+0000","last_active":"2024-02-18T16:23:30.178294+0000","last_peered":"2024-02-18T16:23:30.178294+0000","last_clean":"2024-02-18T16:23:30.178294+0000","last_became_active":"2024-02-18T16:20:59.856337+0000","last_became_peered":"2024-02-18T16:20:59.856337+0000","last_unstale":"2024-02-18T16:23:30.178294+0000","last_undegraded":"2024-02-18T16:23:30.178294+0000","last_fullsized":"2024-02-18T16:23:30.178294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:30.178051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:30.178051+0000","last_clean_scrub_stamp":"2024-02-18T16:23:30.178051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:55:30.301871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:13.185309+0000","last_change":"2024-02-18T16:23:13.185363+0000","last_active":"2024-02-18T16:23:13.185309+0000","last_peered":"2024-02-18T16:23:13.185309+0000","last_clean":"2024-02-18T16:23:13.185309+0000","last_became_active":"2024-02-18T16:21:01.851645+0000","last_became_peered":"2024-02-18T16:21:01.851645+0000","last_unstale":"2024-02-18T16:23:13.185309+0000","last_undegraded":"2024-02-18T16:23:13.185309+0000","last_fullsized":"2024-02-18T16:23:13.185309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:13.185106+0000","last_clean_scrub_stamp":"2024-02-18T16:23:13.185106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:05:23.477010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.128487+0000","last_change":"2024-02-18T16:23:26.128566+0000","last_active":"2024-02-18T16:23:26.128487+0000","last_peered":"2024-02-18T16:23:26.128487+0000","last_clean":"2024-02-18T16:23:26.128487+0000","last_became_active":"2024-02-18T16:20:59.858923+0000","last_became_peered":"2024-02-18T16:20:59.858923+0000","last_unstale":"2024-02-18T16:23:26.128487+0000","last_undegraded":"2024-02-18T16:23:26.128487+0000","last_fullsized":"2024-02-18T16:23:26.128487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:26.128280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:26.128280+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.128280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:52:08.092199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'8","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:42.719359+0000","last_change":"2024-02-18T16:23:42.719359+0000","last_active":"2024-02-18T16:23:42.719359+0000","last_peered":"2024-02-18T16:23:42.719359+0000","last_clean":"2024-02-18T16:23:42.719359+0000","last_became_active":"2024-02-18T16:21:40.942202+0000","last_became_peered":"2024-02-18T16:21:40.942202+0000","last_unstale":"2024-02-18T16:23:42.719359+0000","last_undegraded":"2024-02-18T16:23:42.719359+0000","last_fullsized":"2024-02-18T16:23:42.719359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:42.719100+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:42.719100+0000","last_clean_scrub_stamp":"2024-02-18T16:23:42.719100+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:35:35.837283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.779164+0000","last_change":"2024-02-18T16:23:25.779308+0000","last_active":"2024-02-18T16:23:25.779164+0000","last_peered":"2024-02-18T16:23:25.779164+0000","last_clean":"2024-02-18T16:23:25.779164+0000","last_became_active":"2024-02-18T16:20:59.856413+0000","last_became_peered":"2024-02-18T16:20:59.856413+0000","last_unstale":"2024-02-18T16:23:25.779164+0000","last_undegraded":"2024-02-18T16:23:25.779164+0000","last_fullsized":"2024-02-18T16:23:25.779164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.778902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.778902+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.778902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:34:06.641181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.127529+0000","last_change":"2024-02-18T16:23:27.127580+0000","last_active":"2024-02-18T16:23:27.127529+0000","last_peered":"2024-02-18T16:23:27.127529+0000","last_clean":"2024-02-18T16:23:27.127529+0000","last_became_active":"2024-02-18T16:21:01.840973+0000","last_became_peered":"2024-02-18T16:21:01.840973+0000","last_unstale":"2024-02-18T16:23:27.127529+0000","last_undegraded":"2024-02-18T16:23:27.127529+0000","last_fullsized":"2024-02-18T16:23:27.127529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:27.127342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:27.127342+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.127342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:15:19.910312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.861175+0000","last_change":"2024-02-18T16:23:28.861242+0000","last_active":"2024-02-18T16:23:28.861175+0000","last_peered":"2024-02-18T16:23:28.861175+0000","last_clean":"2024-02-18T16:23:28.861175+0000","last_became_active":"2024-02-18T16:20:59.834671+0000","last_became_peered":"2024-02-18T16:20:59.834671+0000","last_unstale":"2024-02-18T16:23:28.861175+0000","last_undegraded":"2024-02-18T16:23:28.861175+0000","last_fullsized":"2024-02-18T16:23:28.861175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.860971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.860971+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.860971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:25.802445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:22.756466+0000","last_change":"2024-02-18T16:23:22.756531+0000","last_active":"2024-02-18T16:23:22.756466+0000","last_peered":"2024-02-18T16:23:22.756466+0000","last_clean":"2024-02-18T16:23:22.756466+0000","last_became_active":"2024-02-18T16:21:01.837887+0000","last_became_peered":"2024-02-18T16:21:01.837887+0000","last_unstale":"2024-02-18T16:23:22.756466+0000","last_undegraded":"2024-02-18T16:23:22.756466+0000","last_fullsized":"2024-02-18T16:23:22.756466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:22.756253+0000","last_clean_scrub_stamp":"2024-02-18T16:23:22.756253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:36:19.697727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.165521+0000","last_change":"2024-02-18T16:23:28.165582+0000","last_active":"2024-02-18T16:23:28.165521+0000","last_peered":"2024-02-18T16:23:28.165521+0000","last_clean":"2024-02-18T16:23:28.165521+0000","last_became_active":"2024-02-18T16:20:59.856505+0000","last_became_peered":"2024-02-18T16:20:59.856505+0000","last_unstale":"2024-02-18T16:23:28.165521+0000","last_undegraded":"2024-02-18T16:23:28.165521+0000","last_fullsized":"2024-02-18T16:23:28.165521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.165316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.165316+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.165316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:24:34.370583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:28.779865+0000","last_change":"2024-02-18T16:23:28.779917+0000","last_active":"2024-02-18T16:23:28.779865+0000","last_peered":"2024-02-18T16:23:28.779865+0000","last_clean":"2024-02-18T16:23:28.779865+0000","last_became_active":"2024-02-18T16:21:01.837717+0000","last_became_peered":"2024-02-18T16:21:01.837717+0000","last_unstale":"2024-02-18T16:23:28.779865+0000","last_undegraded":"2024-02-18T16:23:28.779865+0000","last_fullsized":"2024-02-18T16:23:28.779865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:28.779667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:28.779667+0000","last_clean_scrub_stamp":"2024-02-18T16:23:28.779667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T03:00:05.304973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:05.800510+0000","last_change":"2024-02-18T16:24:05.800575+0000","last_active":"2024-02-18T16:24:05.800510+0000","last_peered":"2024-02-18T16:24:05.800510+0000","last_clean":"2024-02-18T16:24:05.800510+0000","last_became_active":"2024-02-18T16:20:59.852114+0000","last_became_peered":"2024-02-18T16:20:59.852114+0000","last_unstale":"2024-02-18T16:24:05.800510+0000","last_undegraded":"2024-02-18T16:24:05.800510+0000","last_fullsized":"2024-02-18T16:24:05.800510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:05.800282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:05.800282+0000","last_clean_scrub_stamp":"2024-02-18T16:24:05.800282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T01:44:36.551397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:27.737010+0000","last_change":"2024-02-18T16:23:27.737075+0000","last_active":"2024-02-18T16:23:27.737010+0000","last_peered":"2024-02-18T16:23:27.737010+0000","last_clean":"2024-02-18T16:23:27.737010+0000","last_became_active":"2024-02-18T16:21:01.853551+0000","last_became_peered":"2024-02-18T16:21:01.853551+0000","last_unstale":"2024-02-18T16:23:27.737010+0000","last_undegraded":"2024-02-18T16:23:27.737010+0000","last_fullsized":"2024-02-18T16:23:27.737010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:27.736808+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:27.736808+0000","last_clean_scrub_stamp":"2024-02-18T16:23:27.736808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:56:21.997367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:39.213659+0000","last_change":"2024-02-18T16:23:39.213721+0000","last_active":"2024-02-18T16:23:39.213659+0000","last_peered":"2024-02-18T16:23:39.213659+0000","last_clean":"2024-02-18T16:23:39.213659+0000","last_became_active":"2024-02-18T16:20:59.852425+0000","last_became_peered":"2024-02-18T16:20:59.852425+0000","last_unstale":"2024-02-18T16:23:39.213659+0000","last_undegraded":"2024-02-18T16:23:39.213659+0000","last_fullsized":"2024-02-18T16:23:39.213659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-02-18T16:23:39.213463+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-02-18T16:23:39.213463+0000","last_clean_scrub_stamp":"2024-02-18T16:23:39.213463+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:27:12.046770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:12.212996+0000","last_change":"2024-02-18T16:23:12.212996+0000","last_active":"2024-02-18T16:23:12.212996+0000","last_peered":"2024-02-18T16:23:12.212996+0000","last_clean":"2024-02-18T16:23:12.212996+0000","last_became_active":"2024-02-18T16:21:01.853451+0000","last_became_peered":"2024-02-18T16:21:01.853451+0000","last_unstale":"2024-02-18T16:23:12.212996+0000","last_undegraded":"2024-02-18T16:23:12.212996+0000","last_fullsized":"2024-02-18T16:23:12.212996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:12.212729+0000","last_clean_scrub_stamp":"2024-02-18T16:23:12.212729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:52:54.222143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:38.941128+0000","last_change":"2024-02-18T16:23:38.941193+0000","last_active":"2024-02-18T16:23:38.941128+0000","last_peered":"2024-02-18T16:23:38.941128+0000","last_clean":"2024-02-18T16:23:38.941128+0000","last_became_active":"2024-02-18T16:20:59.856216+0000","last_became_peered":"2024-02-18T16:20:59.856216+0000","last_unstale":"2024-02-18T16:23:38.941128+0000","last_undegraded":"2024-02-18T16:23:38.941128+0000","last_fullsized":"2024-02-18T16:23:38.941128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:38.940925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:38.940925+0000","last_clean_scrub_stamp":"2024-02-18T16:23:38.940925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:44:54.178081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:24.757093+0000","last_change":"2024-02-18T16:23:24.757151+0000","last_active":"2024-02-18T16:23:24.757093+0000","last_peered":"2024-02-18T16:23:24.757093+0000","last_clean":"2024-02-18T16:23:24.757093+0000","last_became_active":"2024-02-18T16:21:01.839040+0000","last_became_peered":"2024-02-18T16:21:01.839040+0000","last_unstale":"2024-02-18T16:23:24.757093+0000","last_undegraded":"2024-02-18T16:23:24.757093+0000","last_fullsized":"2024-02-18T16:23:24.757093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-02-18T16:23:24.756900+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-02-18T16:23:24.756900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:24.756900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:37:41.262573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:37.956312+0000","last_change":"2024-02-18T16:23:37.956378+0000","last_active":"2024-02-18T16:23:37.956312+0000","last_peered":"2024-02-18T16:23:37.956312+0000","last_clean":"2024-02-18T16:23:37.956312+0000","last_became_active":"2024-02-18T16:20:59.856634+0000","last_became_peered":"2024-02-18T16:20:59.856634+0000","last_unstale":"2024-02-18T16:23:37.956312+0000","last_undegraded":"2024-02-18T16:23:37.956312+0000","last_fullsized":"2024-02-18T16:23:37.956312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:37.956099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:37.956099+0000","last_clean_scrub_stamp":"2024-02-18T16:23:37.956099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:16:29.927127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:08.693758+0000","last_change":"2024-02-18T16:23:08.693758+0000","last_active":"2024-02-18T16:23:08.693758+0000","last_peered":"2024-02-18T16:23:08.693758+0000","last_clean":"2024-02-18T16:23:08.693758+0000","last_became_active":"2024-02-18T16:21:01.847761+0000","last_became_peered":"2024-02-18T16:21:01.847761+0000","last_unstale":"2024-02-18T16:23:08.693758+0000","last_undegraded":"2024-02-18T16:23:08.693758+0000","last_fullsized":"2024-02-18T16:23:08.693758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:08.693466+0000","last_clean_scrub_stamp":"2024-02-18T16:23:08.693466+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:30:43.884820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:45.780137+0000","last_change":"2024-02-18T16:23:45.780294+0000","last_active":"2024-02-18T16:23:45.780137+0000","last_peered":"2024-02-18T16:23:45.780137+0000","last_clean":"2024-02-18T16:23:45.780137+0000","last_became_active":"2024-02-18T16:20:59.863236+0000","last_became_peered":"2024-02-18T16:20:59.863236+0000","last_unstale":"2024-02-18T16:23:45.780137+0000","last_undegraded":"2024-02-18T16:23:45.780137+0000","last_fullsized":"2024-02-18T16:23:45.780137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:45.779887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:45.779887+0000","last_clean_scrub_stamp":"2024-02-18T16:23:45.779887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:17:30.311975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.923282+0000","last_change":"2024-02-18T16:23:40.923356+0000","last_active":"2024-02-18T16:23:40.923282+0000","last_peered":"2024-02-18T16:23:40.923282+0000","last_clean":"2024-02-18T16:23:40.923282+0000","last_became_active":"2024-02-18T16:21:01.837872+0000","last_became_peered":"2024-02-18T16:21:01.837872+0000","last_unstale":"2024-02-18T16:23:40.923282+0000","last_undegraded":"2024-02-18T16:23:40.923282+0000","last_fullsized":"2024-02-18T16:23:40.923282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-02-18T16:23:40.923088+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-02-18T16:23:40.923088+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.923088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T00:47:39.018071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:24:06.809536+0000","last_change":"2024-02-18T16:24:06.809595+0000","last_active":"2024-02-18T16:24:06.809536+0000","last_peered":"2024-02-18T16:24:06.809536+0000","last_clean":"2024-02-18T16:24:06.809536+0000","last_became_active":"2024-02-18T16:20:59.870496+0000","last_became_peered":"2024-02-18T16:20:59.870496+0000","last_unstale":"2024-02-18T16:24:06.809536+0000","last_undegraded":"2024-02-18T16:24:06.809536+0000","last_fullsized":"2024-02-18T16:24:06.809536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:24:06.809317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:24:06.809317+0000","last_clean_scrub_stamp":"2024-02-18T16:24:06.809317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:33:12.649311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:25.736468+0000","last_change":"2024-02-18T16:23:25.736525+0000","last_active":"2024-02-18T16:23:25.736468+0000","last_peered":"2024-02-18T16:23:25.736468+0000","last_clean":"2024-02-18T16:23:25.736468+0000","last_became_active":"2024-02-18T16:21:01.854295+0000","last_became_peered":"2024-02-18T16:21:01.854295+0000","last_unstale":"2024-02-18T16:23:25.736468+0000","last_undegraded":"2024-02-18T16:23:25.736468+0000","last_fullsized":"2024-02-18T16:23:25.736468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:25.736273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:25.736273+0000","last_clean_scrub_stamp":"2024-02-18T16:23:25.736273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:40:48.181060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:20.875104+0000","last_change":"2024-02-18T16:23:20.875163+0000","last_active":"2024-02-18T16:23:20.875104+0000","last_peered":"2024-02-18T16:23:20.875104+0000","last_clean":"2024-02-18T16:23:20.875104+0000","last_became_active":"2024-02-18T16:20:59.854350+0000","last_became_peered":"2024-02-18T16:20:59.854350+0000","last_unstale":"2024-02-18T16:23:20.875104+0000","last_undegraded":"2024-02-18T16:23:20.875104+0000","last_fullsized":"2024-02-18T16:23:20.875104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:20.874900+0000","last_clean_scrub_stamp":"2024-02-18T16:23:20.874900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:20.030506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:18.750625+0000","last_change":"2024-02-18T16:23:18.750690+0000","last_active":"2024-02-18T16:23:18.750625+0000","last_peered":"2024-02-18T16:23:18.750625+0000","last_clean":"2024-02-18T16:23:18.750625+0000","last_became_active":"2024-02-18T16:21:01.837924+0000","last_became_peered":"2024-02-18T16:21:01.837924+0000","last_unstale":"2024-02-18T16:23:18.750625+0000","last_undegraded":"2024-02-18T16:23:18.750625+0000","last_fullsized":"2024-02-18T16:23:18.750625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-02-18T16:23:18.750433+0000","last_clean_scrub_stamp":"2024-02-18T16:23:18.750433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:13:02.263592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:56.850528+0000","last_change":"2024-02-18T16:23:56.850595+0000","last_active":"2024-02-18T16:23:56.850528+0000","last_peered":"2024-02-18T16:23:56.850528+0000","last_clean":"2024-02-18T16:23:56.850528+0000","last_became_active":"2024-02-18T16:20:59.871353+0000","last_became_peered":"2024-02-18T16:20:59.871353+0000","last_unstale":"2024-02-18T16:23:56.850528+0000","last_undegraded":"2024-02-18T16:23:56.850528+0000","last_fullsized":"2024-02-18T16:23:56.850528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:56.850302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:56.850302+0000","last_clean_scrub_stamp":"2024-02-18T16:23:56.850302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T02:23:50.059676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:57.855634+0000","last_change":"2024-02-18T16:23:57.855753+0000","last_active":"2024-02-18T16:23:57.855634+0000","last_peered":"2024-02-18T16:23:57.855634+0000","last_clean":"2024-02-18T16:23:57.855634+0000","last_became_active":"2024-02-18T16:20:59.853828+0000","last_became_peered":"2024-02-18T16:20:59.853828+0000","last_unstale":"2024-02-18T16:23:57.855634+0000","last_undegraded":"2024-02-18T16:23:57.855634+0000","last_fullsized":"2024-02-18T16:23:57.855634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:57.855325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:57.855325+0000","last_clean_scrub_stamp":"2024-02-18T16:23:57.855325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:31:03.050984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:14.165328+0000","last_change":"2024-02-18T16:23:14.165328+0000","last_active":"2024-02-18T16:23:14.165328+0000","last_peered":"2024-02-18T16:23:14.165328+0000","last_clean":"2024-02-18T16:23:14.165328+0000","last_became_active":"2024-02-18T16:21:01.846433+0000","last_became_peered":"2024-02-18T16:21:01.846433+0000","last_unstale":"2024-02-18T16:23:14.165328+0000","last_undegraded":"2024-02-18T16:23:14.165328+0000","last_fullsized":"2024-02-18T16:23:14.165328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:14.165073+0000","last_clean_scrub_stamp":"2024-02-18T16:23:14.165073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:13.320679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:40.237166+0000","last_change":"2024-02-18T16:23:40.237226+0000","last_active":"2024-02-18T16:23:40.237166+0000","last_peered":"2024-02-18T16:23:40.237166+0000","last_clean":"2024-02-18T16:23:40.237166+0000","last_became_active":"2024-02-18T16:20:59.853807+0000","last_became_peered":"2024-02-18T16:20:59.853807+0000","last_unstale":"2024-02-18T16:23:40.237166+0000","last_undegraded":"2024-02-18T16:23:40.237166+0000","last_fullsized":"2024-02-18T16:23:40.237166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T16:23:40.236966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T16:23:40.236966+0000","last_clean_scrub_stamp":"2024-02-18T16:23:40.236966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T23:20:04.224436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-18T16:23:26.757028+0000","last_change":"2024-02-18T16:23:26.757028+0000","last_active":"2024-02-18T16:23:26.757028+0000","last_peered":"2024-02-18T16:23:26.757028+0000","last_clean":"2024-02-18T16:23:26.757028+0000","last_became_active":"2024-02-18T16:21:01.839052+0000","last_became_peered":"2024-02-18T16:21:01.839052+0000","last_unstale":"2024-02-18T16:23:26.757028+0000","last_undegraded":"2024-02-18T16:23:26.757028+0000","last_fullsized":"2024-02-18T16:23:26.757028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-18T16:23:26.756605+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-18T16:23:26.756605+0000","last_clean_scrub_stamp":"2024-02-18T16:23:26.756605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:13:18.607706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1422,"ondisk_log_size":1422,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":910,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705713,"num_pgs":180,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39932,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331908,"statfs":{"total":96636764160,"available":96595873792,"internally_reserved":0,"allocated":446464,"data_stored":149064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.76800000000000002,"5min":0.88,"15min":0.88},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.56799999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78700000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":1,"last update":"Sun Feb 18 16:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.48599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.80700000000000005,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.505,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Feb 18 16:23:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.502,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81699999999999995,"5min":1.2,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76200000000000001,"5min":1.319,"15min":1.319},"last":0.54500000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:23:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.745,"15min":0.77300000000000002},"min":{"1min":0.56599999999999995,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77300000000000002}]},{"osd":1,"last update":"Sun Feb 18 16:23:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.004,"15min":1.208},"min":{"1min":0.36899999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.66400000000000003,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.86299999999999999,"15min":0.995},"min":{"1min":0.47199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.68200000000000005,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Sun Feb 18 16:23:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.622},"min":{"1min":0.47399999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.78900000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.3440000000000001,"15min":1.6299999999999999},"min":{"1min":0.59799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79700000000000004,"5min":26.050999999999998,"15min":26.050999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1019904,"data_stored":739352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Feb 18 16:23:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.434,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82099999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.60099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Feb 18 16:23:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.501,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70699999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.47499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.747,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55100000000000005}]},{"osd":3,"last update":"Sun Feb 18 16:23:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.52300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.745,"5min":0.87,"15min":0.87},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.56999999999999995,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82199999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61099999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39900,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331940,"statfs":{"total":96636764160,"available":96595906560,"internally_reserved":0,"allocated":413696,"data_stored":147582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Feb 18 16:23:51 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.48799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.68500000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.80500000000000005}]},{"osd":2,"last update":"Sun Feb 18 16:23:51 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52900000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88100000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89400000000000002,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.93999999999999995}]},{"osd":3,"last update":"Sun Feb 18 16:23:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92200000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.86799999999999999,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T16:24:31.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-18T16:24:31.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13b63b7640 1 Processor -- start 2024-02-18T16:24:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13b63b7640 1 -- start start 2024-02-18T16:24:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13b63b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13b0099400 0x7f13b0133580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13b63b7640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b0073250 con 0x7f13b0098910 2024-02-18T16:24:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13b63b7640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b0096da0 con 0x7f13b0099400 2024-02-18T16:24:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13af7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f13b0099400 0x7f13b0133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13affff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f13b0098910 0x7f13b0098cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35212/0 (socket says 172.21.15.80:35212) 2024-02-18T16:24:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13affff640 1 -- 172.21.15.80:0/582264436 learned_addr learned my addr 172.21.15.80:0/582264436 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-02-18T16:24:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13aeffd640 1 -- 172.21.15.80:0/582264436 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886035008 0 0) 0x7f13b0073250 con 0x7f13b0098910 2024-02-18T16:24:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13aeffd640 1 -- 172.21.15.80:0/582264436 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1398003530 con 0x7f13b0098910 2024-02-18T16:24:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13af7fe640 1 -- 172.21.15.80:0/582264436 >> v1:172.21.15.80:6789/0 conn(0x7f13b0098910 legacy=0x7f13b0098cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13af7fe640 1 -- 172.21.15.80:0/582264436 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0099ee0 con 0x7f13b0099400 2024-02-18T16:24:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13af7fe640 1 --2- 172.21.15.80:0/582264436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0099400 0x7f13b0133580 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009740 tx=0x7f13a401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8361bf9c7f50cb0c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13aeffd640 1 -- 172.21.15.80:0/582264436 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a40ab530 con 0x7f13b0099400 2024-02-18T16:24:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13aeffd640 1 -- 172.21.15.80:0/582264436 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40a7050 con 0x7f13b0099400 2024-02-18T16:24:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.190+0000 7f13aeffd640 1 -- 172.21.15.80:0/582264436 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a40ab7c0 con 0x7f13b0099400 2024-02-18T16:24:31.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/582264436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0099400 msgr2=0x7f13b0133580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 --2- 172.21.15.80:0/582264436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0099400 0x7f13b0133580 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009740 tx=0x7f13a401c370 comp rx=0 tx=0).stop 2024-02-18T16:24:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/582264436 shutdown_connections 2024-02-18T16:24:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 --2- 172.21.15.80:0/582264436 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0099400 0x7f13b0133580 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/582264436 >> 172.21.15.80:0/582264436 conn(0x7f13b009e900 msgr2=0x7f13b009ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:24:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/582264436 shutdown_connections 2024-02-18T16:24:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/582264436 wait complete. 2024-02-18T16:24:31.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 Processor -- start 2024-02-18T16:24:31.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- start start 2024-02-18T16:24:31.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 0x7f13b0093340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:31.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00960d0 con 0x7f13b0098910 2024-02-18T16:24:31.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13affff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 0x7f13b0093340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13affff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 0x7f13b0093340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34016/0 (socket says 172.21.15.80:34016) 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13affff640 1 -- 172.21.15.80:0/928592279 learned_addr learned my addr 172.21.15.80:0/928592279 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13affff640 1 -- 172.21.15.80:0/928592279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009420 con 0x7f13b0098910 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13affff640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 0x7f13b0093340 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c450 tx=0x7f13a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a0005ce0 con 0x7f13b0098910 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a0005e40 con 0x7f13b0098910 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a0007200 con 0x7f13b0098910 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b0094c20 con 0x7f13b0098910 2024-02-18T16:24:31.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.194+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b0093880 con 0x7f13b0098910 2024-02-18T16:24:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.198+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b0095f20 con 0x7f13b0098910 2024-02-18T16:24:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.198+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f13a0007420 con 0x7f13b0098910 2024-02-18T16:24:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.198+0000 7f13acff9640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f139c0359c0 0x7f139c037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T16:24:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.198+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6336+0+0 (secure 0 0 0) 0x7f13a0047e10 con 0x7f13b0098910 2024-02-18T16:24:31.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.198+0000 7f13af7fe640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f139c0359c0 0x7f139c037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T16:24:31.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.198+0000 7f13af7fe640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f139c0359c0 0x7f139c037e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009740 tx=0x7f13a40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T16:24:31.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.202+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f13a001b3b0 con 0x7f13b0098910 2024-02-18T16:24:31.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.354+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f13b0125780 con 0x7f13b0098910 2024-02-18T16:24:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.358+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f13a0017070 con 0x7f13b0098910 2024-02-18T16:24:31.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.358+0000 7f13acff9640 1 -- 172.21.15.80:0/928592279 <== mon.0 v2:172.21.15.80:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f13a001b3b0 con 0x7f13b0098910 2024-02-18T16:24:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f139c0359c0 msgr2=0x7f139c037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f139c0359c0 0x7f139c037e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009740 tx=0x7f13a40a6000 comp rx=0 tx=0).stop 2024-02-18T16:24:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 msgr2=0x7f13b0093340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T16:24:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 0x7f13b0093340 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c450 tx=0x7f13a000c910 comp rx=0 tx=0).stop 2024-02-18T16:24:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 shutdown_connections 2024-02-18T16:24:31.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.129:6824/4092544777,v1:172.21.15.129:6825/4092544777] conn(0x7f139c0359c0 0x7f139c037e80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 --2- 172.21.15.80:0/928592279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f13b0098910 0x7f13b0093340 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T16:24:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 >> 172.21.15.80:0/928592279 conn(0x7f13b009e900 msgr2=0x7f13b006f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T16:24:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 shutdown_connections 2024-02-18T16:24:31.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-18T16:24:31.362+0000 7f13b63b7640 1 -- 172.21.15.80:0/928592279 wait complete. 2024-02-18T16:24:31.383 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-18T16:24:31.383 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-18T16:24:31.383 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-18T16:24:31.384 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:24:31.454 INFO:tasks.ceph.osd.0:Stopped 2024-02-18T16:24:31.454 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-18T16:24:31.454 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:24:31.545 INFO:tasks.ceph.osd.1:Stopped 2024-02-18T16:24:31.545 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-18T16:24:31.546 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:24:31.629 INFO:tasks.ceph.osd.2:Stopped 2024-02-18T16:24:31.630 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-18T16:24:31.630 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:24:31.704 INFO:tasks.ceph.osd.3:Stopped 2024-02-18T16:24:31.705 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-18T16:24:31.705 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-18T16:24:31.705 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:24:31.733 INFO:tasks.ceph.mgr.x:Stopped 2024-02-18T16:24:31.734 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-18T16:24:31.734 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-18T16:24:31.734 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T16:24:31.757 INFO:tasks.ceph.mon.a:Stopped 2024-02-18T16:24:31.758 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-18T16:24:31.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-02-18T16:24:31.815 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi080.front.sepia.ceph.com 2024-02-18T16:24:31.815 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-18T16:24:32.101 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:24:32.101 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-18T16:24:32.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:24:32.404 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-18T16:24:32.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:24:32.565 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-18T16:24:32.725 INFO:tasks.ceph:Archiving mon data... 2024-02-18T16:24:32.727 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/data/mon.a.tgz 2024-02-18T16:24:32.727 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-02-18T16:24:32.733 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.CRhW3KiWID 2024-02-18T16:24:32.733 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CRhW3KiWID 2024-02-18T16:24:32.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.CRhW3KiWID 2024-02-18T16:24:32.910 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.CRhW3KiWID is 242KB 2024-02-18T16:24:32.940 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.CRhW3KiWID 2024-02-18T16:24:32.945 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-18T16:24:32.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-18T16:24:32.994 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-18T16:24:33.052 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-18T16:24:33.057 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-18T16:24:33.058 INFO:tasks.ceph:Archiving crash dumps... 2024-02-18T16:24:33.063 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/remote/smithi080/crash 2024-02-18T16:24:33.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-18T16:24:33.109 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/remote/smithi129/crash 2024-02-18T16:24:33.110 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-18T16:24:33.123 INFO:tasks.ceph:Compressing logs... 2024-02-18T16:24:33.123 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-18T16:24:33.157 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-18T16:24:33.184 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62687.log 2024-02-18T16:24:33.214 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20191.log 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23699.log 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.tmp-client.admin.20191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23335.log 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24076.log 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20191.log.gz 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23699.log.gz 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23373.log 2024-02-18T16:24:33.215 INFO:teuthology.orchestra.run.smithi080.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23335.log.gz 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23168.log 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24076.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.23373.log: -- /var/log/ceph/ceph-osd.0.log 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24076.log.gz 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23168.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23373.log.gz 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23231.log 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23168.log.gz 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24206.log 2024-02-18T16:24:33.216 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24024.log 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23231.log.gz 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21515.log 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24024.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24206.log.gz 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23816.log 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24024.log.gz 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.21515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23946.log 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.21515.log.gz 2024-02-18T16:24:33.217 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23920.log 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23816.log.gz 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21445.log 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23946.log.gz 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23283.log 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.21445.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.23920.log.gz 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23998.log 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23283.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.21445.log.gz 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-18T16:24:33.218 INFO:teuthology.orchestra.run.smithi080.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23283.log.gz 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24154.log 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23998.log.gz 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24230.log 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24102.log 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24154.log.gz 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23569.log 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24230.log.gz 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21558.log 2024-02-18T16:24:33.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24102.log: /var/log/ceph/ceph-client.admin.23569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23365.log 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24102.log.gz 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23569.log.gz 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.21558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23206.log 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.21558.log.gz 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23257.log 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23365.log.gz 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23206.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-18T16:24:33.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23257.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23206.log.gz 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23475.log 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23257.log.gz 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23972.log 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.23475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23576.log 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23475.log.gz 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23842.log 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23972.log.gz 2024-02-18T16:24:33.221 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5/var/log/ceph/ceph-client.admin.23576.log: --verbose -- /var/log/ceph/ceph-client.admin.23371.log 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23576.log.gz 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23842.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23842.log.gz 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23371.log: /var/log/ceph/ceph-client.admin.23894.log 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23673.log 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23371.log.gz 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23894.log: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-18T16:24:33.222 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23477.log 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23894.log.gz 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23790.log 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23673.log: /var/log/ceph/ceph-client.admin.23477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23581.log 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23477.log.gz 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23673.log.gz 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23868.log 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23790.log.gz 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23465.log 2024-02-18T16:24:33.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23581.log: /var/log/ceph/ceph-client.admin.23868.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23581.log.gz 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23725.log 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.23868.log.gz 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24180.log 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23465.log: /var/log/ceph/ceph-client.admin.23725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24050.log 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23465.log.gz 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24180.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23725.log.gz 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23577.log 2024-02-18T16:24:33.224 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24180.log.gz 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24128.log 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23764.log 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23577.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24050.log.gz 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.24128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23476.log 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23577.log.gz 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24128.log.gz 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23372.log 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23764.log.gz 2024-02-18T16:24:33.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23309.log 2024-02-18T16:24:33.226 INFO:teuthology.orchestra.run.smithi080.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23476.log.gz 2024-02-18T16:24:33.226 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.23372.log: /var/log/ceph/ceph-client.admin.23309.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23372.log.gz 2024-02-18T16:24:33.226 INFO:teuthology.orchestra.run.smithi080.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23309.log.gz 2024-02-18T16:24:33.244 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45577.log 2024-02-18T16:24:33.244 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.62687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28349.log 2024-02-18T16:24:33.244 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.45577.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37317.log 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.28349.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.62687.log.gz 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62097.log 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45577.log.gz 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28349.log.gz 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60327.log 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.37317.log: /var/log/ceph/ceph-client.0.62097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71539.log 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.60327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56787.log 2024-02-18T16:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.71539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33187.log 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.62097.log.gz 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.56787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69179.log 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.37317.log.gz 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.33187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53247.log 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.69179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54427.log 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.53247.log: 92.9% 91.4% -- replaced with /var/log/ceph/ceph-client.0.71539.log.gz 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr: -- replaced with /var/log/ceph/ceph-client.0.60327.log.gz 2024-02-18T16:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51477.log 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.33187.log.gz 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.54427.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56787.log.gz 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23776.log 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69179.log.gz 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.51477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65637.log 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.23776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42627.log 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53247.log.gz 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.23776.log.gz 2024-02-18T16:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.65637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40267.log 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54427.log.gz 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28325.log 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.42627.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51477.log.gz 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.40267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30243.log 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.28325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63277.log 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28325.log.gz 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.30243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55017.log 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.65637.log.gz 2024-02-18T16:24:33.248 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42627.log.gz 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.63277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50887.log 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40267.log.gz 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.55017.log: /var/log/ceph/ceph-client.0.50887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73309.log 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.2.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30243.log.gz 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47347.log 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63277.log.gz 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.73309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65047.log 2024-02-18T16:24:33.249 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.47347.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55017.log.gz 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64457.log 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.50887.log.gz 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.65047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75669.log 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.64457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68589.log 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.75669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34367.log 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.47347.log.gz 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65047.log.gz/var/log/ceph/ceph-client.0.68589.log: 2024-02-18T16:24:33.250 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41447.log 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73309.log.gz 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3%/var/log/ceph/ceph-client.0.34367.log: -- replaced with /var/log/ceph/ceph-client.0.64457.log.gz 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47937.log 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.75669.log.gz 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.41447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39677.log 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.47937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23752.log 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68589.log.gz 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.39677.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34367.log.gz 2024-02-18T16:24:33.251 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31423.log 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.23752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79179.log 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41447.log.gz 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr: 84.9%/var/log/ceph/ceph-client.0.31423.log: -- replaced with /var/log/ceph/ceph-client.admin.23752.log.gz 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28373.log 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47937.log.gz 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.79179.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76843.log 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr: -- replaced with /var/log/ceph/ceph-client.0.39677.log.gz 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.28373.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.79179.log.gz 2024-02-18T16:24:33.252 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61507.log 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28373.log.gz 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.76843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60917.log 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31423.log.gz 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.61507.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76843.log.gz 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.60917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40857.log 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73899.log 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.0.40857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38497.log 2024-02-18T16:24:33.253 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.73899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76259.log 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.38497.log: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61507.log.gz 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.40857.log.gz 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67999.log 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.76259.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73899.log.gz 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38497.log.gz 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.76259.log.gz 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23728.log 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.60917.log.gz 2024-02-18T16:24:33.254 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.67999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75079.log 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.23728.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23728.log.gz 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.75079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72129.log 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49117.log 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.1.log: 91.6%/var/log/ceph/ceph-client.0.72129.log: -- replaced with /var/log/ceph/ceph-client.0.67999.log.gzgzip 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.70949.log 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.49117.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.75079.log.gz 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72129.log.gz 2024-02-18T16:24:33.255 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49117.log.gz 2024-02-18T16:24:33.256 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49707.log 2024-02-18T16:24:33.256 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.70949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29653.log 2024-02-18T16:24:33.256 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.49707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57377.log 2024-02-18T16:24:33.256 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.29653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80352.log 2024-02-18T16:24:33.256 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.57377.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49707.log.gz 91.1% 2024-02-18T16:24:33.256 INFO:teuthology.orchestra.run.smithi129.stderr: -- replaced with /var/log/ceph/ceph-client.0.70949.log.gz 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44397.log 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29653.log.gz 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.80352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43807.log 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57377.log.gz 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29063.log 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.44397.log: /var/log/ceph/ceph-client.0.43807.log: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42037.log 2024-02-18T16:24:33.257 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44397.log.gz 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43807.log.gz 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.29063.log: 93.6% -- replaced with /var/log/ceph/ceph-client.0.80352.log.gz 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.42037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78595.log 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39087.log 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.78595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78011.log 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.29063.log.gz 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.39087.log: 91.3% 90.8% -- replaced with /var/log/ceph/ceph-client.0.78595.log.gz 2024-02-18T16:24:33.258 INFO:teuthology.orchestra.run.smithi129.stderr: -- replaced with /var/log/ceph/ceph-client.0.42037.log.gz 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77427.log 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.78011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28397.log 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.77427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72719.log 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr: 90.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.39087.log.gz 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr: -- replaced with /var/log/ceph/ceph-client.0.78011.log.gz 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.28397.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77427.log.gz 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28397.log.gz 2024-02-18T16:24:33.259 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34957.log 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.72719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48527.log 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.34957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43217.log 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.48527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53837.log 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.43217.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.72719.log.gz 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34957.log.gz 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48527.log.gz 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43217.log.gz 2024-02-18T16:24:33.260 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30833.log 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.53837.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.30833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79763.log 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63867.log 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.79763.log: 90.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53837.log.gz 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.79763.log.gz 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58557.log 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30833.log.gz 2024-02-18T16:24:33.261 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.63867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57967.log 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.58557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67409.log 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.57967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70359.log 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.67409.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.58557.log.gz 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.63867.log.gz 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.57967.log.gz 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.67409.log.gz 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59737.log 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.70359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59147.log 2024-02-18T16:24:33.262 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.59737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55607.log 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.59147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32597.log 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.55607.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70359.log.gz 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59737.log.gz 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55607.log.gz 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.59147.log.gz -5 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr: --verbose -- /var/log/ceph/ceph-client.0.56197.log 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.32597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50297.log 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.56197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66819.log 2024-02-18T16:24:33.263 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.50297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44987.log 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.66819.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.32597.log.gz 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56197.log.gz 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.50297.log.gz 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66819.log.gz 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23800.log 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.44987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46757.log 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.23800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52067.log 2024-02-18T16:24:33.264 INFO:teuthology.orchestra.run.smithi129.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.23800.log.gz/var/log/ceph/ceph-client.0.46757.log: 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32013.log 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.44987.log.gz 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.52067.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.46757.log.gz 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.52067.log.gz 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33777.log 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.32013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37907.log 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.33777.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.32013.log.gz 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66229.log 2024-02-18T16:24:33.265 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.37907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46167.log 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.66229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35547.log 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.46167.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.33777.log.gz 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37907.log.gz 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74489.log 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.35547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28301.log 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66229.log.gz 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.46167.log.gz 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.74489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69769.log 2024-02-18T16:24:33.266 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.28301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52657.log 2024-02-18T16:24:33.267 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.69769.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.35547.log.gz 2024-02-18T16:24:33.267 INFO:teuthology.orchestra.run.smithi129.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28301.log.gz 2024-02-18T16:24:33.267 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36727.log 2024-02-18T16:24:33.267 INFO:teuthology.orchestra.run.smithi129.stderr: 91.5%/var/log/ceph/ceph-client.0.52657.log: -- replaced with /var/log/ceph/ceph-client.0.74489.log.gz 2024-02-18T16:24:33.267 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36137.log 2024-02-18T16:24:33.267 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.0.36727.log: 91.5%/var/log/ceph/ceph-client.0.36137.log: -- replaced with /var/log/ceph/ceph-client.0.69769.log.gz 2024-02-18T16:24:33.268 INFO:teuthology.orchestra.run.smithi129.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52657.log.gz 2024-02-18T16:24:33.268 INFO:teuthology.orchestra.run.smithi129.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36727.log.gz 2024-02-18T16:24:33.272 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.36137.log.gz 2024-02-18T16:24:33.272 INFO:teuthology.orchestra.run.smithi129.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-18T16:24:33.358 INFO:teuthology.orchestra.run.smithi080.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-18T16:24:33.920 INFO:teuthology.orchestra.run.smithi129.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-18T16:24:33.974 INFO:teuthology.orchestra.run.smithi080.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-18T16:24:33.975 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-18T16:24:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m0.817s 2024-02-18T16:24:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m0.966s 2024-02-18T16:24:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.069s 2024-02-18T16:24:34.078 INFO:teuthology.orchestra.run.smithi129.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-18T16:24:34.093 INFO:teuthology.orchestra.run.smithi129.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-18T16:24:34.094 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-02-18T16:24:34.094 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m0.925s 2024-02-18T16:24:34.095 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m2.638s 2024-02-18T16:24:34.095 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.164s 2024-02-18T16:24:34.095 INFO:tasks.ceph:Archiving logs... 2024-02-18T16:24:34.095 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/remote/smithi080/log 2024-02-18T16:24:34.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-18T16:24:34.296 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/remote/smithi129/log 2024-02-18T16:24:34.298 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-18T16:24:34.735 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-18T16:24:34.746 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-18T16:24:34.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-18T16:24:34.748 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-18T16:24:34.815 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-18T16:24:34.824 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-18T16:24:34.825 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T16:24:34.827 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T16:24:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-02-18T16:24:34.838 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-02-18T16:24:34.838 INFO:teuthology.orchestra.run.smithi080.stdout:*hv01.front.sepi 44.4.53.2 2 u 28 64 177 0.134 -0.627 0.955 2024-02-18T16:24:34.838 INFO:teuthology.orchestra.run.smithi080.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 177 0.123 +0.916 0.937 2024-02-18T16:24:34.838 INFO:teuthology.orchestra.run.smithi080.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 64 177 0.149 -2.364 0.823 2024-02-18T16:24:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:24:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: remote refid st t when poll reach delay offset jitter 2024-02-18T16:24:34.841 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================== 2024-02-18T16:24:34.841 INFO:teuthology.orchestra.run.smithi129.stdout:*hv01.front.sepi 44.4.53.2 2 u 20 64 177 0.151 -1.271 1.415 2024-02-18T16:24:34.842 INFO:teuthology.orchestra.run.smithi129.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 177 0.103 +0.332 1.065 2024-02-18T16:24:34.842 INFO:teuthology.orchestra.run.smithi129.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 64 177 0.270 -2.958 1.497 2024-02-18T16:24:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-18T16:24:34.843 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-18T16:24:34.856 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-18T16:24:34.857 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-18T16:24:34.866 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-18T16:24:34.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-18T16:24:34.883 INFO:teuthology.task.internal:Duration was 849.056848 seconds 2024-02-18T16:24:34.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-18T16:24:34.892 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-18T16:24:34.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-18T16:24:34.895 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-18T16:24:34.930 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-18T16:24:34.931 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-02-18T16:24:34.931 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-18T16:24:34.983 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-02-18T16:24:34.984 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-18T16:24:34.993 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-18T16:24:34.994 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-18T16:24:35.032 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-18T16:24:35.065 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-18T16:24:35.066 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-18T16:24:35.101 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-18T16:24:35.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-18T16:24:35.167 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-18T16:24:35.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-18T16:24:35.177 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-18T16:24:35.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-18T16:24:35.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-18T16:24:35.220 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-18T16:24:35.228 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-02-18T16:24:35.240 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-02-18T16:24:35.346 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-18T16:24:35.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:24:35.352 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-18T16:24:35.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T16:24:35.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-18T16:24:35.405 INFO:teuthology.task.internal:Transferring archived files... 2024-02-18T16:24:35.405 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/remote/smithi080 2024-02-18T16:24:35.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-18T16:24:35.429 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752/remote/smithi129 2024-02-18T16:24:35.429 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-18T16:24:35.459 INFO:teuthology.task.internal:Removing archive directory... 2024-02-18T16:24:35.459 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-18T16:24:35.468 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-18T16:24:35.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-18T16:24:35.514 INFO:teuthology.task.internal:Not uploading archives. 2024-02-18T16:24:35.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-18T16:24:35.525 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-18T16:24:35.525 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-18T16:24:35.528 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-18T16:24:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 16:24 /home/ubuntu/cephtest 2024-02-18T16:24:35.550 INFO:teuthology.orchestra.run.smithi129.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 16:24 /home/ubuntu/cephtest 2024-02-18T16:24:35.551 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-18T16:24:35.562 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-18T16:24:35.582 INFO:teuthology.nuke:Checking targets against current locks 2024-02-18T16:24:35.608 DEBUG:teuthology.nuke:shortname: smithi080 2024-02-18T16:24:35.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T16:24:35.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 16:01:51.701550', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEKfYAOznc3GwJnU4o9Ae1ngD7K1yZIn11qCR78NNpvD3Cmo2ued9PUzr2WArEK1gseXqPIB+0Rkw+2wwO1vcw='} 2024-02-18T16:24:35.635 DEBUG:teuthology.nuke:shortname: smithi129 2024-02-18T16:24:35.635 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T16:24:35.659 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-16_18:38:34-rgw-wip-64173-distro-default-smithi/7562752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 16:01:51.703422', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArFJcbYpAUM4WaXDGxHpbZSgmfY43t/QQEZrjLs80RLZPVb5XM/llYH5uonBXZPDZdxSENiFJHLu9v/4Fiq8ZQ='} 2024-02-18T16:24:35.681 INFO:teuthology.orchestra.console.smithi080:Power off 2024-02-18T16:24:35.681 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T16:24:35.706 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-02-18T16:24:35.706 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:35.728 INFO:teuthology.orchestra.console.smithi129:Power off 2024-02-18T16:24:35.729 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T16:24:35.740 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-18T16:24:35.755 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-02-18T16:24:35.755 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:35.781 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-02-18T16:24:39.741 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:39.782 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:39.854 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-18T16:24:39.894 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-02-18T16:24:43.856 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:43.896 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:43.970 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-18T16:24:44.012 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-02-18T16:24:44.112 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-02-18T16:24:47.972 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T16:24:48.085 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-18T16:24:48.186 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-02-18T16:24:48.290 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 849.0568482875824 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000720387af4375c46c-0065d22ecd-4224-default4224-default-default' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0698f2d68e7e4c2c97e30e2aae5d9f5f status: fail success: false 2024-02-18T16:24:48.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T16:24:48.370 INFO:teuthology.run:FAIL